Feb 25 15:47:05 devstack cinder-volume[73655]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=73655) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:390}} Feb 25 15:47:05 devstack cinder-volume[73655]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=73655) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:393}} Feb 25 15:47:05 devstack cinder-volume[73655]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=73655) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:413}} Feb 25 15:47:06 devstack cinder-volume[73655]: INFO dbcounter [None req-203a21c1-0897-49e7-a0b3-deab8820e8ca None None] Registered counter for database cinder Feb 25 15:47:06 devstack cinder-volume[73655]: DEBUG oslo_db.sqlalchemy.engines [None req-203a21c1-0897-49e7-a0b3-deab8820e8ca None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=73655) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}} Feb 25 15:47:06 devstack cinder-volume[73655]: DEBUG dbcounter [-] [73655] Writer thread running {{(pid=73655) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:102}} Feb 25 15:47:06 devstack cinder-volume[73655]: INFO cinder.rpc [None req-203a21c1-0897-49e7-a0b3-deab8820e8ca None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Feb 25 15:47:06 devstack cinder-volume[73655]: INFO cinder.rpc [None req-203a21c1-0897-49e7-a0b3-deab8820e8ca None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Feb 25 15:47:06 devstack cinder-volume[73655]: DEBUG oslo_db.sqlalchemy.engines [None req-203a21c1-0897-49e7-a0b3-deab8820e8ca None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=73655) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}} Feb 25 15:47:06 devstack cinder-volume[73655]: INFO cinder.volume.manager [None req-203a21c1-0897-49e7-a0b3-deab8820e8ca None None] Determined volume DB was empty at startup. Feb 25 15:47:06 devstack cinder-volume[73655]: DEBUG cinder.volume.manager [None req-203a21c1-0897-49e7-a0b3-deab8820e8ca None None] Cinder Volume DB check: vol_db_empty=True {{(pid=73655) __init__ /opt/stack/cinder/cinder/volume/manager.py:288}} Feb 25 15:47:06 devstack cinder-volume[73655]: INFO cinder.volume.manager [None req-203a21c1-0897-49e7-a0b3-deab8820e8ca None None] Service not found for updating active_backend_id, assuming default for driver init. Feb 25 15:47:06 devstack cinder-volume[73655]: WARNING stevedore.named [None req-203a21c1-0897-49e7-a0b3-deab8820e8ca None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Feb 25 15:47:06 devstack cinder-volume[73655]: WARNING castellan.key_manager [None req-203a21c1-0897-49e7-a0b3-deab8820e8ca None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Feb 25 15:47:06 devstack cinder-volume[73655]: WARNING cinder.keymgr.conf_key_mgr [None req-203a21c1-0897-49e7-a0b3-deab8820e8ca None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Feb 25 15:47:06 devstack cinder-volume[73655]: DEBUG cinder.volume.drivers.lvm [None req-203a21c1-0897-49e7-a0b3-deab8820e8ca None None] Attempting to initialize LVM driver with the following target_driver: cinder.volume.targets.lio.LioAdm {{(pid=73655) __init__ /opt/stack/cinder/cinder/volume/drivers/lvm.py:106}} Feb 25 15:47:06 devstack cinder-volume[73655]: DEBUG oslo_concurrency.processutils [None req-203a21c1-0897-49e7-a0b3-deab8820e8ca None None] Running cmd (subprocess): cinder-rtstool verify {{(pid=73655) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 25 15:47:06 devstack cinder-volume[73655]: DEBUG oslo_concurrency.processutils [None req-203a21c1-0897-49e7-a0b3-deab8820e8ca None None] CMD "cinder-rtstool verify" returned: 0 in 0.214s {{(pid=73655) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 25 15:47:06 devstack cinder-volume[73655]: DEBUG oslo_db.sqlalchemy.engines [None req-203a21c1-0897-49e7-a0b3-deab8820e8ca None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=73655) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}} Feb 25 15:47:06 devstack cinder-volume[73655]: INFO cinder.rpc [None req-203a21c1-0897-49e7-a0b3-deab8820e8ca None None] Automatically selected cinder-volume objects version 1.39 as minimum service version. Feb 25 15:47:06 devstack cinder-volume[73655]: INFO cinder.rpc [None req-203a21c1-0897-49e7-a0b3-deab8820e8ca None None] Automatically selected cinder-volume RPC version 3.20 as minimum service version. Feb 25 15:47:06 devstack cinder-volume[73655]: WARNING stevedore.named [None req-203a21c1-0897-49e7-a0b3-deab8820e8ca None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Feb 25 15:47:06 devstack cinder-volume[73655]: WARNING castellan.key_manager [None req-203a21c1-0897-49e7-a0b3-deab8820e8ca None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Feb 25 15:47:06 devstack cinder-volume[73655]: INFO cinder.volume.manager [None req-203a21c1-0897-49e7-a0b3-deab8820e8ca None None] Image-volume cache enabled for host devstack@lvmdriver-1. Feb 25 15:47:06 devstack cinder-volume[73655]: DEBUG oslo_db.sqlalchemy.engines [None req-203a21c1-0897-49e7-a0b3-deab8820e8ca None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=73655) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}} Feb 25 15:47:07 devstack cinder-volume[73655]: INFO oslo_service.backend._eventlet.service [None req-203a21c1-0897-49e7-a0b3-deab8820e8ca None None] Starting 1 workers Feb 25 15:47:07 devstack cinder-volume[73655]: DEBUG oslo_service.backend._eventlet.service [None req-203a21c1-0897-49e7-a0b3-deab8820e8ca None None] Started child 73755 {{(pid=73655) _start_child /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:491}} Feb 25 15:47:07 devstack cinder-volume[73655]: DEBUG oslo_service.backend._eventlet.service [None req-203a21c1-0897-49e7-a0b3-deab8820e8ca None None] Full set of CONF: {{(pid=73655) wait /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:565}} Feb 25 15:47:07 devstack cinder-volume[73655]: DEBUG oslo_service.backend._eventlet.service [None req-203a21c1-0897-49e7-a0b3-deab8820e8ca None None] ******************************************************************************** {{(pid=73655) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2979}} Feb 25 15:47:07 devstack cinder-volume[73655]: DEBUG oslo_service.backend._eventlet.service [None req-203a21c1-0897-49e7-a0b3-deab8820e8ca None None] Configuration options gathered from: {{(pid=73655) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2980}} Feb 25 15:47:07 devstack cinder-volume[73655]: DEBUG oslo_service.backend._eventlet.service [None req-203a21c1-0897-49e7-a0b3-deab8820e8ca None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=73655) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2981}} Feb 25 15:47:07 devstack cinder-volume[73655]: DEBUG oslo_service.backend._eventlet.service [None req-203a21c1-0897-49e7-a0b3-deab8820e8ca None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=73655) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2982}} Feb 25 15:47:07 devstack cinder-volume[73655]: DEBUG oslo_service.backend._eventlet.service [None req-203a21c1-0897-49e7-a0b3-deab8820e8ca None None] ================================================================================ {{(pid=73655) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2987}} Feb 25 15:47:07 devstack cinder-volume[73655]: DEBUG oslo_service.backend._eventlet.service [None req-203a21c1-0897-49e7-a0b3-deab8820e8ca None None] allow_availability_zone_fallback = False {{(pid=73655) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 25 15:47:07 devstack cinder-volume[73655]: DEBUG oslo_service.backend._eventlet.service [None req-203a21c1-0897-49e7-a0b3-deab8820e8ca None None] allow_compression_on_image_upload = False {{(pid=73655) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 25 15:47:07 devstack cinder-volume[73655]: DEBUG oslo_service.backend._eventlet.service [None req-203a21c1-0897-49e7-a0b3-deab8820e8ca None None] allowed_direct_url_schemes = [] {{(pid=73655) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 25 15:47:07 devstack cinder-volume[73655]: DEBUG oslo_service.backend._eventlet.service [None req-203a21c1-0897-49e7-a0b3-deab8820e8ca None None] api_rate_limit = True {{(pid=73655) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 25 15:47:07 devstack cinder-volume[73655]: DEBUG oslo_service.backend._eventlet.service [None req-203a21c1-0897-49e7-a0b3-deab8820e8ca None None] auth_strategy = keystone {{(pid=73655) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 25 15:47:07 devstack cinder-volume[73655]: DEBUG oslo_service.backend._eventlet.service [None req-203a21c1-0897-49e7-a0b3-deab8820e8ca None None] az_cache_duration = 3600 {{(pid=73655) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 25 15:47:07 devstack cinder-volume[73655]: DEBUG oslo_service.backend._eventlet.service [None req-203a21c1-0897-49e7-a0b3-deab8820e8ca None None] backend_availability_zone = None {{(pid=73655) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 25 15:47:07 devstack cinder-volume[73655]: DEBUG oslo_service.backend._eventlet.service [None req-203a21c1-0897-49e7-a0b3-deab8820e8ca None None] backend_host = None {{(pid=73655) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 25 15:47:07 devstack cinder-volume[73655]: DEBUG oslo_service.backend._eventlet.service [None req-203a21c1-0897-49e7-a0b3-deab8820e8ca None None] backend_name = None {{(pid=73655) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 25 15:47:07 devstack cinder-volume[73655]: DEBUG oslo_service.backend._eventlet.service [None req-203a21c1-0897-49e7-a0b3-deab8820e8ca None None] backend_stats_polling_interval = 60 {{(pid=73655) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 25 15:47:07 devstack cinder-volume[73655]: DEBUG oslo_service.backend._eventlet.service [None req-203a21c1-0897-49e7-a0b3-deab8820e8ca None None] backup_api_class = cinder.backup.api.API {{(pid=73655) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 25 15:47:07 devstack cinder-volume[73655]: DEBUG oslo_service.backend._eventlet.service [None req-203a21c1-0897-49e7-a0b3-deab8820e8ca None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=73655) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 25 15:47:07 devstack cinder-volume[73655]: DEBUG oslo_service.backend._eventlet.service [None req-203a21c1-0897-49e7-a0b3-deab8820e8ca None None] backup_name_template = backup-%s {{(pid=73655) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 25 15:47:07 devstack cinder-volume[73655]: DEBUG oslo_service.backend._eventlet.service [None req-203a21c1-0897-49e7-a0b3-deab8820e8ca None None] backup_use_same_host = False {{(pid=73655) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 25 15:47:07 devstack cinder-volume[73655]: DEBUG oslo_service.backend._eventlet.service [None req-203a21c1-0897-49e7-a0b3-deab8820e8ca None None] backup_use_temp_snapshot = False {{(pid=73655) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 25 15:47:07 devstack cinder-volume[73655]: DEBUG oslo_service.backend._eventlet.service [None req-203a21c1-0897-49e7-a0b3-deab8820e8ca None None] chap_password = **** {{(pid=73655) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 25 15:47:07 devstack cinder-volume[73655]: DEBUG oslo_service.backend._eventlet.service [None req-203a21c1-0897-49e7-a0b3-deab8820e8ca None None] chap_username = {{(pid=73655) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 25 15:47:07 devstack cinder-volume[73655]: DEBUG oslo_service.backend._eventlet.service [None req-203a21c1-0897-49e7-a0b3-deab8820e8ca None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=73655) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 25 15:47:07 devstack cinder-volume[73655]: DEBUG oslo_service.backend._eventlet.service [None req-203a21c1-0897-49e7-a0b3-deab8820e8ca None None] cinder_internal_tenant_project_id = 9bff5ba497904e8c9c68bb7bb7d98a5e {{(pid=73655) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 25 15:47:07 devstack cinder-volume[73655]: DEBUG oslo_service.backend._eventlet.service [None req-203a21c1-0897-49e7-a0b3-deab8820e8ca None None] cinder_internal_tenant_user_id = cdb38ed6699347eb86cca2ce6a17cfb5 {{(pid=73655) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 25 15:47:07 devstack cinder-volume[73655]: DEBUG oslo_service.backend._eventlet.service [None req-203a21c1-0897-49e7-a0b3-deab8820e8ca None None] cloned_volume_same_az = True {{(pid=73655) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 25 15:47:07 devstack cinder-volume[73655]: DEBUG oslo_service.backend._eventlet.service [None req-203a21c1-0897-49e7-a0b3-deab8820e8ca None None] cluster = None {{(pid=73655) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 25 15:47:07 devstack cinder-volume[73655]: DEBUG oslo_service.backend._eventlet.service [None req-203a21c1-0897-49e7-a0b3-deab8820e8ca None None] compression_format = gzip {{(pid=73655) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 25 15:47:07 devstack cinder-volume[73655]: DEBUG oslo_service.backend._eventlet.service [None req-203a21c1-0897-49e7-a0b3-deab8820e8ca None None] compute_api_class = cinder.compute.nova.API {{(pid=73655) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 25 15:47:07 devstack cinder-volume[73755]: INFO cinder.service [-] Starting cinder-volume node (version 27.1.0) Feb 25 15:47:07 devstack cinder-volume[73655]: DEBUG oslo_service.backend._eventlet.service [None req-203a21c1-0897-49e7-a0b3-deab8820e8ca None None] config_dir = [] {{(pid=73655) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 25 15:47:07 devstack cinder-volume[73655]: DEBUG oslo_service.backend._eventlet.service [None req-203a21c1-0897-49e7-a0b3-deab8820e8ca None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=73655) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 25 15:47:07 devstack cinder-volume[73655]: DEBUG oslo_service.backend._eventlet.service [None req-203a21c1-0897-49e7-a0b3-deab8820e8ca None None] config_source = [] {{(pid=73655) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 25 15:47:07 devstack cinder-volume[73655]: DEBUG oslo_service.backend._eventlet.service [None req-203a21c1-0897-49e7-a0b3-deab8820e8ca None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=73655) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 25 15:47:07 devstack cinder-volume[73655]: DEBUG oslo_service.backend._eventlet.service [None req-203a21c1-0897-49e7-a0b3-deab8820e8ca None None] control_exchange = openstack {{(pid=73655) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 25 15:47:07 devstack cinder-volume[73655]: DEBUG oslo_service.backend._eventlet.service [None req-203a21c1-0897-49e7-a0b3-deab8820e8ca None None] debug = True {{(pid=73655) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 25 15:47:07 devstack cinder-volume[73655]: DEBUG oslo_service.backend._eventlet.service [None req-203a21c1-0897-49e7-a0b3-deab8820e8ca None None] default_availability_zone = None {{(pid=73655) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 25 15:47:07 devstack cinder-volume[73655]: DEBUG oslo_service.backend._eventlet.service [None req-203a21c1-0897-49e7-a0b3-deab8820e8ca None None] default_group_type = None {{(pid=73655) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 25 15:47:07 devstack cinder-volume[73655]: DEBUG oslo_service.backend._eventlet.service [None req-203a21c1-0897-49e7-a0b3-deab8820e8ca None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=73655) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 25 15:47:07 devstack cinder-volume[73655]: DEBUG oslo_service.backend._eventlet.service [None req-203a21c1-0897-49e7-a0b3-deab8820e8ca None None] default_volume_type = lvmdriver-1 {{(pid=73655) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 25 15:47:07 devstack cinder-volume[73655]: DEBUG oslo_service.backend._eventlet.service [None req-203a21c1-0897-49e7-a0b3-deab8820e8ca None None] disk_geometry = None {{(pid=73655) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 25 15:47:07 devstack cinder-volume[73655]: DEBUG oslo_service.backend._eventlet.service [None req-203a21c1-0897-49e7-a0b3-deab8820e8ca None None] driver_client_cert = None {{(pid=73655) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 25 15:47:07 devstack cinder-volume[73655]: DEBUG oslo_service.backend._eventlet.service [None req-203a21c1-0897-49e7-a0b3-deab8820e8ca None None] driver_client_cert_key = None {{(pid=73655) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 25 15:47:07 devstack cinder-volume[73655]: DEBUG oslo_service.backend._eventlet.service [None req-203a21c1-0897-49e7-a0b3-deab8820e8ca None None] driver_data_namespace = None {{(pid=73655) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 25 15:47:07 devstack cinder-volume[73655]: DEBUG oslo_service.backend._eventlet.service [None req-203a21c1-0897-49e7-a0b3-deab8820e8ca None None] driver_ssl_cert_path = None {{(pid=73655) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 25 15:47:07 devstack cinder-volume[73655]: DEBUG oslo_service.backend._eventlet.service [None req-203a21c1-0897-49e7-a0b3-deab8820e8ca None None] driver_ssl_cert_verify = False {{(pid=73655) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 25 15:47:07 devstack cinder-volume[73655]: DEBUG oslo_service.backend._eventlet.service [None req-203a21c1-0897-49e7-a0b3-deab8820e8ca None None] driver_use_ssl = False {{(pid=73655) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 25 15:47:07 devstack cinder-volume[73655]: DEBUG oslo_service.backend._eventlet.service [None req-203a21c1-0897-49e7-a0b3-deab8820e8ca None None] enable_force_upload = False {{(pid=73655) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 25 15:47:07 devstack cinder-volume[73655]: DEBUG oslo_service.backend._eventlet.service [None req-203a21c1-0897-49e7-a0b3-deab8820e8ca None None] enable_new_services = True {{(pid=73655) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 25 15:47:07 devstack cinder-volume[73655]: DEBUG oslo_service.backend._eventlet.service [None req-203a21c1-0897-49e7-a0b3-deab8820e8ca None None] enable_unsupported_driver = False {{(pid=73655) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 25 15:47:07 devstack cinder-volume[73655]: DEBUG oslo_service.backend._eventlet.service [None req-203a21c1-0897-49e7-a0b3-deab8820e8ca None None] enabled_backends = ['lvmdriver-1'] {{(pid=73655) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 25 15:47:07 devstack cinder-volume[73655]: DEBUG oslo_service.backend._eventlet.service [None req-203a21c1-0897-49e7-a0b3-deab8820e8ca None None] enforce_multipath_for_image_xfer = False {{(pid=73655) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 25 15:47:07 devstack cinder-volume[73655]: DEBUG oslo_service.backend._eventlet.service [None req-203a21c1-0897-49e7-a0b3-deab8820e8ca None None] filter_function = None {{(pid=73655) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 25 15:47:07 devstack cinder-volume[73655]: DEBUG oslo_service.backend._eventlet.service [None req-203a21c1-0897-49e7-a0b3-deab8820e8ca None None] glance_api_insecure = False {{(pid=73655) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 25 15:47:07 devstack cinder-volume[73655]: DEBUG oslo_service.backend._eventlet.service [None req-203a21c1-0897-49e7-a0b3-deab8820e8ca None None] glance_api_servers = ['http://192.168.122.119/image'] {{(pid=73655) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 25 15:47:07 devstack cinder-volume[73655]: DEBUG oslo_service.backend._eventlet.service [None req-203a21c1-0897-49e7-a0b3-deab8820e8ca None None] glance_api_ssl_compression = False {{(pid=73655) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 25 15:47:07 devstack cinder-volume[73655]: DEBUG oslo_service.backend._eventlet.service [None req-203a21c1-0897-49e7-a0b3-deab8820e8ca None None] glance_ca_certificates_file = None {{(pid=73655) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 25 15:47:07 devstack cinder-volume[73655]: DEBUG oslo_service.backend._eventlet.service [None req-203a21c1-0897-49e7-a0b3-deab8820e8ca None None] glance_catalog_info = image:glance:publicURL {{(pid=73655) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 25 15:47:07 devstack cinder-volume[73655]: DEBUG oslo_service.backend._eventlet.service [None req-203a21c1-0897-49e7-a0b3-deab8820e8ca None None] glance_certfile = None {{(pid=73655) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 25 15:47:07 devstack cinder-volume[73655]: DEBUG oslo_service.backend._eventlet.service [None req-203a21c1-0897-49e7-a0b3-deab8820e8ca None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=73655) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 25 15:47:07 devstack cinder-volume[73655]: DEBUG oslo_service.backend._eventlet.service [None req-203a21c1-0897-49e7-a0b3-deab8820e8ca None None] glance_keyfile = None {{(pid=73655) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 25 15:47:07 devstack cinder-volume[73655]: DEBUG oslo_service.backend._eventlet.service [None req-203a21c1-0897-49e7-a0b3-deab8820e8ca None None] glance_num_retries = 3 {{(pid=73655) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 25 15:47:07 devstack cinder-volume[73655]: DEBUG oslo_service.backend._eventlet.service [None req-203a21c1-0897-49e7-a0b3-deab8820e8ca None None] glance_request_timeout = None {{(pid=73655) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 25 15:47:07 devstack cinder-volume[73655]: DEBUG oslo_service.backend._eventlet.service [None req-203a21c1-0897-49e7-a0b3-deab8820e8ca None None] goodness_function = None {{(pid=73655) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 25 15:47:07 devstack cinder-volume[73655]: DEBUG oslo_service.backend._eventlet.service [None req-203a21c1-0897-49e7-a0b3-deab8820e8ca None None] graceful_shutdown_timeout = 5 {{(pid=73655) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 25 15:47:07 devstack cinder-volume[73655]: DEBUG oslo_service.backend._eventlet.service [None req-203a21c1-0897-49e7-a0b3-deab8820e8ca None None] group_api_class = cinder.group.api.API {{(pid=73655) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 25 15:47:07 devstack cinder-volume[73655]: DEBUG oslo_service.backend._eventlet.service [None req-203a21c1-0897-49e7-a0b3-deab8820e8ca None None] host = devstack {{(pid=73655) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 25 15:47:07 devstack cinder-volume[73655]: DEBUG oslo_service.backend._eventlet.service [None req-203a21c1-0897-49e7-a0b3-deab8820e8ca None None] image_compress_on_upload = True {{(pid=73655) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 25 15:47:07 devstack cinder-volume[73655]: DEBUG oslo_service.backend._eventlet.service [None req-203a21c1-0897-49e7-a0b3-deab8820e8ca None None] image_conversion_address_space_limit = 1 {{(pid=73655) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 25 15:47:07 devstack cinder-volume[73655]: DEBUG oslo_service.backend._eventlet.service [None req-203a21c1-0897-49e7-a0b3-deab8820e8ca None None] image_conversion_cpu_limit = 60 {{(pid=73655) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 25 15:47:07 devstack cinder-volume[73655]: DEBUG oslo_service.backend._eventlet.service [None req-203a21c1-0897-49e7-a0b3-deab8820e8ca None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=73655) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 25 15:47:07 devstack cinder-volume[73655]: DEBUG oslo_service.backend._eventlet.service [None req-203a21c1-0897-49e7-a0b3-deab8820e8ca None None] image_conversion_disable = False {{(pid=73655) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 25 15:47:07 devstack cinder-volume[73655]: DEBUG oslo_service.backend._eventlet.service [None req-203a21c1-0897-49e7-a0b3-deab8820e8ca None None] image_upload_use_cinder_backend = False {{(pid=73655) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 25 15:47:07 devstack cinder-volume[73655]: DEBUG oslo_service.backend._eventlet.service [None req-203a21c1-0897-49e7-a0b3-deab8820e8ca None None] image_upload_use_internal_tenant = False {{(pid=73655) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 25 15:47:07 devstack cinder-volume[73655]: DEBUG oslo_service.backend._eventlet.service [None req-203a21c1-0897-49e7-a0b3-deab8820e8ca None None] image_volume_cache_enabled = False {{(pid=73655) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 25 15:47:07 devstack cinder-volume[73655]: DEBUG oslo_service.backend._eventlet.service [None req-203a21c1-0897-49e7-a0b3-deab8820e8ca None None] image_volume_cache_max_count = 0 {{(pid=73655) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 25 15:47:07 devstack cinder-volume[73655]: DEBUG oslo_service.backend._eventlet.service [None req-203a21c1-0897-49e7-a0b3-deab8820e8ca None None] image_volume_cache_max_size_gb = 0 {{(pid=73655) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 25 15:47:07 devstack cinder-volume[73655]: DEBUG oslo_service.backend._eventlet.service [None req-203a21c1-0897-49e7-a0b3-deab8820e8ca None None] init_host_max_objects_retrieval = 0 {{(pid=73655) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 25 15:47:07 devstack cinder-volume[73655]: DEBUG oslo_service.backend._eventlet.service [None req-203a21c1-0897-49e7-a0b3-deab8820e8ca None None] instance_format = [instance: %(uuid)s] {{(pid=73655) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 25 15:47:07 devstack cinder-volume[73655]: DEBUG oslo_service.backend._eventlet.service [None req-203a21c1-0897-49e7-a0b3-deab8820e8ca None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=73655) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 25 15:47:07 devstack cinder-volume[73655]: DEBUG oslo_service.backend._eventlet.service [None req-203a21c1-0897-49e7-a0b3-deab8820e8ca None None] iscsi_target_flags = {{(pid=73655) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 25 15:47:07 devstack cinder-volume[73655]: DEBUG oslo_service.backend._eventlet.service [None req-203a21c1-0897-49e7-a0b3-deab8820e8ca None None] iscsi_write_cache = on {{(pid=73655) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 25 15:47:07 devstack cinder-volume[73655]: DEBUG oslo_service.backend._eventlet.service [None req-203a21c1-0897-49e7-a0b3-deab8820e8ca None None] iser_helper = tgtadm {{(pid=73655) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 25 15:47:07 devstack cinder-volume[73655]: DEBUG oslo_service.backend._eventlet.service [None req-203a21c1-0897-49e7-a0b3-deab8820e8ca None None] iser_ip_address = 192.168.122.119 {{(pid=73655) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 25 15:47:07 devstack cinder-volume[73655]: DEBUG oslo_service.backend._eventlet.service [None req-203a21c1-0897-49e7-a0b3-deab8820e8ca None None] iser_port = 3260 {{(pid=73655) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 25 15:47:07 devstack cinder-volume[73655]: DEBUG oslo_service.backend._eventlet.service [None req-203a21c1-0897-49e7-a0b3-deab8820e8ca None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=73655) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 25 15:47:07 devstack cinder-volume[73655]: DEBUG oslo_service.backend._eventlet.service [None req-203a21c1-0897-49e7-a0b3-deab8820e8ca None None] log_color = False {{(pid=73655) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 25 15:47:07 devstack cinder-volume[73655]: DEBUG oslo_service.backend._eventlet.service [None req-203a21c1-0897-49e7-a0b3-deab8820e8ca None None] log_config_append = None {{(pid=73655) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 25 15:47:07 devstack cinder-volume[73655]: DEBUG oslo_service.backend._eventlet.service [None req-203a21c1-0897-49e7-a0b3-deab8820e8ca None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=73655) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 25 15:47:07 devstack cinder-volume[73655]: DEBUG oslo_service.backend._eventlet.service [None req-203a21c1-0897-49e7-a0b3-deab8820e8ca None None] log_dir = None {{(pid=73655) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 25 15:47:07 devstack cinder-volume[73655]: DEBUG oslo_service.backend._eventlet.service [None req-203a21c1-0897-49e7-a0b3-deab8820e8ca None None] log_file = None {{(pid=73655) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 25 15:47:07 devstack cinder-volume[73655]: DEBUG oslo_service.backend._eventlet.service [None req-203a21c1-0897-49e7-a0b3-deab8820e8ca None None] log_options = True {{(pid=73655) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 25 15:47:07 devstack cinder-volume[73655]: DEBUG oslo_service.backend._eventlet.service [None req-203a21c1-0897-49e7-a0b3-deab8820e8ca None None] log_rotate_interval = 1 {{(pid=73655) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 25 15:47:07 devstack cinder-volume[73655]: DEBUG oslo_service.backend._eventlet.service [None req-203a21c1-0897-49e7-a0b3-deab8820e8ca None None] log_rotate_interval_type = days {{(pid=73655) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 25 15:47:07 devstack cinder-volume[73655]: DEBUG oslo_service.backend._eventlet.service [None req-203a21c1-0897-49e7-a0b3-deab8820e8ca None None] log_rotation_type = none {{(pid=73655) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 25 15:47:07 devstack cinder-volume[73655]: DEBUG oslo_service.backend._eventlet.service [None req-203a21c1-0897-49e7-a0b3-deab8820e8ca None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=73655) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 25 15:47:07 devstack cinder-volume[73655]: DEBUG oslo_service.backend._eventlet.service [None req-203a21c1-0897-49e7-a0b3-deab8820e8ca None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=73655) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 25 15:47:07 devstack cinder-volume[73655]: DEBUG oslo_service.backend._eventlet.service [None req-203a21c1-0897-49e7-a0b3-deab8820e8ca None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=73655) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 25 15:47:07 devstack cinder-volume[73655]: DEBUG oslo_service.backend._eventlet.service [None req-203a21c1-0897-49e7-a0b3-deab8820e8ca None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=73655) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 25 15:47:07 devstack cinder-volume[73655]: DEBUG oslo_service.backend._eventlet.service [None req-203a21c1-0897-49e7-a0b3-deab8820e8ca None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=73655) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 25 15:47:07 devstack cinder-volume[73655]: DEBUG oslo_service.backend._eventlet.service [None req-203a21c1-0897-49e7-a0b3-deab8820e8ca None None] max_age = 0 {{(pid=73655) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 25 15:47:07 devstack cinder-volume[73655]: DEBUG oslo_service.backend._eventlet.service [None req-203a21c1-0897-49e7-a0b3-deab8820e8ca None None] max_logfile_count = 30 {{(pid=73655) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 25 15:47:07 devstack cinder-volume[73655]: DEBUG oslo_service.backend._eventlet.service [None req-203a21c1-0897-49e7-a0b3-deab8820e8ca None None] max_logfile_size_mb = 200 {{(pid=73655) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 25 15:47:07 devstack cinder-volume[73655]: DEBUG oslo_service.backend._eventlet.service [None req-203a21c1-0897-49e7-a0b3-deab8820e8ca None None] max_over_subscription_ratio = 20.0 {{(pid=73655) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 25 15:47:07 devstack cinder-volume[73655]: DEBUG oslo_service.backend._eventlet.service [None req-203a21c1-0897-49e7-a0b3-deab8820e8ca None None] message_reap_interval = 86400 {{(pid=73655) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 25 15:47:07 devstack cinder-volume[73655]: DEBUG oslo_service.backend._eventlet.service [None req-203a21c1-0897-49e7-a0b3-deab8820e8ca None None] message_ttl = 2592000 {{(pid=73655) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 25 15:47:07 devstack cinder-volume[73655]: DEBUG oslo_service.backend._eventlet.service [None req-203a21c1-0897-49e7-a0b3-deab8820e8ca None None] migration_create_volume_timeout_secs = 300 {{(pid=73655) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 25 15:47:07 devstack cinder-volume[73655]: DEBUG oslo_service.backend._eventlet.service [None req-203a21c1-0897-49e7-a0b3-deab8820e8ca None None] monkey_patch = False {{(pid=73655) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 25 15:47:07 devstack cinder-volume[73655]: DEBUG oslo_service.backend._eventlet.service [None req-203a21c1-0897-49e7-a0b3-deab8820e8ca None None] monkey_patch_modules = [] {{(pid=73655) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 25 15:47:07 devstack cinder-volume[73655]: DEBUG oslo_service.backend._eventlet.service [None req-203a21c1-0897-49e7-a0b3-deab8820e8ca None None] my_ip = 192.168.122.119 {{(pid=73655) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 25 15:47:07 devstack cinder-volume[73655]: DEBUG oslo_service.backend._eventlet.service [None req-203a21c1-0897-49e7-a0b3-deab8820e8ca None None] no_snapshot_gb_quota = False {{(pid=73655) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 25 15:47:07 devstack cinder-volume[73655]: DEBUG oslo_service.backend._eventlet.service [None req-203a21c1-0897-49e7-a0b3-deab8820e8ca None None] num_iser_scan_tries = 3 {{(pid=73655) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 25 15:47:07 devstack cinder-volume[73655]: DEBUG oslo_service.backend._eventlet.service [None req-203a21c1-0897-49e7-a0b3-deab8820e8ca None None] num_shell_tries = 3 {{(pid=73655) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 25 15:47:07 devstack cinder-volume[73655]: DEBUG oslo_service.backend._eventlet.service [None req-203a21c1-0897-49e7-a0b3-deab8820e8ca None None] num_volume_device_scan_tries = 3 {{(pid=73655) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 25 15:47:07 devstack cinder-volume[73655]: DEBUG oslo_service.backend._eventlet.service [None req-203a21c1-0897-49e7-a0b3-deab8820e8ca None None] nvmeof_conn_info_version = 1 {{(pid=73655) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 25 15:47:07 devstack cinder-volume[73655]: DEBUG oslo_service.backend._eventlet.service [None req-203a21c1-0897-49e7-a0b3-deab8820e8ca None None] nvmet_ns_id = 10 {{(pid=73655) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 25 15:47:07 devstack cinder-volume[73655]: DEBUG oslo_service.backend._eventlet.service [None req-203a21c1-0897-49e7-a0b3-deab8820e8ca None None] nvmet_port_id = 1 {{(pid=73655) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 25 15:47:07 devstack cinder-volume[73655]: DEBUG oslo_service.backend._eventlet.service [None req-203a21c1-0897-49e7-a0b3-deab8820e8ca None None] osapi_max_limit = 1000 {{(pid=73655) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 25 15:47:07 devstack cinder-volume[73655]: DEBUG oslo_service.backend._eventlet.service [None req-203a21c1-0897-49e7-a0b3-deab8820e8ca None None] osapi_volume_ext_list = [] {{(pid=73655) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 25 15:47:07 devstack cinder-volume[73655]: DEBUG oslo_service.backend._eventlet.service [None req-203a21c1-0897-49e7-a0b3-deab8820e8ca None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=73655) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 25 15:47:07 devstack cinder-volume[73655]: DEBUG oslo_service.backend._eventlet.service [None req-203a21c1-0897-49e7-a0b3-deab8820e8ca None None] osapi_volume_listen = 0.0.0.0 {{(pid=73655) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 25 15:47:07 devstack cinder-volume[73655]: DEBUG oslo_service.backend._eventlet.service [None req-203a21c1-0897-49e7-a0b3-deab8820e8ca None None] osapi_volume_listen_port = 8776 {{(pid=73655) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 25 15:47:07 devstack cinder-volume[73655]: DEBUG oslo_service.backend._eventlet.service [None req-203a21c1-0897-49e7-a0b3-deab8820e8ca None None] osapi_volume_use_ssl = False {{(pid=73655) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 25 15:47:07 devstack cinder-volume[73655]: DEBUG oslo_service.backend._eventlet.service [None req-203a21c1-0897-49e7-a0b3-deab8820e8ca None None] osapi_volume_workers = 2 {{(pid=73655) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 25 15:47:07 devstack cinder-volume[73655]: DEBUG oslo_service.backend._eventlet.service [None req-203a21c1-0897-49e7-a0b3-deab8820e8ca None None] per_volume_size_limit = -1 {{(pid=73655) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 25 15:47:07 devstack cinder-volume[73655]: DEBUG oslo_service.backend._eventlet.service [None req-203a21c1-0897-49e7-a0b3-deab8820e8ca None None] periodic_fuzzy_delay = 60 {{(pid=73655) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 25 15:47:07 devstack cinder-volume[73655]: DEBUG oslo_service.backend._eventlet.service [None req-203a21c1-0897-49e7-a0b3-deab8820e8ca None None] periodic_interval = 60 {{(pid=73655) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 25 15:47:07 devstack cinder-volume[73655]: DEBUG oslo_service.backend._eventlet.service [None req-203a21c1-0897-49e7-a0b3-deab8820e8ca None None] project_id_regex = [0-9a-f\-]+ {{(pid=73655) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 25 15:47:07 devstack cinder-volume[73655]: DEBUG oslo_service.backend._eventlet.service [None req-203a21c1-0897-49e7-a0b3-deab8820e8ca None None] public_endpoint = None {{(pid=73655) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 25 15:47:07 devstack cinder-volume[73655]: DEBUG oslo_service.backend._eventlet.service [None req-203a21c1-0897-49e7-a0b3-deab8820e8ca None None] publish_errors = False {{(pid=73655) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 25 15:47:07 devstack cinder-volume[73655]: DEBUG oslo_service.backend._eventlet.service [None req-203a21c1-0897-49e7-a0b3-deab8820e8ca None None] quota_backup_gigabytes = 1000 {{(pid=73655) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 25 15:47:07 devstack cinder-volume[73655]: DEBUG oslo_service.backend._eventlet.service [None req-203a21c1-0897-49e7-a0b3-deab8820e8ca None None] quota_backups = 10 {{(pid=73655) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 25 15:47:07 devstack cinder-volume[73655]: DEBUG oslo_service.backend._eventlet.service [None req-203a21c1-0897-49e7-a0b3-deab8820e8ca None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=73655) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 25 15:47:07 devstack cinder-volume[73655]: DEBUG oslo_service.backend._eventlet.service [None req-203a21c1-0897-49e7-a0b3-deab8820e8ca None None] quota_gigabytes = 1000 {{(pid=73655) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 25 15:47:07 devstack cinder-volume[73655]: DEBUG oslo_service.backend._eventlet.service [None req-203a21c1-0897-49e7-a0b3-deab8820e8ca None None] quota_groups = 10 {{(pid=73655) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 25 15:47:07 devstack cinder-volume[73655]: DEBUG oslo_service.backend._eventlet.service [None req-203a21c1-0897-49e7-a0b3-deab8820e8ca None None] quota_snapshots = 10 {{(pid=73655) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 25 15:47:07 devstack cinder-volume[73655]: DEBUG oslo_service.backend._eventlet.service [None req-203a21c1-0897-49e7-a0b3-deab8820e8ca None None] quota_volumes = 10 {{(pid=73655) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 25 15:47:07 devstack cinder-volume[73655]: DEBUG oslo_service.backend._eventlet.service [None req-203a21c1-0897-49e7-a0b3-deab8820e8ca None None] rate_limit_burst = 0 {{(pid=73655) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 25 15:47:07 devstack cinder-volume[73655]: DEBUG oslo_service.backend._eventlet.service [None req-203a21c1-0897-49e7-a0b3-deab8820e8ca None None] rate_limit_except_level = CRITICAL {{(pid=73655) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 25 15:47:07 devstack cinder-volume[73655]: DEBUG oslo_service.backend._eventlet.service [None req-203a21c1-0897-49e7-a0b3-deab8820e8ca None None] rate_limit_interval = 0 {{(pid=73655) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 25 15:47:07 devstack cinder-volume[73655]: DEBUG oslo_service.backend._eventlet.service [None req-203a21c1-0897-49e7-a0b3-deab8820e8ca None None] reinit_driver_count = 3 {{(pid=73655) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 25 15:47:07 devstack cinder-volume[73655]: DEBUG oslo_service.backend._eventlet.service [None req-203a21c1-0897-49e7-a0b3-deab8820e8ca None None] replication_device = **** {{(pid=73655) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 25 15:47:07 devstack cinder-volume[73655]: DEBUG oslo_service.backend._eventlet.service [None req-203a21c1-0897-49e7-a0b3-deab8820e8ca None None] report_discard_supported = False {{(pid=73655) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 25 15:47:07 devstack cinder-volume[73655]: DEBUG oslo_service.backend._eventlet.service [None req-203a21c1-0897-49e7-a0b3-deab8820e8ca None None] report_interval = 120 {{(pid=73655) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 25 15:47:07 devstack cinder-volume[73655]: DEBUG oslo_service.backend._eventlet.service [None req-203a21c1-0897-49e7-a0b3-deab8820e8ca None None] reservation_clean_interval = 86400 {{(pid=73655) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 25 15:47:07 devstack cinder-volume[73655]: DEBUG oslo_service.backend._eventlet.service [None req-203a21c1-0897-49e7-a0b3-deab8820e8ca None None] reservation_expire = 86400 {{(pid=73655) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 25 15:47:07 devstack cinder-volume[73655]: DEBUG oslo_service.backend._eventlet.service [None req-203a21c1-0897-49e7-a0b3-deab8820e8ca None None] reserved_image_namespaces = [] {{(pid=73655) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 25 15:47:07 devstack cinder-volume[73655]: DEBUG oslo_service.backend._eventlet.service [None req-203a21c1-0897-49e7-a0b3-deab8820e8ca None None] reserved_percentage = 0 {{(pid=73655) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 25 15:47:07 devstack cinder-volume[73655]: DEBUG oslo_service.backend._eventlet.service [None req-203a21c1-0897-49e7-a0b3-deab8820e8ca None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=73655) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 25 15:47:07 devstack cinder-volume[73655]: DEBUG oslo_service.backend._eventlet.service [None req-203a21c1-0897-49e7-a0b3-deab8820e8ca None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=73655) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 25 15:47:07 devstack cinder-volume[73655]: DEBUG oslo_service.backend._eventlet.service [None req-203a21c1-0897-49e7-a0b3-deab8820e8ca None None] rpc_response_timeout = 120 {{(pid=73655) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 25 15:47:07 devstack cinder-volume[73655]: DEBUG oslo_service.backend._eventlet.service [None req-203a21c1-0897-49e7-a0b3-deab8820e8ca None None] run_external_periodic_tasks = True {{(pid=73655) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 25 15:47:07 devstack cinder-volume[73655]: DEBUG oslo_service.backend._eventlet.service [None req-203a21c1-0897-49e7-a0b3-deab8820e8ca None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=73655) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 25 15:47:07 devstack cinder-volume[73655]: DEBUG oslo_service.backend._eventlet.service [None req-203a21c1-0897-49e7-a0b3-deab8820e8ca None None] scst_target_driver = iscsi {{(pid=73655) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 25 15:47:07 devstack cinder-volume[73655]: DEBUG oslo_service.backend._eventlet.service [None req-203a21c1-0897-49e7-a0b3-deab8820e8ca None None] scst_target_iqn_name = None {{(pid=73655) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 25 15:47:07 devstack cinder-volume[73655]: DEBUG oslo_service.backend._eventlet.service [None req-203a21c1-0897-49e7-a0b3-deab8820e8ca None None] service_down_time = 720 {{(pid=73655) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 25 15:47:07 devstack cinder-volume[73655]: DEBUG oslo_service.backend._eventlet.service [None req-203a21c1-0897-49e7-a0b3-deab8820e8ca None None] shell_completion = None {{(pid=73655) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 25 15:47:07 devstack cinder-volume[73655]: DEBUG oslo_service.backend._eventlet.service [None req-203a21c1-0897-49e7-a0b3-deab8820e8ca None None] snapshot_name_template = snapshot-%s {{(pid=73655) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 25 15:47:07 devstack cinder-volume[73655]: DEBUG oslo_service.backend._eventlet.service [None req-203a21c1-0897-49e7-a0b3-deab8820e8ca None None] snapshot_same_host = True {{(pid=73655) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 25 15:47:07 devstack cinder-volume[73655]: DEBUG oslo_service.backend._eventlet.service [None req-203a21c1-0897-49e7-a0b3-deab8820e8ca None None] split_loggers = False {{(pid=73655) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 25 15:47:07 devstack cinder-volume[73655]: DEBUG oslo_service.backend._eventlet.service [None req-203a21c1-0897-49e7-a0b3-deab8820e8ca None None] state_path = /opt/stack/data/cinder {{(pid=73655) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 25 15:47:07 devstack cinder-volume[73655]: DEBUG oslo_service.backend._eventlet.service [None req-203a21c1-0897-49e7-a0b3-deab8820e8ca None None] storage_availability_zone = nova {{(pid=73655) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 25 15:47:07 devstack cinder-volume[73655]: DEBUG oslo_service.backend._eventlet.service [None req-203a21c1-0897-49e7-a0b3-deab8820e8ca None None] storage_protocol = iSCSI {{(pid=73655) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 25 15:47:07 devstack cinder-volume[73655]: DEBUG oslo_service.backend._eventlet.service [None req-203a21c1-0897-49e7-a0b3-deab8820e8ca None None] syslog_log_facility = LOG_USER {{(pid=73655) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 25 15:47:07 devstack cinder-volume[73655]: DEBUG oslo_service.backend._eventlet.service [None req-203a21c1-0897-49e7-a0b3-deab8820e8ca None None] target_helper = lioadm {{(pid=73655) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 25 15:47:07 devstack cinder-volume[73655]: DEBUG oslo_service.backend._eventlet.service [None req-203a21c1-0897-49e7-a0b3-deab8820e8ca None None] target_ip_address = 192.168.122.119 {{(pid=73655) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 25 15:47:07 devstack cinder-volume[73655]: DEBUG oslo_service.backend._eventlet.service [None req-203a21c1-0897-49e7-a0b3-deab8820e8ca None None] target_port = 3260 {{(pid=73655) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 25 15:47:07 devstack cinder-volume[73655]: DEBUG oslo_service.backend._eventlet.service [None req-203a21c1-0897-49e7-a0b3-deab8820e8ca None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=73655) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 25 15:47:07 devstack cinder-volume[73655]: DEBUG oslo_service.backend._eventlet.service [None req-203a21c1-0897-49e7-a0b3-deab8820e8ca None None] target_protocol = iscsi {{(pid=73655) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 25 15:47:07 devstack cinder-volume[73655]: DEBUG oslo_service.backend._eventlet.service [None req-203a21c1-0897-49e7-a0b3-deab8820e8ca None None] target_secondary_ip_addresses = [] {{(pid=73655) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 25 15:47:07 devstack cinder-volume[73655]: DEBUG oslo_service.backend._eventlet.service [None req-203a21c1-0897-49e7-a0b3-deab8820e8ca None None] trace_flags = None {{(pid=73655) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 25 15:47:07 devstack cinder-volume[73655]: DEBUG oslo_service.backend._eventlet.service [None req-203a21c1-0897-49e7-a0b3-deab8820e8ca None None] transfer_api_class = cinder.transfer.api.API {{(pid=73655) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 25 15:47:07 devstack cinder-volume[73655]: DEBUG oslo_service.backend._eventlet.service [None req-203a21c1-0897-49e7-a0b3-deab8820e8ca None None] transport_url = **** {{(pid=73655) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 25 15:47:07 devstack cinder-volume[73655]: DEBUG oslo_service.backend._eventlet.service [None req-203a21c1-0897-49e7-a0b3-deab8820e8ca None None] until_refresh = 0 {{(pid=73655) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 25 15:47:07 devstack cinder-volume[73655]: DEBUG oslo_service.backend._eventlet.service [None req-203a21c1-0897-49e7-a0b3-deab8820e8ca None None] use_chap_auth = False {{(pid=73655) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 25 15:47:07 devstack cinder-volume[73655]: DEBUG oslo_service.backend._eventlet.service [None req-203a21c1-0897-49e7-a0b3-deab8820e8ca None None] use_default_quota_class = True {{(pid=73655) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 25 15:47:07 devstack cinder-volume[73655]: DEBUG oslo_service.backend._eventlet.service [None req-203a21c1-0897-49e7-a0b3-deab8820e8ca None None] use_journal = False {{(pid=73655) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 25 15:47:07 devstack cinder-volume[73655]: DEBUG oslo_service.backend._eventlet.service [None req-203a21c1-0897-49e7-a0b3-deab8820e8ca None None] use_json = False {{(pid=73655) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 25 15:47:07 devstack cinder-volume[73655]: DEBUG oslo_service.backend._eventlet.service [None req-203a21c1-0897-49e7-a0b3-deab8820e8ca None None] use_multipath_for_image_xfer = False {{(pid=73655) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 25 15:47:07 devstack cinder-volume[73655]: DEBUG oslo_service.backend._eventlet.service [None req-203a21c1-0897-49e7-a0b3-deab8820e8ca None None] use_stderr = False {{(pid=73655) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 25 15:47:07 devstack cinder-volume[73655]: DEBUG oslo_service.backend._eventlet.service [None req-203a21c1-0897-49e7-a0b3-deab8820e8ca None None] use_syslog = False {{(pid=73655) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 25 15:47:07 devstack cinder-volume[73655]: DEBUG oslo_service.backend._eventlet.service [None req-203a21c1-0897-49e7-a0b3-deab8820e8ca None None] verify_glance_signatures = enabled {{(pid=73655) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 25 15:47:07 devstack cinder-volume[73655]: DEBUG oslo_service.backend._eventlet.service [None req-203a21c1-0897-49e7-a0b3-deab8820e8ca None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=73655) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 25 15:47:07 devstack cinder-volume[73655]: DEBUG oslo_service.backend._eventlet.service [None req-203a21c1-0897-49e7-a0b3-deab8820e8ca None None] volume_api_class = cinder.volume.api.API {{(pid=73655) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 25 15:47:07 devstack cinder-volume[73655]: DEBUG oslo_service.backend._eventlet.service [None req-203a21c1-0897-49e7-a0b3-deab8820e8ca None None] volume_backend_name = None {{(pid=73655) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 25 15:47:07 devstack cinder-volume[73655]: DEBUG oslo_service.backend._eventlet.service [None req-203a21c1-0897-49e7-a0b3-deab8820e8ca None None] volume_clear = zero {{(pid=73655) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 25 15:47:07 devstack cinder-volume[73655]: DEBUG oslo_service.backend._eventlet.service [None req-203a21c1-0897-49e7-a0b3-deab8820e8ca None None] volume_clear_ionice = None {{(pid=73655) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 25 15:47:07 devstack cinder-volume[73655]: DEBUG oslo_service.backend._eventlet.service [None req-203a21c1-0897-49e7-a0b3-deab8820e8ca None None] volume_clear_size = 0 {{(pid=73655) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 25 15:47:07 devstack cinder-volume[73655]: DEBUG oslo_service.backend._eventlet.service [None req-203a21c1-0897-49e7-a0b3-deab8820e8ca None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=73655) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 25 15:47:07 devstack cinder-volume[73655]: DEBUG oslo_service.backend._eventlet.service [None req-203a21c1-0897-49e7-a0b3-deab8820e8ca None None] volume_copy_bps_limit = 0 {{(pid=73655) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 25 15:47:07 devstack cinder-volume[73755]: INFO cinder.volume.manager [None req-bec051e7-ca60-4608-901c-5bd51659c94d None None] Starting volume driver LVMVolumeDriver (3.0.0) Feb 25 15:47:07 devstack cinder-volume[73655]: DEBUG oslo_service.backend._eventlet.service [None req-203a21c1-0897-49e7-a0b3-deab8820e8ca None None] volume_dd_blocksize = 1M {{(pid=73655) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 25 15:47:07 devstack cinder-volume[73655]: DEBUG oslo_service.backend._eventlet.service [None req-203a21c1-0897-49e7-a0b3-deab8820e8ca None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=73655) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 25 15:47:07 devstack cinder-volume[73655]: DEBUG oslo_service.backend._eventlet.service [None req-203a21c1-0897-49e7-a0b3-deab8820e8ca None None] volume_name_template = volume-%s {{(pid=73655) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 25 15:47:07 devstack cinder-volume[73755]: DEBUG oslo_concurrency.processutils [None req-bec051e7-ca60-4608-901c-5bd51659c94d None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=73755) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 25 15:47:07 devstack cinder-volume[73655]: DEBUG oslo_service.backend._eventlet.service [None req-203a21c1-0897-49e7-a0b3-deab8820e8ca None None] volume_service_inithost_offload = False {{(pid=73655) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 25 15:47:07 devstack cinder-volume[73655]: DEBUG oslo_service.backend._eventlet.service [None req-203a21c1-0897-49e7-a0b3-deab8820e8ca None None] volume_usage_audit_period = month {{(pid=73655) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 25 15:47:07 devstack cinder-volume[73655]: DEBUG oslo_service.backend._eventlet.service [None req-203a21c1-0897-49e7-a0b3-deab8820e8ca None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=73655) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 25 15:47:07 devstack cinder-volume[73655]: DEBUG oslo_service.backend._eventlet.service [None req-203a21c1-0897-49e7-a0b3-deab8820e8ca None None] zoning_mode = None {{(pid=73655) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 25 15:47:07 devstack cinder-volume[73655]: DEBUG oslo_service.backend._eventlet.service [None req-203a21c1-0897-49e7-a0b3-deab8820e8ca None None] os_brick.lightos_discovery_client_address = localhost {{(pid=73655) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:47:07 devstack cinder-volume[73655]: DEBUG oslo_service.backend._eventlet.service [None req-203a21c1-0897-49e7-a0b3-deab8820e8ca None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=73655) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:47:07 devstack cinder-volume[73655]: DEBUG oslo_service.backend._eventlet.service [None req-203a21c1-0897-49e7-a0b3-deab8820e8ca None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=73655) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:47:07 devstack cinder-volume[73655]: DEBUG oslo_service.backend._eventlet.service [None req-203a21c1-0897-49e7-a0b3-deab8820e8ca None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=73655) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:47:07 devstack cinder-volume[73655]: DEBUG oslo_service.backend._eventlet.service [None req-203a21c1-0897-49e7-a0b3-deab8820e8ca None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=73655) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:47:07 devstack cinder-volume[73655]: DEBUG oslo_service.backend._eventlet.service [None req-203a21c1-0897-49e7-a0b3-deab8820e8ca None None] os_brick.wait_mpath_device_interval = 1 {{(pid=73655) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:47:07 devstack cinder-volume[73655]: DEBUG oslo_service.backend._eventlet.service [None req-203a21c1-0897-49e7-a0b3-deab8820e8ca None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=73655) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:47:07 devstack cinder-volume[73655]: DEBUG oslo_service.backend._eventlet.service [None req-203a21c1-0897-49e7-a0b3-deab8820e8ca None None] oslo_concurrency.disable_process_locking = False {{(pid=73655) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:47:07 devstack cinder-volume[73655]: DEBUG oslo_service.backend._eventlet.service [None req-203a21c1-0897-49e7-a0b3-deab8820e8ca None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=73655) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:47:07 devstack cinder-volume[73655]: DEBUG oslo_service.backend._eventlet.service [None req-203a21c1-0897-49e7-a0b3-deab8820e8ca None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=73655) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:47:07 devstack cinder-volume[73655]: DEBUG oslo_service.backend._eventlet.service [None req-203a21c1-0897-49e7-a0b3-deab8820e8ca None None] keystone_authtoken.admin_password = **** {{(pid=73655) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:47:07 devstack cinder-volume[73655]: DEBUG oslo_service.backend._eventlet.service [None req-203a21c1-0897-49e7-a0b3-deab8820e8ca None None] keystone_authtoken.admin_tenant_name = admin {{(pid=73655) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:47:07 devstack cinder-volume[73655]: DEBUG oslo_service.backend._eventlet.service [None req-203a21c1-0897-49e7-a0b3-deab8820e8ca None None] keystone_authtoken.admin_token = **** {{(pid=73655) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:47:07 devstack cinder-volume[73655]: DEBUG oslo_service.backend._eventlet.service [None req-203a21c1-0897-49e7-a0b3-deab8820e8ca None None] keystone_authtoken.admin_user = None {{(pid=73655) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:47:07 devstack cinder-volume[73655]: DEBUG oslo_service.backend._eventlet.service [None req-203a21c1-0897-49e7-a0b3-deab8820e8ca None None] keystone_authtoken.auth_admin_prefix = {{(pid=73655) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:47:07 devstack cinder-volume[73655]: DEBUG oslo_service.backend._eventlet.service [None req-203a21c1-0897-49e7-a0b3-deab8820e8ca None None] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=73655) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:47:07 devstack cinder-volume[73655]: DEBUG oslo_service.backend._eventlet.service [None req-203a21c1-0897-49e7-a0b3-deab8820e8ca None None] keystone_authtoken.auth_port = 35357 {{(pid=73655) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:47:07 devstack cinder-volume[73655]: DEBUG oslo_service.backend._eventlet.service [None req-203a21c1-0897-49e7-a0b3-deab8820e8ca None None] keystone_authtoken.auth_protocol = https {{(pid=73655) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:47:07 devstack cinder-volume[73655]: DEBUG oslo_service.backend._eventlet.service [None req-203a21c1-0897-49e7-a0b3-deab8820e8ca None None] keystone_authtoken.auth_section = None {{(pid=73655) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:47:07 devstack cinder-volume[73655]: DEBUG oslo_service.backend._eventlet.service [None req-203a21c1-0897-49e7-a0b3-deab8820e8ca None None] keystone_authtoken.auth_type = password {{(pid=73655) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:47:07 devstack cinder-volume[73655]: DEBUG oslo_service.backend._eventlet.service [None req-203a21c1-0897-49e7-a0b3-deab8820e8ca None None] keystone_authtoken.auth_uri = None {{(pid=73655) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:47:07 devstack cinder-volume[73655]: DEBUG oslo_service.backend._eventlet.service [None req-203a21c1-0897-49e7-a0b3-deab8820e8ca None None] keystone_authtoken.auth_version = None {{(pid=73655) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:47:07 devstack cinder-volume[73655]: DEBUG oslo_service.backend._eventlet.service [None req-203a21c1-0897-49e7-a0b3-deab8820e8ca None None] keystone_authtoken.cache = None {{(pid=73655) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:47:07 devstack cinder-volume[73655]: DEBUG oslo_service.backend._eventlet.service [None req-203a21c1-0897-49e7-a0b3-deab8820e8ca None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=73655) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:47:07 devstack cinder-volume[73655]: DEBUG oslo_service.backend._eventlet.service [None req-203a21c1-0897-49e7-a0b3-deab8820e8ca None None] keystone_authtoken.certfile = None {{(pid=73655) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:47:07 devstack cinder-volume[73655]: DEBUG oslo_service.backend._eventlet.service [None req-203a21c1-0897-49e7-a0b3-deab8820e8ca None None] keystone_authtoken.delay_auth_decision = False {{(pid=73655) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:47:07 devstack cinder-volume[73655]: DEBUG oslo_service.backend._eventlet.service [None req-203a21c1-0897-49e7-a0b3-deab8820e8ca None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=73655) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:47:07 devstack cinder-volume[73655]: DEBUG oslo_service.backend._eventlet.service [None req-203a21c1-0897-49e7-a0b3-deab8820e8ca None None] keystone_authtoken.http_connect_timeout = None {{(pid=73655) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:47:07 devstack cinder-volume[73655]: DEBUG oslo_service.backend._eventlet.service [None req-203a21c1-0897-49e7-a0b3-deab8820e8ca None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=73655) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:47:07 devstack cinder-volume[73655]: DEBUG oslo_service.backend._eventlet.service [None req-203a21c1-0897-49e7-a0b3-deab8820e8ca None None] keystone_authtoken.identity_uri = None {{(pid=73655) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:47:07 devstack cinder-volume[73655]: DEBUG oslo_service.backend._eventlet.service [None req-203a21c1-0897-49e7-a0b3-deab8820e8ca None None] keystone_authtoken.include_service_catalog = True {{(pid=73655) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:47:07 devstack cinder-volume[73655]: DEBUG oslo_service.backend._eventlet.service [None req-203a21c1-0897-49e7-a0b3-deab8820e8ca None None] keystone_authtoken.insecure = False {{(pid=73655) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:47:07 devstack cinder-volume[73655]: DEBUG oslo_service.backend._eventlet.service [None req-203a21c1-0897-49e7-a0b3-deab8820e8ca None None] keystone_authtoken.interface = public {{(pid=73655) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:47:07 devstack cinder-volume[73655]: DEBUG oslo_service.backend._eventlet.service [None req-203a21c1-0897-49e7-a0b3-deab8820e8ca None None] keystone_authtoken.keyfile = None {{(pid=73655) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:47:07 devstack cinder-volume[73655]: DEBUG oslo_service.backend._eventlet.service [None req-203a21c1-0897-49e7-a0b3-deab8820e8ca None None] keystone_authtoken.memcache_password = {{(pid=73655) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:47:07 devstack cinder-volume[73655]: DEBUG oslo_service.backend._eventlet.service [None req-203a21c1-0897-49e7-a0b3-deab8820e8ca None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=73655) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:47:07 devstack cinder-volume[73655]: DEBUG oslo_service.backend._eventlet.service [None req-203a21c1-0897-49e7-a0b3-deab8820e8ca None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=73655) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:47:07 devstack cinder-volume[73655]: DEBUG oslo_service.backend._eventlet.service [None req-203a21c1-0897-49e7-a0b3-deab8820e8ca None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=73655) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:47:07 devstack cinder-volume[73655]: DEBUG oslo_service.backend._eventlet.service [None req-203a21c1-0897-49e7-a0b3-deab8820e8ca None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=73655) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:47:07 devstack cinder-volume[73655]: DEBUG oslo_service.backend._eventlet.service [None req-203a21c1-0897-49e7-a0b3-deab8820e8ca None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=73655) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:47:07 devstack cinder-volume[73655]: DEBUG oslo_service.backend._eventlet.service [None req-203a21c1-0897-49e7-a0b3-deab8820e8ca None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=73655) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:47:07 devstack cinder-volume[73655]: DEBUG oslo_service.backend._eventlet.service [None req-203a21c1-0897-49e7-a0b3-deab8820e8ca None None] keystone_authtoken.memcache_secret_key = **** {{(pid=73655) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:47:07 devstack cinder-volume[73655]: DEBUG oslo_service.backend._eventlet.service [None req-203a21c1-0897-49e7-a0b3-deab8820e8ca None None] keystone_authtoken.memcache_security_strategy = None {{(pid=73655) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:47:07 devstack cinder-volume[73655]: DEBUG oslo_service.backend._eventlet.service [None req-203a21c1-0897-49e7-a0b3-deab8820e8ca None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=73655) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:47:07 devstack cinder-volume[73655]: DEBUG oslo_service.backend._eventlet.service [None req-203a21c1-0897-49e7-a0b3-deab8820e8ca None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=73655) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:47:07 devstack cinder-volume[73655]: DEBUG oslo_service.backend._eventlet.service [None req-203a21c1-0897-49e7-a0b3-deab8820e8ca None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=73655) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:47:07 devstack cinder-volume[73655]: DEBUG oslo_service.backend._eventlet.service [None req-203a21c1-0897-49e7-a0b3-deab8820e8ca None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=73655) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:47:07 devstack cinder-volume[73655]: DEBUG oslo_service.backend._eventlet.service [None req-203a21c1-0897-49e7-a0b3-deab8820e8ca None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=73655) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:47:07 devstack cinder-volume[73655]: DEBUG oslo_service.backend._eventlet.service [None req-203a21c1-0897-49e7-a0b3-deab8820e8ca None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=73655) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:47:07 devstack cinder-volume[73655]: DEBUG oslo_service.backend._eventlet.service [None req-203a21c1-0897-49e7-a0b3-deab8820e8ca None None] keystone_authtoken.memcache_username = {{(pid=73655) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:47:07 devstack cinder-volume[73655]: DEBUG oslo_service.backend._eventlet.service [None req-203a21c1-0897-49e7-a0b3-deab8820e8ca None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=73655) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:47:07 devstack cinder-volume[73655]: DEBUG oslo_service.backend._eventlet.service [None req-203a21c1-0897-49e7-a0b3-deab8820e8ca None None] keystone_authtoken.region_name = None {{(pid=73655) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:47:07 devstack cinder-volume[73655]: DEBUG oslo_service.backend._eventlet.service [None req-203a21c1-0897-49e7-a0b3-deab8820e8ca None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=73655) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:47:07 devstack cinder-volume[73655]: DEBUG oslo_service.backend._eventlet.service [None req-203a21c1-0897-49e7-a0b3-deab8820e8ca None None] keystone_authtoken.service_token_roles_required = False {{(pid=73655) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:47:07 devstack cinder-volume[73655]: DEBUG oslo_service.backend._eventlet.service [None req-203a21c1-0897-49e7-a0b3-deab8820e8ca None None] keystone_authtoken.service_type = None {{(pid=73655) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:47:07 devstack cinder-volume[73655]: DEBUG oslo_service.backend._eventlet.service [None req-203a21c1-0897-49e7-a0b3-deab8820e8ca None None] keystone_authtoken.token_cache_time = 300 {{(pid=73655) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:47:07 devstack cinder-volume[73655]: DEBUG oslo_service.backend._eventlet.service [None req-203a21c1-0897-49e7-a0b3-deab8820e8ca None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.119/identity {{(pid=73655) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:47:07 devstack cinder-volume[73655]: DEBUG oslo_service.backend._eventlet.service [None req-203a21c1-0897-49e7-a0b3-deab8820e8ca None None] cache.backend = dogpile.cache.null {{(pid=73655) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:47:07 devstack cinder-volume[73655]: DEBUG oslo_service.backend._eventlet.service [None req-203a21c1-0897-49e7-a0b3-deab8820e8ca None None] cache.backend_argument = **** {{(pid=73655) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:47:07 devstack cinder-volume[73655]: DEBUG oslo_service.backend._eventlet.service [None req-203a21c1-0897-49e7-a0b3-deab8820e8ca None None] cache.backend_expiration_time = None {{(pid=73655) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:47:07 devstack cinder-volume[73655]: DEBUG oslo_service.backend._eventlet.service [None req-203a21c1-0897-49e7-a0b3-deab8820e8ca None None] cache.config_prefix = cache.oslo {{(pid=73655) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:47:07 devstack cinder-volume[73655]: DEBUG oslo_service.backend._eventlet.service [None req-203a21c1-0897-49e7-a0b3-deab8820e8ca None None] cache.debug_cache_backend = False {{(pid=73655) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:47:07 devstack cinder-volume[73655]: DEBUG oslo_service.backend._eventlet.service [None req-203a21c1-0897-49e7-a0b3-deab8820e8ca None None] cache.enable_retry_client = False {{(pid=73655) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:47:07 devstack cinder-volume[73655]: DEBUG oslo_service.backend._eventlet.service [None req-203a21c1-0897-49e7-a0b3-deab8820e8ca None None] cache.enable_socket_keepalive = False {{(pid=73655) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:47:07 devstack cinder-volume[73655]: DEBUG oslo_service.backend._eventlet.service [None req-203a21c1-0897-49e7-a0b3-deab8820e8ca None None] cache.enabled = False {{(pid=73655) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:47:07 devstack cinder-volume[73655]: DEBUG oslo_service.backend._eventlet.service [None req-203a21c1-0897-49e7-a0b3-deab8820e8ca None None] cache.enforce_fips_mode = False {{(pid=73655) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:47:07 devstack cinder-volume[73655]: DEBUG oslo_service.backend._eventlet.service [None req-203a21c1-0897-49e7-a0b3-deab8820e8ca None None] cache.expiration_time = 600 {{(pid=73655) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:47:07 devstack cinder-volume[73655]: DEBUG oslo_service.backend._eventlet.service [None req-203a21c1-0897-49e7-a0b3-deab8820e8ca None None] cache.hashclient_dead_timeout = 60.0 {{(pid=73655) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:47:07 devstack cinder-volume[73655]: DEBUG oslo_service.backend._eventlet.service [None req-203a21c1-0897-49e7-a0b3-deab8820e8ca None None] cache.hashclient_retry_attempts = 2 {{(pid=73655) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:47:07 devstack cinder-volume[73655]: DEBUG oslo_service.backend._eventlet.service [None req-203a21c1-0897-49e7-a0b3-deab8820e8ca None None] cache.hashclient_retry_timeout = 1.0 {{(pid=73655) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:47:07 devstack cinder-volume[73655]: DEBUG oslo_service.backend._eventlet.service [None req-203a21c1-0897-49e7-a0b3-deab8820e8ca None None] cache.memcache_dead_retry = 300 {{(pid=73655) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:47:07 devstack cinder-volume[73655]: DEBUG oslo_service.backend._eventlet.service [None req-203a21c1-0897-49e7-a0b3-deab8820e8ca None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=73655) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:47:07 devstack cinder-volume[73655]: DEBUG oslo_service.backend._eventlet.service [None req-203a21c1-0897-49e7-a0b3-deab8820e8ca None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=73655) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:47:07 devstack cinder-volume[73655]: DEBUG oslo_service.backend._eventlet.service [None req-203a21c1-0897-49e7-a0b3-deab8820e8ca None None] cache.memcache_pool_maxsize = 10 {{(pid=73655) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:47:07 devstack cinder-volume[73655]: DEBUG oslo_service.backend._eventlet.service [None req-203a21c1-0897-49e7-a0b3-deab8820e8ca None None] cache.memcache_pool_unused_timeout = 60 {{(pid=73655) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:47:07 devstack cinder-volume[73655]: DEBUG oslo_service.backend._eventlet.service [None req-203a21c1-0897-49e7-a0b3-deab8820e8ca None None] cache.memcache_sasl_enabled = False {{(pid=73655) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:47:07 devstack cinder-volume[73655]: DEBUG oslo_service.backend._eventlet.service [None req-203a21c1-0897-49e7-a0b3-deab8820e8ca None None] cache.memcache_servers = ['localhost:11211'] {{(pid=73655) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:47:07 devstack cinder-volume[73655]: DEBUG oslo_service.backend._eventlet.service [None req-203a21c1-0897-49e7-a0b3-deab8820e8ca None None] cache.password = **** {{(pid=73655) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:47:07 devstack cinder-volume[73655]: DEBUG oslo_service.backend._eventlet.service [None req-203a21c1-0897-49e7-a0b3-deab8820e8ca None None] cache.proxies = [] {{(pid=73655) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:47:07 devstack cinder-volume[73655]: DEBUG oslo_service.backend._eventlet.service [None req-203a21c1-0897-49e7-a0b3-deab8820e8ca None None] cache.redis_db = 0 {{(pid=73655) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:47:07 devstack cinder-volume[73655]: DEBUG oslo_service.backend._eventlet.service [None req-203a21c1-0897-49e7-a0b3-deab8820e8ca None None] cache.redis_sentinel_service_name = mymaster {{(pid=73655) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:47:07 devstack cinder-volume[73655]: DEBUG oslo_service.backend._eventlet.service [None req-203a21c1-0897-49e7-a0b3-deab8820e8ca None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=73655) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:47:07 devstack cinder-volume[73655]: DEBUG oslo_service.backend._eventlet.service [None req-203a21c1-0897-49e7-a0b3-deab8820e8ca None None] cache.redis_server = localhost:6379 {{(pid=73655) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:47:07 devstack cinder-volume[73655]: DEBUG oslo_service.backend._eventlet.service [None req-203a21c1-0897-49e7-a0b3-deab8820e8ca None None] cache.retry_attempts = 2 {{(pid=73655) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:47:07 devstack cinder-volume[73655]: DEBUG oslo_service.backend._eventlet.service [None req-203a21c1-0897-49e7-a0b3-deab8820e8ca None None] cache.retry_delay = 0.0 {{(pid=73655) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:47:07 devstack cinder-volume[73655]: DEBUG oslo_service.backend._eventlet.service [None req-203a21c1-0897-49e7-a0b3-deab8820e8ca None None] cache.socket_keepalive_count = 1 {{(pid=73655) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:47:07 devstack cinder-volume[73655]: DEBUG oslo_service.backend._eventlet.service [None req-203a21c1-0897-49e7-a0b3-deab8820e8ca None None] cache.socket_keepalive_idle = 1 {{(pid=73655) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:47:07 devstack cinder-volume[73655]: DEBUG oslo_service.backend._eventlet.service [None req-203a21c1-0897-49e7-a0b3-deab8820e8ca None None] cache.socket_keepalive_interval = 1 {{(pid=73655) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:47:07 devstack cinder-volume[73655]: DEBUG oslo_service.backend._eventlet.service [None req-203a21c1-0897-49e7-a0b3-deab8820e8ca None None] cache.socket_timeout = 1.0 {{(pid=73655) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:47:07 devstack cinder-volume[73655]: DEBUG oslo_service.backend._eventlet.service [None req-203a21c1-0897-49e7-a0b3-deab8820e8ca None None] cache.tls_allowed_ciphers = None {{(pid=73655) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:47:07 devstack cinder-volume[73655]: DEBUG oslo_service.backend._eventlet.service [None req-203a21c1-0897-49e7-a0b3-deab8820e8ca None None] cache.tls_cafile = None {{(pid=73655) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:47:07 devstack cinder-volume[73655]: DEBUG oslo_service.backend._eventlet.service [None req-203a21c1-0897-49e7-a0b3-deab8820e8ca None None] cache.tls_certfile = None {{(pid=73655) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:47:07 devstack cinder-volume[73655]: DEBUG oslo_service.backend._eventlet.service [None req-203a21c1-0897-49e7-a0b3-deab8820e8ca None None] cache.tls_enabled = False {{(pid=73655) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:47:07 devstack cinder-volume[73655]: DEBUG oslo_service.backend._eventlet.service [None req-203a21c1-0897-49e7-a0b3-deab8820e8ca None None] cache.tls_keyfile = None {{(pid=73655) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:47:07 devstack cinder-volume[73655]: DEBUG oslo_service.backend._eventlet.service [None req-203a21c1-0897-49e7-a0b3-deab8820e8ca None None] cache.username = None {{(pid=73655) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:47:07 devstack cinder-volume[73655]: DEBUG oslo_service.backend._eventlet.service [None req-203a21c1-0897-49e7-a0b3-deab8820e8ca None None] coordination.backend_url = **** {{(pid=73655) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:47:07 devstack cinder-volume[73655]: DEBUG oslo_service.backend._eventlet.service [None req-203a21c1-0897-49e7-a0b3-deab8820e8ca None None] database.asyncio_connection = **** {{(pid=73655) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:47:07 devstack cinder-volume[73655]: DEBUG oslo_service.backend._eventlet.service [None req-203a21c1-0897-49e7-a0b3-deab8820e8ca None None] database.asyncio_slave_connection = **** {{(pid=73655) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:47:07 devstack cinder-volume[73655]: DEBUG oslo_service.backend._eventlet.service [None req-203a21c1-0897-49e7-a0b3-deab8820e8ca None None] database.backend = sqlalchemy {{(pid=73655) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:47:07 devstack cinder-volume[73655]: DEBUG oslo_service.backend._eventlet.service [None req-203a21c1-0897-49e7-a0b3-deab8820e8ca None None] database.connection = **** {{(pid=73655) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:47:07 devstack cinder-volume[73655]: DEBUG oslo_service.backend._eventlet.service [None req-203a21c1-0897-49e7-a0b3-deab8820e8ca None None] database.connection_debug = 0 {{(pid=73655) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:47:07 devstack cinder-volume[73655]: DEBUG oslo_service.backend._eventlet.service [None req-203a21c1-0897-49e7-a0b3-deab8820e8ca None None] database.connection_parameters = {{(pid=73655) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:47:07 devstack cinder-volume[73655]: DEBUG oslo_service.backend._eventlet.service [None req-203a21c1-0897-49e7-a0b3-deab8820e8ca None None] database.connection_recycle_time = 3600 {{(pid=73655) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:47:07 devstack cinder-volume[73655]: DEBUG oslo_service.backend._eventlet.service [None req-203a21c1-0897-49e7-a0b3-deab8820e8ca None None] database.connection_trace = False {{(pid=73655) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:47:07 devstack cinder-volume[73655]: DEBUG oslo_service.backend._eventlet.service [None req-203a21c1-0897-49e7-a0b3-deab8820e8ca None None] database.db_inc_retry_interval = True {{(pid=73655) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:47:07 devstack cinder-volume[73655]: DEBUG oslo_service.backend._eventlet.service [None req-203a21c1-0897-49e7-a0b3-deab8820e8ca None None] database.db_max_retries = 20 {{(pid=73655) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:47:07 devstack cinder-volume[73655]: DEBUG oslo_service.backend._eventlet.service [None req-203a21c1-0897-49e7-a0b3-deab8820e8ca None None] database.db_max_retry_interval = 10 {{(pid=73655) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:47:07 devstack cinder-volume[73655]: DEBUG oslo_service.backend._eventlet.service [None req-203a21c1-0897-49e7-a0b3-deab8820e8ca None None] database.db_retry_interval = 1 {{(pid=73655) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:47:07 devstack cinder-volume[73655]: DEBUG oslo_service.backend._eventlet.service [None req-203a21c1-0897-49e7-a0b3-deab8820e8ca None None] database.max_overflow = 50 {{(pid=73655) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:47:07 devstack cinder-volume[73655]: DEBUG oslo_service.backend._eventlet.service [None req-203a21c1-0897-49e7-a0b3-deab8820e8ca None None] database.max_pool_size = 5 {{(pid=73655) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:47:07 devstack cinder-volume[73655]: DEBUG oslo_service.backend._eventlet.service [None req-203a21c1-0897-49e7-a0b3-deab8820e8ca None None] database.max_retries = 10 {{(pid=73655) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:47:07 devstack cinder-volume[73655]: DEBUG oslo_service.backend._eventlet.service [None req-203a21c1-0897-49e7-a0b3-deab8820e8ca None None] database.mysql_sql_mode = TRADITIONAL {{(pid=73655) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:47:07 devstack cinder-volume[73655]: DEBUG oslo_service.backend._eventlet.service [None req-203a21c1-0897-49e7-a0b3-deab8820e8ca None None] database.mysql_wsrep_sync_wait = None {{(pid=73655) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:47:07 devstack cinder-volume[73655]: DEBUG oslo_service.backend._eventlet.service [None req-203a21c1-0897-49e7-a0b3-deab8820e8ca None None] database.pool_timeout = None {{(pid=73655) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:47:07 devstack cinder-volume[73655]: DEBUG oslo_service.backend._eventlet.service [None req-203a21c1-0897-49e7-a0b3-deab8820e8ca None None] database.retry_interval = 10 {{(pid=73655) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:47:07 devstack cinder-volume[73655]: DEBUG oslo_service.backend._eventlet.service [None req-203a21c1-0897-49e7-a0b3-deab8820e8ca None None] database.slave_connection = **** {{(pid=73655) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:47:07 devstack cinder-volume[73655]: DEBUG oslo_service.backend._eventlet.service [None req-203a21c1-0897-49e7-a0b3-deab8820e8ca None None] database.sqlite_synchronous = True {{(pid=73655) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:47:07 devstack cinder-volume[73655]: DEBUG oslo_service.backend._eventlet.service [None req-203a21c1-0897-49e7-a0b3-deab8820e8ca None None] database.synchronous_reader = True {{(pid=73655) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:47:07 devstack cinder-volume[73655]: DEBUG oslo_service.backend._eventlet.service [None req-203a21c1-0897-49e7-a0b3-deab8820e8ca None None] database.use_db_reconnect = False {{(pid=73655) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:47:07 devstack cinder-volume[73655]: DEBUG oslo_service.backend._eventlet.service [None req-203a21c1-0897-49e7-a0b3-deab8820e8ca None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=73655) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:47:07 devstack cinder-volume[73655]: DEBUG oslo_service.backend._eventlet.service [None req-203a21c1-0897-49e7-a0b3-deab8820e8ca None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=73655) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:47:07 devstack cinder-volume[73655]: DEBUG oslo_service.backend._eventlet.service [None req-203a21c1-0897-49e7-a0b3-deab8820e8ca None None] oslo_messaging_metrics.metrics_process_name = {{(pid=73655) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:47:07 devstack cinder-volume[73655]: DEBUG oslo_service.backend._eventlet.service [None req-203a21c1-0897-49e7-a0b3-deab8820e8ca None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=73655) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:47:07 devstack cinder-volume[73655]: DEBUG oslo_service.backend._eventlet.service [None req-203a21c1-0897-49e7-a0b3-deab8820e8ca None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=73655) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:47:07 devstack cinder-volume[73655]: DEBUG oslo_service.backend._eventlet.service [None req-203a21c1-0897-49e7-a0b3-deab8820e8ca None None] profiler.connection_string = messaging:// {{(pid=73655) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:47:07 devstack cinder-volume[73655]: DEBUG oslo_service.backend._eventlet.service [None req-203a21c1-0897-49e7-a0b3-deab8820e8ca None None] profiler.enabled = False {{(pid=73655) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:47:07 devstack cinder-volume[73655]: DEBUG oslo_service.backend._eventlet.service [None req-203a21c1-0897-49e7-a0b3-deab8820e8ca None None] profiler.es_doc_type = notification {{(pid=73655) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:47:07 devstack cinder-volume[73655]: DEBUG oslo_service.backend._eventlet.service [None req-203a21c1-0897-49e7-a0b3-deab8820e8ca None None] profiler.es_scroll_size = 10000 {{(pid=73655) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:47:07 devstack cinder-volume[73655]: DEBUG oslo_service.backend._eventlet.service [None req-203a21c1-0897-49e7-a0b3-deab8820e8ca None None] profiler.es_scroll_time = 2m {{(pid=73655) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:47:07 devstack cinder-volume[73655]: DEBUG oslo_service.backend._eventlet.service [None req-203a21c1-0897-49e7-a0b3-deab8820e8ca None None] profiler.filter_error_trace = False {{(pid=73655) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:47:07 devstack cinder-volume[73655]: DEBUG oslo_service.backend._eventlet.service [None req-203a21c1-0897-49e7-a0b3-deab8820e8ca None None] profiler.hmac_keys = **** {{(pid=73655) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:47:07 devstack cinder-volume[73655]: DEBUG oslo_service.backend._eventlet.service [None req-203a21c1-0897-49e7-a0b3-deab8820e8ca None None] profiler.sentinel_service_name = mymaster {{(pid=73655) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:47:07 devstack cinder-volume[73655]: DEBUG oslo_service.backend._eventlet.service [None req-203a21c1-0897-49e7-a0b3-deab8820e8ca None None] profiler.socket_timeout = 0.1 {{(pid=73655) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:47:07 devstack cinder-volume[73655]: DEBUG oslo_service.backend._eventlet.service [None req-203a21c1-0897-49e7-a0b3-deab8820e8ca None None] profiler.trace_requests = False {{(pid=73655) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:47:07 devstack cinder-volume[73655]: DEBUG oslo_service.backend._eventlet.service [None req-203a21c1-0897-49e7-a0b3-deab8820e8ca None None] profiler.trace_sqlalchemy = False {{(pid=73655) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:47:07 devstack cinder-volume[73655]: DEBUG oslo_service.backend._eventlet.service [None req-203a21c1-0897-49e7-a0b3-deab8820e8ca None None] profiler_jaeger.process_tags = {} {{(pid=73655) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:47:07 devstack cinder-volume[73655]: DEBUG oslo_service.backend._eventlet.service [None req-203a21c1-0897-49e7-a0b3-deab8820e8ca None None] profiler_jaeger.service_name_prefix = None {{(pid=73655) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:47:07 devstack cinder-volume[73655]: DEBUG oslo_service.backend._eventlet.service [None req-203a21c1-0897-49e7-a0b3-deab8820e8ca None None] profiler_otlp.service_name_prefix = None {{(pid=73655) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:47:07 devstack cinder-volume[73655]: DEBUG oslo_service.backend._eventlet.service [None req-203a21c1-0897-49e7-a0b3-deab8820e8ca None None] oslo_policy.enforce_new_defaults = False {{(pid=73655) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:47:07 devstack cinder-volume[73655]: WARNING oslo_config.cfg [None req-203a21c1-0897-49e7-a0b3-deab8820e8ca None None] Deprecated: Option "enforce_scope" from group "oslo_policy" is deprecated for removal (This configuration was added temporarily to facilitate a smooth transition to the new RBAC. OpenStack will always enforce scope checks. This configuration option is deprecated and will be removed in the 2025.2 cycle.). Its value may be silently ignored in the future. Feb 25 15:47:07 devstack cinder-volume[73655]: DEBUG oslo_service.backend._eventlet.service [None req-203a21c1-0897-49e7-a0b3-deab8820e8ca None None] oslo_policy.enforce_scope = False {{(pid=73655) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:47:07 devstack cinder-volume[73655]: DEBUG oslo_service.backend._eventlet.service [None req-203a21c1-0897-49e7-a0b3-deab8820e8ca None None] oslo_policy.policy_default_rule = default {{(pid=73655) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:47:07 devstack cinder-volume[73655]: DEBUG oslo_service.backend._eventlet.service [None req-203a21c1-0897-49e7-a0b3-deab8820e8ca None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=73655) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:47:07 devstack cinder-volume[73655]: DEBUG oslo_service.backend._eventlet.service [None req-203a21c1-0897-49e7-a0b3-deab8820e8ca None None] oslo_policy.policy_file = policy.yaml {{(pid=73655) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:47:07 devstack cinder-volume[73655]: DEBUG oslo_service.backend._eventlet.service [None req-203a21c1-0897-49e7-a0b3-deab8820e8ca None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=73655) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:47:07 devstack cinder-volume[73655]: DEBUG oslo_service.backend._eventlet.service [None req-203a21c1-0897-49e7-a0b3-deab8820e8ca None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=73655) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:47:07 devstack cinder-volume[73655]: DEBUG oslo_service.backend._eventlet.service [None req-203a21c1-0897-49e7-a0b3-deab8820e8ca None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=73655) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:47:07 devstack cinder-volume[73655]: DEBUG oslo_service.backend._eventlet.service [None req-203a21c1-0897-49e7-a0b3-deab8820e8ca None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=73655) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:47:07 devstack cinder-volume[73655]: DEBUG oslo_service.backend._eventlet.service [None req-203a21c1-0897-49e7-a0b3-deab8820e8ca None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=73655) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:47:07 devstack cinder-volume[73655]: DEBUG oslo_service.backend._eventlet.service [None req-203a21c1-0897-49e7-a0b3-deab8820e8ca None None] oslo_policy.remote_timeout = 60.0 {{(pid=73655) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:47:07 devstack cinder-volume[73655]: DEBUG oslo_service.backend._eventlet.service [None req-203a21c1-0897-49e7-a0b3-deab8820e8ca None None] privsep_osbrick.capabilities = [21, 2] {{(pid=73655) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:47:07 devstack cinder-volume[73655]: DEBUG oslo_service.backend._eventlet.service [None req-203a21c1-0897-49e7-a0b3-deab8820e8ca None None] privsep_osbrick.group = None {{(pid=73655) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:47:07 devstack cinder-volume[73655]: DEBUG oslo_service.backend._eventlet.service [None req-203a21c1-0897-49e7-a0b3-deab8820e8ca None None] privsep_osbrick.helper_command = None {{(pid=73655) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:47:07 devstack cinder-volume[73655]: DEBUG oslo_service.backend._eventlet.service [None req-203a21c1-0897-49e7-a0b3-deab8820e8ca None None] privsep_osbrick.log_daemon_traceback = False {{(pid=73655) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:47:07 devstack cinder-volume[73655]: DEBUG oslo_service.backend._eventlet.service [None req-203a21c1-0897-49e7-a0b3-deab8820e8ca None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=73655) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:47:07 devstack cinder-volume[73655]: DEBUG oslo_service.backend._eventlet.service [None req-203a21c1-0897-49e7-a0b3-deab8820e8ca None None] privsep_osbrick.thread_pool_size = 4 {{(pid=73655) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:47:07 devstack cinder-volume[73655]: DEBUG oslo_service.backend._eventlet.service [None req-203a21c1-0897-49e7-a0b3-deab8820e8ca None None] privsep_osbrick.user = None {{(pid=73655) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:47:07 devstack cinder-volume[73655]: DEBUG oslo_service.backend._eventlet.service [None req-203a21c1-0897-49e7-a0b3-deab8820e8ca None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=73655) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:47:07 devstack cinder-volume[73655]: DEBUG oslo_service.backend._eventlet.service [None req-203a21c1-0897-49e7-a0b3-deab8820e8ca None None] cinder_sys_admin.group = None {{(pid=73655) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:47:07 devstack cinder-volume[73655]: DEBUG oslo_service.backend._eventlet.service [None req-203a21c1-0897-49e7-a0b3-deab8820e8ca None None] cinder_sys_admin.helper_command = None {{(pid=73655) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:47:07 devstack cinder-volume[73655]: DEBUG oslo_service.backend._eventlet.service [None req-203a21c1-0897-49e7-a0b3-deab8820e8ca None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=73655) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:47:07 devstack cinder-volume[73655]: DEBUG oslo_service.backend._eventlet.service [None req-203a21c1-0897-49e7-a0b3-deab8820e8ca None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=73655) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:47:07 devstack cinder-volume[73655]: DEBUG oslo_service.backend._eventlet.service [None req-203a21c1-0897-49e7-a0b3-deab8820e8ca None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=73655) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:47:07 devstack cinder-volume[73655]: DEBUG oslo_service.backend._eventlet.service [None req-203a21c1-0897-49e7-a0b3-deab8820e8ca None None] cinder_sys_admin.user = None {{(pid=73655) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:47:07 devstack cinder-volume[73655]: DEBUG oslo_service.backend._eventlet.service [None req-203a21c1-0897-49e7-a0b3-deab8820e8ca None None] service_user.auth_section = None {{(pid=73655) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:47:07 devstack cinder-volume[73655]: DEBUG oslo_service.backend._eventlet.service [None req-203a21c1-0897-49e7-a0b3-deab8820e8ca None None] service_user.auth_type = password {{(pid=73655) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:47:07 devstack cinder-volume[73655]: DEBUG oslo_service.backend._eventlet.service [None req-203a21c1-0897-49e7-a0b3-deab8820e8ca None None] service_user.cafile = None {{(pid=73655) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:47:07 devstack cinder-volume[73655]: DEBUG oslo_service.backend._eventlet.service [None req-203a21c1-0897-49e7-a0b3-deab8820e8ca None None] service_user.certfile = None {{(pid=73655) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:47:07 devstack cinder-volume[73655]: DEBUG oslo_service.backend._eventlet.service [None req-203a21c1-0897-49e7-a0b3-deab8820e8ca None None] service_user.collect_timing = False {{(pid=73655) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:47:07 devstack cinder-volume[73655]: DEBUG oslo_service.backend._eventlet.service [None req-203a21c1-0897-49e7-a0b3-deab8820e8ca None None] service_user.insecure = False {{(pid=73655) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:47:07 devstack cinder-volume[73655]: DEBUG oslo_service.backend._eventlet.service [None req-203a21c1-0897-49e7-a0b3-deab8820e8ca None None] service_user.keyfile = None {{(pid=73655) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:47:07 devstack cinder-volume[73655]: DEBUG oslo_service.backend._eventlet.service [None req-203a21c1-0897-49e7-a0b3-deab8820e8ca None None] service_user.send_service_user_token = True {{(pid=73655) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:47:07 devstack cinder-volume[73655]: DEBUG oslo_service.backend._eventlet.service [None req-203a21c1-0897-49e7-a0b3-deab8820e8ca None None] service_user.split_loggers = False {{(pid=73655) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:47:07 devstack cinder-volume[73655]: DEBUG oslo_service.backend._eventlet.service [None req-203a21c1-0897-49e7-a0b3-deab8820e8ca None None] service_user.timeout = None {{(pid=73655) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:47:07 devstack cinder-volume[73655]: DEBUG oslo_service.backend._eventlet.service [None req-203a21c1-0897-49e7-a0b3-deab8820e8ca None None] glance.auth_section = None {{(pid=73655) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:47:07 devstack cinder-volume[73655]: DEBUG oslo_service.backend._eventlet.service [None req-203a21c1-0897-49e7-a0b3-deab8820e8ca None None] glance.auth_type = password {{(pid=73655) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:47:07 devstack cinder-volume[73655]: DEBUG oslo_service.backend._eventlet.service [None req-203a21c1-0897-49e7-a0b3-deab8820e8ca None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=73655) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:47:07 devstack cinder-volume[73655]: DEBUG oslo_service.backend._eventlet.service [None req-203a21c1-0897-49e7-a0b3-deab8820e8ca None None] glance.certfile = None {{(pid=73655) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:47:07 devstack cinder-volume[73655]: DEBUG oslo_service.backend._eventlet.service [None req-203a21c1-0897-49e7-a0b3-deab8820e8ca None None] glance.collect_timing = False {{(pid=73655) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:47:07 devstack cinder-volume[73655]: DEBUG oslo_service.backend._eventlet.service [None req-203a21c1-0897-49e7-a0b3-deab8820e8ca None None] glance.insecure = False {{(pid=73655) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:47:07 devstack cinder-volume[73655]: DEBUG oslo_service.backend._eventlet.service [None req-203a21c1-0897-49e7-a0b3-deab8820e8ca None None] glance.keyfile = None {{(pid=73655) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:47:07 devstack cinder-volume[73655]: DEBUG oslo_service.backend._eventlet.service [None req-203a21c1-0897-49e7-a0b3-deab8820e8ca None None] glance.region_name = None {{(pid=73655) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:47:07 devstack cinder-volume[73655]: DEBUG oslo_service.backend._eventlet.service [None req-203a21c1-0897-49e7-a0b3-deab8820e8ca None None] glance.split_loggers = False {{(pid=73655) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:47:07 devstack cinder-volume[73655]: DEBUG oslo_service.backend._eventlet.service [None req-203a21c1-0897-49e7-a0b3-deab8820e8ca None None] glance.timeout = None {{(pid=73655) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:47:07 devstack cinder-volume[73655]: DEBUG oslo_service.backend._eventlet.service [None req-203a21c1-0897-49e7-a0b3-deab8820e8ca None None] backend_defaults.backend_availability_zone = None {{(pid=73655) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:47:07 devstack cinder-volume[73655]: DEBUG oslo_service.backend._eventlet.service [None req-203a21c1-0897-49e7-a0b3-deab8820e8ca None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=73655) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:47:07 devstack cinder-volume[73655]: DEBUG oslo_service.backend._eventlet.service [None req-203a21c1-0897-49e7-a0b3-deab8820e8ca None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=73655) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:47:07 devstack cinder-volume[73655]: DEBUG oslo_service.backend._eventlet.service [None req-203a21c1-0897-49e7-a0b3-deab8820e8ca None None] backend_defaults.chap_password = **** {{(pid=73655) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:47:07 devstack cinder-volume[73655]: DEBUG oslo_service.backend._eventlet.service [None req-203a21c1-0897-49e7-a0b3-deab8820e8ca None None] backend_defaults.chap_username = {{(pid=73655) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:47:07 devstack cinder-volume[73755]: DEBUG oslo_concurrency.processutils [None req-bec051e7-ca60-4608-901c-5bd51659c94d None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.049s {{(pid=73755) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 25 15:47:07 devstack cinder-volume[73655]: DEBUG oslo_service.backend._eventlet.service [None req-203a21c1-0897-49e7-a0b3-deab8820e8ca None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=73655) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:47:07 devstack cinder-volume[73655]: DEBUG oslo_service.backend._eventlet.service [None req-203a21c1-0897-49e7-a0b3-deab8820e8ca None None] backend_defaults.disk_geometry = None {{(pid=73655) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:47:07 devstack cinder-volume[73655]: DEBUG oslo_service.backend._eventlet.service [None req-203a21c1-0897-49e7-a0b3-deab8820e8ca None None] backend_defaults.driver_client_cert = None {{(pid=73655) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:47:07 devstack cinder-volume[73655]: DEBUG oslo_service.backend._eventlet.service [None req-203a21c1-0897-49e7-a0b3-deab8820e8ca None None] backend_defaults.driver_client_cert_key = None {{(pid=73655) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:47:07 devstack cinder-volume[73655]: DEBUG oslo_service.backend._eventlet.service [None req-203a21c1-0897-49e7-a0b3-deab8820e8ca None None] backend_defaults.driver_data_namespace = None {{(pid=73655) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:47:07 devstack cinder-volume[73655]: DEBUG oslo_service.backend._eventlet.service [None req-203a21c1-0897-49e7-a0b3-deab8820e8ca None None] backend_defaults.driver_ssl_cert_path = None {{(pid=73655) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:47:07 devstack cinder-volume[73655]: DEBUG oslo_service.backend._eventlet.service [None req-203a21c1-0897-49e7-a0b3-deab8820e8ca None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=73655) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:47:07 devstack cinder-volume[73655]: DEBUG oslo_service.backend._eventlet.service [None req-203a21c1-0897-49e7-a0b3-deab8820e8ca None None] backend_defaults.driver_use_ssl = False {{(pid=73655) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:47:07 devstack cinder-volume[73655]: DEBUG oslo_service.backend._eventlet.service [None req-203a21c1-0897-49e7-a0b3-deab8820e8ca None None] backend_defaults.enable_unsupported_driver = False {{(pid=73655) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:47:07 devstack cinder-volume[73655]: DEBUG oslo_service.backend._eventlet.service [None req-203a21c1-0897-49e7-a0b3-deab8820e8ca None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=73655) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:47:07 devstack cinder-volume[73655]: DEBUG oslo_service.backend._eventlet.service [None req-203a21c1-0897-49e7-a0b3-deab8820e8ca None None] backend_defaults.extra_capabilities = {} {{(pid=73655) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:47:07 devstack cinder-volume[73655]: DEBUG oslo_service.backend._eventlet.service [None req-203a21c1-0897-49e7-a0b3-deab8820e8ca None None] backend_defaults.filter_function = None {{(pid=73655) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:47:07 devstack cinder-volume[73655]: DEBUG oslo_service.backend._eventlet.service [None req-203a21c1-0897-49e7-a0b3-deab8820e8ca None None] backend_defaults.goodness_function = None {{(pid=73655) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:47:07 devstack cinder-volume[73755]: DEBUG oslo_concurrency.processutils [None req-bec051e7-ca60-4608-901c-5bd51659c94d None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=73755) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 25 15:47:07 devstack cinder-volume[73655]: DEBUG oslo_service.backend._eventlet.service [None req-203a21c1-0897-49e7-a0b3-deab8820e8ca None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=73655) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:47:07 devstack cinder-volume[73655]: DEBUG oslo_service.backend._eventlet.service [None req-203a21c1-0897-49e7-a0b3-deab8820e8ca None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=73655) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:47:07 devstack cinder-volume[73655]: DEBUG oslo_service.backend._eventlet.service [None req-203a21c1-0897-49e7-a0b3-deab8820e8ca None None] backend_defaults.image_volume_cache_enabled = False {{(pid=73655) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:47:07 devstack cinder-volume[73655]: DEBUG oslo_service.backend._eventlet.service [None req-203a21c1-0897-49e7-a0b3-deab8820e8ca None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=73655) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:47:07 devstack cinder-volume[73655]: DEBUG oslo_service.backend._eventlet.service [None req-203a21c1-0897-49e7-a0b3-deab8820e8ca None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=73655) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:47:07 devstack cinder-volume[73655]: DEBUG oslo_service.backend._eventlet.service [None req-203a21c1-0897-49e7-a0b3-deab8820e8ca None None] backend_defaults.iscsi_target_flags = {{(pid=73655) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:47:07 devstack cinder-volume[73655]: DEBUG oslo_service.backend._eventlet.service [None req-203a21c1-0897-49e7-a0b3-deab8820e8ca None None] backend_defaults.iscsi_write_cache = on {{(pid=73655) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:47:07 devstack cinder-volume[73655]: DEBUG oslo_service.backend._eventlet.service [None req-203a21c1-0897-49e7-a0b3-deab8820e8ca None None] backend_defaults.iser_helper = tgtadm {{(pid=73655) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:47:07 devstack cinder-volume[73655]: DEBUG oslo_service.backend._eventlet.service [None req-203a21c1-0897-49e7-a0b3-deab8820e8ca None None] backend_defaults.iser_ip_address = 192.168.122.119 {{(pid=73655) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:47:07 devstack cinder-volume[73655]: DEBUG oslo_service.backend._eventlet.service [None req-203a21c1-0897-49e7-a0b3-deab8820e8ca None None] backend_defaults.iser_port = 3260 {{(pid=73655) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:47:07 devstack cinder-volume[73655]: DEBUG oslo_service.backend._eventlet.service [None req-203a21c1-0897-49e7-a0b3-deab8820e8ca None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=73655) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:47:07 devstack cinder-volume[73655]: DEBUG oslo_service.backend._eventlet.service [None req-203a21c1-0897-49e7-a0b3-deab8820e8ca None None] backend_defaults.lvm_conf_file = /etc/cinder/lvm.conf {{(pid=73655) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:47:07 devstack cinder-volume[73655]: DEBUG oslo_service.backend._eventlet.service [None req-203a21c1-0897-49e7-a0b3-deab8820e8ca None None] backend_defaults.lvm_mirrors = 0 {{(pid=73655) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:47:07 devstack cinder-volume[73655]: DEBUG oslo_service.backend._eventlet.service [None req-203a21c1-0897-49e7-a0b3-deab8820e8ca None None] backend_defaults.lvm_share_target = False {{(pid=73655) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:47:07 devstack cinder-volume[73655]: DEBUG oslo_service.backend._eventlet.service [None req-203a21c1-0897-49e7-a0b3-deab8820e8ca None None] backend_defaults.lvm_suppress_fd_warnings = False {{(pid=73655) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:47:07 devstack cinder-volume[73655]: DEBUG oslo_service.backend._eventlet.service [None req-203a21c1-0897-49e7-a0b3-deab8820e8ca None None] backend_defaults.lvm_type = auto {{(pid=73655) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:47:07 devstack cinder-volume[73655]: DEBUG oslo_service.backend._eventlet.service [None req-203a21c1-0897-49e7-a0b3-deab8820e8ca None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=73655) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:47:07 devstack cinder-volume[73655]: DEBUG oslo_service.backend._eventlet.service [None req-203a21c1-0897-49e7-a0b3-deab8820e8ca None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=73655) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:47:07 devstack cinder-volume[73655]: DEBUG oslo_service.backend._eventlet.service [None req-203a21c1-0897-49e7-a0b3-deab8820e8ca None None] backend_defaults.num_shell_tries = 3 {{(pid=73655) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:47:07 devstack cinder-volume[73655]: DEBUG oslo_service.backend._eventlet.service [None req-203a21c1-0897-49e7-a0b3-deab8820e8ca None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=73655) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:47:07 devstack cinder-volume[73655]: DEBUG oslo_service.backend._eventlet.service [None req-203a21c1-0897-49e7-a0b3-deab8820e8ca None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=73655) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:47:07 devstack cinder-volume[73655]: DEBUG oslo_service.backend._eventlet.service [None req-203a21c1-0897-49e7-a0b3-deab8820e8ca None None] backend_defaults.nvmet_ns_id = 10 {{(pid=73655) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:47:07 devstack cinder-volume[73655]: DEBUG oslo_service.backend._eventlet.service [None req-203a21c1-0897-49e7-a0b3-deab8820e8ca None None] backend_defaults.nvmet_port_id = 1 {{(pid=73655) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:47:07 devstack cinder-volume[73655]: DEBUG oslo_service.backend._eventlet.service [None req-203a21c1-0897-49e7-a0b3-deab8820e8ca None None] backend_defaults.replication_device = **** {{(pid=73655) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:47:07 devstack cinder-volume[73655]: DEBUG oslo_service.backend._eventlet.service [None req-203a21c1-0897-49e7-a0b3-deab8820e8ca None None] backend_defaults.report_discard_supported = False {{(pid=73655) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:47:07 devstack cinder-volume[73655]: DEBUG oslo_service.backend._eventlet.service [None req-203a21c1-0897-49e7-a0b3-deab8820e8ca None None] backend_defaults.reserved_percentage = 0 {{(pid=73655) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:47:07 devstack cinder-volume[73655]: DEBUG oslo_service.backend._eventlet.service [None req-203a21c1-0897-49e7-a0b3-deab8820e8ca None None] backend_defaults.scst_target_driver = iscsi {{(pid=73655) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:47:07 devstack cinder-volume[73655]: DEBUG oslo_service.backend._eventlet.service [None req-203a21c1-0897-49e7-a0b3-deab8820e8ca None None] backend_defaults.scst_target_iqn_name = None {{(pid=73655) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:47:07 devstack cinder-volume[73655]: DEBUG oslo_service.backend._eventlet.service [None req-203a21c1-0897-49e7-a0b3-deab8820e8ca None None] backend_defaults.storage_protocol = iSCSI {{(pid=73655) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:47:07 devstack cinder-volume[73655]: DEBUG oslo_service.backend._eventlet.service [None req-203a21c1-0897-49e7-a0b3-deab8820e8ca None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=73655) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:47:07 devstack cinder-volume[73655]: DEBUG oslo_service.backend._eventlet.service [None req-203a21c1-0897-49e7-a0b3-deab8820e8ca None None] backend_defaults.target_helper = tgtadm {{(pid=73655) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:47:07 devstack cinder-volume[73655]: DEBUG oslo_service.backend._eventlet.service [None req-203a21c1-0897-49e7-a0b3-deab8820e8ca None None] backend_defaults.target_ip_address = 192.168.122.119 {{(pid=73655) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:47:07 devstack cinder-volume[73655]: DEBUG oslo_service.backend._eventlet.service [None req-203a21c1-0897-49e7-a0b3-deab8820e8ca None None] backend_defaults.target_port = 3260 {{(pid=73655) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:47:07 devstack cinder-volume[73655]: DEBUG oslo_service.backend._eventlet.service [None req-203a21c1-0897-49e7-a0b3-deab8820e8ca None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=73655) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:47:07 devstack cinder-volume[73655]: DEBUG oslo_service.backend._eventlet.service [None req-203a21c1-0897-49e7-a0b3-deab8820e8ca None None] backend_defaults.target_protocol = iscsi {{(pid=73655) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:47:07 devstack cinder-volume[73655]: DEBUG oslo_service.backend._eventlet.service [None req-203a21c1-0897-49e7-a0b3-deab8820e8ca None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=73655) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:47:07 devstack cinder-volume[73655]: DEBUG oslo_service.backend._eventlet.service [None req-203a21c1-0897-49e7-a0b3-deab8820e8ca None None] backend_defaults.trace_flags = None {{(pid=73655) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:47:07 devstack cinder-volume[73655]: DEBUG oslo_service.backend._eventlet.service [None req-203a21c1-0897-49e7-a0b3-deab8820e8ca None None] backend_defaults.unique_fqdn_network = True {{(pid=73655) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:47:07 devstack cinder-volume[73655]: DEBUG oslo_service.backend._eventlet.service [None req-203a21c1-0897-49e7-a0b3-deab8820e8ca None None] backend_defaults.use_chap_auth = False {{(pid=73655) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:47:07 devstack cinder-volume[73655]: DEBUG oslo_service.backend._eventlet.service [None req-203a21c1-0897-49e7-a0b3-deab8820e8ca None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=73655) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:47:07 devstack cinder-volume[73655]: DEBUG oslo_service.backend._eventlet.service [None req-203a21c1-0897-49e7-a0b3-deab8820e8ca None None] backend_defaults.volume_backend_name = None {{(pid=73655) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:47:07 devstack cinder-volume[73655]: DEBUG oslo_service.backend._eventlet.service [None req-203a21c1-0897-49e7-a0b3-deab8820e8ca None None] backend_defaults.volume_clear = zero {{(pid=73655) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:47:07 devstack cinder-volume[73655]: DEBUG oslo_service.backend._eventlet.service [None req-203a21c1-0897-49e7-a0b3-deab8820e8ca None None] backend_defaults.volume_clear_ionice = None {{(pid=73655) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:47:07 devstack cinder-volume[73655]: DEBUG oslo_service.backend._eventlet.service [None req-203a21c1-0897-49e7-a0b3-deab8820e8ca None None] backend_defaults.volume_clear_size = 0 {{(pid=73655) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:47:07 devstack cinder-volume[73655]: DEBUG oslo_service.backend._eventlet.service [None req-203a21c1-0897-49e7-a0b3-deab8820e8ca None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=73655) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:47:07 devstack cinder-volume[73655]: DEBUG oslo_service.backend._eventlet.service [None req-203a21c1-0897-49e7-a0b3-deab8820e8ca None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=73655) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:47:07 devstack cinder-volume[73655]: DEBUG oslo_service.backend._eventlet.service [None req-203a21c1-0897-49e7-a0b3-deab8820e8ca None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=73655) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:47:07 devstack cinder-volume[73655]: DEBUG oslo_service.backend._eventlet.service [None req-203a21c1-0897-49e7-a0b3-deab8820e8ca None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=73655) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:47:07 devstack cinder-volume[73655]: DEBUG oslo_service.backend._eventlet.service [None req-203a21c1-0897-49e7-a0b3-deab8820e8ca None None] backend_defaults.volume_group = cinder-volumes {{(pid=73655) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:47:07 devstack cinder-volume[73655]: DEBUG oslo_service.backend._eventlet.service [None req-203a21c1-0897-49e7-a0b3-deab8820e8ca None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=73655) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:47:07 devstack cinder-volume[73655]: DEBUG oslo_service.backend._eventlet.service [None req-203a21c1-0897-49e7-a0b3-deab8820e8ca None None] oslo_reports.file_event_handler = None {{(pid=73655) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:47:07 devstack cinder-volume[73655]: DEBUG oslo_service.backend._eventlet.service [None req-203a21c1-0897-49e7-a0b3-deab8820e8ca None None] oslo_reports.file_event_handler_interval = 1 {{(pid=73655) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:47:07 devstack cinder-volume[73655]: DEBUG oslo_service.backend._eventlet.service [None req-203a21c1-0897-49e7-a0b3-deab8820e8ca None None] oslo_reports.log_dir = None {{(pid=73655) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:47:07 devstack cinder-volume[73655]: DEBUG oslo_service.backend._eventlet.service [None req-203a21c1-0897-49e7-a0b3-deab8820e8ca None None] lvmdriver-1.backend_availability_zone = None {{(pid=73655) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:47:07 devstack cinder-volume[73655]: DEBUG oslo_service.backend._eventlet.service [None req-203a21c1-0897-49e7-a0b3-deab8820e8ca None None] lvmdriver-1.backend_host = None {{(pid=73655) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:47:07 devstack cinder-volume[73655]: DEBUG oslo_service.backend._eventlet.service [None req-203a21c1-0897-49e7-a0b3-deab8820e8ca None None] lvmdriver-1.backend_native_threads_pool_size = None {{(pid=73655) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:47:07 devstack cinder-volume[73655]: DEBUG oslo_service.backend._eventlet.service [None req-203a21c1-0897-49e7-a0b3-deab8820e8ca None None] lvmdriver-1.backup_use_temp_snapshot = None {{(pid=73655) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:47:07 devstack cinder-volume[73655]: DEBUG oslo_service.backend._eventlet.service [None req-203a21c1-0897-49e7-a0b3-deab8820e8ca None None] lvmdriver-1.chap_password = **** {{(pid=73655) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:47:07 devstack cinder-volume[73655]: DEBUG oslo_service.backend._eventlet.service [None req-203a21c1-0897-49e7-a0b3-deab8820e8ca None None] lvmdriver-1.chap_username = None {{(pid=73655) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:47:07 devstack cinder-volume[73655]: DEBUG oslo_service.backend._eventlet.service [None req-203a21c1-0897-49e7-a0b3-deab8820e8ca None None] lvmdriver-1.chiscsi_conf = None {{(pid=73655) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:47:07 devstack cinder-volume[73655]: DEBUG oslo_service.backend._eventlet.service [None req-203a21c1-0897-49e7-a0b3-deab8820e8ca None None] lvmdriver-1.disk_geometry = None {{(pid=73655) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:47:07 devstack cinder-volume[73655]: DEBUG oslo_service.backend._eventlet.service [None req-203a21c1-0897-49e7-a0b3-deab8820e8ca None None] lvmdriver-1.driver_client_cert = None {{(pid=73655) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:47:07 devstack cinder-volume[73655]: DEBUG oslo_service.backend._eventlet.service [None req-203a21c1-0897-49e7-a0b3-deab8820e8ca None None] lvmdriver-1.driver_client_cert_key = None {{(pid=73655) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:47:07 devstack cinder-volume[73655]: DEBUG oslo_service.backend._eventlet.service [None req-203a21c1-0897-49e7-a0b3-deab8820e8ca None None] lvmdriver-1.driver_data_namespace = None {{(pid=73655) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:47:07 devstack cinder-volume[73655]: DEBUG oslo_service.backend._eventlet.service [None req-203a21c1-0897-49e7-a0b3-deab8820e8ca None None] lvmdriver-1.driver_ssl_cert_path = None {{(pid=73655) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:47:07 devstack cinder-volume[73655]: DEBUG oslo_service.backend._eventlet.service [None req-203a21c1-0897-49e7-a0b3-deab8820e8ca None None] lvmdriver-1.driver_ssl_cert_verify = None {{(pid=73655) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:47:07 devstack cinder-volume[73655]: DEBUG oslo_service.backend._eventlet.service [None req-203a21c1-0897-49e7-a0b3-deab8820e8ca None None] lvmdriver-1.driver_use_ssl = None {{(pid=73655) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:47:07 devstack cinder-volume[73655]: DEBUG oslo_service.backend._eventlet.service [None req-203a21c1-0897-49e7-a0b3-deab8820e8ca None None] lvmdriver-1.enable_unsupported_driver = None {{(pid=73655) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:47:07 devstack cinder-volume[73655]: DEBUG oslo_service.backend._eventlet.service [None req-203a21c1-0897-49e7-a0b3-deab8820e8ca None None] lvmdriver-1.enforce_multipath_for_image_xfer = None {{(pid=73655) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:47:07 devstack cinder-volume[73655]: DEBUG oslo_service.backend._eventlet.service [None req-203a21c1-0897-49e7-a0b3-deab8820e8ca None None] lvmdriver-1.extra_capabilities = None {{(pid=73655) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:47:07 devstack cinder-volume[73655]: DEBUG oslo_service.backend._eventlet.service [None req-203a21c1-0897-49e7-a0b3-deab8820e8ca None None] lvmdriver-1.filter_function = None {{(pid=73655) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:47:07 devstack cinder-volume[73655]: DEBUG oslo_service.backend._eventlet.service [None req-203a21c1-0897-49e7-a0b3-deab8820e8ca None None] lvmdriver-1.goodness_function = None {{(pid=73655) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:47:07 devstack cinder-volume[73655]: DEBUG oslo_service.backend._eventlet.service [None req-203a21c1-0897-49e7-a0b3-deab8820e8ca None None] lvmdriver-1.image_upload_use_cinder_backend = None {{(pid=73655) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:47:07 devstack cinder-volume[73655]: DEBUG oslo_service.backend._eventlet.service [None req-203a21c1-0897-49e7-a0b3-deab8820e8ca None None] lvmdriver-1.image_upload_use_internal_tenant = None {{(pid=73655) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:47:07 devstack cinder-volume[73655]: DEBUG oslo_service.backend._eventlet.service [None req-203a21c1-0897-49e7-a0b3-deab8820e8ca None None] lvmdriver-1.image_volume_cache_enabled = True {{(pid=73655) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:47:07 devstack cinder-volume[73655]: DEBUG oslo_service.backend._eventlet.service [None req-203a21c1-0897-49e7-a0b3-deab8820e8ca None None] lvmdriver-1.image_volume_cache_max_count = None {{(pid=73655) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:47:07 devstack cinder-volume[73655]: DEBUG oslo_service.backend._eventlet.service [None req-203a21c1-0897-49e7-a0b3-deab8820e8ca None None] lvmdriver-1.image_volume_cache_max_size_gb = None {{(pid=73655) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:47:07 devstack cinder-volume[73655]: DEBUG oslo_service.backend._eventlet.service [None req-203a21c1-0897-49e7-a0b3-deab8820e8ca None None] lvmdriver-1.iscsi_target_flags = None {{(pid=73655) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:47:07 devstack cinder-volume[73655]: DEBUG oslo_service.backend._eventlet.service [None req-203a21c1-0897-49e7-a0b3-deab8820e8ca None None] lvmdriver-1.iscsi_write_cache = None {{(pid=73655) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:47:07 devstack cinder-volume[73655]: DEBUG oslo_service.backend._eventlet.service [None req-203a21c1-0897-49e7-a0b3-deab8820e8ca None None] lvmdriver-1.iser_helper = None {{(pid=73655) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:47:07 devstack cinder-volume[73655]: DEBUG oslo_service.backend._eventlet.service [None req-203a21c1-0897-49e7-a0b3-deab8820e8ca None None] lvmdriver-1.iser_ip_address = None {{(pid=73655) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:47:07 devstack cinder-volume[73655]: DEBUG oslo_service.backend._eventlet.service [None req-203a21c1-0897-49e7-a0b3-deab8820e8ca None None] lvmdriver-1.iser_port = None {{(pid=73655) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:47:07 devstack cinder-volume[73655]: DEBUG oslo_service.backend._eventlet.service [None req-203a21c1-0897-49e7-a0b3-deab8820e8ca None None] lvmdriver-1.iser_target_prefix = None {{(pid=73655) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:47:07 devstack cinder-volume[73655]: DEBUG oslo_service.backend._eventlet.service [None req-203a21c1-0897-49e7-a0b3-deab8820e8ca None None] lvmdriver-1.lvm_conf_file = None {{(pid=73655) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:47:07 devstack cinder-volume[73655]: DEBUG oslo_service.backend._eventlet.service [None req-203a21c1-0897-49e7-a0b3-deab8820e8ca None None] lvmdriver-1.lvm_mirrors = None {{(pid=73655) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:47:07 devstack cinder-volume[73655]: DEBUG oslo_service.backend._eventlet.service [None req-203a21c1-0897-49e7-a0b3-deab8820e8ca None None] lvmdriver-1.lvm_share_target = None {{(pid=73655) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:47:07 devstack cinder-volume[73655]: DEBUG oslo_service.backend._eventlet.service [None req-203a21c1-0897-49e7-a0b3-deab8820e8ca None None] lvmdriver-1.lvm_suppress_fd_warnings = None {{(pid=73655) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:47:07 devstack cinder-volume[73655]: DEBUG oslo_service.backend._eventlet.service [None req-203a21c1-0897-49e7-a0b3-deab8820e8ca None None] lvmdriver-1.lvm_type = auto {{(pid=73655) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:47:07 devstack cinder-volume[73655]: DEBUG oslo_service.backend._eventlet.service [None req-203a21c1-0897-49e7-a0b3-deab8820e8ca None None] lvmdriver-1.max_over_subscription_ratio = None {{(pid=73655) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:47:07 devstack cinder-volume[73655]: DEBUG oslo_service.backend._eventlet.service [None req-203a21c1-0897-49e7-a0b3-deab8820e8ca None None] lvmdriver-1.num_iser_scan_tries = None {{(pid=73655) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:47:07 devstack cinder-volume[73655]: DEBUG oslo_service.backend._eventlet.service [None req-203a21c1-0897-49e7-a0b3-deab8820e8ca None None] lvmdriver-1.num_shell_tries = None {{(pid=73655) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:47:07 devstack cinder-volume[73655]: DEBUG oslo_service.backend._eventlet.service [None req-203a21c1-0897-49e7-a0b3-deab8820e8ca None None] lvmdriver-1.num_volume_device_scan_tries = None {{(pid=73655) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:47:07 devstack cinder-volume[73655]: DEBUG oslo_service.backend._eventlet.service [None req-203a21c1-0897-49e7-a0b3-deab8820e8ca None None] lvmdriver-1.nvmeof_conn_info_version = None {{(pid=73655) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:47:07 devstack cinder-volume[73655]: DEBUG oslo_service.backend._eventlet.service [None req-203a21c1-0897-49e7-a0b3-deab8820e8ca None None] lvmdriver-1.nvmet_ns_id = None {{(pid=73655) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:47:07 devstack cinder-volume[73655]: DEBUG oslo_service.backend._eventlet.service [None req-203a21c1-0897-49e7-a0b3-deab8820e8ca None None] lvmdriver-1.nvmet_port_id = None {{(pid=73655) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:47:07 devstack cinder-volume[73655]: DEBUG oslo_service.backend._eventlet.service [None req-203a21c1-0897-49e7-a0b3-deab8820e8ca None None] lvmdriver-1.replication_device = **** {{(pid=73655) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:47:07 devstack cinder-volume[73655]: DEBUG oslo_service.backend._eventlet.service [None req-203a21c1-0897-49e7-a0b3-deab8820e8ca None None] lvmdriver-1.report_discard_supported = None {{(pid=73655) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:47:07 devstack cinder-volume[73655]: DEBUG oslo_service.backend._eventlet.service [None req-203a21c1-0897-49e7-a0b3-deab8820e8ca None None] lvmdriver-1.reserved_percentage = None {{(pid=73655) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:47:07 devstack cinder-volume[73655]: DEBUG oslo_service.backend._eventlet.service [None req-203a21c1-0897-49e7-a0b3-deab8820e8ca None None] lvmdriver-1.scst_target_driver = None {{(pid=73655) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:47:07 devstack cinder-volume[73655]: DEBUG oslo_service.backend._eventlet.service [None req-203a21c1-0897-49e7-a0b3-deab8820e8ca None None] lvmdriver-1.scst_target_iqn_name = None {{(pid=73655) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:47:07 devstack cinder-volume[73655]: DEBUG oslo_service.backend._eventlet.service [None req-203a21c1-0897-49e7-a0b3-deab8820e8ca None None] lvmdriver-1.storage_protocol = None {{(pid=73655) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:47:07 devstack cinder-volume[73655]: DEBUG oslo_service.backend._eventlet.service [None req-203a21c1-0897-49e7-a0b3-deab8820e8ca None None] lvmdriver-1.suppress_requests_ssl_warnings = None {{(pid=73655) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:47:07 devstack cinder-volume[73655]: DEBUG oslo_service.backend._eventlet.service [None req-203a21c1-0897-49e7-a0b3-deab8820e8ca None None] lvmdriver-1.target_helper = lioadm {{(pid=73655) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:47:07 devstack cinder-volume[73655]: DEBUG oslo_service.backend._eventlet.service [None req-203a21c1-0897-49e7-a0b3-deab8820e8ca None None] lvmdriver-1.target_ip_address = None {{(pid=73655) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:47:07 devstack cinder-volume[73655]: DEBUG oslo_service.backend._eventlet.service [None req-203a21c1-0897-49e7-a0b3-deab8820e8ca None None] lvmdriver-1.target_port = 3260 {{(pid=73655) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:47:07 devstack cinder-volume[73655]: DEBUG oslo_service.backend._eventlet.service [None req-203a21c1-0897-49e7-a0b3-deab8820e8ca None None] lvmdriver-1.target_prefix = iqn.2010-10.org.openstack: {{(pid=73655) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:47:07 devstack cinder-volume[73655]: DEBUG oslo_service.backend._eventlet.service [None req-203a21c1-0897-49e7-a0b3-deab8820e8ca None None] lvmdriver-1.target_protocol = iscsi {{(pid=73655) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:47:07 devstack cinder-volume[73655]: DEBUG oslo_service.backend._eventlet.service [None req-203a21c1-0897-49e7-a0b3-deab8820e8ca None None] lvmdriver-1.target_secondary_ip_addresses = None {{(pid=73655) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:47:07 devstack cinder-volume[73655]: DEBUG oslo_service.backend._eventlet.service [None req-203a21c1-0897-49e7-a0b3-deab8820e8ca None None] lvmdriver-1.trace_flags = None {{(pid=73655) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:47:07 devstack cinder-volume[73655]: DEBUG oslo_service.backend._eventlet.service [None req-203a21c1-0897-49e7-a0b3-deab8820e8ca None None] lvmdriver-1.unique_fqdn_network = None {{(pid=73655) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:47:07 devstack cinder-volume[73655]: DEBUG oslo_service.backend._eventlet.service [None req-203a21c1-0897-49e7-a0b3-deab8820e8ca None None] lvmdriver-1.use_chap_auth = None {{(pid=73655) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:47:07 devstack cinder-volume[73655]: DEBUG oslo_service.backend._eventlet.service [None req-203a21c1-0897-49e7-a0b3-deab8820e8ca None None] lvmdriver-1.use_multipath_for_image_xfer = None {{(pid=73655) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:47:07 devstack cinder-volume[73655]: DEBUG oslo_service.backend._eventlet.service [None req-203a21c1-0897-49e7-a0b3-deab8820e8ca None None] lvmdriver-1.volume_backend_name = lvmdriver-1 {{(pid=73655) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:47:07 devstack cinder-volume[73655]: DEBUG oslo_service.backend._eventlet.service [None req-203a21c1-0897-49e7-a0b3-deab8820e8ca None None] lvmdriver-1.volume_clear = zero {{(pid=73655) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:47:07 devstack cinder-volume[73655]: DEBUG oslo_service.backend._eventlet.service [None req-203a21c1-0897-49e7-a0b3-deab8820e8ca None None] lvmdriver-1.volume_clear_ionice = None {{(pid=73655) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:47:07 devstack cinder-volume[73655]: DEBUG oslo_service.backend._eventlet.service [None req-203a21c1-0897-49e7-a0b3-deab8820e8ca None None] lvmdriver-1.volume_clear_size = None {{(pid=73655) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:47:07 devstack cinder-volume[73655]: DEBUG oslo_service.backend._eventlet.service [None req-203a21c1-0897-49e7-a0b3-deab8820e8ca None None] lvmdriver-1.volume_copy_blkio_cgroup_name = None {{(pid=73655) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:47:07 devstack cinder-volume[73655]: DEBUG oslo_service.backend._eventlet.service [None req-203a21c1-0897-49e7-a0b3-deab8820e8ca None None] lvmdriver-1.volume_copy_bps_limit = None {{(pid=73655) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:47:07 devstack cinder-volume[73655]: DEBUG oslo_service.backend._eventlet.service [None req-203a21c1-0897-49e7-a0b3-deab8820e8ca None None] lvmdriver-1.volume_dd_blocksize = None {{(pid=73655) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:47:07 devstack cinder-volume[73655]: DEBUG oslo_service.backend._eventlet.service [None req-203a21c1-0897-49e7-a0b3-deab8820e8ca None None] lvmdriver-1.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=73655) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:47:07 devstack cinder-volume[73655]: DEBUG oslo_service.backend._eventlet.service [None req-203a21c1-0897-49e7-a0b3-deab8820e8ca None None] lvmdriver-1.volume_group = stack-volumes-lvmdriver-1 {{(pid=73655) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:47:07 devstack cinder-volume[73655]: DEBUG oslo_service.backend._eventlet.service [None req-203a21c1-0897-49e7-a0b3-deab8820e8ca None None] lvmdriver-1.volumes_dir = None {{(pid=73655) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:47:07 devstack cinder-volume[73655]: DEBUG oslo_service.backend._eventlet.service [None req-203a21c1-0897-49e7-a0b3-deab8820e8ca None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=73655) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:47:07 devstack cinder-volume[73655]: DEBUG oslo_service.backend._eventlet.service [None req-203a21c1-0897-49e7-a0b3-deab8820e8ca None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=73655) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:47:07 devstack cinder-volume[73655]: DEBUG oslo_service.backend._eventlet.service [None req-203a21c1-0897-49e7-a0b3-deab8820e8ca None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=73655) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:47:07 devstack cinder-volume[73655]: DEBUG oslo_service.backend._eventlet.service [None req-203a21c1-0897-49e7-a0b3-deab8820e8ca None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=73655) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:47:07 devstack cinder-volume[73655]: DEBUG oslo_service.backend._eventlet.service [None req-203a21c1-0897-49e7-a0b3-deab8820e8ca None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=73655) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:47:07 devstack cinder-volume[73655]: DEBUG oslo_service.backend._eventlet.service [None req-203a21c1-0897-49e7-a0b3-deab8820e8ca None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=73655) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:47:07 devstack cinder-volume[73655]: DEBUG oslo_service.backend._eventlet.service [None req-203a21c1-0897-49e7-a0b3-deab8820e8ca None None] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=73655) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:47:07 devstack cinder-volume[73655]: DEBUG oslo_service.backend._eventlet.service [None req-203a21c1-0897-49e7-a0b3-deab8820e8ca None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=73655) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:47:07 devstack cinder-volume[73655]: DEBUG oslo_service.backend._eventlet.service [None req-203a21c1-0897-49e7-a0b3-deab8820e8ca None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=73655) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:47:07 devstack cinder-volume[73655]: DEBUG oslo_service.backend._eventlet.service [None req-203a21c1-0897-49e7-a0b3-deab8820e8ca None None] oslo_messaging_rabbit.hostname = devstack {{(pid=73655) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:47:07 devstack cinder-volume[73655]: DEBUG oslo_service.backend._eventlet.service [None req-203a21c1-0897-49e7-a0b3-deab8820e8ca None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=73655) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:47:07 devstack cinder-volume[73655]: DEBUG oslo_service.backend._eventlet.service [None req-203a21c1-0897-49e7-a0b3-deab8820e8ca None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=73655) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:47:07 devstack cinder-volume[73655]: DEBUG oslo_service.backend._eventlet.service [None req-203a21c1-0897-49e7-a0b3-deab8820e8ca None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=73655) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:47:07 devstack cinder-volume[73655]: DEBUG oslo_service.backend._eventlet.service [None req-203a21c1-0897-49e7-a0b3-deab8820e8ca None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=73655) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:47:07 devstack cinder-volume[73655]: DEBUG oslo_service.backend._eventlet.service [None req-203a21c1-0897-49e7-a0b3-deab8820e8ca None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=73655) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:47:07 devstack cinder-volume[73655]: DEBUG oslo_service.backend._eventlet.service [None req-203a21c1-0897-49e7-a0b3-deab8820e8ca None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=73655) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:47:07 devstack cinder-volume[73655]: DEBUG oslo_service.backend._eventlet.service [None req-203a21c1-0897-49e7-a0b3-deab8820e8ca None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=73655) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:47:07 devstack cinder-volume[73655]: DEBUG oslo_service.backend._eventlet.service [None req-203a21c1-0897-49e7-a0b3-deab8820e8ca None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=73655) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:47:07 devstack cinder-volume[73655]: DEBUG oslo_service.backend._eventlet.service [None req-203a21c1-0897-49e7-a0b3-deab8820e8ca None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=73655) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:47:07 devstack cinder-volume[73655]: DEBUG oslo_service.backend._eventlet.service [None req-203a21c1-0897-49e7-a0b3-deab8820e8ca None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=73655) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:47:07 devstack cinder-volume[73655]: DEBUG oslo_service.backend._eventlet.service [None req-203a21c1-0897-49e7-a0b3-deab8820e8ca None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=73655) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:47:07 devstack cinder-volume[73655]: DEBUG oslo_service.backend._eventlet.service [None req-203a21c1-0897-49e7-a0b3-deab8820e8ca None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=73655) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:47:07 devstack cinder-volume[73655]: DEBUG oslo_service.backend._eventlet.service [None req-203a21c1-0897-49e7-a0b3-deab8820e8ca None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=73655) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:47:07 devstack cinder-volume[73655]: DEBUG oslo_service.backend._eventlet.service [None req-203a21c1-0897-49e7-a0b3-deab8820e8ca None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=73655) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:47:07 devstack cinder-volume[73655]: DEBUG oslo_service.backend._eventlet.service [None req-203a21c1-0897-49e7-a0b3-deab8820e8ca None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=73655) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:47:07 devstack cinder-volume[73755]: DEBUG oslo_concurrency.processutils [None req-bec051e7-ca60-4608-901c-5bd51659c94d None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.035s {{(pid=73755) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 25 15:47:07 devstack cinder-volume[73655]: DEBUG oslo_service.backend._eventlet.service [None req-203a21c1-0897-49e7-a0b3-deab8820e8ca None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=73655) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:47:07 devstack cinder-volume[73655]: DEBUG oslo_service.backend._eventlet.service [None req-203a21c1-0897-49e7-a0b3-deab8820e8ca None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=73655) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:47:07 devstack cinder-volume[73655]: DEBUG oslo_service.backend._eventlet.service [None req-203a21c1-0897-49e7-a0b3-deab8820e8ca None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=73655) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:47:07 devstack cinder-volume[73655]: DEBUG oslo_service.backend._eventlet.service [None req-203a21c1-0897-49e7-a0b3-deab8820e8ca None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=73655) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:47:07 devstack cinder-volume[73655]: DEBUG oslo_service.backend._eventlet.service [None req-203a21c1-0897-49e7-a0b3-deab8820e8ca None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=73655) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:47:07 devstack cinder-volume[73655]: DEBUG oslo_service.backend._eventlet.service [None req-203a21c1-0897-49e7-a0b3-deab8820e8ca None None] oslo_messaging_rabbit.ssl = False {{(pid=73655) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:47:07 devstack cinder-volume[73655]: DEBUG oslo_service.backend._eventlet.service [None req-203a21c1-0897-49e7-a0b3-deab8820e8ca None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=73655) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:47:07 devstack cinder-volume[73655]: DEBUG oslo_service.backend._eventlet.service [None req-203a21c1-0897-49e7-a0b3-deab8820e8ca None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=73655) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:47:07 devstack cinder-volume[73655]: DEBUG oslo_service.backend._eventlet.service [None req-203a21c1-0897-49e7-a0b3-deab8820e8ca None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=73655) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:47:07 devstack cinder-volume[73655]: DEBUG oslo_service.backend._eventlet.service [None req-203a21c1-0897-49e7-a0b3-deab8820e8ca None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=73655) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:47:07 devstack cinder-volume[73655]: DEBUG oslo_service.backend._eventlet.service [None req-203a21c1-0897-49e7-a0b3-deab8820e8ca None None] oslo_messaging_rabbit.ssl_version = {{(pid=73655) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:47:07 devstack cinder-volume[73655]: DEBUG oslo_service.backend._eventlet.service [None req-203a21c1-0897-49e7-a0b3-deab8820e8ca None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=73655) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:47:07 devstack cinder-volume[73655]: DEBUG oslo_service.backend._eventlet.service [None req-203a21c1-0897-49e7-a0b3-deab8820e8ca None None] oslo_messaging_notifications.driver = [] {{(pid=73655) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:47:07 devstack cinder-volume[73655]: DEBUG oslo_service.backend._eventlet.service [None req-203a21c1-0897-49e7-a0b3-deab8820e8ca None None] oslo_messaging_notifications.retry = -1 {{(pid=73655) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:47:07 devstack cinder-volume[73655]: DEBUG oslo_service.backend._eventlet.service [None req-203a21c1-0897-49e7-a0b3-deab8820e8ca None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=73655) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:47:07 devstack cinder-volume[73655]: DEBUG oslo_service.backend._eventlet.service [None req-203a21c1-0897-49e7-a0b3-deab8820e8ca None None] oslo_messaging_notifications.transport_url = **** {{(pid=73655) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:47:07 devstack cinder-volume[73655]: DEBUG oslo_service.backend._eventlet.service [None req-203a21c1-0897-49e7-a0b3-deab8820e8ca None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=73655) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:47:07 devstack cinder-volume[73655]: DEBUG oslo_service.backend._eventlet.service [None req-203a21c1-0897-49e7-a0b3-deab8820e8ca None None] key_manager.fixed_key = **** {{(pid=73655) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:47:07 devstack cinder-volume[73655]: DEBUG oslo_service.backend._eventlet.service [None req-203a21c1-0897-49e7-a0b3-deab8820e8ca None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=73655) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:47:07 devstack cinder-volume[73655]: DEBUG oslo_service.backend._eventlet.service [None req-203a21c1-0897-49e7-a0b3-deab8820e8ca None None] barbican.barbican_api_version = None {{(pid=73655) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:47:07 devstack cinder-volume[73755]: DEBUG oslo_concurrency.processutils [None req-bec051e7-ca60-4608-901c-5bd51659c94d None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=73755) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 25 15:47:07 devstack cinder-volume[73655]: DEBUG oslo_service.backend._eventlet.service [None req-203a21c1-0897-49e7-a0b3-deab8820e8ca None None] barbican.barbican_endpoint = None {{(pid=73655) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:47:07 devstack cinder-volume[73655]: DEBUG oslo_service.backend._eventlet.service [None req-203a21c1-0897-49e7-a0b3-deab8820e8ca None None] barbican.barbican_endpoint_type = public {{(pid=73655) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:47:07 devstack cinder-volume[73655]: DEBUG oslo_service.backend._eventlet.service [None req-203a21c1-0897-49e7-a0b3-deab8820e8ca None None] barbican.barbican_region_name = None {{(pid=73655) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:47:07 devstack cinder-volume[73655]: DEBUG oslo_service.backend._eventlet.service [None req-203a21c1-0897-49e7-a0b3-deab8820e8ca None None] barbican.cafile = None {{(pid=73655) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:47:07 devstack cinder-volume[73655]: DEBUG oslo_service.backend._eventlet.service [None req-203a21c1-0897-49e7-a0b3-deab8820e8ca None None] barbican.certfile = None {{(pid=73655) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:47:07 devstack cinder-volume[73655]: DEBUG oslo_service.backend._eventlet.service [None req-203a21c1-0897-49e7-a0b3-deab8820e8ca None None] barbican.collect_timing = False {{(pid=73655) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:47:07 devstack cinder-volume[73655]: DEBUG oslo_service.backend._eventlet.service [None req-203a21c1-0897-49e7-a0b3-deab8820e8ca None None] barbican.insecure = False {{(pid=73655) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:47:07 devstack cinder-volume[73655]: DEBUG oslo_service.backend._eventlet.service [None req-203a21c1-0897-49e7-a0b3-deab8820e8ca None None] barbican.keyfile = None {{(pid=73655) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:47:07 devstack cinder-volume[73655]: DEBUG oslo_service.backend._eventlet.service [None req-203a21c1-0897-49e7-a0b3-deab8820e8ca None None] barbican.number_of_retries = 60 {{(pid=73655) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:47:07 devstack cinder-volume[73655]: DEBUG oslo_service.backend._eventlet.service [None req-203a21c1-0897-49e7-a0b3-deab8820e8ca None None] barbican.retry_delay = 1 {{(pid=73655) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:47:07 devstack cinder-volume[73655]: DEBUG oslo_service.backend._eventlet.service [None req-203a21c1-0897-49e7-a0b3-deab8820e8ca None None] barbican.send_service_user_token = False {{(pid=73655) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:47:07 devstack cinder-volume[73655]: DEBUG oslo_service.backend._eventlet.service [None req-203a21c1-0897-49e7-a0b3-deab8820e8ca None None] barbican.split_loggers = False {{(pid=73655) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:47:07 devstack cinder-volume[73655]: DEBUG oslo_service.backend._eventlet.service [None req-203a21c1-0897-49e7-a0b3-deab8820e8ca None None] barbican.timeout = None {{(pid=73655) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:47:07 devstack cinder-volume[73655]: DEBUG oslo_service.backend._eventlet.service [None req-203a21c1-0897-49e7-a0b3-deab8820e8ca None None] barbican.verify_ssl = True {{(pid=73655) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:47:07 devstack cinder-volume[73655]: DEBUG oslo_service.backend._eventlet.service [None req-203a21c1-0897-49e7-a0b3-deab8820e8ca None None] barbican.verify_ssl_path = None {{(pid=73655) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:47:07 devstack cinder-volume[73655]: DEBUG oslo_service.backend._eventlet.service [None req-203a21c1-0897-49e7-a0b3-deab8820e8ca None None] barbican_service_user.auth_section = None {{(pid=73655) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:47:07 devstack cinder-volume[73655]: DEBUG oslo_service.backend._eventlet.service [None req-203a21c1-0897-49e7-a0b3-deab8820e8ca None None] barbican_service_user.auth_type = None {{(pid=73655) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:47:07 devstack cinder-volume[73655]: DEBUG oslo_service.backend._eventlet.service [None req-203a21c1-0897-49e7-a0b3-deab8820e8ca None None] barbican_service_user.cafile = None {{(pid=73655) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:47:07 devstack cinder-volume[73655]: DEBUG oslo_service.backend._eventlet.service [None req-203a21c1-0897-49e7-a0b3-deab8820e8ca None None] barbican_service_user.certfile = None {{(pid=73655) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:47:07 devstack cinder-volume[73655]: DEBUG oslo_service.backend._eventlet.service [None req-203a21c1-0897-49e7-a0b3-deab8820e8ca None None] barbican_service_user.collect_timing = False {{(pid=73655) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:47:07 devstack cinder-volume[73655]: DEBUG oslo_service.backend._eventlet.service [None req-203a21c1-0897-49e7-a0b3-deab8820e8ca None None] barbican_service_user.insecure = False {{(pid=73655) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:47:07 devstack cinder-volume[73655]: DEBUG oslo_service.backend._eventlet.service [None req-203a21c1-0897-49e7-a0b3-deab8820e8ca None None] barbican_service_user.keyfile = None {{(pid=73655) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:47:07 devstack cinder-volume[73655]: DEBUG oslo_service.backend._eventlet.service [None req-203a21c1-0897-49e7-a0b3-deab8820e8ca None None] barbican_service_user.split_loggers = False {{(pid=73655) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:47:07 devstack cinder-volume[73655]: DEBUG oslo_service.backend._eventlet.service [None req-203a21c1-0897-49e7-a0b3-deab8820e8ca None None] barbican_service_user.timeout = None {{(pid=73655) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:47:07 devstack cinder-volume[73655]: DEBUG oslo_service.backend._eventlet.service [None req-203a21c1-0897-49e7-a0b3-deab8820e8ca None None] vault.approle_role_id = **** {{(pid=73655) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:47:07 devstack cinder-volume[73655]: DEBUG oslo_service.backend._eventlet.service [None req-203a21c1-0897-49e7-a0b3-deab8820e8ca None None] vault.approle_secret_id = **** {{(pid=73655) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:47:07 devstack cinder-volume[73655]: DEBUG oslo_service.backend._eventlet.service [None req-203a21c1-0897-49e7-a0b3-deab8820e8ca None None] vault.kv_mountpoint = secret {{(pid=73655) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:47:07 devstack cinder-volume[73655]: DEBUG oslo_service.backend._eventlet.service [None req-203a21c1-0897-49e7-a0b3-deab8820e8ca None None] vault.kv_path = None {{(pid=73655) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:47:07 devstack cinder-volume[73655]: DEBUG oslo_service.backend._eventlet.service [None req-203a21c1-0897-49e7-a0b3-deab8820e8ca None None] vault.kv_version = 2 {{(pid=73655) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:47:07 devstack cinder-volume[73655]: DEBUG oslo_service.backend._eventlet.service [None req-203a21c1-0897-49e7-a0b3-deab8820e8ca None None] vault.namespace = None {{(pid=73655) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:47:07 devstack cinder-volume[73655]: DEBUG oslo_service.backend._eventlet.service [None req-203a21c1-0897-49e7-a0b3-deab8820e8ca None None] vault.root_token_id = **** {{(pid=73655) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:47:07 devstack cinder-volume[73655]: DEBUG oslo_service.backend._eventlet.service [None req-203a21c1-0897-49e7-a0b3-deab8820e8ca None None] vault.ssl_ca_crt_file = None {{(pid=73655) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:47:07 devstack cinder-volume[73655]: DEBUG oslo_service.backend._eventlet.service [None req-203a21c1-0897-49e7-a0b3-deab8820e8ca None None] vault.timeout = 60.0 {{(pid=73655) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:47:07 devstack cinder-volume[73655]: DEBUG oslo_service.backend._eventlet.service [None req-203a21c1-0897-49e7-a0b3-deab8820e8ca None None] vault.use_ssl = False {{(pid=73655) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:47:07 devstack cinder-volume[73655]: DEBUG oslo_service.backend._eventlet.service [None req-203a21c1-0897-49e7-a0b3-deab8820e8ca None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=73655) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:47:07 devstack cinder-volume[73655]: DEBUG oslo_service.backend._eventlet.service [None req-203a21c1-0897-49e7-a0b3-deab8820e8ca None None] ******************************************************************************** {{(pid=73655) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3013}} Feb 25 15:47:07 devstack cinder-volume[73755]: DEBUG oslo_concurrency.processutils [None req-bec051e7-ca60-4608-901c-5bd51659c94d None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.031s {{(pid=73755) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 25 15:47:07 devstack cinder-volume[73755]: DEBUG oslo_concurrency.processutils [None req-bec051e7-ca60-4608-901c-5bd51659c94d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1 {{(pid=73755) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 25 15:47:07 devstack sudo[73759]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1 Feb 25 15:47:07 devstack sudo[73759]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 25 15:47:07 devstack sudo[73759]: pam_unix(sudo:session): session closed for user root Feb 25 15:47:07 devstack cinder-volume[73755]: DEBUG oslo_concurrency.processutils [None req-bec051e7-ca60-4608-901c-5bd51659c94d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1" returned: 0 in 0.498s {{(pid=73755) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 25 15:47:07 devstack cinder-volume[73755]: DEBUG oslo_concurrency.processutils [None req-bec051e7-ca60-4608-901c-5bd51659c94d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=73755) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 25 15:47:07 devstack sudo[73887]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Feb 25 15:47:07 devstack sudo[73887]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 25 15:47:08 devstack sudo[73887]: pam_unix(sudo:session): session closed for user root Feb 25 15:47:08 devstack cinder-volume[73755]: DEBUG oslo_concurrency.processutils [None req-bec051e7-ca60-4608-901c-5bd51659c94d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 5 in 0.546s {{(pid=73755) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 25 15:47:08 devstack cinder-volume[73755]: DEBUG oslo_concurrency.processutils [None req-bec051e7-ca60-4608-901c-5bd51659c94d None None] 'sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' failed. Not Retrying. {{(pid=73755) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Feb 25 15:47:08 devstack cinder-volume[73755]: INFO cinder.brick.local_dev.lvm [None req-bec051e7-ca60-4608-901c-5bd51659c94d None None] Logical Volume not found when querying LVM info. (vg_name=stack-volumes-lvmdriver-1, lv_name=stack-volumes-lvmdriver-1-pool Feb 25 15:47:08 devstack cinder-volume[73755]: DEBUG oslo_concurrency.processutils [None req-bec051e7-ca60-4608-901c-5bd51659c94d None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=73755) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 25 15:47:08 devstack cinder-volume[73755]: DEBUG oslo_concurrency.processutils [None req-bec051e7-ca60-4608-901c-5bd51659c94d None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.010s {{(pid=73755) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 25 15:47:08 devstack cinder-volume[73755]: DEBUG oslo_concurrency.processutils [None req-bec051e7-ca60-4608-901c-5bd51659c94d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=73755) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 25 15:47:08 devstack sudo[74151]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Feb 25 15:47:08 devstack sudo[74151]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 25 15:47:08 devstack sudo[74151]: pam_unix(sudo:session): session closed for user root Feb 25 15:47:08 devstack cinder-volume[73755]: DEBUG oslo_concurrency.processutils [None req-bec051e7-ca60-4608-901c-5bd51659c94d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.553s {{(pid=73755) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 25 15:47:08 devstack cinder-volume[73755]: DEBUG cinder.brick.local_dev.lvm [None req-bec051e7-ca60-4608-901c-5bd51659c94d None None] Creating thin pool 'stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' with size 28.5g of total 30.0g {{(pid=73755) create_thin_pool /opt/stack/cinder/cinder/brick/local_dev/lvm.py:550}} Feb 25 15:47:08 devstack cinder-volume[73755]: DEBUG oslo_concurrency.processutils [None req-bec051e7-ca60-4608-901c-5bd51659c94d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=73755) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 25 15:47:08 devstack sudo[74310]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Feb 25 15:47:08 devstack sudo[74310]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 25 15:47:09 devstack sudo[74310]: pam_unix(sudo:session): session closed for user root Feb 25 15:47:09 devstack cinder-volume[73755]: DEBUG oslo_concurrency.processutils [None req-bec051e7-ca60-4608-901c-5bd51659c94d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.822s {{(pid=73755) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 25 15:47:09 devstack cinder-volume[73755]: DEBUG oslo_concurrency.processutils [None req-bec051e7-ca60-4608-901c-5bd51659c94d None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=73755) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 25 15:47:09 devstack cinder-volume[73755]: DEBUG oslo_concurrency.processutils [None req-bec051e7-ca60-4608-901c-5bd51659c94d None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.026s {{(pid=73755) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 25 15:47:09 devstack cinder-volume[73755]: DEBUG oslo_concurrency.processutils [None req-bec051e7-ca60-4608-901c-5bd51659c94d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=73755) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 25 15:47:09 devstack sudo[74443]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Feb 25 15:47:09 devstack sudo[74443]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 25 15:47:10 devstack sudo[74443]: pam_unix(sudo:session): session closed for user root Feb 25 15:47:10 devstack cinder-volume[73755]: DEBUG oslo_concurrency.processutils [None req-bec051e7-ca60-4608-901c-5bd51659c94d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.494s {{(pid=73755) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 25 15:47:10 devstack cinder-volume[73755]: DEBUG oslo_concurrency.processutils [None req-bec051e7-ca60-4608-901c-5bd51659c94d None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=73755) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 25 15:47:10 devstack cinder-volume[73755]: DEBUG oslo_concurrency.processutils [None req-bec051e7-ca60-4608-901c-5bd51659c94d None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.022s {{(pid=73755) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 25 15:47:10 devstack cinder-volume[73755]: DEBUG oslo_concurrency.processutils [None req-bec051e7-ca60-4608-901c-5bd51659c94d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster {{(pid=73755) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 25 15:47:10 devstack sudo[74478]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster Feb 25 15:47:10 devstack sudo[74478]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 25 15:47:10 devstack sudo[74478]: pam_unix(sudo:session): session closed for user root Feb 25 15:47:10 devstack cinder-volume[73755]: DEBUG oslo_concurrency.processutils [None req-bec051e7-ca60-4608-901c-5bd51659c94d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster" returned: 0 in 0.454s {{(pid=73755) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 25 15:47:10 devstack cinder-volume[73755]: DEBUG oslo_concurrency.processutils [None req-bec051e7-ca60-4608-901c-5bd51659c94d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=73755) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 25 15:47:10 devstack sudo[74481]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Feb 25 15:47:10 devstack sudo[74481]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 25 15:47:11 devstack sudo[74481]: pam_unix(sudo:session): session closed for user root Feb 25 15:47:11 devstack cinder-volume[73755]: DEBUG oslo_concurrency.processutils [None req-bec051e7-ca60-4608-901c-5bd51659c94d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.460s {{(pid=73755) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 25 15:47:11 devstack cinder-volume[73755]: DEBUG oslo_concurrency.processutils [None req-bec051e7-ca60-4608-901c-5bd51659c94d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=73755) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 25 15:47:11 devstack sudo[74486]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Feb 25 15:47:11 devstack sudo[74486]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 25 15:47:11 devstack sudo[74486]: pam_unix(sudo:session): session closed for user root Feb 25 15:47:11 devstack cinder-volume[73755]: DEBUG oslo_concurrency.processutils [None req-bec051e7-ca60-4608-901c-5bd51659c94d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.474s {{(pid=73755) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 25 15:47:11 devstack cinder-volume[73755]: DEBUG oslo_concurrency.processutils [None req-bec051e7-ca60-4608-901c-5bd51659c94d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=73755) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 25 15:47:11 devstack sudo[74491]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Feb 25 15:47:11 devstack sudo[74491]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 25 15:47:12 devstack sudo[74491]: pam_unix(sudo:session): session closed for user root Feb 25 15:47:12 devstack cinder-volume[73755]: DEBUG oslo_concurrency.processutils [None req-bec051e7-ca60-4608-901c-5bd51659c94d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.503s {{(pid=73755) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 25 15:47:12 devstack cinder-volume[73755]: DEBUG oslo_concurrency.processutils [None req-bec051e7-ca60-4608-901c-5bd51659c94d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=73755) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 25 15:47:12 devstack sudo[74499]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Feb 25 15:47:12 devstack sudo[74499]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 25 15:47:12 devstack sudo[74499]: pam_unix(sudo:session): session closed for user root Feb 25 15:47:12 devstack cinder-volume[73755]: DEBUG oslo_concurrency.processutils [None req-bec051e7-ca60-4608-901c-5bd51659c94d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.488s {{(pid=73755) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 25 15:47:12 devstack cinder-volume[73755]: DEBUG oslo_concurrency.processutils [None req-bec051e7-ca60-4608-901c-5bd51659c94d None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=73755) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 25 15:47:12 devstack cinder-volume[73755]: DEBUG oslo_concurrency.processutils [None req-bec051e7-ca60-4608-901c-5bd51659c94d None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.022s {{(pid=73755) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 25 15:47:12 devstack cinder-volume[73755]: DEBUG oslo_concurrency.processutils [None req-bec051e7-ca60-4608-901c-5bd51659c94d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=73755) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 25 15:47:12 devstack sudo[74503]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Feb 25 15:47:12 devstack sudo[74503]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 25 15:47:13 devstack sudo[74503]: pam_unix(sudo:session): session closed for user root Feb 25 15:47:13 devstack cinder-volume[73755]: DEBUG oslo_concurrency.processutils [None req-bec051e7-ca60-4608-901c-5bd51659c94d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.558s {{(pid=73755) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 25 15:47:13 devstack cinder-volume[73755]: INFO cinder.volume.drivers.lvm [None req-bec051e7-ca60-4608-901c-5bd51659c94d None None] Enabling LVM thin provisioning by default because a thin pool exists. Feb 25 15:47:13 devstack cinder-volume[73755]: DEBUG oslo_concurrency.processutils [None req-bec051e7-ca60-4608-901c-5bd51659c94d None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=73755) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 25 15:47:13 devstack cinder-volume[73755]: DEBUG oslo_concurrency.processutils [None req-bec051e7-ca60-4608-901c-5bd51659c94d None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.015s {{(pid=73755) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 25 15:47:13 devstack cinder-volume[73755]: DEBUG oslo_concurrency.processutils [None req-bec051e7-ca60-4608-901c-5bd51659c94d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=73755) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 25 15:47:13 devstack sudo[74599]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Feb 25 15:47:13 devstack sudo[74599]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 25 15:47:13 devstack sudo[74599]: pam_unix(sudo:session): session closed for user root Feb 25 15:47:13 devstack cinder-volume[73755]: DEBUG oslo_concurrency.processutils [None req-bec051e7-ca60-4608-901c-5bd51659c94d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.488s {{(pid=73755) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 25 15:47:13 devstack cinder-volume[73755]: DEBUG cinder.volume.drivers.lvm [None req-bec051e7-ca60-4608-901c-5bd51659c94d None None] Updating volume stats {{(pid=73755) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Feb 25 15:47:13 devstack cinder-volume[73755]: DEBUG oslo_concurrency.processutils [None req-bec051e7-ca60-4608-901c-5bd51659c94d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=73755) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 25 15:47:13 devstack sudo[74632]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Feb 25 15:47:13 devstack sudo[74632]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 25 15:47:14 devstack sudo[74632]: pam_unix(sudo:session): session closed for user root Feb 25 15:47:14 devstack cinder-volume[73755]: DEBUG oslo_concurrency.processutils [None req-bec051e7-ca60-4608-901c-5bd51659c94d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.463s {{(pid=73755) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 25 15:47:14 devstack cinder-volume[73755]: DEBUG oslo_concurrency.processutils [None req-bec051e7-ca60-4608-901c-5bd51659c94d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=73755) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 25 15:47:14 devstack sudo[74774]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Feb 25 15:47:14 devstack sudo[74774]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 25 15:47:14 devstack sudo[74774]: pam_unix(sudo:session): session closed for user root Feb 25 15:47:14 devstack cinder-volume[73755]: DEBUG oslo_concurrency.processutils [None req-bec051e7-ca60-4608-901c-5bd51659c94d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.446s {{(pid=73755) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 25 15:47:14 devstack cinder-volume[73755]: DEBUG oslo_concurrency.processutils [None req-bec051e7-ca60-4608-901c-5bd51659c94d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=73755) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 25 15:47:14 devstack sudo[74778]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Feb 25 15:47:14 devstack sudo[74778]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 25 15:47:15 devstack sudo[74778]: pam_unix(sudo:session): session closed for user root Feb 25 15:47:15 devstack cinder-volume[73755]: DEBUG oslo_concurrency.processutils [None req-bec051e7-ca60-4608-901c-5bd51659c94d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.466s {{(pid=73755) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 25 15:47:15 devstack cinder-volume[73755]: DEBUG oslo_concurrency.processutils [None req-bec051e7-ca60-4608-901c-5bd51659c94d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=73755) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 25 15:47:15 devstack sudo[74781]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Feb 25 15:47:15 devstack sudo[74781]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 25 15:47:15 devstack sudo[74781]: pam_unix(sudo:session): session closed for user root Feb 25 15:47:15 devstack cinder-volume[73755]: DEBUG oslo_concurrency.processutils [None req-bec051e7-ca60-4608-901c-5bd51659c94d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.462s {{(pid=73755) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 25 15:47:15 devstack cinder-volume[73755]: INFO cinder.volume.driver [None req-bec051e7-ca60-4608-901c-5bd51659c94d None None] Driver hasn't implemented _init_vendor_properties() Feb 25 15:47:15 devstack cinder-volume[73755]: DEBUG cinder.volume.driver [None req-bec051e7-ca60-4608-901c-5bd51659c94d None None] Initialized capabilities list: {'volume_backend_name': 'lvmdriver-1', 'vendor_name': 'Open Source', 'driver_version': '3.0.0', 'storage_protocol': 'iSCSI', 'pools': [{'pool_name': 'lvmdriver-1', 'total_capacity_gb': 28.5, 'free_capacity_gb': 28.5, 'reserved_percentage': 0, 'location_info': 'LVMVolumeDriver:devstack:stack-volumes-lvmdriver-1:thin:0', 'QoS_support': False, 'provisioned_capacity_gb': 0.0, 'max_over_subscription_ratio': '20.0', 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'total_volumes': 1, 'filter_function': None, 'goodness_function': None, 'multiattach': True, 'backend_state': 'up'}], 'shared_targets': False, 'sparse_copy_volume': True, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=73755) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:873}} Feb 25 15:47:15 devstack cinder-volume[73755]: DEBUG oslo_db.sqlalchemy.engines [None req-bec051e7-ca60-4608-901c-5bd51659c94d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=73755) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}} Feb 25 15:47:15 devstack cinder-volume[73755]: DEBUG dbcounter [-] [73755] Writer thread running {{(pid=73755) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:102}} Feb 25 15:47:15 devstack cinder-volume[73755]: DEBUG cinder.db.sqlalchemy.api [None req-bec051e7-ca60-4608-901c-5bd51659c94d None None] Building query based on filter {{(pid=73755) _process_snaps_filters /opt/stack/cinder/cinder/db/sqlalchemy/api.py:3943}} Feb 25 15:47:15 devstack cinder-volume[73755]: DEBUG cinder.image.image_utils [None req-bec051e7-ca60-4608-901c-5bd51659c94d None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=73755) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1298}} Feb 25 15:47:15 devstack cinder-volume[73755]: INFO cinder.keymgr.migration [None req-1d94ce70-870d-4b69-b28e-9324bad45d1e None None] Not migrating encryption keys because the ConfKeyManager is still in use. Feb 25 15:47:15 devstack cinder-volume[73755]: DEBUG cinder.volume.drivers.lvm [None req-bec051e7-ca60-4608-901c-5bd51659c94d None None] Updating volume stats {{(pid=73755) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Feb 25 15:47:15 devstack cinder-volume[73755]: DEBUG oslo_concurrency.processutils [None req-bec051e7-ca60-4608-901c-5bd51659c94d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=73755) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 25 15:47:15 devstack sudo[74785]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Feb 25 15:47:15 devstack sudo[74785]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 25 15:47:16 devstack sudo[74785]: pam_unix(sudo:session): session closed for user root Feb 25 15:47:16 devstack cinder-volume[73755]: DEBUG oslo_concurrency.processutils [None req-bec051e7-ca60-4608-901c-5bd51659c94d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.471s {{(pid=73755) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 25 15:47:16 devstack cinder-volume[73755]: DEBUG oslo_concurrency.processutils [None req-bec051e7-ca60-4608-901c-5bd51659c94d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=73755) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 25 15:47:16 devstack sudo[74792]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Feb 25 15:47:16 devstack sudo[74792]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 25 15:47:16 devstack sudo[74792]: pam_unix(sudo:session): session closed for user root Feb 25 15:47:16 devstack cinder-volume[73755]: DEBUG oslo_concurrency.processutils [None req-bec051e7-ca60-4608-901c-5bd51659c94d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.468s {{(pid=73755) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 25 15:47:16 devstack cinder-volume[73755]: DEBUG oslo_concurrency.processutils [None req-bec051e7-ca60-4608-901c-5bd51659c94d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=73755) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 25 15:47:16 devstack sudo[74796]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Feb 25 15:47:16 devstack sudo[74796]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 25 15:47:16 devstack sudo[74796]: pam_unix(sudo:session): session closed for user root Feb 25 15:47:16 devstack cinder-volume[73755]: DEBUG oslo_concurrency.processutils [None req-bec051e7-ca60-4608-901c-5bd51659c94d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.455s {{(pid=73755) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 25 15:47:16 devstack cinder-volume[73755]: DEBUG oslo_concurrency.processutils [None req-bec051e7-ca60-4608-901c-5bd51659c94d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=73755) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 25 15:47:16 devstack sudo[74800]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Feb 25 15:47:16 devstack sudo[74800]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 25 15:47:16 devstack cinder-volume[73655]: DEBUG dbcounter [-] [73655] Writing DB stats cinder:SELECT=8,cinder:INSERT=1,cinder:UPDATE=1 {{(pid=73655) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Feb 25 15:47:17 devstack sudo[74800]: pam_unix(sudo:session): session closed for user root Feb 25 15:47:17 devstack cinder-volume[73755]: DEBUG oslo_concurrency.processutils [None req-bec051e7-ca60-4608-901c-5bd51659c94d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.438s {{(pid=73755) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 25 15:47:17 devstack cinder-volume[73755]: DEBUG cinder.manager [None req-bec051e7-ca60-4608-901c-5bd51659c94d None None] Notifying Schedulers of capabilities ... {{(pid=73755) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 25 15:47:17 devstack cinder-volume[73755]: INFO cinder.volume.manager [None req-bec051e7-ca60-4608-901c-5bd51659c94d None None] Driver initialization completed successfully. Feb 25 15:47:17 devstack cinder-volume[73755]: INFO cinder.manager [None req-bec051e7-ca60-4608-901c-5bd51659c94d None None] Initiating service 2 cleanup Feb 25 15:47:17 devstack cinder-volume[73755]: INFO cinder.manager [None req-bec051e7-ca60-4608-901c-5bd51659c94d None None] Service 2 cleanup completed. Feb 25 15:47:17 devstack cinder-volume[73755]: DEBUG cinder.service [None req-bec051e7-ca60-4608-901c-5bd51659c94d None None] Creating RPC server for service cinder-volume {{(pid=73755) start /opt/stack/cinder/cinder/service.py:231}} Feb 25 15:47:17 devstack cinder-volume[73755]: DEBUG cinder.service [None req-bec051e7-ca60-4608-901c-5bd51659c94d None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=73755) start /opt/stack/cinder/cinder/service.py:237}} Feb 25 15:47:17 devstack cinder-volume[73755]: INFO cinder.volume.manager [None req-bec051e7-ca60-4608-901c-5bd51659c94d None None] Initializing RPC dependent components of volume driver LVMVolumeDriver (3.0.0) Feb 25 15:47:17 devstack cinder-volume[73755]: DEBUG cinder.volume.drivers.lvm [None req-bec051e7-ca60-4608-901c-5bd51659c94d None None] Updating volume stats {{(pid=73755) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Feb 25 15:47:17 devstack cinder-volume[73755]: DEBUG oslo_concurrency.processutils [None req-bec051e7-ca60-4608-901c-5bd51659c94d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=73755) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 25 15:47:17 devstack sudo[74806]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Feb 25 15:47:17 devstack sudo[74806]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 25 15:47:17 devstack sudo[74806]: pam_unix(sudo:session): session closed for user root Feb 25 15:47:17 devstack cinder-volume[73755]: DEBUG oslo_concurrency.processutils [None req-bec051e7-ca60-4608-901c-5bd51659c94d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.472s {{(pid=73755) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 25 15:47:17 devstack cinder-volume[73755]: DEBUG oslo_concurrency.processutils [None req-bec051e7-ca60-4608-901c-5bd51659c94d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=73755) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 25 15:47:17 devstack sudo[74812]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Feb 25 15:47:17 devstack sudo[74812]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 25 15:47:18 devstack sudo[74812]: pam_unix(sudo:session): session closed for user root Feb 25 15:47:18 devstack cinder-volume[73755]: DEBUG oslo_concurrency.processutils [None req-bec051e7-ca60-4608-901c-5bd51659c94d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.434s {{(pid=73755) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 25 15:47:18 devstack cinder-volume[73755]: DEBUG oslo_concurrency.processutils [None req-bec051e7-ca60-4608-901c-5bd51659c94d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=73755) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 25 15:47:18 devstack sudo[74869]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Feb 25 15:47:18 devstack sudo[74869]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 25 15:47:18 devstack sudo[74869]: pam_unix(sudo:session): session closed for user root Feb 25 15:47:18 devstack cinder-volume[73755]: DEBUG oslo_concurrency.processutils [None req-bec051e7-ca60-4608-901c-5bd51659c94d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.419s {{(pid=73755) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 25 15:47:18 devstack cinder-volume[73755]: DEBUG oslo_concurrency.processutils [None req-bec051e7-ca60-4608-901c-5bd51659c94d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=73755) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 25 15:47:18 devstack sudo[74872]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Feb 25 15:47:18 devstack sudo[74872]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 25 15:47:19 devstack sudo[74872]: pam_unix(sudo:session): session closed for user root Feb 25 15:47:19 devstack cinder-volume[73755]: DEBUG oslo_concurrency.processutils [None req-bec051e7-ca60-4608-901c-5bd51659c94d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.473s {{(pid=73755) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 25 15:47:19 devstack cinder-volume[73755]: INFO cinder.volume.manager [None req-bec051e7-ca60-4608-901c-5bd51659c94d None None] Driver post RPC initialization completed successfully. Feb 25 15:47:27 devstack cinder-volume[73755]: DEBUG dbcounter [-] [73755] Writing DB stats cinder:SELECT=11,cinder:INSERT=1,cinder:UPDATE=1 {{(pid=73755) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Feb 25 15:47:29 devstack cinder-volume[73755]: DEBUG dbcounter [-] [73755] Writing DB stats cinder:SELECT=3,cinder:UPDATE=1 {{(pid=73755) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Feb 25 15:48:12 devstack cinder-volume[73755]: DEBUG oslo_service.periodic_task [None req-be15cf97-6be6-4700-9d86-6583e2cbb380 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=73755) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Feb 25 15:48:12 devstack cinder-volume[73755]: DEBUG cinder.volume.drivers.lvm [None req-be15cf97-6be6-4700-9d86-6583e2cbb380 None None] Updating volume stats {{(pid=73755) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Feb 25 15:48:12 devstack cinder-volume[73755]: DEBUG oslo_concurrency.processutils [None req-be15cf97-6be6-4700-9d86-6583e2cbb380 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=73755) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 25 15:48:12 devstack sudo[77123]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Feb 25 15:48:12 devstack sudo[77123]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 25 15:48:12 devstack sudo[77123]: pam_unix(sudo:session): session closed for user root Feb 25 15:48:12 devstack cinder-volume[73755]: DEBUG oslo_concurrency.processutils [None req-be15cf97-6be6-4700-9d86-6583e2cbb380 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.451s {{(pid=73755) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 25 15:48:12 devstack cinder-volume[73755]: DEBUG oslo_concurrency.processutils [None req-be15cf97-6be6-4700-9d86-6583e2cbb380 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=73755) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 25 15:48:12 devstack sudo[77256]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Feb 25 15:48:12 devstack sudo[77256]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 25 15:48:13 devstack sudo[77256]: pam_unix(sudo:session): session closed for user root Feb 25 15:48:13 devstack cinder-volume[73755]: DEBUG oslo_concurrency.processutils [None req-be15cf97-6be6-4700-9d86-6583e2cbb380 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.424s {{(pid=73755) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 25 15:48:13 devstack cinder-volume[73755]: DEBUG oslo_concurrency.processutils [None req-be15cf97-6be6-4700-9d86-6583e2cbb380 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=73755) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 25 15:48:13 devstack sudo[77265]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Feb 25 15:48:13 devstack sudo[77265]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 25 15:48:13 devstack sudo[77265]: pam_unix(sudo:session): session closed for user root Feb 25 15:48:13 devstack cinder-volume[73755]: DEBUG oslo_concurrency.processutils [None req-be15cf97-6be6-4700-9d86-6583e2cbb380 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.440s {{(pid=73755) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 25 15:48:13 devstack cinder-volume[73755]: DEBUG oslo_concurrency.processutils [None req-be15cf97-6be6-4700-9d86-6583e2cbb380 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=73755) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 25 15:48:13 devstack sudo[77268]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Feb 25 15:48:13 devstack sudo[77268]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 25 15:48:14 devstack sudo[77268]: pam_unix(sudo:session): session closed for user root Feb 25 15:48:14 devstack cinder-volume[73755]: DEBUG oslo_concurrency.processutils [None req-be15cf97-6be6-4700-9d86-6583e2cbb380 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.435s {{(pid=73755) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 25 15:48:14 devstack cinder-volume[73755]: DEBUG cinder.manager [None req-be15cf97-6be6-4700-9d86-6583e2cbb380 None None] Notifying Schedulers of capabilities ... {{(pid=73755) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 25 15:49:12 devstack cinder-volume[73755]: DEBUG oslo_service.periodic_task [None req-be15cf97-6be6-4700-9d86-6583e2cbb380 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=73755) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Feb 25 15:49:12 devstack cinder-volume[73755]: DEBUG cinder.volume.drivers.lvm [None req-be15cf97-6be6-4700-9d86-6583e2cbb380 None None] Updating volume stats {{(pid=73755) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Feb 25 15:49:12 devstack cinder-volume[73755]: DEBUG oslo_concurrency.processutils [None req-be15cf97-6be6-4700-9d86-6583e2cbb380 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=73755) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 25 15:49:12 devstack sudo[80077]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Feb 25 15:49:12 devstack sudo[80077]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 25 15:49:12 devstack sudo[80077]: pam_unix(sudo:session): session closed for user root Feb 25 15:49:12 devstack cinder-volume[73755]: DEBUG oslo_concurrency.processutils [None req-be15cf97-6be6-4700-9d86-6583e2cbb380 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.492s {{(pid=73755) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 25 15:49:12 devstack cinder-volume[73755]: DEBUG oslo_concurrency.processutils [None req-be15cf97-6be6-4700-9d86-6583e2cbb380 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=73755) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 25 15:49:12 devstack sudo[80083]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Feb 25 15:49:12 devstack sudo[80083]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 25 15:49:13 devstack sudo[80083]: pam_unix(sudo:session): session closed for user root Feb 25 15:49:13 devstack cinder-volume[73755]: DEBUG oslo_concurrency.processutils [None req-be15cf97-6be6-4700-9d86-6583e2cbb380 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.418s {{(pid=73755) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 25 15:49:13 devstack cinder-volume[73755]: DEBUG oslo_concurrency.processutils [None req-be15cf97-6be6-4700-9d86-6583e2cbb380 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=73755) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 25 15:49:13 devstack sudo[80094]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Feb 25 15:49:13 devstack sudo[80094]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 25 15:49:13 devstack sudo[80094]: pam_unix(sudo:session): session closed for user root Feb 25 15:49:13 devstack cinder-volume[73755]: DEBUG oslo_concurrency.processutils [None req-be15cf97-6be6-4700-9d86-6583e2cbb380 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.439s {{(pid=73755) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 25 15:49:13 devstack cinder-volume[73755]: DEBUG oslo_concurrency.processutils [None req-be15cf97-6be6-4700-9d86-6583e2cbb380 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=73755) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 25 15:49:13 devstack sudo[80097]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Feb 25 15:49:13 devstack sudo[80097]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 25 15:49:14 devstack sudo[80097]: pam_unix(sudo:session): session closed for user root Feb 25 15:49:14 devstack cinder-volume[73755]: DEBUG oslo_concurrency.processutils [None req-be15cf97-6be6-4700-9d86-6583e2cbb380 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.427s {{(pid=73755) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 25 15:49:14 devstack cinder-volume[73755]: DEBUG cinder.manager [None req-be15cf97-6be6-4700-9d86-6583e2cbb380 None None] Notifying Schedulers of capabilities ... {{(pid=73755) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 25 15:49:29 devstack cinder-volume[73755]: DEBUG dbcounter [-] [73755] Writing DB stats cinder:SELECT=1 {{(pid=73755) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Feb 25 15:49:29 devstack cinder-volume[73755]: DEBUG dbcounter [-] [73755] Writing DB stats cinder:UPDATE=1 {{(pid=73755) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Feb 25 15:50:12 devstack cinder-volume[73755]: DEBUG oslo_service.periodic_task [None req-be15cf97-6be6-4700-9d86-6583e2cbb380 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=73755) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Feb 25 15:50:12 devstack cinder-volume[73755]: DEBUG cinder.volume.drivers.lvm [None req-be15cf97-6be6-4700-9d86-6583e2cbb380 None None] Updating volume stats {{(pid=73755) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Feb 25 15:50:12 devstack cinder-volume[73755]: DEBUG oslo_concurrency.processutils [None req-be15cf97-6be6-4700-9d86-6583e2cbb380 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=73755) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 25 15:50:12 devstack sudo[82086]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Feb 25 15:50:12 devstack sudo[82086]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 25 15:50:12 devstack sudo[82086]: pam_unix(sudo:session): session closed for user root Feb 25 15:50:12 devstack cinder-volume[73755]: DEBUG oslo_concurrency.processutils [None req-be15cf97-6be6-4700-9d86-6583e2cbb380 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.442s {{(pid=73755) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 25 15:50:12 devstack cinder-volume[73755]: DEBUG oslo_concurrency.processutils [None req-be15cf97-6be6-4700-9d86-6583e2cbb380 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=73755) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 25 15:50:12 devstack sudo[82101]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Feb 25 15:50:12 devstack sudo[82101]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 25 15:50:13 devstack sudo[82101]: pam_unix(sudo:session): session closed for user root Feb 25 15:50:13 devstack cinder-volume[73755]: DEBUG oslo_concurrency.processutils [None req-be15cf97-6be6-4700-9d86-6583e2cbb380 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.431s {{(pid=73755) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 25 15:50:13 devstack cinder-volume[73755]: DEBUG oslo_concurrency.processutils [None req-be15cf97-6be6-4700-9d86-6583e2cbb380 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=73755) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 25 15:50:13 devstack sudo[82110]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Feb 25 15:50:13 devstack sudo[82110]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 25 15:50:13 devstack sudo[82110]: pam_unix(sudo:session): session closed for user root Feb 25 15:50:13 devstack cinder-volume[73755]: DEBUG oslo_concurrency.processutils [None req-be15cf97-6be6-4700-9d86-6583e2cbb380 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.420s {{(pid=73755) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 25 15:50:13 devstack cinder-volume[73755]: DEBUG oslo_concurrency.processutils [None req-be15cf97-6be6-4700-9d86-6583e2cbb380 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=73755) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 25 15:50:13 devstack sudo[82136]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Feb 25 15:50:13 devstack sudo[82136]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 25 15:50:14 devstack sudo[82136]: pam_unix(sudo:session): session closed for user root Feb 25 15:50:14 devstack cinder-volume[73755]: DEBUG oslo_concurrency.processutils [None req-be15cf97-6be6-4700-9d86-6583e2cbb380 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.435s {{(pid=73755) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 25 15:50:14 devstack cinder-volume[73755]: DEBUG cinder.manager [None req-be15cf97-6be6-4700-9d86-6583e2cbb380 None None] Notifying Schedulers of capabilities ... {{(pid=73755) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 25 15:50:50 devstack cinder-volume[73655]: INFO oslo_service.backend._eventlet.service [None req-203a21c1-0897-49e7-a0b3-deab8820e8ca None None] Caught SIGTERM, stopping children Feb 25 15:50:50 devstack cinder-volume[73655]: DEBUG oslo_concurrency.lockutils [None req-203a21c1-0897-49e7-a0b3-deab8820e8ca None None] Acquiring lock "singleton_lock" {{(pid=73655) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:390}} Feb 25 15:50:50 devstack cinder-volume[73655]: DEBUG oslo_concurrency.lockutils [None req-203a21c1-0897-49e7-a0b3-deab8820e8ca None None] Acquired lock "singleton_lock" {{(pid=73655) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:393}} Feb 25 15:50:50 devstack cinder-volume[73655]: DEBUG oslo_concurrency.lockutils [None req-203a21c1-0897-49e7-a0b3-deab8820e8ca None None] Releasing lock "singleton_lock" {{(pid=73655) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:413}} Feb 25 15:50:50 devstack cinder-volume[73655]: DEBUG oslo_service.backend._eventlet.service [None req-203a21c1-0897-49e7-a0b3-deab8820e8ca None None] Stop services. {{(pid=73655) stop /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:611}} Feb 25 15:50:50 devstack cinder-volume[73655]: DEBUG oslo_service.backend._eventlet.service [None req-203a21c1-0897-49e7-a0b3-deab8820e8ca None None] Killing children. {{(pid=73655) stop /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:616}} Feb 25 15:50:50 devstack cinder-volume[73655]: INFO oslo_service.backend._eventlet.service [None req-203a21c1-0897-49e7-a0b3-deab8820e8ca None None] Waiting on 1 children to exit Feb 25 15:50:52 devstack cinder-volume[73755]: DEBUG oslo_concurrency.lockutils [None req-203a21c1-0897-49e7-a0b3-deab8820e8ca None None] Acquiring lock "singleton_lock" {{(pid=73755) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:390}} Feb 25 15:50:52 devstack cinder-volume[73755]: DEBUG oslo_concurrency.lockutils [None req-203a21c1-0897-49e7-a0b3-deab8820e8ca None None] Acquired lock "singleton_lock" {{(pid=73755) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:393}} Feb 25 15:50:52 devstack cinder-volume[73755]: DEBUG oslo_concurrency.lockutils [None req-203a21c1-0897-49e7-a0b3-deab8820e8ca None None] Releasing lock "singleton_lock" {{(pid=73755) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:413}} Feb 25 15:50:52 devstack cinder-volume[73755]: WARNING amqp [None req-203a21c1-0897-49e7-a0b3-deab8820e8ca None None] Received method (60, 30) during closing channel 1. This method will be ignored Feb 25 15:50:52 devstack cinder-volume[73755]: WARNING amqp [None req-203a21c1-0897-49e7-a0b3-deab8820e8ca None None] Received method (60, 30) during closing channel 1. This method will be ignored Feb 25 15:50:52 devstack cinder-volume[73655]: INFO oslo_service.backend._eventlet.service [None req-203a21c1-0897-49e7-a0b3-deab8820e8ca None None] Child 73755 exited with status 0 Feb 25 15:50:54 devstack cinder-volume[82975]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=82975) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:390}} Feb 25 15:50:54 devstack cinder-volume[82975]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=82975) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:393}} Feb 25 15:50:54 devstack cinder-volume[82975]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=82975) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:413}} Feb 25 15:50:55 devstack cinder-volume[82975]: INFO dbcounter [None req-8ff9f6e9-a9a0-4cb9-9233-6f0d297a23ef None None] Registered counter for database cinder Feb 25 15:50:55 devstack cinder-volume[82975]: DEBUG oslo_db.sqlalchemy.engines [None req-8ff9f6e9-a9a0-4cb9-9233-6f0d297a23ef None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=82975) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}} Feb 25 15:50:55 devstack cinder-volume[82975]: DEBUG dbcounter [-] [82975] Writer thread running {{(pid=82975) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:102}} Feb 25 15:50:55 devstack cinder-volume[82975]: INFO cinder.rpc [None req-8ff9f6e9-a9a0-4cb9-9233-6f0d297a23ef None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Feb 25 15:50:55 devstack cinder-volume[82975]: INFO cinder.rpc [None req-8ff9f6e9-a9a0-4cb9-9233-6f0d297a23ef None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Feb 25 15:50:55 devstack cinder-volume[82975]: DEBUG oslo_db.sqlalchemy.engines [None req-8ff9f6e9-a9a0-4cb9-9233-6f0d297a23ef None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=82975) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}} Feb 25 15:50:55 devstack cinder-volume[82975]: INFO cinder.volume.manager [None req-8ff9f6e9-a9a0-4cb9-9233-6f0d297a23ef None None] Determined volume DB was empty at startup. Feb 25 15:50:55 devstack cinder-volume[82975]: DEBUG cinder.volume.manager [None req-8ff9f6e9-a9a0-4cb9-9233-6f0d297a23ef None None] Cinder Volume DB check: vol_db_empty=True {{(pid=82975) __init__ /opt/stack/cinder/cinder/volume/manager.py:288}} Feb 25 15:50:55 devstack cinder-volume[82975]: INFO cinder.volume.manager [None req-8ff9f6e9-a9a0-4cb9-9233-6f0d297a23ef None None] Service not found for updating active_backend_id, assuming default for driver init. Feb 25 15:50:55 devstack cinder-volume[82975]: WARNING stevedore.named [None req-8ff9f6e9-a9a0-4cb9-9233-6f0d297a23ef None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Feb 25 15:50:55 devstack cinder-volume[82975]: WARNING castellan.key_manager [None req-8ff9f6e9-a9a0-4cb9-9233-6f0d297a23ef None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Feb 25 15:50:55 devstack cinder-volume[82975]: WARNING cinder.keymgr.conf_key_mgr [None req-8ff9f6e9-a9a0-4cb9-9233-6f0d297a23ef None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Feb 25 15:50:55 devstack cinder-volume[82975]: INFO cinder.volume.manager [None req-8ff9f6e9-a9a0-4cb9-9233-6f0d297a23ef None None] Image-volume cache disabled for host devstack@QuobyteHD. Feb 25 15:50:55 devstack cinder-volume[82975]: DEBUG oslo_db.sqlalchemy.engines [None req-8ff9f6e9-a9a0-4cb9-9233-6f0d297a23ef None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=82975) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}} Feb 25 15:50:55 devstack cinder-volume[82975]: INFO oslo_service.backend._eventlet.service [None req-8ff9f6e9-a9a0-4cb9-9233-6f0d297a23ef None None] Starting 1 workers Feb 25 15:50:55 devstack cinder-volume[82975]: DEBUG oslo_service.backend._eventlet.service [None req-8ff9f6e9-a9a0-4cb9-9233-6f0d297a23ef None None] Started child 83095 {{(pid=82975) _start_child /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:491}} Feb 25 15:50:55 devstack cinder-volume[82975]: DEBUG oslo_service.backend._eventlet.service [None req-8ff9f6e9-a9a0-4cb9-9233-6f0d297a23ef None None] Full set of CONF: {{(pid=82975) wait /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:565}} Feb 25 15:50:55 devstack cinder-volume[82975]: DEBUG oslo_service.backend._eventlet.service [None req-8ff9f6e9-a9a0-4cb9-9233-6f0d297a23ef None None] ******************************************************************************** {{(pid=82975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2979}} Feb 25 15:50:55 devstack cinder-volume[82975]: DEBUG oslo_service.backend._eventlet.service [None req-8ff9f6e9-a9a0-4cb9-9233-6f0d297a23ef None None] Configuration options gathered from: {{(pid=82975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2980}} Feb 25 15:50:55 devstack cinder-volume[82975]: DEBUG oslo_service.backend._eventlet.service [None req-8ff9f6e9-a9a0-4cb9-9233-6f0d297a23ef None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=82975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2981}} Feb 25 15:50:55 devstack cinder-volume[83095]: INFO cinder.service [-] Starting cinder-volume node (version 27.1.0) Feb 25 15:50:55 devstack cinder-volume[82975]: DEBUG oslo_service.backend._eventlet.service [None req-8ff9f6e9-a9a0-4cb9-9233-6f0d297a23ef None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=82975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2982}} Feb 25 15:50:55 devstack cinder-volume[82975]: DEBUG oslo_service.backend._eventlet.service [None req-8ff9f6e9-a9a0-4cb9-9233-6f0d297a23ef None None] ================================================================================ {{(pid=82975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2987}} Feb 25 15:50:55 devstack cinder-volume[82975]: DEBUG oslo_service.backend._eventlet.service [None req-8ff9f6e9-a9a0-4cb9-9233-6f0d297a23ef None None] allow_availability_zone_fallback = False {{(pid=82975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 25 15:50:55 devstack cinder-volume[82975]: DEBUG oslo_service.backend._eventlet.service [None req-8ff9f6e9-a9a0-4cb9-9233-6f0d297a23ef None None] allow_compression_on_image_upload = False {{(pid=82975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 25 15:50:55 devstack cinder-volume[82975]: DEBUG oslo_service.backend._eventlet.service [None req-8ff9f6e9-a9a0-4cb9-9233-6f0d297a23ef None None] allowed_direct_url_schemes = [] {{(pid=82975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 25 15:50:55 devstack cinder-volume[82975]: DEBUG oslo_service.backend._eventlet.service [None req-8ff9f6e9-a9a0-4cb9-9233-6f0d297a23ef None None] api_rate_limit = True {{(pid=82975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 25 15:50:55 devstack cinder-volume[82975]: DEBUG oslo_service.backend._eventlet.service [None req-8ff9f6e9-a9a0-4cb9-9233-6f0d297a23ef None None] auth_strategy = keystone {{(pid=82975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 25 15:50:55 devstack cinder-volume[82975]: DEBUG oslo_service.backend._eventlet.service [None req-8ff9f6e9-a9a0-4cb9-9233-6f0d297a23ef None None] backend_availability_zone = None {{(pid=82975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 25 15:50:55 devstack cinder-volume[82975]: DEBUG oslo_service.backend._eventlet.service [None req-8ff9f6e9-a9a0-4cb9-9233-6f0d297a23ef None None] backend_host = None {{(pid=82975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 25 15:50:55 devstack cinder-volume[82975]: DEBUG oslo_service.backend._eventlet.service [None req-8ff9f6e9-a9a0-4cb9-9233-6f0d297a23ef None None] backend_name = None {{(pid=82975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 25 15:50:55 devstack cinder-volume[82975]: DEBUG oslo_service.backend._eventlet.service [None req-8ff9f6e9-a9a0-4cb9-9233-6f0d297a23ef None None] backend_stats_polling_interval = 60 {{(pid=82975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 25 15:50:55 devstack cinder-volume[82975]: DEBUG oslo_service.backend._eventlet.service [None req-8ff9f6e9-a9a0-4cb9-9233-6f0d297a23ef None None] backup_api_class = cinder.backup.api.API {{(pid=82975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 25 15:50:55 devstack cinder-volume[82975]: DEBUG oslo_service.backend._eventlet.service [None req-8ff9f6e9-a9a0-4cb9-9233-6f0d297a23ef None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=82975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 25 15:50:55 devstack cinder-volume[82975]: DEBUG oslo_service.backend._eventlet.service [None req-8ff9f6e9-a9a0-4cb9-9233-6f0d297a23ef None None] backup_name_template = backup-%s {{(pid=82975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 25 15:50:55 devstack cinder-volume[82975]: DEBUG oslo_service.backend._eventlet.service [None req-8ff9f6e9-a9a0-4cb9-9233-6f0d297a23ef None None] backup_use_same_host = False {{(pid=82975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 25 15:50:55 devstack cinder-volume[82975]: DEBUG oslo_service.backend._eventlet.service [None req-8ff9f6e9-a9a0-4cb9-9233-6f0d297a23ef None None] backup_use_temp_snapshot = False {{(pid=82975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 25 15:50:55 devstack cinder-volume[82975]: DEBUG oslo_service.backend._eventlet.service [None req-8ff9f6e9-a9a0-4cb9-9233-6f0d297a23ef None None] chap_password = **** {{(pid=82975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 25 15:50:55 devstack cinder-volume[82975]: DEBUG oslo_service.backend._eventlet.service [None req-8ff9f6e9-a9a0-4cb9-9233-6f0d297a23ef None None] chap_username = {{(pid=82975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 25 15:50:55 devstack cinder-volume[82975]: DEBUG oslo_service.backend._eventlet.service [None req-8ff9f6e9-a9a0-4cb9-9233-6f0d297a23ef None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=82975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 25 15:50:55 devstack cinder-volume[82975]: DEBUG oslo_service.backend._eventlet.service [None req-8ff9f6e9-a9a0-4cb9-9233-6f0d297a23ef None None] cinder_internal_tenant_project_id = 9bff5ba497904e8c9c68bb7bb7d98a5e {{(pid=82975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 25 15:50:55 devstack cinder-volume[82975]: DEBUG oslo_service.backend._eventlet.service [None req-8ff9f6e9-a9a0-4cb9-9233-6f0d297a23ef None None] cinder_internal_tenant_user_id = cdb38ed6699347eb86cca2ce6a17cfb5 {{(pid=82975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 25 15:50:55 devstack cinder-volume[82975]: DEBUG oslo_service.backend._eventlet.service [None req-8ff9f6e9-a9a0-4cb9-9233-6f0d297a23ef None None] cluster = None {{(pid=82975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 25 15:50:55 devstack cinder-volume[82975]: DEBUG oslo_service.backend._eventlet.service [None req-8ff9f6e9-a9a0-4cb9-9233-6f0d297a23ef None None] compression_format = gzip {{(pid=82975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 25 15:50:55 devstack cinder-volume[82975]: DEBUG oslo_service.backend._eventlet.service [None req-8ff9f6e9-a9a0-4cb9-9233-6f0d297a23ef None None] compute_api_class = cinder.compute.nova.API {{(pid=82975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 25 15:50:55 devstack cinder-volume[82975]: DEBUG oslo_service.backend._eventlet.service [None req-8ff9f6e9-a9a0-4cb9-9233-6f0d297a23ef None None] config_dir = [] {{(pid=82975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 25 15:50:55 devstack cinder-volume[82975]: DEBUG oslo_service.backend._eventlet.service [None req-8ff9f6e9-a9a0-4cb9-9233-6f0d297a23ef None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=82975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 25 15:50:55 devstack cinder-volume[82975]: DEBUG oslo_service.backend._eventlet.service [None req-8ff9f6e9-a9a0-4cb9-9233-6f0d297a23ef None None] config_source = [] {{(pid=82975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 25 15:50:55 devstack cinder-volume[82975]: DEBUG oslo_service.backend._eventlet.service [None req-8ff9f6e9-a9a0-4cb9-9233-6f0d297a23ef None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=82975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 25 15:50:55 devstack cinder-volume[82975]: DEBUG oslo_service.backend._eventlet.service [None req-8ff9f6e9-a9a0-4cb9-9233-6f0d297a23ef None None] control_exchange = openstack {{(pid=82975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 25 15:50:55 devstack cinder-volume[82975]: DEBUG oslo_service.backend._eventlet.service [None req-8ff9f6e9-a9a0-4cb9-9233-6f0d297a23ef None None] debug = True {{(pid=82975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 25 15:50:55 devstack cinder-volume[82975]: DEBUG oslo_service.backend._eventlet.service [None req-8ff9f6e9-a9a0-4cb9-9233-6f0d297a23ef None None] default_availability_zone = None {{(pid=82975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 25 15:50:55 devstack cinder-volume[82975]: DEBUG oslo_service.backend._eventlet.service [None req-8ff9f6e9-a9a0-4cb9-9233-6f0d297a23ef None None] default_group_type = None {{(pid=82975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 25 15:50:55 devstack cinder-volume[82975]: DEBUG oslo_service.backend._eventlet.service [None req-8ff9f6e9-a9a0-4cb9-9233-6f0d297a23ef None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=82975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 25 15:50:55 devstack cinder-volume[82975]: DEBUG oslo_service.backend._eventlet.service [None req-8ff9f6e9-a9a0-4cb9-9233-6f0d297a23ef None None] default_volume_type = QuobyteHD {{(pid=82975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 25 15:50:55 devstack cinder-volume[82975]: DEBUG oslo_service.backend._eventlet.service [None req-8ff9f6e9-a9a0-4cb9-9233-6f0d297a23ef None None] disk_geometry = None {{(pid=82975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 25 15:50:55 devstack cinder-volume[82975]: DEBUG oslo_service.backend._eventlet.service [None req-8ff9f6e9-a9a0-4cb9-9233-6f0d297a23ef None None] driver_client_cert = None {{(pid=82975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 25 15:50:55 devstack cinder-volume[82975]: DEBUG oslo_service.backend._eventlet.service [None req-8ff9f6e9-a9a0-4cb9-9233-6f0d297a23ef None None] driver_client_cert_key = None {{(pid=82975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 25 15:50:55 devstack cinder-volume[82975]: DEBUG oslo_service.backend._eventlet.service [None req-8ff9f6e9-a9a0-4cb9-9233-6f0d297a23ef None None] driver_data_namespace = None {{(pid=82975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 25 15:50:55 devstack cinder-volume[82975]: DEBUG oslo_service.backend._eventlet.service [None req-8ff9f6e9-a9a0-4cb9-9233-6f0d297a23ef None None] driver_ssl_cert_path = None {{(pid=82975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 25 15:50:55 devstack cinder-volume[82975]: DEBUG oslo_service.backend._eventlet.service [None req-8ff9f6e9-a9a0-4cb9-9233-6f0d297a23ef None None] driver_ssl_cert_verify = False {{(pid=82975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 25 15:50:55 devstack cinder-volume[82975]: DEBUG oslo_service.backend._eventlet.service [None req-8ff9f6e9-a9a0-4cb9-9233-6f0d297a23ef None None] driver_use_ssl = False {{(pid=82975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 25 15:50:55 devstack cinder-volume[82975]: DEBUG oslo_service.backend._eventlet.service [None req-8ff9f6e9-a9a0-4cb9-9233-6f0d297a23ef None None] enable_new_services = True {{(pid=82975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 25 15:50:55 devstack cinder-volume[82975]: DEBUG oslo_service.backend._eventlet.service [None req-8ff9f6e9-a9a0-4cb9-9233-6f0d297a23ef None None] enable_unsupported_driver = False {{(pid=82975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 25 15:50:55 devstack cinder-volume[82975]: DEBUG oslo_service.backend._eventlet.service [None req-8ff9f6e9-a9a0-4cb9-9233-6f0d297a23ef None None] enabled_backends = ['QuobyteHD'] {{(pid=82975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 25 15:50:55 devstack cinder-volume[82975]: DEBUG oslo_service.backend._eventlet.service [None req-8ff9f6e9-a9a0-4cb9-9233-6f0d297a23ef None None] enforce_multipath_for_image_xfer = False {{(pid=82975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 25 15:50:55 devstack cinder-volume[82975]: DEBUG oslo_service.backend._eventlet.service [None req-8ff9f6e9-a9a0-4cb9-9233-6f0d297a23ef None None] filter_function = None {{(pid=82975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 25 15:50:55 devstack cinder-volume[83095]: INFO cinder.volume.manager [None req-4f722c8d-1eb6-48b5-b14c-0ab78036b384 None None] Starting volume driver QuobyteDriver (1.1.14) Feb 25 15:50:55 devstack cinder-volume[82975]: DEBUG oslo_service.backend._eventlet.service [None req-8ff9f6e9-a9a0-4cb9-9233-6f0d297a23ef None None] glance_api_insecure = False {{(pid=82975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 25 15:50:55 devstack cinder-volume[82975]: DEBUG oslo_service.backend._eventlet.service [None req-8ff9f6e9-a9a0-4cb9-9233-6f0d297a23ef None None] glance_api_servers = ['http://192.168.122.119/image'] {{(pid=82975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 25 15:50:55 devstack cinder-volume[82975]: DEBUG oslo_service.backend._eventlet.service [None req-8ff9f6e9-a9a0-4cb9-9233-6f0d297a23ef None None] glance_api_ssl_compression = False {{(pid=82975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 25 15:50:55 devstack cinder-volume[83095]: DEBUG cinder.volume.drivers.remotefs [None req-4f722c8d-1eb6-48b5-b14c-0ab78036b384 None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=83095) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}} Feb 25 15:50:55 devstack cinder-volume[82975]: DEBUG oslo_service.backend._eventlet.service [None req-8ff9f6e9-a9a0-4cb9-9233-6f0d297a23ef None None] glance_ca_certificates_file = None {{(pid=82975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 25 15:50:55 devstack cinder-volume[82975]: DEBUG oslo_service.backend._eventlet.service [None req-8ff9f6e9-a9a0-4cb9-9233-6f0d297a23ef None None] glance_catalog_info = image:glance:publicURL {{(pid=82975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 25 15:50:55 devstack cinder-volume[82975]: DEBUG oslo_service.backend._eventlet.service [None req-8ff9f6e9-a9a0-4cb9-9233-6f0d297a23ef None None] glance_certfile = None {{(pid=82975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 25 15:50:55 devstack cinder-volume[82975]: DEBUG oslo_service.backend._eventlet.service [None req-8ff9f6e9-a9a0-4cb9-9233-6f0d297a23ef None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=82975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 25 15:50:55 devstack cinder-volume[82975]: DEBUG oslo_service.backend._eventlet.service [None req-8ff9f6e9-a9a0-4cb9-9233-6f0d297a23ef None None] glance_keyfile = None {{(pid=82975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 25 15:50:55 devstack cinder-volume[82975]: DEBUG oslo_service.backend._eventlet.service [None req-8ff9f6e9-a9a0-4cb9-9233-6f0d297a23ef None None] glance_num_retries = 3 {{(pid=82975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 25 15:50:55 devstack cinder-volume[82975]: DEBUG oslo_service.backend._eventlet.service [None req-8ff9f6e9-a9a0-4cb9-9233-6f0d297a23ef None None] glance_request_timeout = None {{(pid=82975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 25 15:50:55 devstack cinder-volume[82975]: DEBUG oslo_service.backend._eventlet.service [None req-8ff9f6e9-a9a0-4cb9-9233-6f0d297a23ef None None] goodness_function = None {{(pid=82975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 25 15:50:55 devstack cinder-volume[82975]: DEBUG oslo_service.backend._eventlet.service [None req-8ff9f6e9-a9a0-4cb9-9233-6f0d297a23ef None None] graceful_shutdown_timeout = 5 {{(pid=82975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 25 15:50:55 devstack cinder-volume[82975]: DEBUG oslo_service.backend._eventlet.service [None req-8ff9f6e9-a9a0-4cb9-9233-6f0d297a23ef None None] group_api_class = cinder.group.api.API {{(pid=82975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 25 15:50:55 devstack cinder-volume[82975]: DEBUG oslo_service.backend._eventlet.service [None req-8ff9f6e9-a9a0-4cb9-9233-6f0d297a23ef None None] host = devstack {{(pid=82975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 25 15:50:55 devstack cinder-volume[82975]: DEBUG oslo_service.backend._eventlet.service [None req-8ff9f6e9-a9a0-4cb9-9233-6f0d297a23ef None None] image_compress_on_upload = True {{(pid=82975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 25 15:50:55 devstack cinder-volume[82975]: DEBUG oslo_service.backend._eventlet.service [None req-8ff9f6e9-a9a0-4cb9-9233-6f0d297a23ef None None] image_conversion_address_space_limit = 1 {{(pid=82975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 25 15:50:55 devstack cinder-volume[82975]: DEBUG oslo_service.backend._eventlet.service [None req-8ff9f6e9-a9a0-4cb9-9233-6f0d297a23ef None None] image_conversion_cpu_limit = 60 {{(pid=82975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 25 15:50:55 devstack cinder-volume[82975]: DEBUG oslo_service.backend._eventlet.service [None req-8ff9f6e9-a9a0-4cb9-9233-6f0d297a23ef None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=82975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 25 15:50:55 devstack cinder-volume[82975]: DEBUG oslo_service.backend._eventlet.service [None req-8ff9f6e9-a9a0-4cb9-9233-6f0d297a23ef None None] image_conversion_disable = False {{(pid=82975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 25 15:50:55 devstack cinder-volume[82975]: DEBUG oslo_service.backend._eventlet.service [None req-8ff9f6e9-a9a0-4cb9-9233-6f0d297a23ef None None] image_upload_use_cinder_backend = False {{(pid=82975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 25 15:50:55 devstack cinder-volume[82975]: DEBUG oslo_service.backend._eventlet.service [None req-8ff9f6e9-a9a0-4cb9-9233-6f0d297a23ef None None] image_upload_use_internal_tenant = False {{(pid=82975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 25 15:50:55 devstack cinder-volume[82975]: DEBUG oslo_service.backend._eventlet.service [None req-8ff9f6e9-a9a0-4cb9-9233-6f0d297a23ef None None] image_volume_cache_enabled = False {{(pid=82975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 25 15:50:55 devstack cinder-volume[82975]: DEBUG oslo_service.backend._eventlet.service [None req-8ff9f6e9-a9a0-4cb9-9233-6f0d297a23ef None None] image_volume_cache_max_count = 0 {{(pid=82975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 25 15:50:55 devstack cinder-volume[82975]: DEBUG oslo_service.backend._eventlet.service [None req-8ff9f6e9-a9a0-4cb9-9233-6f0d297a23ef None None] image_volume_cache_max_size_gb = 0 {{(pid=82975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 25 15:50:55 devstack cinder-volume[82975]: DEBUG oslo_service.backend._eventlet.service [None req-8ff9f6e9-a9a0-4cb9-9233-6f0d297a23ef None None] init_host_max_objects_retrieval = 0 {{(pid=82975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 25 15:50:55 devstack cinder-volume[82975]: DEBUG oslo_service.backend._eventlet.service [None req-8ff9f6e9-a9a0-4cb9-9233-6f0d297a23ef None None] instance_format = [instance: %(uuid)s] {{(pid=82975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 25 15:50:55 devstack cinder-volume[82975]: DEBUG oslo_service.backend._eventlet.service [None req-8ff9f6e9-a9a0-4cb9-9233-6f0d297a23ef None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=82975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 25 15:50:55 devstack cinder-volume[82975]: DEBUG oslo_service.backend._eventlet.service [None req-8ff9f6e9-a9a0-4cb9-9233-6f0d297a23ef None None] iscsi_target_flags = {{(pid=82975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 25 15:50:55 devstack cinder-volume[82975]: DEBUG oslo_service.backend._eventlet.service [None req-8ff9f6e9-a9a0-4cb9-9233-6f0d297a23ef None None] iscsi_write_cache = on {{(pid=82975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 25 15:50:55 devstack cinder-volume[82975]: DEBUG oslo_service.backend._eventlet.service [None req-8ff9f6e9-a9a0-4cb9-9233-6f0d297a23ef None None] iser_helper = tgtadm {{(pid=82975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 25 15:50:55 devstack cinder-volume[82975]: DEBUG oslo_service.backend._eventlet.service [None req-8ff9f6e9-a9a0-4cb9-9233-6f0d297a23ef None None] iser_ip_address = 192.168.122.119 {{(pid=82975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 25 15:50:55 devstack cinder-volume[82975]: DEBUG oslo_service.backend._eventlet.service [None req-8ff9f6e9-a9a0-4cb9-9233-6f0d297a23ef None None] iser_port = 3260 {{(pid=82975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 25 15:50:55 devstack cinder-volume[82975]: DEBUG oslo_service.backend._eventlet.service [None req-8ff9f6e9-a9a0-4cb9-9233-6f0d297a23ef None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=82975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 25 15:50:55 devstack cinder-volume[82975]: DEBUG oslo_service.backend._eventlet.service [None req-8ff9f6e9-a9a0-4cb9-9233-6f0d297a23ef None None] log_color = False {{(pid=82975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 25 15:50:55 devstack cinder-volume[82975]: DEBUG oslo_service.backend._eventlet.service [None req-8ff9f6e9-a9a0-4cb9-9233-6f0d297a23ef None None] log_config_append = None {{(pid=82975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 25 15:50:55 devstack cinder-volume[82975]: DEBUG oslo_service.backend._eventlet.service [None req-8ff9f6e9-a9a0-4cb9-9233-6f0d297a23ef None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=82975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 25 15:50:55 devstack cinder-volume[82975]: DEBUG oslo_service.backend._eventlet.service [None req-8ff9f6e9-a9a0-4cb9-9233-6f0d297a23ef None None] log_dir = None {{(pid=82975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 25 15:50:55 devstack cinder-volume[82975]: DEBUG oslo_service.backend._eventlet.service [None req-8ff9f6e9-a9a0-4cb9-9233-6f0d297a23ef None None] log_file = None {{(pid=82975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 25 15:50:55 devstack cinder-volume[82975]: DEBUG oslo_service.backend._eventlet.service [None req-8ff9f6e9-a9a0-4cb9-9233-6f0d297a23ef None None] log_options = True {{(pid=82975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 25 15:50:55 devstack cinder-volume[82975]: DEBUG oslo_service.backend._eventlet.service [None req-8ff9f6e9-a9a0-4cb9-9233-6f0d297a23ef None None] log_rotate_interval = 1 {{(pid=82975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 25 15:50:55 devstack cinder-volume[82975]: DEBUG oslo_service.backend._eventlet.service [None req-8ff9f6e9-a9a0-4cb9-9233-6f0d297a23ef None None] log_rotate_interval_type = days {{(pid=82975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 25 15:50:55 devstack cinder-volume[82975]: DEBUG oslo_service.backend._eventlet.service [None req-8ff9f6e9-a9a0-4cb9-9233-6f0d297a23ef None None] log_rotation_type = none {{(pid=82975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 25 15:50:55 devstack cinder-volume[82975]: DEBUG oslo_service.backend._eventlet.service [None req-8ff9f6e9-a9a0-4cb9-9233-6f0d297a23ef None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=82975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 25 15:50:55 devstack cinder-volume[82975]: DEBUG oslo_service.backend._eventlet.service [None req-8ff9f6e9-a9a0-4cb9-9233-6f0d297a23ef None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=82975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 25 15:50:55 devstack cinder-volume[82975]: DEBUG oslo_service.backend._eventlet.service [None req-8ff9f6e9-a9a0-4cb9-9233-6f0d297a23ef None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=82975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 25 15:50:55 devstack cinder-volume[82975]: DEBUG oslo_service.backend._eventlet.service [None req-8ff9f6e9-a9a0-4cb9-9233-6f0d297a23ef None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=82975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 25 15:50:55 devstack cinder-volume[82975]: DEBUG oslo_service.backend._eventlet.service [None req-8ff9f6e9-a9a0-4cb9-9233-6f0d297a23ef None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=82975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 25 15:50:55 devstack cinder-volume[82975]: DEBUG oslo_service.backend._eventlet.service [None req-8ff9f6e9-a9a0-4cb9-9233-6f0d297a23ef None None] max_age = 0 {{(pid=82975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 25 15:50:55 devstack cinder-volume[82975]: DEBUG oslo_service.backend._eventlet.service [None req-8ff9f6e9-a9a0-4cb9-9233-6f0d297a23ef None None] max_logfile_count = 30 {{(pid=82975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 25 15:50:55 devstack cinder-volume[82975]: DEBUG oslo_service.backend._eventlet.service [None req-8ff9f6e9-a9a0-4cb9-9233-6f0d297a23ef None None] max_logfile_size_mb = 200 {{(pid=82975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 25 15:50:55 devstack cinder-volume[82975]: DEBUG oslo_service.backend._eventlet.service [None req-8ff9f6e9-a9a0-4cb9-9233-6f0d297a23ef None None] max_over_subscription_ratio = 20.0 {{(pid=82975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 25 15:50:55 devstack cinder-volume[82975]: DEBUG oslo_service.backend._eventlet.service [None req-8ff9f6e9-a9a0-4cb9-9233-6f0d297a23ef None None] message_reap_interval = 86400 {{(pid=82975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 25 15:50:55 devstack cinder-volume[82975]: DEBUG oslo_service.backend._eventlet.service [None req-8ff9f6e9-a9a0-4cb9-9233-6f0d297a23ef None None] message_ttl = 2592000 {{(pid=82975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 25 15:50:55 devstack cinder-volume[82975]: DEBUG oslo_service.backend._eventlet.service [None req-8ff9f6e9-a9a0-4cb9-9233-6f0d297a23ef None None] migration_create_volume_timeout_secs = 300 {{(pid=82975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 25 15:50:55 devstack cinder-volume[82975]: DEBUG oslo_service.backend._eventlet.service [None req-8ff9f6e9-a9a0-4cb9-9233-6f0d297a23ef None None] monkey_patch = False {{(pid=82975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 25 15:50:55 devstack cinder-volume[82975]: DEBUG oslo_service.backend._eventlet.service [None req-8ff9f6e9-a9a0-4cb9-9233-6f0d297a23ef None None] monkey_patch_modules = [] {{(pid=82975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 25 15:50:55 devstack cinder-volume[82975]: DEBUG oslo_service.backend._eventlet.service [None req-8ff9f6e9-a9a0-4cb9-9233-6f0d297a23ef None None] my_ip = 192.168.122.119 {{(pid=82975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 25 15:50:55 devstack cinder-volume[82975]: DEBUG oslo_service.backend._eventlet.service [None req-8ff9f6e9-a9a0-4cb9-9233-6f0d297a23ef None None] no_snapshot_gb_quota = False {{(pid=82975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 25 15:50:55 devstack cinder-volume[82975]: DEBUG oslo_service.backend._eventlet.service [None req-8ff9f6e9-a9a0-4cb9-9233-6f0d297a23ef None None] num_iser_scan_tries = 3 {{(pid=82975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 25 15:50:55 devstack cinder-volume[82975]: DEBUG oslo_service.backend._eventlet.service [None req-8ff9f6e9-a9a0-4cb9-9233-6f0d297a23ef None None] num_shell_tries = 3 {{(pid=82975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 25 15:50:55 devstack cinder-volume[82975]: DEBUG oslo_service.backend._eventlet.service [None req-8ff9f6e9-a9a0-4cb9-9233-6f0d297a23ef None None] num_volume_device_scan_tries = 3 {{(pid=82975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 25 15:50:55 devstack cinder-volume[82975]: DEBUG oslo_service.backend._eventlet.service [None req-8ff9f6e9-a9a0-4cb9-9233-6f0d297a23ef None None] nvmeof_conn_info_version = 1 {{(pid=82975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 25 15:50:55 devstack cinder-volume[82975]: DEBUG oslo_service.backend._eventlet.service [None req-8ff9f6e9-a9a0-4cb9-9233-6f0d297a23ef None None] nvmet_ns_id = 10 {{(pid=82975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 25 15:50:55 devstack cinder-volume[82975]: DEBUG oslo_service.backend._eventlet.service [None req-8ff9f6e9-a9a0-4cb9-9233-6f0d297a23ef None None] nvmet_port_id = 1 {{(pid=82975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 25 15:50:55 devstack cinder-volume[82975]: DEBUG oslo_service.backend._eventlet.service [None req-8ff9f6e9-a9a0-4cb9-9233-6f0d297a23ef None None] osapi_max_limit = 1000 {{(pid=82975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 25 15:50:55 devstack cinder-volume[82975]: DEBUG oslo_service.backend._eventlet.service [None req-8ff9f6e9-a9a0-4cb9-9233-6f0d297a23ef None None] osapi_volume_ext_list = [] {{(pid=82975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 25 15:50:55 devstack cinder-volume[82975]: DEBUG oslo_service.backend._eventlet.service [None req-8ff9f6e9-a9a0-4cb9-9233-6f0d297a23ef None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=82975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 25 15:50:55 devstack cinder-volume[82975]: DEBUG oslo_service.backend._eventlet.service [None req-8ff9f6e9-a9a0-4cb9-9233-6f0d297a23ef None None] osapi_volume_listen = 0.0.0.0 {{(pid=82975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 25 15:50:55 devstack cinder-volume[82975]: DEBUG oslo_service.backend._eventlet.service [None req-8ff9f6e9-a9a0-4cb9-9233-6f0d297a23ef None None] osapi_volume_listen_port = 8776 {{(pid=82975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 25 15:50:55 devstack cinder-volume[82975]: DEBUG oslo_service.backend._eventlet.service [None req-8ff9f6e9-a9a0-4cb9-9233-6f0d297a23ef None None] osapi_volume_use_ssl = False {{(pid=82975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 25 15:50:55 devstack cinder-volume[82975]: DEBUG oslo_service.backend._eventlet.service [None req-8ff9f6e9-a9a0-4cb9-9233-6f0d297a23ef None None] osapi_volume_workers = 2 {{(pid=82975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 25 15:50:55 devstack cinder-volume[82975]: DEBUG oslo_service.backend._eventlet.service [None req-8ff9f6e9-a9a0-4cb9-9233-6f0d297a23ef None None] per_volume_size_limit = -1 {{(pid=82975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 25 15:50:55 devstack cinder-volume[82975]: DEBUG oslo_service.backend._eventlet.service [None req-8ff9f6e9-a9a0-4cb9-9233-6f0d297a23ef None None] periodic_fuzzy_delay = 60 {{(pid=82975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 25 15:50:55 devstack cinder-volume[82975]: DEBUG oslo_service.backend._eventlet.service [None req-8ff9f6e9-a9a0-4cb9-9233-6f0d297a23ef None None] periodic_interval = 60 {{(pid=82975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 25 15:50:55 devstack cinder-volume[82975]: DEBUG oslo_service.backend._eventlet.service [None req-8ff9f6e9-a9a0-4cb9-9233-6f0d297a23ef None None] project_id_regex = [0-9a-f\-]+ {{(pid=82975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 25 15:50:55 devstack cinder-volume[82975]: DEBUG oslo_service.backend._eventlet.service [None req-8ff9f6e9-a9a0-4cb9-9233-6f0d297a23ef None None] public_endpoint = None {{(pid=82975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 25 15:50:55 devstack cinder-volume[82975]: DEBUG oslo_service.backend._eventlet.service [None req-8ff9f6e9-a9a0-4cb9-9233-6f0d297a23ef None None] publish_errors = False {{(pid=82975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 25 15:50:55 devstack cinder-volume[82975]: DEBUG oslo_service.backend._eventlet.service [None req-8ff9f6e9-a9a0-4cb9-9233-6f0d297a23ef None None] quota_backup_gigabytes = 1000 {{(pid=82975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 25 15:50:55 devstack cinder-volume[82975]: DEBUG oslo_service.backend._eventlet.service [None req-8ff9f6e9-a9a0-4cb9-9233-6f0d297a23ef None None] quota_backups = 10 {{(pid=82975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 25 15:50:55 devstack cinder-volume[82975]: DEBUG oslo_service.backend._eventlet.service [None req-8ff9f6e9-a9a0-4cb9-9233-6f0d297a23ef None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=82975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 25 15:50:55 devstack cinder-volume[82975]: DEBUG oslo_service.backend._eventlet.service [None req-8ff9f6e9-a9a0-4cb9-9233-6f0d297a23ef None None] quota_gigabytes = 1000 {{(pid=82975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 25 15:50:55 devstack cinder-volume[82975]: DEBUG oslo_service.backend._eventlet.service [None req-8ff9f6e9-a9a0-4cb9-9233-6f0d297a23ef None None] quota_groups = 10 {{(pid=82975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 25 15:50:55 devstack cinder-volume[82975]: DEBUG oslo_service.backend._eventlet.service [None req-8ff9f6e9-a9a0-4cb9-9233-6f0d297a23ef None None] quota_snapshots = 10 {{(pid=82975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 25 15:50:55 devstack cinder-volume[82975]: DEBUG oslo_service.backend._eventlet.service [None req-8ff9f6e9-a9a0-4cb9-9233-6f0d297a23ef None None] quota_volumes = 10 {{(pid=82975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 25 15:50:55 devstack cinder-volume[82975]: DEBUG oslo_service.backend._eventlet.service [None req-8ff9f6e9-a9a0-4cb9-9233-6f0d297a23ef None None] rate_limit_burst = 0 {{(pid=82975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 25 15:50:55 devstack cinder-volume[82975]: DEBUG oslo_service.backend._eventlet.service [None req-8ff9f6e9-a9a0-4cb9-9233-6f0d297a23ef None None] rate_limit_except_level = CRITICAL {{(pid=82975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 25 15:50:55 devstack cinder-volume[82975]: DEBUG oslo_service.backend._eventlet.service [None req-8ff9f6e9-a9a0-4cb9-9233-6f0d297a23ef None None] rate_limit_interval = 0 {{(pid=82975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 25 15:50:55 devstack cinder-volume[82975]: DEBUG oslo_service.backend._eventlet.service [None req-8ff9f6e9-a9a0-4cb9-9233-6f0d297a23ef None None] reinit_driver_count = 3 {{(pid=82975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 25 15:50:55 devstack cinder-volume[82975]: DEBUG oslo_service.backend._eventlet.service [None req-8ff9f6e9-a9a0-4cb9-9233-6f0d297a23ef None None] replication_device = **** {{(pid=82975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 25 15:50:55 devstack cinder-volume[82975]: DEBUG oslo_service.backend._eventlet.service [None req-8ff9f6e9-a9a0-4cb9-9233-6f0d297a23ef None None] report_discard_supported = False {{(pid=82975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 25 15:50:55 devstack cinder-volume[82975]: DEBUG oslo_service.backend._eventlet.service [None req-8ff9f6e9-a9a0-4cb9-9233-6f0d297a23ef None None] report_interval = 120 {{(pid=82975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 25 15:50:55 devstack cinder-volume[82975]: DEBUG oslo_service.backend._eventlet.service [None req-8ff9f6e9-a9a0-4cb9-9233-6f0d297a23ef None None] reservation_clean_interval = 86400 {{(pid=82975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 25 15:50:55 devstack cinder-volume[82975]: DEBUG oslo_service.backend._eventlet.service [None req-8ff9f6e9-a9a0-4cb9-9233-6f0d297a23ef None None] reservation_expire = 86400 {{(pid=82975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 25 15:50:55 devstack cinder-volume[82975]: DEBUG oslo_service.backend._eventlet.service [None req-8ff9f6e9-a9a0-4cb9-9233-6f0d297a23ef None None] reserved_image_namespaces = [] {{(pid=82975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 25 15:50:55 devstack cinder-volume[82975]: DEBUG oslo_service.backend._eventlet.service [None req-8ff9f6e9-a9a0-4cb9-9233-6f0d297a23ef None None] reserved_percentage = 0 {{(pid=82975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 25 15:50:55 devstack cinder-volume[82975]: DEBUG oslo_service.backend._eventlet.service [None req-8ff9f6e9-a9a0-4cb9-9233-6f0d297a23ef None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=82975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 25 15:50:55 devstack cinder-volume[82975]: DEBUG oslo_service.backend._eventlet.service [None req-8ff9f6e9-a9a0-4cb9-9233-6f0d297a23ef None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=82975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 25 15:50:55 devstack cinder-volume[82975]: DEBUG oslo_service.backend._eventlet.service [None req-8ff9f6e9-a9a0-4cb9-9233-6f0d297a23ef None None] rpc_response_timeout = 120 {{(pid=82975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 25 15:50:55 devstack cinder-volume[82975]: DEBUG oslo_service.backend._eventlet.service [None req-8ff9f6e9-a9a0-4cb9-9233-6f0d297a23ef None None] run_external_periodic_tasks = True {{(pid=82975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 25 15:50:55 devstack cinder-volume[82975]: DEBUG oslo_service.backend._eventlet.service [None req-8ff9f6e9-a9a0-4cb9-9233-6f0d297a23ef None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=82975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 25 15:50:55 devstack cinder-volume[82975]: DEBUG oslo_service.backend._eventlet.service [None req-8ff9f6e9-a9a0-4cb9-9233-6f0d297a23ef None None] scst_target_driver = iscsi {{(pid=82975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 25 15:50:55 devstack cinder-volume[83095]: DEBUG cinder.volume.drivers.quobyte [None req-4f722c8d-1eb6-48b5-b14c-0ab78036b384 None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=83095) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:305}} Feb 25 15:50:55 devstack cinder-volume[83095]: WARNING cinder.volume.drivers.quobyte [None req-4f722c8d-1eb6-48b5-b14c-0ab78036b384 None None] The NAS file operations will be run as root, allowing root level access at the storage backend. Feb 25 15:50:55 devstack cinder-volume[83095]: WARNING cinder.volume.drivers.quobyte [None req-4f722c8d-1eb6-48b5-b14c-0ab78036b384 None None] The NAS file permissions mode will be 666 (allowing other/world read & write access). Feb 25 15:50:55 devstack cinder-volume[82975]: DEBUG oslo_service.backend._eventlet.service [None req-8ff9f6e9-a9a0-4cb9-9233-6f0d297a23ef None None] scst_target_iqn_name = None {{(pid=82975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 25 15:50:55 devstack cinder-volume[82975]: DEBUG oslo_service.backend._eventlet.service [None req-8ff9f6e9-a9a0-4cb9-9233-6f0d297a23ef None None] service_down_time = 720 {{(pid=82975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 25 15:50:55 devstack cinder-volume[82975]: DEBUG oslo_service.backend._eventlet.service [None req-8ff9f6e9-a9a0-4cb9-9233-6f0d297a23ef None None] shell_completion = None {{(pid=82975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 25 15:50:55 devstack cinder-volume[83095]: DEBUG oslo_concurrency.processutils [None req-4f722c8d-1eb6-48b5-b14c-0ab78036b384 None None] Running cmd (subprocess): mount.quobyte {{(pid=83095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 25 15:50:55 devstack cinder-volume[82975]: DEBUG oslo_service.backend._eventlet.service [None req-8ff9f6e9-a9a0-4cb9-9233-6f0d297a23ef None None] snapshot_name_template = snapshot-%s {{(pid=82975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 25 15:50:55 devstack cinder-volume[82975]: DEBUG oslo_service.backend._eventlet.service [None req-8ff9f6e9-a9a0-4cb9-9233-6f0d297a23ef None None] split_loggers = False {{(pid=82975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 25 15:50:55 devstack cinder-volume[82975]: DEBUG oslo_service.backend._eventlet.service [None req-8ff9f6e9-a9a0-4cb9-9233-6f0d297a23ef None None] state_path = /opt/stack/data/cinder {{(pid=82975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 25 15:50:55 devstack cinder-volume[82975]: DEBUG oslo_service.backend._eventlet.service [None req-8ff9f6e9-a9a0-4cb9-9233-6f0d297a23ef None None] storage_availability_zone = nova {{(pid=82975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 25 15:50:55 devstack cinder-volume[82975]: DEBUG oslo_service.backend._eventlet.service [None req-8ff9f6e9-a9a0-4cb9-9233-6f0d297a23ef None None] storage_protocol = iSCSI {{(pid=82975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 25 15:50:55 devstack cinder-volume[82975]: DEBUG oslo_service.backend._eventlet.service [None req-8ff9f6e9-a9a0-4cb9-9233-6f0d297a23ef None None] syslog_log_facility = LOG_USER {{(pid=82975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 25 15:50:55 devstack cinder-volume[82975]: DEBUG oslo_service.backend._eventlet.service [None req-8ff9f6e9-a9a0-4cb9-9233-6f0d297a23ef None None] target_helper = lioadm {{(pid=82975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 25 15:50:55 devstack cinder-volume[82975]: DEBUG oslo_service.backend._eventlet.service [None req-8ff9f6e9-a9a0-4cb9-9233-6f0d297a23ef None None] target_ip_address = 192.168.122.119 {{(pid=82975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 25 15:50:55 devstack cinder-volume[82975]: DEBUG oslo_service.backend._eventlet.service [None req-8ff9f6e9-a9a0-4cb9-9233-6f0d297a23ef None None] target_port = 3260 {{(pid=82975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 25 15:50:55 devstack cinder-volume[82975]: DEBUG oslo_service.backend._eventlet.service [None req-8ff9f6e9-a9a0-4cb9-9233-6f0d297a23ef None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=82975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 25 15:50:55 devstack cinder-volume[82975]: DEBUG oslo_service.backend._eventlet.service [None req-8ff9f6e9-a9a0-4cb9-9233-6f0d297a23ef None None] target_protocol = iscsi {{(pid=82975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 25 15:50:55 devstack cinder-volume[82975]: DEBUG oslo_service.backend._eventlet.service [None req-8ff9f6e9-a9a0-4cb9-9233-6f0d297a23ef None None] target_secondary_ip_addresses = [] {{(pid=82975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 25 15:50:55 devstack cinder-volume[82975]: DEBUG oslo_service.backend._eventlet.service [None req-8ff9f6e9-a9a0-4cb9-9233-6f0d297a23ef None None] trace_flags = None {{(pid=82975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 25 15:50:55 devstack cinder-volume[82975]: DEBUG oslo_service.backend._eventlet.service [None req-8ff9f6e9-a9a0-4cb9-9233-6f0d297a23ef None None] transfer_api_class = cinder.transfer.api.API {{(pid=82975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 25 15:50:55 devstack cinder-volume[82975]: DEBUG oslo_service.backend._eventlet.service [None req-8ff9f6e9-a9a0-4cb9-9233-6f0d297a23ef None None] transport_url = **** {{(pid=82975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 25 15:50:55 devstack cinder-volume[82975]: DEBUG oslo_service.backend._eventlet.service [None req-8ff9f6e9-a9a0-4cb9-9233-6f0d297a23ef None None] until_refresh = 0 {{(pid=82975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 25 15:50:55 devstack cinder-volume[82975]: DEBUG oslo_service.backend._eventlet.service [None req-8ff9f6e9-a9a0-4cb9-9233-6f0d297a23ef None None] use_chap_auth = False {{(pid=82975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 25 15:50:55 devstack cinder-volume[82975]: DEBUG oslo_service.backend._eventlet.service [None req-8ff9f6e9-a9a0-4cb9-9233-6f0d297a23ef None None] use_default_quota_class = True {{(pid=82975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 25 15:50:55 devstack cinder-volume[82975]: DEBUG oslo_service.backend._eventlet.service [None req-8ff9f6e9-a9a0-4cb9-9233-6f0d297a23ef None None] use_journal = False {{(pid=82975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 25 15:50:55 devstack cinder-volume[82975]: DEBUG oslo_service.backend._eventlet.service [None req-8ff9f6e9-a9a0-4cb9-9233-6f0d297a23ef None None] use_json = False {{(pid=82975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 25 15:50:55 devstack cinder-volume[82975]: DEBUG oslo_service.backend._eventlet.service [None req-8ff9f6e9-a9a0-4cb9-9233-6f0d297a23ef None None] use_multipath_for_image_xfer = False {{(pid=82975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 25 15:50:55 devstack cinder-volume[82975]: DEBUG oslo_service.backend._eventlet.service [None req-8ff9f6e9-a9a0-4cb9-9233-6f0d297a23ef None None] use_stderr = False {{(pid=82975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 25 15:50:55 devstack cinder-volume[82975]: DEBUG oslo_service.backend._eventlet.service [None req-8ff9f6e9-a9a0-4cb9-9233-6f0d297a23ef None None] use_syslog = False {{(pid=82975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 25 15:50:55 devstack cinder-volume[82975]: DEBUG oslo_service.backend._eventlet.service [None req-8ff9f6e9-a9a0-4cb9-9233-6f0d297a23ef None None] verify_glance_signatures = enabled {{(pid=82975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 25 15:50:55 devstack cinder-volume[82975]: DEBUG oslo_service.backend._eventlet.service [None req-8ff9f6e9-a9a0-4cb9-9233-6f0d297a23ef None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=82975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 25 15:50:55 devstack cinder-volume[82975]: DEBUG oslo_service.backend._eventlet.service [None req-8ff9f6e9-a9a0-4cb9-9233-6f0d297a23ef None None] volume_api_class = cinder.volume.api.API {{(pid=82975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 25 15:50:55 devstack cinder-volume[82975]: DEBUG oslo_service.backend._eventlet.service [None req-8ff9f6e9-a9a0-4cb9-9233-6f0d297a23ef None None] volume_backend_name = None {{(pid=82975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 25 15:50:55 devstack cinder-volume[82975]: DEBUG oslo_service.backend._eventlet.service [None req-8ff9f6e9-a9a0-4cb9-9233-6f0d297a23ef None None] volume_clear = zero {{(pid=82975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 25 15:50:55 devstack cinder-volume[82975]: DEBUG oslo_service.backend._eventlet.service [None req-8ff9f6e9-a9a0-4cb9-9233-6f0d297a23ef None None] volume_clear_ionice = None {{(pid=82975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 25 15:50:55 devstack cinder-volume[82975]: DEBUG oslo_service.backend._eventlet.service [None req-8ff9f6e9-a9a0-4cb9-9233-6f0d297a23ef None None] volume_clear_size = 0 {{(pid=82975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 25 15:50:55 devstack cinder-volume[82975]: DEBUG oslo_service.backend._eventlet.service [None req-8ff9f6e9-a9a0-4cb9-9233-6f0d297a23ef None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=82975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 25 15:50:55 devstack cinder-volume[82975]: DEBUG oslo_service.backend._eventlet.service [None req-8ff9f6e9-a9a0-4cb9-9233-6f0d297a23ef None None] volume_copy_bps_limit = 0 {{(pid=82975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 25 15:50:55 devstack cinder-volume[82975]: DEBUG oslo_service.backend._eventlet.service [None req-8ff9f6e9-a9a0-4cb9-9233-6f0d297a23ef None None] volume_dd_blocksize = 1M {{(pid=82975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 25 15:50:55 devstack cinder-volume[82975]: DEBUG oslo_service.backend._eventlet.service [None req-8ff9f6e9-a9a0-4cb9-9233-6f0d297a23ef None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=82975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 25 15:50:55 devstack cinder-volume[82975]: DEBUG oslo_service.backend._eventlet.service [None req-8ff9f6e9-a9a0-4cb9-9233-6f0d297a23ef None None] volume_name_template = volume-%s {{(pid=82975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 25 15:50:55 devstack cinder-volume[82975]: DEBUG oslo_service.backend._eventlet.service [None req-8ff9f6e9-a9a0-4cb9-9233-6f0d297a23ef None None] volume_service_inithost_offload = False {{(pid=82975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 25 15:50:55 devstack cinder-volume[82975]: DEBUG oslo_service.backend._eventlet.service [None req-8ff9f6e9-a9a0-4cb9-9233-6f0d297a23ef None None] volume_usage_audit_period = month {{(pid=82975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 25 15:50:55 devstack cinder-volume[82975]: DEBUG oslo_service.backend._eventlet.service [None req-8ff9f6e9-a9a0-4cb9-9233-6f0d297a23ef None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=82975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 25 15:50:55 devstack cinder-volume[82975]: DEBUG oslo_service.backend._eventlet.service [None req-8ff9f6e9-a9a0-4cb9-9233-6f0d297a23ef None None] zoning_mode = None {{(pid=82975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 25 15:50:55 devstack cinder-volume[82975]: DEBUG oslo_service.backend._eventlet.service [None req-8ff9f6e9-a9a0-4cb9-9233-6f0d297a23ef None None] os_brick.lightos_discovery_client_address = localhost {{(pid=82975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:50:55 devstack cinder-volume[82975]: DEBUG oslo_service.backend._eventlet.service [None req-8ff9f6e9-a9a0-4cb9-9233-6f0d297a23ef None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=82975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:50:55 devstack cinder-volume[82975]: DEBUG oslo_service.backend._eventlet.service [None req-8ff9f6e9-a9a0-4cb9-9233-6f0d297a23ef None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=82975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:50:55 devstack cinder-volume[82975]: DEBUG oslo_service.backend._eventlet.service [None req-8ff9f6e9-a9a0-4cb9-9233-6f0d297a23ef None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=82975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:50:55 devstack cinder-volume[82975]: DEBUG oslo_service.backend._eventlet.service [None req-8ff9f6e9-a9a0-4cb9-9233-6f0d297a23ef None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=82975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:50:55 devstack cinder-volume[82975]: DEBUG oslo_service.backend._eventlet.service [None req-8ff9f6e9-a9a0-4cb9-9233-6f0d297a23ef None None] os_brick.wait_mpath_device_interval = 1 {{(pid=82975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:50:55 devstack cinder-volume[82975]: DEBUG oslo_service.backend._eventlet.service [None req-8ff9f6e9-a9a0-4cb9-9233-6f0d297a23ef None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=82975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:50:55 devstack cinder-volume[82975]: DEBUG oslo_service.backend._eventlet.service [None req-8ff9f6e9-a9a0-4cb9-9233-6f0d297a23ef None None] oslo_concurrency.disable_process_locking = False {{(pid=82975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:50:55 devstack cinder-volume[82975]: DEBUG oslo_service.backend._eventlet.service [None req-8ff9f6e9-a9a0-4cb9-9233-6f0d297a23ef None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=82975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:50:55 devstack cinder-volume[82975]: DEBUG oslo_service.backend._eventlet.service [None req-8ff9f6e9-a9a0-4cb9-9233-6f0d297a23ef None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=82975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:50:55 devstack cinder-volume[82975]: DEBUG oslo_service.backend._eventlet.service [None req-8ff9f6e9-a9a0-4cb9-9233-6f0d297a23ef None None] keystone_authtoken.admin_password = **** {{(pid=82975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:50:55 devstack cinder-volume[82975]: DEBUG oslo_service.backend._eventlet.service [None req-8ff9f6e9-a9a0-4cb9-9233-6f0d297a23ef None None] keystone_authtoken.admin_tenant_name = admin {{(pid=82975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:50:55 devstack cinder-volume[82975]: DEBUG oslo_service.backend._eventlet.service [None req-8ff9f6e9-a9a0-4cb9-9233-6f0d297a23ef None None] keystone_authtoken.admin_token = **** {{(pid=82975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:50:55 devstack cinder-volume[82975]: DEBUG oslo_service.backend._eventlet.service [None req-8ff9f6e9-a9a0-4cb9-9233-6f0d297a23ef None None] keystone_authtoken.admin_user = None {{(pid=82975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:50:55 devstack cinder-volume[82975]: DEBUG oslo_service.backend._eventlet.service [None req-8ff9f6e9-a9a0-4cb9-9233-6f0d297a23ef None None] keystone_authtoken.auth_admin_prefix = {{(pid=82975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:50:55 devstack cinder-volume[82975]: DEBUG oslo_service.backend._eventlet.service [None req-8ff9f6e9-a9a0-4cb9-9233-6f0d297a23ef None None] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=82975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:50:55 devstack cinder-volume[82975]: DEBUG oslo_service.backend._eventlet.service [None req-8ff9f6e9-a9a0-4cb9-9233-6f0d297a23ef None None] keystone_authtoken.auth_port = 35357 {{(pid=82975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:50:55 devstack cinder-volume[82975]: DEBUG oslo_service.backend._eventlet.service [None req-8ff9f6e9-a9a0-4cb9-9233-6f0d297a23ef None None] keystone_authtoken.auth_protocol = https {{(pid=82975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:50:55 devstack cinder-volume[82975]: DEBUG oslo_service.backend._eventlet.service [None req-8ff9f6e9-a9a0-4cb9-9233-6f0d297a23ef None None] keystone_authtoken.auth_section = None {{(pid=82975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:50:55 devstack cinder-volume[82975]: DEBUG oslo_service.backend._eventlet.service [None req-8ff9f6e9-a9a0-4cb9-9233-6f0d297a23ef None None] keystone_authtoken.auth_type = password {{(pid=82975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:50:55 devstack cinder-volume[82975]: DEBUG oslo_service.backend._eventlet.service [None req-8ff9f6e9-a9a0-4cb9-9233-6f0d297a23ef None None] keystone_authtoken.auth_uri = None {{(pid=82975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:50:55 devstack cinder-volume[82975]: DEBUG oslo_service.backend._eventlet.service [None req-8ff9f6e9-a9a0-4cb9-9233-6f0d297a23ef None None] keystone_authtoken.auth_version = None {{(pid=82975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:50:55 devstack cinder-volume[82975]: DEBUG oslo_service.backend._eventlet.service [None req-8ff9f6e9-a9a0-4cb9-9233-6f0d297a23ef None None] keystone_authtoken.cache = None {{(pid=82975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:50:55 devstack cinder-volume[82975]: DEBUG oslo_service.backend._eventlet.service [None req-8ff9f6e9-a9a0-4cb9-9233-6f0d297a23ef None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=82975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:50:55 devstack cinder-volume[82975]: DEBUG oslo_service.backend._eventlet.service [None req-8ff9f6e9-a9a0-4cb9-9233-6f0d297a23ef None None] keystone_authtoken.certfile = None {{(pid=82975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:50:55 devstack cinder-volume[82975]: DEBUG oslo_service.backend._eventlet.service [None req-8ff9f6e9-a9a0-4cb9-9233-6f0d297a23ef None None] keystone_authtoken.delay_auth_decision = False {{(pid=82975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:50:55 devstack cinder-volume[82975]: DEBUG oslo_service.backend._eventlet.service [None req-8ff9f6e9-a9a0-4cb9-9233-6f0d297a23ef None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=82975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:50:55 devstack cinder-volume[82975]: DEBUG oslo_service.backend._eventlet.service [None req-8ff9f6e9-a9a0-4cb9-9233-6f0d297a23ef None None] keystone_authtoken.http_connect_timeout = None {{(pid=82975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:50:55 devstack cinder-volume[82975]: DEBUG oslo_service.backend._eventlet.service [None req-8ff9f6e9-a9a0-4cb9-9233-6f0d297a23ef None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=82975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:50:55 devstack cinder-volume[82975]: DEBUG oslo_service.backend._eventlet.service [None req-8ff9f6e9-a9a0-4cb9-9233-6f0d297a23ef None None] keystone_authtoken.identity_uri = None {{(pid=82975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:50:55 devstack cinder-volume[82975]: DEBUG oslo_service.backend._eventlet.service [None req-8ff9f6e9-a9a0-4cb9-9233-6f0d297a23ef None None] keystone_authtoken.include_service_catalog = True {{(pid=82975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:50:55 devstack cinder-volume[82975]: DEBUG oslo_service.backend._eventlet.service [None req-8ff9f6e9-a9a0-4cb9-9233-6f0d297a23ef None None] keystone_authtoken.insecure = False {{(pid=82975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:50:55 devstack cinder-volume[82975]: DEBUG oslo_service.backend._eventlet.service [None req-8ff9f6e9-a9a0-4cb9-9233-6f0d297a23ef None None] keystone_authtoken.interface = public {{(pid=82975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:50:55 devstack cinder-volume[82975]: DEBUG oslo_service.backend._eventlet.service [None req-8ff9f6e9-a9a0-4cb9-9233-6f0d297a23ef None None] keystone_authtoken.keyfile = None {{(pid=82975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:50:55 devstack cinder-volume[82975]: DEBUG oslo_service.backend._eventlet.service [None req-8ff9f6e9-a9a0-4cb9-9233-6f0d297a23ef None None] keystone_authtoken.memcache_password = {{(pid=82975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:50:55 devstack cinder-volume[82975]: DEBUG oslo_service.backend._eventlet.service [None req-8ff9f6e9-a9a0-4cb9-9233-6f0d297a23ef None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=82975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:50:55 devstack cinder-volume[82975]: DEBUG oslo_service.backend._eventlet.service [None req-8ff9f6e9-a9a0-4cb9-9233-6f0d297a23ef None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=82975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:50:55 devstack cinder-volume[82975]: DEBUG oslo_service.backend._eventlet.service [None req-8ff9f6e9-a9a0-4cb9-9233-6f0d297a23ef None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=82975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:50:55 devstack cinder-volume[82975]: DEBUG oslo_service.backend._eventlet.service [None req-8ff9f6e9-a9a0-4cb9-9233-6f0d297a23ef None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=82975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:50:55 devstack cinder-volume[82975]: DEBUG oslo_service.backend._eventlet.service [None req-8ff9f6e9-a9a0-4cb9-9233-6f0d297a23ef None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=82975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:50:55 devstack cinder-volume[82975]: DEBUG oslo_service.backend._eventlet.service [None req-8ff9f6e9-a9a0-4cb9-9233-6f0d297a23ef None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=82975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:50:55 devstack cinder-volume[82975]: DEBUG oslo_service.backend._eventlet.service [None req-8ff9f6e9-a9a0-4cb9-9233-6f0d297a23ef None None] keystone_authtoken.memcache_secret_key = **** {{(pid=82975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:50:55 devstack cinder-volume[82975]: DEBUG oslo_service.backend._eventlet.service [None req-8ff9f6e9-a9a0-4cb9-9233-6f0d297a23ef None None] keystone_authtoken.memcache_security_strategy = None {{(pid=82975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:50:55 devstack cinder-volume[82975]: DEBUG oslo_service.backend._eventlet.service [None req-8ff9f6e9-a9a0-4cb9-9233-6f0d297a23ef None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=82975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:50:55 devstack cinder-volume[82975]: DEBUG oslo_service.backend._eventlet.service [None req-8ff9f6e9-a9a0-4cb9-9233-6f0d297a23ef None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=82975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:50:55 devstack cinder-volume[82975]: DEBUG oslo_service.backend._eventlet.service [None req-8ff9f6e9-a9a0-4cb9-9233-6f0d297a23ef None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=82975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:50:55 devstack cinder-volume[82975]: DEBUG oslo_service.backend._eventlet.service [None req-8ff9f6e9-a9a0-4cb9-9233-6f0d297a23ef None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=82975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:50:55 devstack cinder-volume[82975]: DEBUG oslo_service.backend._eventlet.service [None req-8ff9f6e9-a9a0-4cb9-9233-6f0d297a23ef None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=82975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:50:55 devstack cinder-volume[82975]: DEBUG oslo_service.backend._eventlet.service [None req-8ff9f6e9-a9a0-4cb9-9233-6f0d297a23ef None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=82975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:50:55 devstack cinder-volume[82975]: DEBUG oslo_service.backend._eventlet.service [None req-8ff9f6e9-a9a0-4cb9-9233-6f0d297a23ef None None] keystone_authtoken.memcache_username = {{(pid=82975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:50:55 devstack cinder-volume[82975]: DEBUG oslo_service.backend._eventlet.service [None req-8ff9f6e9-a9a0-4cb9-9233-6f0d297a23ef None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=82975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:50:55 devstack cinder-volume[82975]: DEBUG oslo_service.backend._eventlet.service [None req-8ff9f6e9-a9a0-4cb9-9233-6f0d297a23ef None None] keystone_authtoken.region_name = None {{(pid=82975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:50:55 devstack cinder-volume[82975]: DEBUG oslo_service.backend._eventlet.service [None req-8ff9f6e9-a9a0-4cb9-9233-6f0d297a23ef None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=82975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:50:55 devstack cinder-volume[82975]: DEBUG oslo_service.backend._eventlet.service [None req-8ff9f6e9-a9a0-4cb9-9233-6f0d297a23ef None None] keystone_authtoken.service_token_roles_required = False {{(pid=82975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:50:55 devstack cinder-volume[82975]: DEBUG oslo_service.backend._eventlet.service [None req-8ff9f6e9-a9a0-4cb9-9233-6f0d297a23ef None None] keystone_authtoken.service_type = None {{(pid=82975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:50:55 devstack cinder-volume[82975]: DEBUG oslo_service.backend._eventlet.service [None req-8ff9f6e9-a9a0-4cb9-9233-6f0d297a23ef None None] keystone_authtoken.token_cache_time = 300 {{(pid=82975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:50:55 devstack cinder-volume[82975]: DEBUG oslo_service.backend._eventlet.service [None req-8ff9f6e9-a9a0-4cb9-9233-6f0d297a23ef None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.119/identity {{(pid=82975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:50:55 devstack cinder-volume[82975]: DEBUG oslo_service.backend._eventlet.service [None req-8ff9f6e9-a9a0-4cb9-9233-6f0d297a23ef None None] cache.backend = dogpile.cache.null {{(pid=82975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:50:55 devstack cinder-volume[82975]: DEBUG oslo_service.backend._eventlet.service [None req-8ff9f6e9-a9a0-4cb9-9233-6f0d297a23ef None None] cache.backend_argument = **** {{(pid=82975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:50:55 devstack cinder-volume[82975]: DEBUG oslo_service.backend._eventlet.service [None req-8ff9f6e9-a9a0-4cb9-9233-6f0d297a23ef None None] cache.backend_expiration_time = None {{(pid=82975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:50:55 devstack cinder-volume[82975]: DEBUG oslo_service.backend._eventlet.service [None req-8ff9f6e9-a9a0-4cb9-9233-6f0d297a23ef None None] cache.config_prefix = cache.oslo {{(pid=82975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:50:55 devstack cinder-volume[82975]: DEBUG oslo_service.backend._eventlet.service [None req-8ff9f6e9-a9a0-4cb9-9233-6f0d297a23ef None None] cache.debug_cache_backend = False {{(pid=82975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:50:55 devstack cinder-volume[82975]: DEBUG oslo_service.backend._eventlet.service [None req-8ff9f6e9-a9a0-4cb9-9233-6f0d297a23ef None None] cache.enable_retry_client = False {{(pid=82975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:50:55 devstack cinder-volume[82975]: DEBUG oslo_service.backend._eventlet.service [None req-8ff9f6e9-a9a0-4cb9-9233-6f0d297a23ef None None] cache.enable_socket_keepalive = False {{(pid=82975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:50:55 devstack cinder-volume[82975]: DEBUG oslo_service.backend._eventlet.service [None req-8ff9f6e9-a9a0-4cb9-9233-6f0d297a23ef None None] cache.enabled = False {{(pid=82975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:50:55 devstack cinder-volume[82975]: DEBUG oslo_service.backend._eventlet.service [None req-8ff9f6e9-a9a0-4cb9-9233-6f0d297a23ef None None] cache.enforce_fips_mode = False {{(pid=82975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:50:55 devstack cinder-volume[82975]: DEBUG oslo_service.backend._eventlet.service [None req-8ff9f6e9-a9a0-4cb9-9233-6f0d297a23ef None None] cache.expiration_time = 600 {{(pid=82975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:50:55 devstack cinder-volume[82975]: DEBUG oslo_service.backend._eventlet.service [None req-8ff9f6e9-a9a0-4cb9-9233-6f0d297a23ef None None] cache.hashclient_dead_timeout = 60.0 {{(pid=82975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:50:55 devstack cinder-volume[82975]: DEBUG oslo_service.backend._eventlet.service [None req-8ff9f6e9-a9a0-4cb9-9233-6f0d297a23ef None None] cache.hashclient_retry_attempts = 2 {{(pid=82975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:50:55 devstack cinder-volume[82975]: DEBUG oslo_service.backend._eventlet.service [None req-8ff9f6e9-a9a0-4cb9-9233-6f0d297a23ef None None] cache.hashclient_retry_timeout = 1.0 {{(pid=82975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:50:55 devstack cinder-volume[82975]: DEBUG oslo_service.backend._eventlet.service [None req-8ff9f6e9-a9a0-4cb9-9233-6f0d297a23ef None None] cache.memcache_dead_retry = 300 {{(pid=82975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:50:55 devstack cinder-volume[82975]: DEBUG oslo_service.backend._eventlet.service [None req-8ff9f6e9-a9a0-4cb9-9233-6f0d297a23ef None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=82975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:50:55 devstack cinder-volume[82975]: DEBUG oslo_service.backend._eventlet.service [None req-8ff9f6e9-a9a0-4cb9-9233-6f0d297a23ef None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=82975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:50:55 devstack cinder-volume[82975]: DEBUG oslo_service.backend._eventlet.service [None req-8ff9f6e9-a9a0-4cb9-9233-6f0d297a23ef None None] cache.memcache_pool_maxsize = 10 {{(pid=82975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:50:55 devstack cinder-volume[82975]: DEBUG oslo_service.backend._eventlet.service [None req-8ff9f6e9-a9a0-4cb9-9233-6f0d297a23ef None None] cache.memcache_pool_unused_timeout = 60 {{(pid=82975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:50:55 devstack cinder-volume[82975]: DEBUG oslo_service.backend._eventlet.service [None req-8ff9f6e9-a9a0-4cb9-9233-6f0d297a23ef None None] cache.memcache_sasl_enabled = False {{(pid=82975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:50:55 devstack cinder-volume[82975]: DEBUG oslo_service.backend._eventlet.service [None req-8ff9f6e9-a9a0-4cb9-9233-6f0d297a23ef None None] cache.memcache_servers = ['localhost:11211'] {{(pid=82975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:50:55 devstack cinder-volume[82975]: DEBUG oslo_service.backend._eventlet.service [None req-8ff9f6e9-a9a0-4cb9-9233-6f0d297a23ef None None] cache.password = **** {{(pid=82975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:50:55 devstack cinder-volume[82975]: DEBUG oslo_service.backend._eventlet.service [None req-8ff9f6e9-a9a0-4cb9-9233-6f0d297a23ef None None] cache.proxies = [] {{(pid=82975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:50:55 devstack cinder-volume[82975]: DEBUG oslo_service.backend._eventlet.service [None req-8ff9f6e9-a9a0-4cb9-9233-6f0d297a23ef None None] cache.redis_db = 0 {{(pid=82975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:50:55 devstack cinder-volume[82975]: DEBUG oslo_service.backend._eventlet.service [None req-8ff9f6e9-a9a0-4cb9-9233-6f0d297a23ef None None] cache.redis_sentinel_service_name = mymaster {{(pid=82975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:50:55 devstack cinder-volume[82975]: DEBUG oslo_service.backend._eventlet.service [None req-8ff9f6e9-a9a0-4cb9-9233-6f0d297a23ef None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=82975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:50:55 devstack cinder-volume[82975]: DEBUG oslo_service.backend._eventlet.service [None req-8ff9f6e9-a9a0-4cb9-9233-6f0d297a23ef None None] cache.redis_server = localhost:6379 {{(pid=82975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:50:55 devstack cinder-volume[82975]: DEBUG oslo_service.backend._eventlet.service [None req-8ff9f6e9-a9a0-4cb9-9233-6f0d297a23ef None None] cache.retry_attempts = 2 {{(pid=82975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:50:55 devstack cinder-volume[82975]: DEBUG oslo_service.backend._eventlet.service [None req-8ff9f6e9-a9a0-4cb9-9233-6f0d297a23ef None None] cache.retry_delay = 0.0 {{(pid=82975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:50:55 devstack cinder-volume[82975]: DEBUG oslo_service.backend._eventlet.service [None req-8ff9f6e9-a9a0-4cb9-9233-6f0d297a23ef None None] cache.socket_keepalive_count = 1 {{(pid=82975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:50:55 devstack cinder-volume[82975]: DEBUG oslo_service.backend._eventlet.service [None req-8ff9f6e9-a9a0-4cb9-9233-6f0d297a23ef None None] cache.socket_keepalive_idle = 1 {{(pid=82975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:50:55 devstack cinder-volume[82975]: DEBUG oslo_service.backend._eventlet.service [None req-8ff9f6e9-a9a0-4cb9-9233-6f0d297a23ef None None] cache.socket_keepalive_interval = 1 {{(pid=82975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:50:55 devstack cinder-volume[82975]: DEBUG oslo_service.backend._eventlet.service [None req-8ff9f6e9-a9a0-4cb9-9233-6f0d297a23ef None None] cache.socket_timeout = 1.0 {{(pid=82975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:50:55 devstack cinder-volume[82975]: DEBUG oslo_service.backend._eventlet.service [None req-8ff9f6e9-a9a0-4cb9-9233-6f0d297a23ef None None] cache.tls_allowed_ciphers = None {{(pid=82975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:50:55 devstack cinder-volume[82975]: DEBUG oslo_service.backend._eventlet.service [None req-8ff9f6e9-a9a0-4cb9-9233-6f0d297a23ef None None] cache.tls_cafile = None {{(pid=82975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:50:55 devstack cinder-volume[82975]: DEBUG oslo_service.backend._eventlet.service [None req-8ff9f6e9-a9a0-4cb9-9233-6f0d297a23ef None None] cache.tls_certfile = None {{(pid=82975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:50:55 devstack quobyte-client[83096]: Reading configuration file: /etc/quobyte/client.cfg Feb 25 15:50:55 devstack quobyte-client[83096]: Invalid parameters found, error: missing mount point. Feb 25 15:50:55 devstack quobyte-client[83096]: Quobyte logging to journald, you can use 'journalctl QUOBYTE_MOUNTPOINT=' to display the log. Feb 25 15:50:55 devstack quobyte-client[83096]: Failed to parse all commandline parameters, please use -h/--help to see available options. Feb 25 15:50:55 devstack cinder-volume[82975]: DEBUG oslo_service.backend._eventlet.service [None req-8ff9f6e9-a9a0-4cb9-9233-6f0d297a23ef None None] cache.tls_enabled = False {{(pid=82975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:50:55 devstack cinder-volume[82975]: DEBUG oslo_service.backend._eventlet.service [None req-8ff9f6e9-a9a0-4cb9-9233-6f0d297a23ef None None] cache.tls_keyfile = None {{(pid=82975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:50:55 devstack cinder-volume[82975]: DEBUG oslo_service.backend._eventlet.service [None req-8ff9f6e9-a9a0-4cb9-9233-6f0d297a23ef None None] cache.username = None {{(pid=82975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:50:55 devstack cinder-volume[82975]: DEBUG oslo_service.backend._eventlet.service [None req-8ff9f6e9-a9a0-4cb9-9233-6f0d297a23ef None None] coordination.backend_url = **** {{(pid=82975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:50:55 devstack cinder-volume[82975]: DEBUG oslo_service.backend._eventlet.service [None req-8ff9f6e9-a9a0-4cb9-9233-6f0d297a23ef None None] database.asyncio_connection = **** {{(pid=82975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:50:55 devstack cinder-volume[82975]: DEBUG oslo_service.backend._eventlet.service [None req-8ff9f6e9-a9a0-4cb9-9233-6f0d297a23ef None None] database.asyncio_slave_connection = **** {{(pid=82975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:50:55 devstack cinder-volume[82975]: DEBUG oslo_service.backend._eventlet.service [None req-8ff9f6e9-a9a0-4cb9-9233-6f0d297a23ef None None] database.backend = sqlalchemy {{(pid=82975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:50:55 devstack cinder-volume[82975]: DEBUG oslo_service.backend._eventlet.service [None req-8ff9f6e9-a9a0-4cb9-9233-6f0d297a23ef None None] database.connection = **** {{(pid=82975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:50:55 devstack cinder-volume[82975]: DEBUG oslo_service.backend._eventlet.service [None req-8ff9f6e9-a9a0-4cb9-9233-6f0d297a23ef None None] database.connection_debug = 0 {{(pid=82975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:50:55 devstack cinder-volume[82975]: DEBUG oslo_service.backend._eventlet.service [None req-8ff9f6e9-a9a0-4cb9-9233-6f0d297a23ef None None] database.connection_parameters = {{(pid=82975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:50:55 devstack cinder-volume[82975]: DEBUG oslo_service.backend._eventlet.service [None req-8ff9f6e9-a9a0-4cb9-9233-6f0d297a23ef None None] database.connection_recycle_time = 3600 {{(pid=82975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:50:55 devstack cinder-volume[82975]: DEBUG oslo_service.backend._eventlet.service [None req-8ff9f6e9-a9a0-4cb9-9233-6f0d297a23ef None None] database.connection_trace = False {{(pid=82975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:50:55 devstack cinder-volume[82975]: DEBUG oslo_service.backend._eventlet.service [None req-8ff9f6e9-a9a0-4cb9-9233-6f0d297a23ef None None] database.db_inc_retry_interval = True {{(pid=82975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:50:55 devstack cinder-volume[82975]: DEBUG oslo_service.backend._eventlet.service [None req-8ff9f6e9-a9a0-4cb9-9233-6f0d297a23ef None None] database.db_max_retries = 20 {{(pid=82975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:50:55 devstack cinder-volume[82975]: DEBUG oslo_service.backend._eventlet.service [None req-8ff9f6e9-a9a0-4cb9-9233-6f0d297a23ef None None] database.db_max_retry_interval = 10 {{(pid=82975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:50:55 devstack cinder-volume[82975]: DEBUG oslo_service.backend._eventlet.service [None req-8ff9f6e9-a9a0-4cb9-9233-6f0d297a23ef None None] database.db_retry_interval = 1 {{(pid=82975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:50:55 devstack cinder-volume[82975]: DEBUG oslo_service.backend._eventlet.service [None req-8ff9f6e9-a9a0-4cb9-9233-6f0d297a23ef None None] database.max_overflow = 50 {{(pid=82975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:50:55 devstack cinder-volume[82975]: DEBUG oslo_service.backend._eventlet.service [None req-8ff9f6e9-a9a0-4cb9-9233-6f0d297a23ef None None] database.max_pool_size = 5 {{(pid=82975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:50:55 devstack cinder-volume[82975]: DEBUG oslo_service.backend._eventlet.service [None req-8ff9f6e9-a9a0-4cb9-9233-6f0d297a23ef None None] database.max_retries = 10 {{(pid=82975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:50:55 devstack cinder-volume[82975]: DEBUG oslo_service.backend._eventlet.service [None req-8ff9f6e9-a9a0-4cb9-9233-6f0d297a23ef None None] database.mysql_sql_mode = TRADITIONAL {{(pid=82975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:50:55 devstack cinder-volume[82975]: DEBUG oslo_service.backend._eventlet.service [None req-8ff9f6e9-a9a0-4cb9-9233-6f0d297a23ef None None] database.mysql_wsrep_sync_wait = None {{(pid=82975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:50:55 devstack cinder-volume[82975]: DEBUG oslo_service.backend._eventlet.service [None req-8ff9f6e9-a9a0-4cb9-9233-6f0d297a23ef None None] database.pool_timeout = None {{(pid=82975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:50:55 devstack cinder-volume[82975]: DEBUG oslo_service.backend._eventlet.service [None req-8ff9f6e9-a9a0-4cb9-9233-6f0d297a23ef None None] database.retry_interval = 10 {{(pid=82975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:50:55 devstack cinder-volume[82975]: DEBUG oslo_service.backend._eventlet.service [None req-8ff9f6e9-a9a0-4cb9-9233-6f0d297a23ef None None] database.slave_connection = **** {{(pid=82975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:50:55 devstack cinder-volume[82975]: DEBUG oslo_service.backend._eventlet.service [None req-8ff9f6e9-a9a0-4cb9-9233-6f0d297a23ef None None] database.sqlite_synchronous = True {{(pid=82975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:50:55 devstack cinder-volume[82975]: DEBUG oslo_service.backend._eventlet.service [None req-8ff9f6e9-a9a0-4cb9-9233-6f0d297a23ef None None] database.synchronous_reader = True {{(pid=82975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:50:55 devstack cinder-volume[82975]: DEBUG oslo_service.backend._eventlet.service [None req-8ff9f6e9-a9a0-4cb9-9233-6f0d297a23ef None None] database.use_db_reconnect = False {{(pid=82975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:50:55 devstack cinder-volume[82975]: DEBUG oslo_service.backend._eventlet.service [None req-8ff9f6e9-a9a0-4cb9-9233-6f0d297a23ef None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=82975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:50:55 devstack cinder-volume[82975]: DEBUG oslo_service.backend._eventlet.service [None req-8ff9f6e9-a9a0-4cb9-9233-6f0d297a23ef None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=82975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:50:55 devstack cinder-volume[83095]: DEBUG oslo_concurrency.processutils [None req-4f722c8d-1eb6-48b5-b14c-0ab78036b384 None None] CMD "mount.quobyte" returned: 1 in 0.077s {{(pid=83095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 25 15:50:55 devstack cinder-volume[82975]: DEBUG oslo_service.backend._eventlet.service [None req-8ff9f6e9-a9a0-4cb9-9233-6f0d297a23ef None None] oslo_messaging_metrics.metrics_process_name = {{(pid=82975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:50:55 devstack cinder-volume[83095]: DEBUG oslo_concurrency.lockutils [None req-4f722c8d-1eb6-48b5-b14c-0ab78036b384 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 25 15:50:55 devstack cinder-volume[82975]: DEBUG oslo_service.backend._eventlet.service [None req-8ff9f6e9-a9a0-4cb9-9233-6f0d297a23ef None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=82975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:50:55 devstack cinder-volume[83095]: DEBUG oslo_concurrency.lockutils [None req-4f722c8d-1eb6-48b5-b14c-0ab78036b384 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 25 15:50:55 devstack cinder-volume[83095]: DEBUG cinder.volume.drivers.quobyte [None req-4f722c8d-1eb6-48b5-b14c-0ab78036b384 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23e9d725-3e04-4cd9-bfe0-c8ef43305589': None} {{(pid=83095) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 25 15:50:55 devstack cinder-volume[82975]: DEBUG oslo_service.backend._eventlet.service [None req-8ff9f6e9-a9a0-4cb9-9233-6f0d297a23ef None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=82975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:50:55 devstack cinder-volume[82975]: DEBUG oslo_service.backend._eventlet.service [None req-8ff9f6e9-a9a0-4cb9-9233-6f0d297a23ef None None] profiler.connection_string = messaging:// {{(pid=82975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:50:55 devstack cinder-volume[83095]: INFO cinder.volume.drivers.quobyte [None req-4f722c8d-1eb6-48b5-b14c-0ab78036b384 None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-23e9d725-3e04-4cd9-bfe0-c8ef43305589 ... Feb 25 15:50:55 devstack cinder-volume[82975]: DEBUG oslo_service.backend._eventlet.service [None req-8ff9f6e9-a9a0-4cb9-9233-6f0d297a23ef None None] profiler.enabled = False {{(pid=82975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:50:55 devstack cinder-volume[83095]: DEBUG oslo_concurrency.processutils [None req-4f722c8d-1eb6-48b5-b14c-0ab78036b384 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-23e9d725-3e04-4cd9-bfe0-c8ef43305589 /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85 -c /etc/quobyte/client-cinder.cfg {{(pid=83095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 25 15:50:55 devstack cinder-volume[82975]: DEBUG oslo_service.backend._eventlet.service [None req-8ff9f6e9-a9a0-4cb9-9233-6f0d297a23ef None None] profiler.es_doc_type = notification {{(pid=82975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:50:55 devstack cinder-volume[82975]: DEBUG oslo_service.backend._eventlet.service [None req-8ff9f6e9-a9a0-4cb9-9233-6f0d297a23ef None None] profiler.es_scroll_size = 10000 {{(pid=82975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:50:55 devstack cinder-volume[82975]: DEBUG oslo_service.backend._eventlet.service [None req-8ff9f6e9-a9a0-4cb9-9233-6f0d297a23ef None None] profiler.es_scroll_time = 2m {{(pid=82975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:50:55 devstack cinder-volume[82975]: DEBUG oslo_service.backend._eventlet.service [None req-8ff9f6e9-a9a0-4cb9-9233-6f0d297a23ef None None] profiler.filter_error_trace = False {{(pid=82975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:50:55 devstack cinder-volume[82975]: DEBUG oslo_service.backend._eventlet.service [None req-8ff9f6e9-a9a0-4cb9-9233-6f0d297a23ef None None] profiler.hmac_keys = **** {{(pid=82975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:50:55 devstack cinder-volume[82975]: DEBUG oslo_service.backend._eventlet.service [None req-8ff9f6e9-a9a0-4cb9-9233-6f0d297a23ef None None] profiler.sentinel_service_name = mymaster {{(pid=82975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:50:55 devstack cinder-volume[82975]: DEBUG oslo_service.backend._eventlet.service [None req-8ff9f6e9-a9a0-4cb9-9233-6f0d297a23ef None None] profiler.socket_timeout = 0.1 {{(pid=82975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:50:55 devstack cinder-volume[82975]: DEBUG oslo_service.backend._eventlet.service [None req-8ff9f6e9-a9a0-4cb9-9233-6f0d297a23ef None None] profiler.trace_requests = False {{(pid=82975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:50:55 devstack cinder-volume[82975]: DEBUG oslo_service.backend._eventlet.service [None req-8ff9f6e9-a9a0-4cb9-9233-6f0d297a23ef None None] profiler.trace_sqlalchemy = False {{(pid=82975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:50:55 devstack cinder-volume[82975]: DEBUG oslo_service.backend._eventlet.service [None req-8ff9f6e9-a9a0-4cb9-9233-6f0d297a23ef None None] profiler_jaeger.process_tags = {} {{(pid=82975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:50:55 devstack cinder-volume[82975]: DEBUG oslo_service.backend._eventlet.service [None req-8ff9f6e9-a9a0-4cb9-9233-6f0d297a23ef None None] profiler_jaeger.service_name_prefix = None {{(pid=82975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:50:55 devstack cinder-volume[82975]: DEBUG oslo_service.backend._eventlet.service [None req-8ff9f6e9-a9a0-4cb9-9233-6f0d297a23ef None None] profiler_otlp.service_name_prefix = None {{(pid=82975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:50:55 devstack cinder-volume[82975]: DEBUG oslo_service.backend._eventlet.service [None req-8ff9f6e9-a9a0-4cb9-9233-6f0d297a23ef None None] oslo_policy.enforce_new_defaults = False {{(pid=82975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:50:55 devstack cinder-volume[82975]: WARNING oslo_config.cfg [None req-8ff9f6e9-a9a0-4cb9-9233-6f0d297a23ef None None] Deprecated: Option "enforce_scope" from group "oslo_policy" is deprecated for removal (This configuration was added temporarily to facilitate a smooth transition to the new RBAC. OpenStack will always enforce scope checks. This configuration option is deprecated and will be removed in the 2025.2 cycle.). Its value may be silently ignored in the future. Feb 25 15:50:55 devstack cinder-volume[82975]: DEBUG oslo_service.backend._eventlet.service [None req-8ff9f6e9-a9a0-4cb9-9233-6f0d297a23ef None None] oslo_policy.enforce_scope = False {{(pid=82975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:50:55 devstack cinder-volume[82975]: DEBUG oslo_service.backend._eventlet.service [None req-8ff9f6e9-a9a0-4cb9-9233-6f0d297a23ef None None] oslo_policy.policy_default_rule = default {{(pid=82975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:50:55 devstack cinder-volume[82975]: DEBUG oslo_service.backend._eventlet.service [None req-8ff9f6e9-a9a0-4cb9-9233-6f0d297a23ef None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=82975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:50:55 devstack cinder-volume[82975]: DEBUG oslo_service.backend._eventlet.service [None req-8ff9f6e9-a9a0-4cb9-9233-6f0d297a23ef None None] oslo_policy.policy_file = policy.yaml {{(pid=82975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:50:55 devstack cinder-volume[82975]: DEBUG oslo_service.backend._eventlet.service [None req-8ff9f6e9-a9a0-4cb9-9233-6f0d297a23ef None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=82975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:50:55 devstack cinder-volume[82975]: DEBUG oslo_service.backend._eventlet.service [None req-8ff9f6e9-a9a0-4cb9-9233-6f0d297a23ef None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=82975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:50:55 devstack cinder-volume[82975]: DEBUG oslo_service.backend._eventlet.service [None req-8ff9f6e9-a9a0-4cb9-9233-6f0d297a23ef None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=82975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:50:55 devstack cinder-volume[82975]: DEBUG oslo_service.backend._eventlet.service [None req-8ff9f6e9-a9a0-4cb9-9233-6f0d297a23ef None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=82975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:50:55 devstack cinder-volume[82975]: DEBUG oslo_service.backend._eventlet.service [None req-8ff9f6e9-a9a0-4cb9-9233-6f0d297a23ef None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=82975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:50:55 devstack cinder-volume[82975]: DEBUG oslo_service.backend._eventlet.service [None req-8ff9f6e9-a9a0-4cb9-9233-6f0d297a23ef None None] oslo_policy.remote_timeout = 60.0 {{(pid=82975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:50:55 devstack cinder-volume[82975]: DEBUG oslo_service.backend._eventlet.service [None req-8ff9f6e9-a9a0-4cb9-9233-6f0d297a23ef None None] privsep_osbrick.capabilities = [21, 2] {{(pid=82975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:50:55 devstack cinder-volume[82975]: DEBUG oslo_service.backend._eventlet.service [None req-8ff9f6e9-a9a0-4cb9-9233-6f0d297a23ef None None] privsep_osbrick.group = None {{(pid=82975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:50:55 devstack cinder-volume[82975]: DEBUG oslo_service.backend._eventlet.service [None req-8ff9f6e9-a9a0-4cb9-9233-6f0d297a23ef None None] privsep_osbrick.helper_command = None {{(pid=82975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:50:55 devstack cinder-volume[82975]: DEBUG oslo_service.backend._eventlet.service [None req-8ff9f6e9-a9a0-4cb9-9233-6f0d297a23ef None None] privsep_osbrick.log_daemon_traceback = False {{(pid=82975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:50:55 devstack cinder-volume[82975]: DEBUG oslo_service.backend._eventlet.service [None req-8ff9f6e9-a9a0-4cb9-9233-6f0d297a23ef None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=82975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:50:55 devstack cinder-volume[82975]: DEBUG oslo_service.backend._eventlet.service [None req-8ff9f6e9-a9a0-4cb9-9233-6f0d297a23ef None None] privsep_osbrick.thread_pool_size = 4 {{(pid=82975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:50:55 devstack cinder-volume[82975]: DEBUG oslo_service.backend._eventlet.service [None req-8ff9f6e9-a9a0-4cb9-9233-6f0d297a23ef None None] privsep_osbrick.user = None {{(pid=82975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:50:55 devstack sudo[83097]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-23e9d725-3e04-4cd9-bfe0-c8ef43305589 /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85 -c /etc/quobyte/client-cinder.cfg Feb 25 15:50:55 devstack sudo[83097]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 25 15:50:55 devstack cinder-volume[82975]: DEBUG oslo_service.backend._eventlet.service [None req-8ff9f6e9-a9a0-4cb9-9233-6f0d297a23ef None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=82975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:50:55 devstack cinder-volume[82975]: DEBUG oslo_service.backend._eventlet.service [None req-8ff9f6e9-a9a0-4cb9-9233-6f0d297a23ef None None] cinder_sys_admin.group = None {{(pid=82975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:50:55 devstack cinder-volume[82975]: DEBUG oslo_service.backend._eventlet.service [None req-8ff9f6e9-a9a0-4cb9-9233-6f0d297a23ef None None] cinder_sys_admin.helper_command = None {{(pid=82975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:50:55 devstack cinder-volume[82975]: DEBUG oslo_service.backend._eventlet.service [None req-8ff9f6e9-a9a0-4cb9-9233-6f0d297a23ef None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=82975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:50:55 devstack cinder-volume[82975]: DEBUG oslo_service.backend._eventlet.service [None req-8ff9f6e9-a9a0-4cb9-9233-6f0d297a23ef None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=82975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:50:55 devstack cinder-volume[82975]: DEBUG oslo_service.backend._eventlet.service [None req-8ff9f6e9-a9a0-4cb9-9233-6f0d297a23ef None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=82975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:50:55 devstack cinder-volume[82975]: DEBUG oslo_service.backend._eventlet.service [None req-8ff9f6e9-a9a0-4cb9-9233-6f0d297a23ef None None] cinder_sys_admin.user = None {{(pid=82975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:50:55 devstack cinder-volume[82975]: DEBUG oslo_service.backend._eventlet.service [None req-8ff9f6e9-a9a0-4cb9-9233-6f0d297a23ef None None] service_user.auth_section = None {{(pid=82975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:50:55 devstack cinder-volume[82975]: DEBUG oslo_service.backend._eventlet.service [None req-8ff9f6e9-a9a0-4cb9-9233-6f0d297a23ef None None] service_user.auth_type = password {{(pid=82975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:50:55 devstack cinder-volume[82975]: DEBUG oslo_service.backend._eventlet.service [None req-8ff9f6e9-a9a0-4cb9-9233-6f0d297a23ef None None] service_user.cafile = None {{(pid=82975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:50:55 devstack cinder-volume[82975]: DEBUG oslo_service.backend._eventlet.service [None req-8ff9f6e9-a9a0-4cb9-9233-6f0d297a23ef None None] service_user.certfile = None {{(pid=82975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:50:55 devstack cinder-volume[82975]: DEBUG oslo_service.backend._eventlet.service [None req-8ff9f6e9-a9a0-4cb9-9233-6f0d297a23ef None None] service_user.collect_timing = False {{(pid=82975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:50:55 devstack cinder-volume[82975]: DEBUG oslo_service.backend._eventlet.service [None req-8ff9f6e9-a9a0-4cb9-9233-6f0d297a23ef None None] service_user.insecure = False {{(pid=82975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:50:55 devstack cinder-volume[82975]: DEBUG oslo_service.backend._eventlet.service [None req-8ff9f6e9-a9a0-4cb9-9233-6f0d297a23ef None None] service_user.keyfile = None {{(pid=82975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:50:55 devstack cinder-volume[82975]: DEBUG oslo_service.backend._eventlet.service [None req-8ff9f6e9-a9a0-4cb9-9233-6f0d297a23ef None None] service_user.send_service_user_token = True {{(pid=82975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:50:55 devstack cinder-volume[82975]: DEBUG oslo_service.backend._eventlet.service [None req-8ff9f6e9-a9a0-4cb9-9233-6f0d297a23ef None None] service_user.split_loggers = False {{(pid=82975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:50:55 devstack cinder-volume[82975]: DEBUG oslo_service.backend._eventlet.service [None req-8ff9f6e9-a9a0-4cb9-9233-6f0d297a23ef None None] service_user.timeout = None {{(pid=82975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:50:55 devstack cinder-volume[82975]: DEBUG oslo_service.backend._eventlet.service [None req-8ff9f6e9-a9a0-4cb9-9233-6f0d297a23ef None None] glance.auth_section = None {{(pid=82975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:50:55 devstack cinder-volume[82975]: DEBUG oslo_service.backend._eventlet.service [None req-8ff9f6e9-a9a0-4cb9-9233-6f0d297a23ef None None] glance.auth_type = password {{(pid=82975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:50:55 devstack cinder-volume[82975]: DEBUG oslo_service.backend._eventlet.service [None req-8ff9f6e9-a9a0-4cb9-9233-6f0d297a23ef None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=82975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:50:55 devstack cinder-volume[82975]: DEBUG oslo_service.backend._eventlet.service [None req-8ff9f6e9-a9a0-4cb9-9233-6f0d297a23ef None None] glance.certfile = None {{(pid=82975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:50:55 devstack cinder-volume[82975]: DEBUG oslo_service.backend._eventlet.service [None req-8ff9f6e9-a9a0-4cb9-9233-6f0d297a23ef None None] glance.collect_timing = False {{(pid=82975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:50:55 devstack cinder-volume[82975]: DEBUG oslo_service.backend._eventlet.service [None req-8ff9f6e9-a9a0-4cb9-9233-6f0d297a23ef None None] glance.insecure = False {{(pid=82975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:50:55 devstack cinder-volume[82975]: DEBUG oslo_service.backend._eventlet.service [None req-8ff9f6e9-a9a0-4cb9-9233-6f0d297a23ef None None] glance.keyfile = None {{(pid=82975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:50:55 devstack cinder-volume[82975]: DEBUG oslo_service.backend._eventlet.service [None req-8ff9f6e9-a9a0-4cb9-9233-6f0d297a23ef None None] glance.region_name = None {{(pid=82975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:50:55 devstack cinder-volume[82975]: DEBUG oslo_service.backend._eventlet.service [None req-8ff9f6e9-a9a0-4cb9-9233-6f0d297a23ef None None] glance.split_loggers = False {{(pid=82975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:50:55 devstack cinder-volume[82975]: DEBUG oslo_service.backend._eventlet.service [None req-8ff9f6e9-a9a0-4cb9-9233-6f0d297a23ef None None] glance.timeout = None {{(pid=82975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:50:55 devstack cinder-volume[82975]: DEBUG oslo_service.backend._eventlet.service [None req-8ff9f6e9-a9a0-4cb9-9233-6f0d297a23ef None None] backend_defaults.backend_availability_zone = None {{(pid=82975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:50:55 devstack cinder-volume[82975]: DEBUG oslo_service.backend._eventlet.service [None req-8ff9f6e9-a9a0-4cb9-9233-6f0d297a23ef None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=82975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:50:55 devstack cinder-volume[82975]: DEBUG oslo_service.backend._eventlet.service [None req-8ff9f6e9-a9a0-4cb9-9233-6f0d297a23ef None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=82975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:50:55 devstack cinder-volume[82975]: DEBUG oslo_service.backend._eventlet.service [None req-8ff9f6e9-a9a0-4cb9-9233-6f0d297a23ef None None] backend_defaults.chap_password = **** {{(pid=82975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:50:55 devstack cinder-volume[82975]: DEBUG oslo_service.backend._eventlet.service [None req-8ff9f6e9-a9a0-4cb9-9233-6f0d297a23ef None None] backend_defaults.chap_username = {{(pid=82975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:50:55 devstack cinder-volume[82975]: DEBUG oslo_service.backend._eventlet.service [None req-8ff9f6e9-a9a0-4cb9-9233-6f0d297a23ef None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=82975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:50:55 devstack cinder-volume[82975]: DEBUG oslo_service.backend._eventlet.service [None req-8ff9f6e9-a9a0-4cb9-9233-6f0d297a23ef None None] backend_defaults.disk_geometry = None {{(pid=82975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:50:55 devstack cinder-volume[82975]: DEBUG oslo_service.backend._eventlet.service [None req-8ff9f6e9-a9a0-4cb9-9233-6f0d297a23ef None None] backend_defaults.driver_client_cert = None {{(pid=82975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:50:55 devstack cinder-volume[82975]: DEBUG oslo_service.backend._eventlet.service [None req-8ff9f6e9-a9a0-4cb9-9233-6f0d297a23ef None None] backend_defaults.driver_client_cert_key = None {{(pid=82975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:50:55 devstack cinder-volume[82975]: DEBUG oslo_service.backend._eventlet.service [None req-8ff9f6e9-a9a0-4cb9-9233-6f0d297a23ef None None] backend_defaults.driver_data_namespace = None {{(pid=82975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:50:55 devstack cinder-volume[82975]: DEBUG oslo_service.backend._eventlet.service [None req-8ff9f6e9-a9a0-4cb9-9233-6f0d297a23ef None None] backend_defaults.driver_ssl_cert_path = None {{(pid=82975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:50:55 devstack cinder-volume[82975]: DEBUG oslo_service.backend._eventlet.service [None req-8ff9f6e9-a9a0-4cb9-9233-6f0d297a23ef None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=82975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:50:55 devstack cinder-volume[82975]: DEBUG oslo_service.backend._eventlet.service [None req-8ff9f6e9-a9a0-4cb9-9233-6f0d297a23ef None None] backend_defaults.driver_use_ssl = False {{(pid=82975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:50:55 devstack cinder-volume[82975]: DEBUG oslo_service.backend._eventlet.service [None req-8ff9f6e9-a9a0-4cb9-9233-6f0d297a23ef None None] backend_defaults.enable_unsupported_driver = False {{(pid=82975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:50:55 devstack cinder-volume[82975]: DEBUG oslo_service.backend._eventlet.service [None req-8ff9f6e9-a9a0-4cb9-9233-6f0d297a23ef None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=82975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:50:55 devstack cinder-volume[82975]: DEBUG oslo_service.backend._eventlet.service [None req-8ff9f6e9-a9a0-4cb9-9233-6f0d297a23ef None None] backend_defaults.extra_capabilities = {} {{(pid=82975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:50:55 devstack cinder-volume[82975]: DEBUG oslo_service.backend._eventlet.service [None req-8ff9f6e9-a9a0-4cb9-9233-6f0d297a23ef None None] backend_defaults.filter_function = None {{(pid=82975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:50:55 devstack cinder-volume[82975]: DEBUG oslo_service.backend._eventlet.service [None req-8ff9f6e9-a9a0-4cb9-9233-6f0d297a23ef None None] backend_defaults.goodness_function = None {{(pid=82975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:50:55 devstack cinder-volume[82975]: DEBUG oslo_service.backend._eventlet.service [None req-8ff9f6e9-a9a0-4cb9-9233-6f0d297a23ef None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=82975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:50:55 devstack cinder-volume[82975]: DEBUG oslo_service.backend._eventlet.service [None req-8ff9f6e9-a9a0-4cb9-9233-6f0d297a23ef None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=82975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:50:55 devstack cinder-volume[82975]: DEBUG oslo_service.backend._eventlet.service [None req-8ff9f6e9-a9a0-4cb9-9233-6f0d297a23ef None None] backend_defaults.image_volume_cache_enabled = False {{(pid=82975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:50:55 devstack cinder-volume[82975]: DEBUG oslo_service.backend._eventlet.service [None req-8ff9f6e9-a9a0-4cb9-9233-6f0d297a23ef None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=82975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:50:55 devstack cinder-volume[82975]: DEBUG oslo_service.backend._eventlet.service [None req-8ff9f6e9-a9a0-4cb9-9233-6f0d297a23ef None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=82975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:50:55 devstack cinder-volume[82975]: DEBUG oslo_service.backend._eventlet.service [None req-8ff9f6e9-a9a0-4cb9-9233-6f0d297a23ef None None] backend_defaults.iscsi_target_flags = {{(pid=82975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:50:55 devstack cinder-volume[82975]: DEBUG oslo_service.backend._eventlet.service [None req-8ff9f6e9-a9a0-4cb9-9233-6f0d297a23ef None None] backend_defaults.iscsi_write_cache = on {{(pid=82975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:50:55 devstack cinder-volume[82975]: DEBUG oslo_service.backend._eventlet.service [None req-8ff9f6e9-a9a0-4cb9-9233-6f0d297a23ef None None] backend_defaults.iser_helper = tgtadm {{(pid=82975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:50:55 devstack cinder-volume[82975]: DEBUG oslo_service.backend._eventlet.service [None req-8ff9f6e9-a9a0-4cb9-9233-6f0d297a23ef None None] backend_defaults.iser_ip_address = 192.168.122.119 {{(pid=82975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:50:55 devstack cinder-volume[82975]: DEBUG oslo_service.backend._eventlet.service [None req-8ff9f6e9-a9a0-4cb9-9233-6f0d297a23ef None None] backend_defaults.iser_port = 3260 {{(pid=82975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:50:55 devstack cinder-volume[82975]: DEBUG oslo_service.backend._eventlet.service [None req-8ff9f6e9-a9a0-4cb9-9233-6f0d297a23ef None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=82975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:50:55 devstack cinder-volume[82975]: DEBUG oslo_service.backend._eventlet.service [None req-8ff9f6e9-a9a0-4cb9-9233-6f0d297a23ef None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=82975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:50:55 devstack cinder-volume[82975]: DEBUG oslo_service.backend._eventlet.service [None req-8ff9f6e9-a9a0-4cb9-9233-6f0d297a23ef None None] backend_defaults.nas_host = {{(pid=82975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:50:55 devstack cinder-volume[82975]: DEBUG oslo_service.backend._eventlet.service [None req-8ff9f6e9-a9a0-4cb9-9233-6f0d297a23ef None None] backend_defaults.nas_login = admin {{(pid=82975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:50:55 devstack cinder-volume[82975]: DEBUG oslo_service.backend._eventlet.service [None req-8ff9f6e9-a9a0-4cb9-9233-6f0d297a23ef None None] backend_defaults.nas_mount_options = None {{(pid=82975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:50:55 devstack cinder-volume[82975]: DEBUG oslo_service.backend._eventlet.service [None req-8ff9f6e9-a9a0-4cb9-9233-6f0d297a23ef None None] backend_defaults.nas_password = **** {{(pid=82975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:50:55 devstack cinder-volume[82975]: DEBUG oslo_service.backend._eventlet.service [None req-8ff9f6e9-a9a0-4cb9-9233-6f0d297a23ef None None] backend_defaults.nas_private_key = {{(pid=82975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:50:55 devstack cinder-volume[82975]: DEBUG oslo_service.backend._eventlet.service [None req-8ff9f6e9-a9a0-4cb9-9233-6f0d297a23ef None None] backend_defaults.nas_secure_file_operations = auto {{(pid=82975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:50:55 devstack cinder-volume[82975]: DEBUG oslo_service.backend._eventlet.service [None req-8ff9f6e9-a9a0-4cb9-9233-6f0d297a23ef None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=82975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:50:55 devstack cinder-volume[82975]: DEBUG oslo_service.backend._eventlet.service [None req-8ff9f6e9-a9a0-4cb9-9233-6f0d297a23ef None None] backend_defaults.nas_share_path = {{(pid=82975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:50:55 devstack cinder-volume[82975]: DEBUG oslo_service.backend._eventlet.service [None req-8ff9f6e9-a9a0-4cb9-9233-6f0d297a23ef None None] backend_defaults.nas_ssh_port = 22 {{(pid=82975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:50:55 devstack cinder-volume[82975]: DEBUG oslo_service.backend._eventlet.service [None req-8ff9f6e9-a9a0-4cb9-9233-6f0d297a23ef None None] backend_defaults.nas_volume_prov_type = thin {{(pid=82975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:50:55 devstack cinder-volume[82975]: DEBUG oslo_service.backend._eventlet.service [None req-8ff9f6e9-a9a0-4cb9-9233-6f0d297a23ef None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=82975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:50:55 devstack cinder-volume[82975]: DEBUG oslo_service.backend._eventlet.service [None req-8ff9f6e9-a9a0-4cb9-9233-6f0d297a23ef None None] backend_defaults.num_shell_tries = 3 {{(pid=82975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:50:55 devstack cinder-volume[82975]: DEBUG oslo_service.backend._eventlet.service [None req-8ff9f6e9-a9a0-4cb9-9233-6f0d297a23ef None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=82975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:50:55 devstack cinder-volume[82975]: DEBUG oslo_service.backend._eventlet.service [None req-8ff9f6e9-a9a0-4cb9-9233-6f0d297a23ef None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=82975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:50:55 devstack cinder-volume[82975]: DEBUG oslo_service.backend._eventlet.service [None req-8ff9f6e9-a9a0-4cb9-9233-6f0d297a23ef None None] backend_defaults.nvmet_ns_id = 10 {{(pid=82975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:50:55 devstack cinder-volume[82975]: DEBUG oslo_service.backend._eventlet.service [None req-8ff9f6e9-a9a0-4cb9-9233-6f0d297a23ef None None] backend_defaults.nvmet_port_id = 1 {{(pid=82975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:50:55 devstack cinder-volume[82975]: DEBUG oslo_service.backend._eventlet.service [None req-8ff9f6e9-a9a0-4cb9-9233-6f0d297a23ef None None] backend_defaults.quobyte_client_cfg = None {{(pid=82975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:50:55 devstack cinder-volume[82975]: DEBUG oslo_service.backend._eventlet.service [None req-8ff9f6e9-a9a0-4cb9-9233-6f0d297a23ef None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=82975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:50:55 devstack cinder-volume[82975]: DEBUG oslo_service.backend._eventlet.service [None req-8ff9f6e9-a9a0-4cb9-9233-6f0d297a23ef None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=82975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:50:55 devstack cinder-volume[82975]: DEBUG oslo_service.backend._eventlet.service [None req-8ff9f6e9-a9a0-4cb9-9233-6f0d297a23ef None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=82975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:50:55 devstack cinder-volume[82975]: DEBUG oslo_service.backend._eventlet.service [None req-8ff9f6e9-a9a0-4cb9-9233-6f0d297a23ef None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=82975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:50:55 devstack cinder-volume[82975]: DEBUG oslo_service.backend._eventlet.service [None req-8ff9f6e9-a9a0-4cb9-9233-6f0d297a23ef None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=82975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:50:55 devstack cinder-volume[82975]: DEBUG oslo_service.backend._eventlet.service [None req-8ff9f6e9-a9a0-4cb9-9233-6f0d297a23ef None None] backend_defaults.quobyte_volume_url = None {{(pid=82975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:50:55 devstack cinder-volume[82975]: DEBUG oslo_service.backend._eventlet.service [None req-8ff9f6e9-a9a0-4cb9-9233-6f0d297a23ef None None] backend_defaults.replication_device = **** {{(pid=82975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:50:55 devstack cinder-volume[82975]: DEBUG oslo_service.backend._eventlet.service [None req-8ff9f6e9-a9a0-4cb9-9233-6f0d297a23ef None None] backend_defaults.report_discard_supported = False {{(pid=82975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:50:55 devstack cinder-volume[82975]: DEBUG oslo_service.backend._eventlet.service [None req-8ff9f6e9-a9a0-4cb9-9233-6f0d297a23ef None None] backend_defaults.reserved_percentage = 0 {{(pid=82975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:50:55 devstack cinder-volume[82975]: DEBUG oslo_service.backend._eventlet.service [None req-8ff9f6e9-a9a0-4cb9-9233-6f0d297a23ef None None] backend_defaults.scst_target_driver = iscsi {{(pid=82975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:50:55 devstack cinder-volume[82975]: DEBUG oslo_service.backend._eventlet.service [None req-8ff9f6e9-a9a0-4cb9-9233-6f0d297a23ef None None] backend_defaults.scst_target_iqn_name = None {{(pid=82975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:50:55 devstack cinder-volume[82975]: DEBUG oslo_service.backend._eventlet.service [None req-8ff9f6e9-a9a0-4cb9-9233-6f0d297a23ef None None] backend_defaults.storage_protocol = iSCSI {{(pid=82975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:50:55 devstack cinder-volume[82975]: DEBUG oslo_service.backend._eventlet.service [None req-8ff9f6e9-a9a0-4cb9-9233-6f0d297a23ef None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=82975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:50:55 devstack cinder-volume[82975]: DEBUG oslo_service.backend._eventlet.service [None req-8ff9f6e9-a9a0-4cb9-9233-6f0d297a23ef None None] backend_defaults.target_helper = tgtadm {{(pid=82975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:50:55 devstack cinder-volume[82975]: DEBUG oslo_service.backend._eventlet.service [None req-8ff9f6e9-a9a0-4cb9-9233-6f0d297a23ef None None] backend_defaults.target_ip_address = 192.168.122.119 {{(pid=82975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:50:55 devstack cinder-volume[82975]: DEBUG oslo_service.backend._eventlet.service [None req-8ff9f6e9-a9a0-4cb9-9233-6f0d297a23ef None None] backend_defaults.target_port = 3260 {{(pid=82975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:50:55 devstack cinder-volume[82975]: DEBUG oslo_service.backend._eventlet.service [None req-8ff9f6e9-a9a0-4cb9-9233-6f0d297a23ef None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=82975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:50:55 devstack cinder-volume[82975]: DEBUG oslo_service.backend._eventlet.service [None req-8ff9f6e9-a9a0-4cb9-9233-6f0d297a23ef None None] backend_defaults.target_protocol = iscsi {{(pid=82975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:50:55 devstack cinder-volume[82975]: DEBUG oslo_service.backend._eventlet.service [None req-8ff9f6e9-a9a0-4cb9-9233-6f0d297a23ef None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=82975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:50:55 devstack cinder-volume[82975]: DEBUG oslo_service.backend._eventlet.service [None req-8ff9f6e9-a9a0-4cb9-9233-6f0d297a23ef None None] backend_defaults.trace_flags = None {{(pid=82975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:50:55 devstack cinder-volume[82975]: DEBUG oslo_service.backend._eventlet.service [None req-8ff9f6e9-a9a0-4cb9-9233-6f0d297a23ef None None] backend_defaults.unique_fqdn_network = True {{(pid=82975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:50:55 devstack cinder-volume[82975]: DEBUG oslo_service.backend._eventlet.service [None req-8ff9f6e9-a9a0-4cb9-9233-6f0d297a23ef None None] backend_defaults.use_chap_auth = False {{(pid=82975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:50:55 devstack cinder-volume[82975]: DEBUG oslo_service.backend._eventlet.service [None req-8ff9f6e9-a9a0-4cb9-9233-6f0d297a23ef None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=82975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:50:55 devstack cinder-volume[82975]: DEBUG oslo_service.backend._eventlet.service [None req-8ff9f6e9-a9a0-4cb9-9233-6f0d297a23ef None None] backend_defaults.volume_backend_name = None {{(pid=82975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:50:55 devstack cinder-volume[82975]: DEBUG oslo_service.backend._eventlet.service [None req-8ff9f6e9-a9a0-4cb9-9233-6f0d297a23ef None None] backend_defaults.volume_clear = zero {{(pid=82975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:50:55 devstack cinder-volume[82975]: DEBUG oslo_service.backend._eventlet.service [None req-8ff9f6e9-a9a0-4cb9-9233-6f0d297a23ef None None] backend_defaults.volume_clear_ionice = None {{(pid=82975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:50:55 devstack cinder-volume[82975]: DEBUG oslo_service.backend._eventlet.service [None req-8ff9f6e9-a9a0-4cb9-9233-6f0d297a23ef None None] backend_defaults.volume_clear_size = 0 {{(pid=82975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:50:55 devstack cinder-volume[82975]: DEBUG oslo_service.backend._eventlet.service [None req-8ff9f6e9-a9a0-4cb9-9233-6f0d297a23ef None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=82975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:50:55 devstack cinder-volume[82975]: DEBUG oslo_service.backend._eventlet.service [None req-8ff9f6e9-a9a0-4cb9-9233-6f0d297a23ef None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=82975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:50:55 devstack cinder-volume[82975]: DEBUG oslo_service.backend._eventlet.service [None req-8ff9f6e9-a9a0-4cb9-9233-6f0d297a23ef None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=82975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:50:55 devstack cinder-volume[82975]: DEBUG oslo_service.backend._eventlet.service [None req-8ff9f6e9-a9a0-4cb9-9233-6f0d297a23ef None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=82975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:50:55 devstack cinder-volume[82975]: DEBUG oslo_service.backend._eventlet.service [None req-8ff9f6e9-a9a0-4cb9-9233-6f0d297a23ef None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=82975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:50:55 devstack cinder-volume[82975]: DEBUG oslo_service.backend._eventlet.service [None req-8ff9f6e9-a9a0-4cb9-9233-6f0d297a23ef None None] oslo_reports.file_event_handler = None {{(pid=82975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:50:55 devstack cinder-volume[82975]: DEBUG oslo_service.backend._eventlet.service [None req-8ff9f6e9-a9a0-4cb9-9233-6f0d297a23ef None None] oslo_reports.file_event_handler_interval = 1 {{(pid=82975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:50:55 devstack cinder-volume[82975]: DEBUG oslo_service.backend._eventlet.service [None req-8ff9f6e9-a9a0-4cb9-9233-6f0d297a23ef None None] oslo_reports.log_dir = None {{(pid=82975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:50:55 devstack cinder-volume[82975]: DEBUG oslo_service.backend._eventlet.service [None req-8ff9f6e9-a9a0-4cb9-9233-6f0d297a23ef None None] QuobyteHD.backend_availability_zone = None {{(pid=82975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:50:55 devstack cinder-volume[82975]: DEBUG oslo_service.backend._eventlet.service [None req-8ff9f6e9-a9a0-4cb9-9233-6f0d297a23ef None None] QuobyteHD.backend_host = None {{(pid=82975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:50:55 devstack cinder-volume[82975]: DEBUG oslo_service.backend._eventlet.service [None req-8ff9f6e9-a9a0-4cb9-9233-6f0d297a23ef None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=82975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:50:55 devstack cinder-volume[82975]: DEBUG oslo_service.backend._eventlet.service [None req-8ff9f6e9-a9a0-4cb9-9233-6f0d297a23ef None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=82975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:50:55 devstack cinder-volume[82975]: DEBUG oslo_service.backend._eventlet.service [None req-8ff9f6e9-a9a0-4cb9-9233-6f0d297a23ef None None] QuobyteHD.chap_password = **** {{(pid=82975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:50:55 devstack cinder-volume[82975]: DEBUG oslo_service.backend._eventlet.service [None req-8ff9f6e9-a9a0-4cb9-9233-6f0d297a23ef None None] QuobyteHD.chap_username = None {{(pid=82975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:50:55 devstack cinder-volume[82975]: DEBUG oslo_service.backend._eventlet.service [None req-8ff9f6e9-a9a0-4cb9-9233-6f0d297a23ef None None] QuobyteHD.chiscsi_conf = None {{(pid=82975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:50:55 devstack cinder-volume[82975]: DEBUG oslo_service.backend._eventlet.service [None req-8ff9f6e9-a9a0-4cb9-9233-6f0d297a23ef None None] QuobyteHD.disk_geometry = None {{(pid=82975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:50:55 devstack cinder-volume[82975]: DEBUG oslo_service.backend._eventlet.service [None req-8ff9f6e9-a9a0-4cb9-9233-6f0d297a23ef None None] QuobyteHD.driver_client_cert = None {{(pid=82975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:50:55 devstack cinder-volume[82975]: DEBUG oslo_service.backend._eventlet.service [None req-8ff9f6e9-a9a0-4cb9-9233-6f0d297a23ef None None] QuobyteHD.driver_client_cert_key = None {{(pid=82975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:50:55 devstack cinder-volume[82975]: DEBUG oslo_service.backend._eventlet.service [None req-8ff9f6e9-a9a0-4cb9-9233-6f0d297a23ef None None] QuobyteHD.driver_data_namespace = None {{(pid=82975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:50:55 devstack cinder-volume[82975]: DEBUG oslo_service.backend._eventlet.service [None req-8ff9f6e9-a9a0-4cb9-9233-6f0d297a23ef None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=82975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:50:55 devstack cinder-volume[82975]: DEBUG oslo_service.backend._eventlet.service [None req-8ff9f6e9-a9a0-4cb9-9233-6f0d297a23ef None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=82975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:50:55 devstack cinder-volume[82975]: DEBUG oslo_service.backend._eventlet.service [None req-8ff9f6e9-a9a0-4cb9-9233-6f0d297a23ef None None] QuobyteHD.driver_use_ssl = None {{(pid=82975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:50:55 devstack cinder-volume[82975]: DEBUG oslo_service.backend._eventlet.service [None req-8ff9f6e9-a9a0-4cb9-9233-6f0d297a23ef None None] QuobyteHD.enable_unsupported_driver = True {{(pid=82975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:50:55 devstack cinder-volume[82975]: DEBUG oslo_service.backend._eventlet.service [None req-8ff9f6e9-a9a0-4cb9-9233-6f0d297a23ef None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=82975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:50:55 devstack cinder-volume[82975]: DEBUG oslo_service.backend._eventlet.service [None req-8ff9f6e9-a9a0-4cb9-9233-6f0d297a23ef None None] QuobyteHD.extra_capabilities = None {{(pid=82975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:50:55 devstack cinder-volume[82975]: DEBUG oslo_service.backend._eventlet.service [None req-8ff9f6e9-a9a0-4cb9-9233-6f0d297a23ef None None] QuobyteHD.filter_function = None {{(pid=82975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:50:55 devstack cinder-volume[82975]: DEBUG oslo_service.backend._eventlet.service [None req-8ff9f6e9-a9a0-4cb9-9233-6f0d297a23ef None None] QuobyteHD.goodness_function = None {{(pid=82975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:50:55 devstack cinder-volume[82975]: DEBUG oslo_service.backend._eventlet.service [None req-8ff9f6e9-a9a0-4cb9-9233-6f0d297a23ef None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=82975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:50:55 devstack cinder-volume[82975]: DEBUG oslo_service.backend._eventlet.service [None req-8ff9f6e9-a9a0-4cb9-9233-6f0d297a23ef None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=82975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:50:55 devstack cinder-volume[82975]: DEBUG oslo_service.backend._eventlet.service [None req-8ff9f6e9-a9a0-4cb9-9233-6f0d297a23ef None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=82975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:50:55 devstack cinder-volume[82975]: DEBUG oslo_service.backend._eventlet.service [None req-8ff9f6e9-a9a0-4cb9-9233-6f0d297a23ef None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=82975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:50:55 devstack cinder-volume[82975]: DEBUG oslo_service.backend._eventlet.service [None req-8ff9f6e9-a9a0-4cb9-9233-6f0d297a23ef None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=82975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:50:55 devstack cinder-volume[82975]: DEBUG oslo_service.backend._eventlet.service [None req-8ff9f6e9-a9a0-4cb9-9233-6f0d297a23ef None None] QuobyteHD.iscsi_target_flags = None {{(pid=82975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:50:55 devstack cinder-volume[82975]: DEBUG oslo_service.backend._eventlet.service [None req-8ff9f6e9-a9a0-4cb9-9233-6f0d297a23ef None None] QuobyteHD.iscsi_write_cache = None {{(pid=82975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:50:55 devstack cinder-volume[82975]: DEBUG oslo_service.backend._eventlet.service [None req-8ff9f6e9-a9a0-4cb9-9233-6f0d297a23ef None None] QuobyteHD.iser_helper = None {{(pid=82975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:50:55 devstack cinder-volume[82975]: DEBUG oslo_service.backend._eventlet.service [None req-8ff9f6e9-a9a0-4cb9-9233-6f0d297a23ef None None] QuobyteHD.iser_ip_address = None {{(pid=82975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:50:55 devstack cinder-volume[82975]: DEBUG oslo_service.backend._eventlet.service [None req-8ff9f6e9-a9a0-4cb9-9233-6f0d297a23ef None None] QuobyteHD.iser_port = None {{(pid=82975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:50:55 devstack cinder-volume[82975]: DEBUG oslo_service.backend._eventlet.service [None req-8ff9f6e9-a9a0-4cb9-9233-6f0d297a23ef None None] QuobyteHD.iser_target_prefix = None {{(pid=82975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:50:55 devstack cinder-volume[82975]: DEBUG oslo_service.backend._eventlet.service [None req-8ff9f6e9-a9a0-4cb9-9233-6f0d297a23ef None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=82975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:50:55 devstack cinder-volume[82975]: DEBUG oslo_service.backend._eventlet.service [None req-8ff9f6e9-a9a0-4cb9-9233-6f0d297a23ef None None] QuobyteHD.nas_host = None {{(pid=82975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:50:55 devstack cinder-volume[82975]: DEBUG oslo_service.backend._eventlet.service [None req-8ff9f6e9-a9a0-4cb9-9233-6f0d297a23ef None None] QuobyteHD.nas_login = None {{(pid=82975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:50:55 devstack cinder-volume[82975]: DEBUG oslo_service.backend._eventlet.service [None req-8ff9f6e9-a9a0-4cb9-9233-6f0d297a23ef None None] QuobyteHD.nas_mount_options = None {{(pid=82975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:50:55 devstack cinder-volume[82975]: DEBUG oslo_service.backend._eventlet.service [None req-8ff9f6e9-a9a0-4cb9-9233-6f0d297a23ef None None] QuobyteHD.nas_password = **** {{(pid=82975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:50:55 devstack cinder-volume[82975]: DEBUG oslo_service.backend._eventlet.service [None req-8ff9f6e9-a9a0-4cb9-9233-6f0d297a23ef None None] QuobyteHD.nas_private_key = None {{(pid=82975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:50:55 devstack cinder-volume[82975]: DEBUG oslo_service.backend._eventlet.service [None req-8ff9f6e9-a9a0-4cb9-9233-6f0d297a23ef None None] QuobyteHD.nas_secure_file_operations = false {{(pid=82975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:50:55 devstack cinder-volume[82975]: DEBUG oslo_service.backend._eventlet.service [None req-8ff9f6e9-a9a0-4cb9-9233-6f0d297a23ef None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=82975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:50:55 devstack cinder-volume[82975]: DEBUG oslo_service.backend._eventlet.service [None req-8ff9f6e9-a9a0-4cb9-9233-6f0d297a23ef None None] QuobyteHD.nas_share_path = None {{(pid=82975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:50:55 devstack cinder-volume[82975]: DEBUG oslo_service.backend._eventlet.service [None req-8ff9f6e9-a9a0-4cb9-9233-6f0d297a23ef None None] QuobyteHD.nas_ssh_port = None {{(pid=82975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:50:55 devstack cinder-volume[82975]: DEBUG oslo_service.backend._eventlet.service [None req-8ff9f6e9-a9a0-4cb9-9233-6f0d297a23ef None None] QuobyteHD.nas_volume_prov_type = None {{(pid=82975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:50:55 devstack cinder-volume[82975]: DEBUG oslo_service.backend._eventlet.service [None req-8ff9f6e9-a9a0-4cb9-9233-6f0d297a23ef None None] QuobyteHD.num_iser_scan_tries = None {{(pid=82975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:50:55 devstack cinder-volume[82975]: DEBUG oslo_service.backend._eventlet.service [None req-8ff9f6e9-a9a0-4cb9-9233-6f0d297a23ef None None] QuobyteHD.num_shell_tries = None {{(pid=82975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:50:55 devstack cinder-volume[82975]: DEBUG oslo_service.backend._eventlet.service [None req-8ff9f6e9-a9a0-4cb9-9233-6f0d297a23ef None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=82975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:50:55 devstack cinder-volume[82975]: DEBUG oslo_service.backend._eventlet.service [None req-8ff9f6e9-a9a0-4cb9-9233-6f0d297a23ef None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=82975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:50:55 devstack cinder-volume[82975]: DEBUG oslo_service.backend._eventlet.service [None req-8ff9f6e9-a9a0-4cb9-9233-6f0d297a23ef None None] QuobyteHD.nvmet_ns_id = None {{(pid=82975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:50:55 devstack cinder-volume[82975]: DEBUG oslo_service.backend._eventlet.service [None req-8ff9f6e9-a9a0-4cb9-9233-6f0d297a23ef None None] QuobyteHD.nvmet_port_id = None {{(pid=82975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:50:55 devstack cinder-volume[82975]: DEBUG oslo_service.backend._eventlet.service [None req-8ff9f6e9-a9a0-4cb9-9233-6f0d297a23ef None None] QuobyteHD.quobyte_client_cfg = /etc/quobyte/client-cinder.cfg {{(pid=82975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:50:55 devstack cinder-volume[82975]: DEBUG oslo_service.backend._eventlet.service [None req-8ff9f6e9-a9a0-4cb9-9233-6f0d297a23ef None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=82975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:50:55 devstack cinder-volume[82975]: DEBUG oslo_service.backend._eventlet.service [None req-8ff9f6e9-a9a0-4cb9-9233-6f0d297a23ef None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=82975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:50:55 devstack cinder-volume[82975]: DEBUG oslo_service.backend._eventlet.service [None req-8ff9f6e9-a9a0-4cb9-9233-6f0d297a23ef None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=82975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:50:55 devstack cinder-volume[82975]: DEBUG oslo_service.backend._eventlet.service [None req-8ff9f6e9-a9a0-4cb9-9233-6f0d297a23ef None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=82975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:50:55 devstack cinder-volume[82975]: DEBUG oslo_service.backend._eventlet.service [None req-8ff9f6e9-a9a0-4cb9-9233-6f0d297a23ef None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=82975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:50:55 devstack cinder-volume[82975]: DEBUG oslo_service.backend._eventlet.service [None req-8ff9f6e9-a9a0-4cb9-9233-6f0d297a23ef None None] QuobyteHD.quobyte_volume_url = quobyte://osci02.corp.quobyte.com/cinder-vol-23e9d725-3e04-4cd9-bfe0-c8ef43305589 {{(pid=82975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:50:55 devstack cinder-volume[82975]: DEBUG oslo_service.backend._eventlet.service [None req-8ff9f6e9-a9a0-4cb9-9233-6f0d297a23ef None None] QuobyteHD.replication_device = **** {{(pid=82975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:50:55 devstack cinder-volume[82975]: DEBUG oslo_service.backend._eventlet.service [None req-8ff9f6e9-a9a0-4cb9-9233-6f0d297a23ef None None] QuobyteHD.report_discard_supported = None {{(pid=82975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:50:55 devstack cinder-volume[82975]: DEBUG oslo_service.backend._eventlet.service [None req-8ff9f6e9-a9a0-4cb9-9233-6f0d297a23ef None None] QuobyteHD.reserved_percentage = None {{(pid=82975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:50:55 devstack cinder-volume[82975]: DEBUG oslo_service.backend._eventlet.service [None req-8ff9f6e9-a9a0-4cb9-9233-6f0d297a23ef None None] QuobyteHD.scst_target_driver = None {{(pid=82975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:50:55 devstack cinder-volume[82975]: DEBUG oslo_service.backend._eventlet.service [None req-8ff9f6e9-a9a0-4cb9-9233-6f0d297a23ef None None] QuobyteHD.scst_target_iqn_name = None {{(pid=82975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:50:55 devstack cinder-volume[82975]: DEBUG oslo_service.backend._eventlet.service [None req-8ff9f6e9-a9a0-4cb9-9233-6f0d297a23ef None None] QuobyteHD.storage_protocol = None {{(pid=82975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:50:55 devstack cinder-volume[82975]: DEBUG oslo_service.backend._eventlet.service [None req-8ff9f6e9-a9a0-4cb9-9233-6f0d297a23ef None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=82975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:50:55 devstack cinder-volume[82975]: DEBUG oslo_service.backend._eventlet.service [None req-8ff9f6e9-a9a0-4cb9-9233-6f0d297a23ef None None] QuobyteHD.target_helper = None {{(pid=82975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:50:55 devstack cinder-volume[82975]: DEBUG oslo_service.backend._eventlet.service [None req-8ff9f6e9-a9a0-4cb9-9233-6f0d297a23ef None None] QuobyteHD.target_ip_address = None {{(pid=82975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:50:55 devstack cinder-volume[82975]: DEBUG oslo_service.backend._eventlet.service [None req-8ff9f6e9-a9a0-4cb9-9233-6f0d297a23ef None None] QuobyteHD.target_port = None {{(pid=82975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:50:55 devstack cinder-volume[82975]: DEBUG oslo_service.backend._eventlet.service [None req-8ff9f6e9-a9a0-4cb9-9233-6f0d297a23ef None None] QuobyteHD.target_prefix = None {{(pid=82975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:50:55 devstack cinder-volume[82975]: DEBUG oslo_service.backend._eventlet.service [None req-8ff9f6e9-a9a0-4cb9-9233-6f0d297a23ef None None] QuobyteHD.target_protocol = None {{(pid=82975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:50:55 devstack cinder-volume[82975]: DEBUG oslo_service.backend._eventlet.service [None req-8ff9f6e9-a9a0-4cb9-9233-6f0d297a23ef None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=82975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:50:55 devstack cinder-volume[82975]: DEBUG oslo_service.backend._eventlet.service [None req-8ff9f6e9-a9a0-4cb9-9233-6f0d297a23ef None None] QuobyteHD.trace_flags = None {{(pid=82975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:50:55 devstack cinder-volume[82975]: DEBUG oslo_service.backend._eventlet.service [None req-8ff9f6e9-a9a0-4cb9-9233-6f0d297a23ef None None] QuobyteHD.unique_fqdn_network = None {{(pid=82975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:50:55 devstack cinder-volume[82975]: DEBUG oslo_service.backend._eventlet.service [None req-8ff9f6e9-a9a0-4cb9-9233-6f0d297a23ef None None] QuobyteHD.use_chap_auth = None {{(pid=82975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:50:55 devstack cinder-volume[82975]: DEBUG oslo_service.backend._eventlet.service [None req-8ff9f6e9-a9a0-4cb9-9233-6f0d297a23ef None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=82975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:50:55 devstack cinder-volume[82975]: DEBUG oslo_service.backend._eventlet.service [None req-8ff9f6e9-a9a0-4cb9-9233-6f0d297a23ef None None] QuobyteHD.volume_backend_name = QuobyteHD {{(pid=82975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:50:55 devstack cinder-volume[82975]: DEBUG oslo_service.backend._eventlet.service [None req-8ff9f6e9-a9a0-4cb9-9233-6f0d297a23ef None None] QuobyteHD.volume_clear = None {{(pid=82975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:50:55 devstack cinder-volume[82975]: DEBUG oslo_service.backend._eventlet.service [None req-8ff9f6e9-a9a0-4cb9-9233-6f0d297a23ef None None] QuobyteHD.volume_clear_ionice = None {{(pid=82975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:50:55 devstack cinder-volume[82975]: DEBUG oslo_service.backend._eventlet.service [None req-8ff9f6e9-a9a0-4cb9-9233-6f0d297a23ef None None] QuobyteHD.volume_clear_size = None {{(pid=82975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:50:55 devstack cinder-volume[82975]: DEBUG oslo_service.backend._eventlet.service [None req-8ff9f6e9-a9a0-4cb9-9233-6f0d297a23ef None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=82975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:50:55 devstack cinder-volume[82975]: DEBUG oslo_service.backend._eventlet.service [None req-8ff9f6e9-a9a0-4cb9-9233-6f0d297a23ef None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=82975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:50:55 devstack cinder-volume[82975]: DEBUG oslo_service.backend._eventlet.service [None req-8ff9f6e9-a9a0-4cb9-9233-6f0d297a23ef None None] QuobyteHD.volume_dd_blocksize = None {{(pid=82975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:50:55 devstack cinder-volume[82975]: DEBUG oslo_service.backend._eventlet.service [None req-8ff9f6e9-a9a0-4cb9-9233-6f0d297a23ef None None] QuobyteHD.volume_driver = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=82975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:50:55 devstack cinder-volume[82975]: DEBUG oslo_service.backend._eventlet.service [None req-8ff9f6e9-a9a0-4cb9-9233-6f0d297a23ef None None] QuobyteHD.volumes_dir = None {{(pid=82975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:50:55 devstack cinder-volume[82975]: DEBUG oslo_service.backend._eventlet.service [None req-8ff9f6e9-a9a0-4cb9-9233-6f0d297a23ef None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=82975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:50:55 devstack cinder-volume[82975]: DEBUG oslo_service.backend._eventlet.service [None req-8ff9f6e9-a9a0-4cb9-9233-6f0d297a23ef None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=82975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:50:55 devstack cinder-volume[82975]: DEBUG oslo_service.backend._eventlet.service [None req-8ff9f6e9-a9a0-4cb9-9233-6f0d297a23ef None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=82975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:50:55 devstack cinder-volume[82975]: DEBUG oslo_service.backend._eventlet.service [None req-8ff9f6e9-a9a0-4cb9-9233-6f0d297a23ef None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=82975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:50:55 devstack cinder-volume[82975]: DEBUG oslo_service.backend._eventlet.service [None req-8ff9f6e9-a9a0-4cb9-9233-6f0d297a23ef None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=82975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:50:55 devstack cinder-volume[82975]: DEBUG oslo_service.backend._eventlet.service [None req-8ff9f6e9-a9a0-4cb9-9233-6f0d297a23ef None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=82975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:50:55 devstack cinder-volume[82975]: DEBUG oslo_service.backend._eventlet.service [None req-8ff9f6e9-a9a0-4cb9-9233-6f0d297a23ef None None] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=82975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:50:55 devstack cinder-volume[82975]: DEBUG oslo_service.backend._eventlet.service [None req-8ff9f6e9-a9a0-4cb9-9233-6f0d297a23ef None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=82975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:50:55 devstack cinder-volume[82975]: DEBUG oslo_service.backend._eventlet.service [None req-8ff9f6e9-a9a0-4cb9-9233-6f0d297a23ef None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=82975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:50:55 devstack cinder-volume[82975]: DEBUG oslo_service.backend._eventlet.service [None req-8ff9f6e9-a9a0-4cb9-9233-6f0d297a23ef None None] oslo_messaging_rabbit.hostname = devstack {{(pid=82975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:50:55 devstack cinder-volume[82975]: DEBUG oslo_service.backend._eventlet.service [None req-8ff9f6e9-a9a0-4cb9-9233-6f0d297a23ef None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=82975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:50:55 devstack cinder-volume[82975]: DEBUG oslo_service.backend._eventlet.service [None req-8ff9f6e9-a9a0-4cb9-9233-6f0d297a23ef None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=82975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:50:55 devstack cinder-volume[82975]: DEBUG oslo_service.backend._eventlet.service [None req-8ff9f6e9-a9a0-4cb9-9233-6f0d297a23ef None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=82975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:50:55 devstack cinder-volume[82975]: DEBUG oslo_service.backend._eventlet.service [None req-8ff9f6e9-a9a0-4cb9-9233-6f0d297a23ef None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=82975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:50:55 devstack cinder-volume[82975]: DEBUG oslo_service.backend._eventlet.service [None req-8ff9f6e9-a9a0-4cb9-9233-6f0d297a23ef None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=82975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:50:55 devstack cinder-volume[82975]: DEBUG oslo_service.backend._eventlet.service [None req-8ff9f6e9-a9a0-4cb9-9233-6f0d297a23ef None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=82975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:50:55 devstack cinder-volume[82975]: DEBUG oslo_service.backend._eventlet.service [None req-8ff9f6e9-a9a0-4cb9-9233-6f0d297a23ef None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=82975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:50:55 devstack cinder-volume[82975]: DEBUG oslo_service.backend._eventlet.service [None req-8ff9f6e9-a9a0-4cb9-9233-6f0d297a23ef None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=82975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:50:55 devstack cinder-volume[82975]: DEBUG oslo_service.backend._eventlet.service [None req-8ff9f6e9-a9a0-4cb9-9233-6f0d297a23ef None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=82975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:50:55 devstack cinder-volume[82975]: DEBUG oslo_service.backend._eventlet.service [None req-8ff9f6e9-a9a0-4cb9-9233-6f0d297a23ef None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=82975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:50:55 devstack cinder-volume[82975]: DEBUG oslo_service.backend._eventlet.service [None req-8ff9f6e9-a9a0-4cb9-9233-6f0d297a23ef None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=82975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:50:55 devstack cinder-volume[82975]: DEBUG oslo_service.backend._eventlet.service [None req-8ff9f6e9-a9a0-4cb9-9233-6f0d297a23ef None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=82975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:50:55 devstack cinder-volume[82975]: DEBUG oslo_service.backend._eventlet.service [None req-8ff9f6e9-a9a0-4cb9-9233-6f0d297a23ef None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=82975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:50:55 devstack cinder-volume[82975]: DEBUG oslo_service.backend._eventlet.service [None req-8ff9f6e9-a9a0-4cb9-9233-6f0d297a23ef None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=82975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:50:55 devstack cinder-volume[82975]: DEBUG oslo_service.backend._eventlet.service [None req-8ff9f6e9-a9a0-4cb9-9233-6f0d297a23ef None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=82975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:50:55 devstack cinder-volume[82975]: DEBUG oslo_service.backend._eventlet.service [None req-8ff9f6e9-a9a0-4cb9-9233-6f0d297a23ef None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=82975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:50:55 devstack cinder-volume[82975]: DEBUG oslo_service.backend._eventlet.service [None req-8ff9f6e9-a9a0-4cb9-9233-6f0d297a23ef None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=82975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:50:55 devstack cinder-volume[82975]: DEBUG oslo_service.backend._eventlet.service [None req-8ff9f6e9-a9a0-4cb9-9233-6f0d297a23ef None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=82975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:50:55 devstack cinder-volume[82975]: DEBUG oslo_service.backend._eventlet.service [None req-8ff9f6e9-a9a0-4cb9-9233-6f0d297a23ef None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=82975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:50:55 devstack cinder-volume[82975]: DEBUG oslo_service.backend._eventlet.service [None req-8ff9f6e9-a9a0-4cb9-9233-6f0d297a23ef None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=82975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:50:55 devstack cinder-volume[82975]: DEBUG oslo_service.backend._eventlet.service [None req-8ff9f6e9-a9a0-4cb9-9233-6f0d297a23ef None None] oslo_messaging_rabbit.ssl = False {{(pid=82975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:50:55 devstack cinder-volume[82975]: DEBUG oslo_service.backend._eventlet.service [None req-8ff9f6e9-a9a0-4cb9-9233-6f0d297a23ef None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=82975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:50:55 devstack cinder-volume[82975]: DEBUG oslo_service.backend._eventlet.service [None req-8ff9f6e9-a9a0-4cb9-9233-6f0d297a23ef None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=82975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:50:55 devstack cinder-volume[82975]: DEBUG oslo_service.backend._eventlet.service [None req-8ff9f6e9-a9a0-4cb9-9233-6f0d297a23ef None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=82975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:50:55 devstack cinder-volume[82975]: DEBUG oslo_service.backend._eventlet.service [None req-8ff9f6e9-a9a0-4cb9-9233-6f0d297a23ef None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=82975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:50:55 devstack cinder-volume[82975]: DEBUG oslo_service.backend._eventlet.service [None req-8ff9f6e9-a9a0-4cb9-9233-6f0d297a23ef None None] oslo_messaging_rabbit.ssl_version = {{(pid=82975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:50:55 devstack cinder-volume[82975]: DEBUG oslo_service.backend._eventlet.service [None req-8ff9f6e9-a9a0-4cb9-9233-6f0d297a23ef None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=82975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:50:55 devstack cinder-volume[82975]: DEBUG oslo_service.backend._eventlet.service [None req-8ff9f6e9-a9a0-4cb9-9233-6f0d297a23ef None None] oslo_messaging_notifications.driver = [] {{(pid=82975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:50:55 devstack cinder-volume[82975]: DEBUG oslo_service.backend._eventlet.service [None req-8ff9f6e9-a9a0-4cb9-9233-6f0d297a23ef None None] oslo_messaging_notifications.retry = -1 {{(pid=82975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:50:55 devstack cinder-volume[82975]: DEBUG oslo_service.backend._eventlet.service [None req-8ff9f6e9-a9a0-4cb9-9233-6f0d297a23ef None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=82975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:50:55 devstack cinder-volume[82975]: DEBUG oslo_service.backend._eventlet.service [None req-8ff9f6e9-a9a0-4cb9-9233-6f0d297a23ef None None] oslo_messaging_notifications.transport_url = **** {{(pid=82975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:50:55 devstack cinder-volume[82975]: DEBUG oslo_service.backend._eventlet.service [None req-8ff9f6e9-a9a0-4cb9-9233-6f0d297a23ef None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=82975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:50:55 devstack cinder-volume[82975]: DEBUG oslo_service.backend._eventlet.service [None req-8ff9f6e9-a9a0-4cb9-9233-6f0d297a23ef None None] key_manager.fixed_key = **** {{(pid=82975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:50:55 devstack cinder-volume[82975]: DEBUG oslo_service.backend._eventlet.service [None req-8ff9f6e9-a9a0-4cb9-9233-6f0d297a23ef None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=82975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:50:55 devstack cinder-volume[82975]: DEBUG oslo_service.backend._eventlet.service [None req-8ff9f6e9-a9a0-4cb9-9233-6f0d297a23ef None None] barbican.barbican_api_version = None {{(pid=82975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:50:55 devstack cinder-volume[82975]: DEBUG oslo_service.backend._eventlet.service [None req-8ff9f6e9-a9a0-4cb9-9233-6f0d297a23ef None None] barbican.barbican_endpoint = None {{(pid=82975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:50:55 devstack cinder-volume[82975]: DEBUG oslo_service.backend._eventlet.service [None req-8ff9f6e9-a9a0-4cb9-9233-6f0d297a23ef None None] barbican.barbican_endpoint_type = public {{(pid=82975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:50:55 devstack cinder-volume[82975]: DEBUG oslo_service.backend._eventlet.service [None req-8ff9f6e9-a9a0-4cb9-9233-6f0d297a23ef None None] barbican.barbican_region_name = None {{(pid=82975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:50:55 devstack cinder-volume[82975]: DEBUG oslo_service.backend._eventlet.service [None req-8ff9f6e9-a9a0-4cb9-9233-6f0d297a23ef None None] barbican.cafile = None {{(pid=82975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:50:55 devstack cinder-volume[82975]: DEBUG oslo_service.backend._eventlet.service [None req-8ff9f6e9-a9a0-4cb9-9233-6f0d297a23ef None None] barbican.certfile = None {{(pid=82975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:50:55 devstack cinder-volume[82975]: DEBUG oslo_service.backend._eventlet.service [None req-8ff9f6e9-a9a0-4cb9-9233-6f0d297a23ef None None] barbican.collect_timing = False {{(pid=82975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:50:55 devstack cinder-volume[82975]: DEBUG oslo_service.backend._eventlet.service [None req-8ff9f6e9-a9a0-4cb9-9233-6f0d297a23ef None None] barbican.insecure = False {{(pid=82975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:50:55 devstack cinder-volume[82975]: DEBUG oslo_service.backend._eventlet.service [None req-8ff9f6e9-a9a0-4cb9-9233-6f0d297a23ef None None] barbican.keyfile = None {{(pid=82975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:50:55 devstack cinder-volume[82975]: DEBUG oslo_service.backend._eventlet.service [None req-8ff9f6e9-a9a0-4cb9-9233-6f0d297a23ef None None] barbican.number_of_retries = 60 {{(pid=82975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:50:55 devstack cinder-volume[82975]: DEBUG oslo_service.backend._eventlet.service [None req-8ff9f6e9-a9a0-4cb9-9233-6f0d297a23ef None None] barbican.retry_delay = 1 {{(pid=82975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:50:55 devstack cinder-volume[82975]: DEBUG oslo_service.backend._eventlet.service [None req-8ff9f6e9-a9a0-4cb9-9233-6f0d297a23ef None None] barbican.send_service_user_token = False {{(pid=82975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:50:55 devstack cinder-volume[82975]: DEBUG oslo_service.backend._eventlet.service [None req-8ff9f6e9-a9a0-4cb9-9233-6f0d297a23ef None None] barbican.split_loggers = False {{(pid=82975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:50:55 devstack cinder-volume[82975]: DEBUG oslo_service.backend._eventlet.service [None req-8ff9f6e9-a9a0-4cb9-9233-6f0d297a23ef None None] barbican.timeout = None {{(pid=82975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:50:55 devstack cinder-volume[82975]: DEBUG oslo_service.backend._eventlet.service [None req-8ff9f6e9-a9a0-4cb9-9233-6f0d297a23ef None None] barbican.verify_ssl = True {{(pid=82975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:50:55 devstack cinder-volume[82975]: DEBUG oslo_service.backend._eventlet.service [None req-8ff9f6e9-a9a0-4cb9-9233-6f0d297a23ef None None] barbican.verify_ssl_path = None {{(pid=82975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:50:55 devstack cinder-volume[82975]: DEBUG oslo_service.backend._eventlet.service [None req-8ff9f6e9-a9a0-4cb9-9233-6f0d297a23ef None None] barbican_service_user.auth_section = None {{(pid=82975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:50:55 devstack cinder-volume[82975]: DEBUG oslo_service.backend._eventlet.service [None req-8ff9f6e9-a9a0-4cb9-9233-6f0d297a23ef None None] barbican_service_user.auth_type = None {{(pid=82975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:50:55 devstack cinder-volume[82975]: DEBUG oslo_service.backend._eventlet.service [None req-8ff9f6e9-a9a0-4cb9-9233-6f0d297a23ef None None] barbican_service_user.cafile = None {{(pid=82975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:50:55 devstack cinder-volume[82975]: DEBUG oslo_service.backend._eventlet.service [None req-8ff9f6e9-a9a0-4cb9-9233-6f0d297a23ef None None] barbican_service_user.certfile = None {{(pid=82975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:50:55 devstack cinder-volume[82975]: DEBUG oslo_service.backend._eventlet.service [None req-8ff9f6e9-a9a0-4cb9-9233-6f0d297a23ef None None] barbican_service_user.collect_timing = False {{(pid=82975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:50:55 devstack cinder-volume[82975]: DEBUG oslo_service.backend._eventlet.service [None req-8ff9f6e9-a9a0-4cb9-9233-6f0d297a23ef None None] barbican_service_user.insecure = False {{(pid=82975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:50:55 devstack cinder-volume[82975]: DEBUG oslo_service.backend._eventlet.service [None req-8ff9f6e9-a9a0-4cb9-9233-6f0d297a23ef None None] barbican_service_user.keyfile = None {{(pid=82975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:50:55 devstack cinder-volume[82975]: DEBUG oslo_service.backend._eventlet.service [None req-8ff9f6e9-a9a0-4cb9-9233-6f0d297a23ef None None] barbican_service_user.split_loggers = False {{(pid=82975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:50:55 devstack cinder-volume[82975]: DEBUG oslo_service.backend._eventlet.service [None req-8ff9f6e9-a9a0-4cb9-9233-6f0d297a23ef None None] barbican_service_user.timeout = None {{(pid=82975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:50:55 devstack cinder-volume[82975]: DEBUG oslo_service.backend._eventlet.service [None req-8ff9f6e9-a9a0-4cb9-9233-6f0d297a23ef None None] vault.approle_role_id = **** {{(pid=82975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:50:55 devstack cinder-volume[82975]: DEBUG oslo_service.backend._eventlet.service [None req-8ff9f6e9-a9a0-4cb9-9233-6f0d297a23ef None None] vault.approle_secret_id = **** {{(pid=82975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:50:55 devstack cinder-volume[82975]: DEBUG oslo_service.backend._eventlet.service [None req-8ff9f6e9-a9a0-4cb9-9233-6f0d297a23ef None None] vault.kv_mountpoint = secret {{(pid=82975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:50:55 devstack cinder-volume[82975]: DEBUG oslo_service.backend._eventlet.service [None req-8ff9f6e9-a9a0-4cb9-9233-6f0d297a23ef None None] vault.kv_path = None {{(pid=82975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:50:55 devstack cinder-volume[82975]: DEBUG oslo_service.backend._eventlet.service [None req-8ff9f6e9-a9a0-4cb9-9233-6f0d297a23ef None None] vault.kv_version = 2 {{(pid=82975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:50:55 devstack cinder-volume[82975]: DEBUG oslo_service.backend._eventlet.service [None req-8ff9f6e9-a9a0-4cb9-9233-6f0d297a23ef None None] vault.namespace = None {{(pid=82975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:50:55 devstack cinder-volume[82975]: DEBUG oslo_service.backend._eventlet.service [None req-8ff9f6e9-a9a0-4cb9-9233-6f0d297a23ef None None] vault.root_token_id = **** {{(pid=82975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:50:55 devstack cinder-volume[82975]: DEBUG oslo_service.backend._eventlet.service [None req-8ff9f6e9-a9a0-4cb9-9233-6f0d297a23ef None None] vault.ssl_ca_crt_file = None {{(pid=82975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:50:55 devstack cinder-volume[82975]: DEBUG oslo_service.backend._eventlet.service [None req-8ff9f6e9-a9a0-4cb9-9233-6f0d297a23ef None None] vault.timeout = 60.0 {{(pid=82975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:50:55 devstack cinder-volume[82975]: DEBUG oslo_service.backend._eventlet.service [None req-8ff9f6e9-a9a0-4cb9-9233-6f0d297a23ef None None] vault.use_ssl = False {{(pid=82975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:50:55 devstack cinder-volume[82975]: DEBUG oslo_service.backend._eventlet.service [None req-8ff9f6e9-a9a0-4cb9-9233-6f0d297a23ef None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=82975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:50:55 devstack cinder-volume[82975]: DEBUG oslo_service.backend._eventlet.service [None req-8ff9f6e9-a9a0-4cb9-9233-6f0d297a23ef None None] ******************************************************************************** {{(pid=82975) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3013}} Feb 25 15:50:56 devstack sudo[83097]: pam_unix(sudo:session): session closed for user root Feb 25 15:50:56 devstack cinder-volume[83095]: DEBUG oslo_concurrency.processutils [None req-4f722c8d-1eb6-48b5-b14c-0ab78036b384 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-23e9d725-3e04-4cd9-bfe0-c8ef43305589 /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85 -c /etc/quobyte/client-cinder.cfg" returned: 0 in 0.497s {{(pid=83095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 25 15:50:56 devstack cinder-volume[83095]: INFO cinder.volume.drivers.quobyte [None req-4f722c8d-1eb6-48b5-b14c-0ab78036b384 None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-23e9d725-3e04-4cd9-bfe0-c8ef43305589 succeeded Feb 25 15:50:56 devstack cinder-volume[83095]: DEBUG cinder.volume.drivers.quobyte [None req-4f722c8d-1eb6-48b5-b14c-0ab78036b384 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23e9d725-3e04-4cd9-bfe0-c8ef43305589'] {{(pid=83095) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 25 15:50:56 devstack cinder-volume[83095]: DEBUG oslo_concurrency.lockutils [None req-4f722c8d-1eb6-48b5-b14c-0ab78036b384 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.504s {{(pid=83095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 25 15:50:56 devstack cinder-volume[83095]: DEBUG oslo_concurrency.processutils [None req-4f722c8d-1eb6-48b5-b14c-0ab78036b384 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85 {{(pid=83095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 25 15:50:56 devstack sudo[83166]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85 Feb 25 15:50:56 devstack sudo[83166]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 25 15:50:56 devstack sudo[83166]: pam_unix(sudo:session): session closed for user root Feb 25 15:50:56 devstack cinder-volume[83095]: DEBUG oslo_concurrency.processutils [None req-4f722c8d-1eb6-48b5-b14c-0ab78036b384 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85" returned: 0 in 0.361s {{(pid=83095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 25 15:50:56 devstack cinder-volume[83095]: INFO cinder.volume.driver [None req-4f722c8d-1eb6-48b5-b14c-0ab78036b384 None None] Driver hasn't implemented _init_vendor_properties() Feb 25 15:50:56 devstack cinder-volume[83095]: DEBUG cinder.volume.driver [None req-4f722c8d-1eb6-48b5-b14c-0ab78036b384 None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.624942779541, 'free_capacity_gb': 1775.624942779541, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=83095) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:873}} Feb 25 15:50:56 devstack cinder-volume[83095]: DEBUG oslo_db.sqlalchemy.engines [None req-4f722c8d-1eb6-48b5-b14c-0ab78036b384 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=83095) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}} Feb 25 15:50:56 devstack cinder-volume[83095]: DEBUG dbcounter [-] [83095] Writer thread running {{(pid=83095) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:102}} Feb 25 15:50:56 devstack cinder-volume[83095]: DEBUG cinder.db.sqlalchemy.api [None req-4f722c8d-1eb6-48b5-b14c-0ab78036b384 None None] Building query based on filter {{(pid=83095) _process_snaps_filters /opt/stack/cinder/cinder/db/sqlalchemy/api.py:3943}} Feb 25 15:50:56 devstack cinder-volume[83095]: DEBUG cinder.image.image_utils [None req-4f722c8d-1eb6-48b5-b14c-0ab78036b384 None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=83095) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1298}} Feb 25 15:50:56 devstack cinder-volume[83095]: INFO cinder.keymgr.migration [None req-a582bbda-a4f1-46b6-a2e7-13988d91206e None None] Not migrating encryption keys because the ConfKeyManager is still in use. Feb 25 15:50:56 devstack cinder-volume[83095]: DEBUG oslo_concurrency.lockutils [None req-4f722c8d-1eb6-48b5-b14c-0ab78036b384 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 25 15:50:56 devstack cinder-volume[83095]: DEBUG oslo_concurrency.lockutils [None req-4f722c8d-1eb6-48b5-b14c-0ab78036b384 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 25 15:50:56 devstack cinder-volume[83095]: DEBUG cinder.volume.drivers.quobyte [None req-4f722c8d-1eb6-48b5-b14c-0ab78036b384 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23e9d725-3e04-4cd9-bfe0-c8ef43305589': None} {{(pid=83095) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 25 15:50:56 devstack cinder-volume[83095]: DEBUG cinder.volume.drivers.quobyte [None req-4f722c8d-1eb6-48b5-b14c-0ab78036b384 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23e9d725-3e04-4cd9-bfe0-c8ef43305589'] {{(pid=83095) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 25 15:50:56 devstack cinder-volume[83095]: DEBUG oslo_concurrency.lockutils [None req-4f722c8d-1eb6-48b5-b14c-0ab78036b384 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=83095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 25 15:50:56 devstack cinder-volume[83095]: DEBUG oslo_concurrency.processutils [None req-4f722c8d-1eb6-48b5-b14c-0ab78036b384 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85 {{(pid=83095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 25 15:50:56 devstack sudo[83169]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85 Feb 25 15:50:56 devstack sudo[83169]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 25 15:50:57 devstack sudo[83169]: pam_unix(sudo:session): session closed for user root Feb 25 15:50:57 devstack cinder-volume[83095]: DEBUG oslo_concurrency.processutils [None req-4f722c8d-1eb6-48b5-b14c-0ab78036b384 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85" returned: 0 in 0.366s {{(pid=83095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 25 15:50:57 devstack cinder-volume[83095]: DEBUG cinder.manager [None req-4f722c8d-1eb6-48b5-b14c-0ab78036b384 None None] Notifying Schedulers of capabilities ... {{(pid=83095) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 25 15:50:57 devstack cinder-volume[83095]: INFO cinder.volume.manager [None req-4f722c8d-1eb6-48b5-b14c-0ab78036b384 None None] Driver initialization completed successfully. Feb 25 15:50:57 devstack cinder-volume[83095]: INFO cinder.manager [None req-4f722c8d-1eb6-48b5-b14c-0ab78036b384 None None] Initiating service 3 cleanup Feb 25 15:50:57 devstack cinder-volume[83095]: INFO cinder.manager [None req-4f722c8d-1eb6-48b5-b14c-0ab78036b384 None None] Service 3 cleanup completed. Feb 25 15:50:57 devstack cinder-volume[83095]: DEBUG cinder.service [None req-4f722c8d-1eb6-48b5-b14c-0ab78036b384 None None] Creating RPC server for service cinder-volume {{(pid=83095) start /opt/stack/cinder/cinder/service.py:231}} Feb 25 15:50:57 devstack cinder-volume[83095]: DEBUG cinder.service [None req-4f722c8d-1eb6-48b5-b14c-0ab78036b384 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=83095) start /opt/stack/cinder/cinder/service.py:237}} Feb 25 15:50:57 devstack cinder-volume[83095]: INFO cinder.volume.manager [None req-4f722c8d-1eb6-48b5-b14c-0ab78036b384 None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.1.14) Feb 25 15:50:57 devstack cinder-volume[83095]: DEBUG oslo_concurrency.lockutils [None req-4f722c8d-1eb6-48b5-b14c-0ab78036b384 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 25 15:50:57 devstack cinder-volume[83095]: DEBUG oslo_concurrency.lockutils [None req-4f722c8d-1eb6-48b5-b14c-0ab78036b384 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 25 15:50:57 devstack cinder-volume[83095]: DEBUG cinder.volume.drivers.quobyte [None req-4f722c8d-1eb6-48b5-b14c-0ab78036b384 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23e9d725-3e04-4cd9-bfe0-c8ef43305589': None} {{(pid=83095) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 25 15:50:57 devstack cinder-volume[83095]: DEBUG cinder.volume.drivers.quobyte [None req-4f722c8d-1eb6-48b5-b14c-0ab78036b384 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23e9d725-3e04-4cd9-bfe0-c8ef43305589'] {{(pid=83095) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 25 15:50:57 devstack cinder-volume[83095]: DEBUG oslo_concurrency.lockutils [None req-4f722c8d-1eb6-48b5-b14c-0ab78036b384 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=83095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 25 15:50:57 devstack cinder-volume[83095]: DEBUG oslo_concurrency.processutils [None req-4f722c8d-1eb6-48b5-b14c-0ab78036b384 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85 {{(pid=83095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 25 15:50:57 devstack sudo[83174]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85 Feb 25 15:50:57 devstack sudo[83174]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 25 15:50:57 devstack sudo[83174]: pam_unix(sudo:session): session closed for user root Feb 25 15:50:57 devstack cinder-volume[83095]: DEBUG oslo_concurrency.processutils [None req-4f722c8d-1eb6-48b5-b14c-0ab78036b384 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85" returned: 0 in 0.395s {{(pid=83095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 25 15:50:57 devstack cinder-volume[83095]: INFO cinder.volume.manager [None req-4f722c8d-1eb6-48b5-b14c-0ab78036b384 None None] Driver post RPC initialization completed successfully. Feb 25 15:51:00 devstack cinder-volume[83095]: DEBUG oslo_concurrency.lockutils [None req-d03e25e0-db5a-46db-ba8b-e45d95c1a39c None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 25 15:51:00 devstack cinder-volume[83095]: DEBUG oslo_concurrency.lockutils [None req-d03e25e0-db5a-46db-ba8b-e45d95c1a39c None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 25 15:51:00 devstack cinder-volume[83095]: DEBUG cinder.volume.drivers.quobyte [None req-d03e25e0-db5a-46db-ba8b-e45d95c1a39c None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23e9d725-3e04-4cd9-bfe0-c8ef43305589': None} {{(pid=83095) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 25 15:51:00 devstack cinder-volume[83095]: DEBUG cinder.volume.drivers.quobyte [None req-d03e25e0-db5a-46db-ba8b-e45d95c1a39c None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23e9d725-3e04-4cd9-bfe0-c8ef43305589'] {{(pid=83095) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 25 15:51:00 devstack cinder-volume[83095]: DEBUG oslo_concurrency.lockutils [None req-d03e25e0-db5a-46db-ba8b-e45d95c1a39c None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=83095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 25 15:51:00 devstack cinder-volume[83095]: DEBUG oslo_concurrency.processutils [None req-d03e25e0-db5a-46db-ba8b-e45d95c1a39c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85 {{(pid=83095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 25 15:51:00 devstack sudo[83245]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85 Feb 25 15:51:00 devstack sudo[83245]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 25 15:51:01 devstack sudo[83245]: pam_unix(sudo:session): session closed for user root Feb 25 15:51:01 devstack cinder-volume[83095]: DEBUG oslo_concurrency.processutils [None req-d03e25e0-db5a-46db-ba8b-e45d95c1a39c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85" returned: 0 in 0.397s {{(pid=83095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 25 15:51:01 devstack cinder-volume[83095]: DEBUG cinder.manager [None req-d03e25e0-db5a-46db-ba8b-e45d95c1a39c None None] Notifying Schedulers of capabilities ... {{(pid=83095) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 25 15:51:01 devstack cinder-volume[82975]: INFO oslo_service.backend._eventlet.service [None req-8ff9f6e9-a9a0-4cb9-9233-6f0d297a23ef None None] Caught SIGTERM, stopping children Feb 25 15:51:01 devstack cinder-volume[82975]: DEBUG oslo_concurrency.lockutils [None req-8ff9f6e9-a9a0-4cb9-9233-6f0d297a23ef None None] Acquiring lock "singleton_lock" {{(pid=82975) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:390}} Feb 25 15:51:01 devstack cinder-volume[82975]: DEBUG oslo_concurrency.lockutils [None req-8ff9f6e9-a9a0-4cb9-9233-6f0d297a23ef None None] Acquired lock "singleton_lock" {{(pid=82975) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:393}} Feb 25 15:51:01 devstack cinder-volume[82975]: DEBUG oslo_concurrency.lockutils [None req-8ff9f6e9-a9a0-4cb9-9233-6f0d297a23ef None None] Releasing lock "singleton_lock" {{(pid=82975) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:413}} Feb 25 15:51:01 devstack cinder-volume[82975]: DEBUG oslo_service.backend._eventlet.service [None req-8ff9f6e9-a9a0-4cb9-9233-6f0d297a23ef None None] Stop services. {{(pid=82975) stop /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:611}} Feb 25 15:51:01 devstack cinder-volume[82975]: DEBUG oslo_service.backend._eventlet.service [None req-8ff9f6e9-a9a0-4cb9-9233-6f0d297a23ef None None] Killing children. {{(pid=82975) stop /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:616}} Feb 25 15:51:01 devstack cinder-volume[82975]: INFO oslo_service.backend._eventlet.service [None req-8ff9f6e9-a9a0-4cb9-9233-6f0d297a23ef None None] Waiting on 1 children to exit Feb 25 15:51:05 devstack cinder-volume[83095]: DEBUG oslo_concurrency.lockutils [None req-8ff9f6e9-a9a0-4cb9-9233-6f0d297a23ef None None] Acquiring lock "singleton_lock" {{(pid=83095) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:390}} Feb 25 15:51:05 devstack cinder-volume[83095]: DEBUG oslo_concurrency.lockutils [None req-8ff9f6e9-a9a0-4cb9-9233-6f0d297a23ef None None] Acquired lock "singleton_lock" {{(pid=83095) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:393}} Feb 25 15:51:05 devstack cinder-volume[83095]: DEBUG oslo_concurrency.lockutils [None req-8ff9f6e9-a9a0-4cb9-9233-6f0d297a23ef None None] Releasing lock "singleton_lock" {{(pid=83095) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:413}} Feb 25 15:51:05 devstack cinder-volume[83095]: WARNING amqp [None req-8ff9f6e9-a9a0-4cb9-9233-6f0d297a23ef None None] Received method (60, 30) during closing channel 1. This method will be ignored Feb 25 15:51:05 devstack cinder-volume[83095]: WARNING amqp [None req-8ff9f6e9-a9a0-4cb9-9233-6f0d297a23ef None None] Received method (60, 30) during closing channel 1. This method will be ignored Feb 25 15:51:05 devstack cinder-volume[82975]: INFO oslo_service.backend._eventlet.service [None req-8ff9f6e9-a9a0-4cb9-9233-6f0d297a23ef None None] Child 83095 exited with status 0 Feb 25 15:51:07 devstack cinder-volume[83324]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=83324) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:390}} Feb 25 15:51:07 devstack cinder-volume[83324]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=83324) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:393}} Feb 25 15:51:07 devstack cinder-volume[83324]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=83324) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:413}} Feb 25 15:51:07 devstack cinder-volume[83324]: INFO dbcounter [None req-0a9f9eed-f226-426b-90ba-01270c051175 None None] Registered counter for database cinder Feb 25 15:51:07 devstack cinder-volume[83324]: DEBUG oslo_db.sqlalchemy.engines [None req-0a9f9eed-f226-426b-90ba-01270c051175 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=83324) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}} Feb 25 15:51:08 devstack cinder-volume[83324]: DEBUG dbcounter [-] [83324] Writer thread running {{(pid=83324) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:102}} Feb 25 15:51:08 devstack cinder-volume[83324]: INFO cinder.rpc [None req-0a9f9eed-f226-426b-90ba-01270c051175 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Feb 25 15:51:08 devstack cinder-volume[83324]: INFO cinder.rpc [None req-0a9f9eed-f226-426b-90ba-01270c051175 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Feb 25 15:51:08 devstack cinder-volume[83324]: DEBUG oslo_db.sqlalchemy.engines [None req-0a9f9eed-f226-426b-90ba-01270c051175 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=83324) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}} Feb 25 15:51:08 devstack cinder-volume[83324]: INFO cinder.volume.manager [None req-0a9f9eed-f226-426b-90ba-01270c051175 None None] Determined volume DB was empty at startup. Feb 25 15:51:08 devstack cinder-volume[83324]: DEBUG cinder.volume.manager [None req-0a9f9eed-f226-426b-90ba-01270c051175 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=83324) __init__ /opt/stack/cinder/cinder/volume/manager.py:288}} Feb 25 15:51:08 devstack cinder-volume[83324]: WARNING stevedore.named [None req-0a9f9eed-f226-426b-90ba-01270c051175 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Feb 25 15:51:08 devstack cinder-volume[83324]: WARNING castellan.key_manager [None req-0a9f9eed-f226-426b-90ba-01270c051175 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Feb 25 15:51:08 devstack cinder-volume[83324]: WARNING cinder.keymgr.conf_key_mgr [None req-0a9f9eed-f226-426b-90ba-01270c051175 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Feb 25 15:51:08 devstack cinder-volume[83324]: INFO cinder.volume.manager [None req-0a9f9eed-f226-426b-90ba-01270c051175 None None] Image-volume cache disabled for host devstack@QuobyteHD. Feb 25 15:51:08 devstack cinder-volume[83324]: DEBUG oslo_db.sqlalchemy.engines [None req-0a9f9eed-f226-426b-90ba-01270c051175 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=83324) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}} Feb 25 15:51:08 devstack cinder-volume[83324]: INFO oslo_service.backend._eventlet.service [None req-0a9f9eed-f226-426b-90ba-01270c051175 None None] Starting 1 workers Feb 25 15:51:08 devstack cinder-volume[83324]: DEBUG oslo_service.backend._eventlet.service [None req-0a9f9eed-f226-426b-90ba-01270c051175 None None] Started child 83528 {{(pid=83324) _start_child /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:491}} Feb 25 15:51:08 devstack cinder-volume[83324]: DEBUG oslo_service.backend._eventlet.service [None req-0a9f9eed-f226-426b-90ba-01270c051175 None None] Full set of CONF: {{(pid=83324) wait /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:565}} Feb 25 15:51:08 devstack cinder-volume[83324]: DEBUG oslo_service.backend._eventlet.service [None req-0a9f9eed-f226-426b-90ba-01270c051175 None None] ******************************************************************************** {{(pid=83324) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2979}} Feb 25 15:51:08 devstack cinder-volume[83324]: DEBUG oslo_service.backend._eventlet.service [None req-0a9f9eed-f226-426b-90ba-01270c051175 None None] Configuration options gathered from: {{(pid=83324) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2980}} Feb 25 15:51:08 devstack cinder-volume[83324]: DEBUG oslo_service.backend._eventlet.service [None req-0a9f9eed-f226-426b-90ba-01270c051175 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=83324) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2981}} Feb 25 15:51:08 devstack cinder-volume[83324]: DEBUG oslo_service.backend._eventlet.service [None req-0a9f9eed-f226-426b-90ba-01270c051175 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=83324) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2982}} Feb 25 15:51:08 devstack cinder-volume[83324]: DEBUG oslo_service.backend._eventlet.service [None req-0a9f9eed-f226-426b-90ba-01270c051175 None None] ================================================================================ {{(pid=83324) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2987}} Feb 25 15:51:08 devstack cinder-volume[83528]: INFO cinder.service [-] Starting cinder-volume node (version 27.1.0) Feb 25 15:51:08 devstack cinder-volume[83324]: DEBUG oslo_service.backend._eventlet.service [None req-0a9f9eed-f226-426b-90ba-01270c051175 None None] allow_availability_zone_fallback = False {{(pid=83324) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 25 15:51:08 devstack cinder-volume[83324]: DEBUG oslo_service.backend._eventlet.service [None req-0a9f9eed-f226-426b-90ba-01270c051175 None None] allow_compression_on_image_upload = False {{(pid=83324) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 25 15:51:08 devstack cinder-volume[83324]: DEBUG oslo_service.backend._eventlet.service [None req-0a9f9eed-f226-426b-90ba-01270c051175 None None] allowed_direct_url_schemes = [] {{(pid=83324) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 25 15:51:08 devstack cinder-volume[83324]: DEBUG oslo_service.backend._eventlet.service [None req-0a9f9eed-f226-426b-90ba-01270c051175 None None] api_rate_limit = True {{(pid=83324) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 25 15:51:08 devstack cinder-volume[83324]: DEBUG oslo_service.backend._eventlet.service [None req-0a9f9eed-f226-426b-90ba-01270c051175 None None] auth_strategy = keystone {{(pid=83324) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 25 15:51:08 devstack cinder-volume[83324]: DEBUG oslo_service.backend._eventlet.service [None req-0a9f9eed-f226-426b-90ba-01270c051175 None None] backend_availability_zone = None {{(pid=83324) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 25 15:51:08 devstack cinder-volume[83324]: DEBUG oslo_service.backend._eventlet.service [None req-0a9f9eed-f226-426b-90ba-01270c051175 None None] backend_host = None {{(pid=83324) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 25 15:51:08 devstack cinder-volume[83324]: DEBUG oslo_service.backend._eventlet.service [None req-0a9f9eed-f226-426b-90ba-01270c051175 None None] backend_name = None {{(pid=83324) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 25 15:51:08 devstack cinder-volume[83324]: DEBUG oslo_service.backend._eventlet.service [None req-0a9f9eed-f226-426b-90ba-01270c051175 None None] backend_stats_polling_interval = 60 {{(pid=83324) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 25 15:51:08 devstack cinder-volume[83324]: DEBUG oslo_service.backend._eventlet.service [None req-0a9f9eed-f226-426b-90ba-01270c051175 None None] backup_api_class = cinder.backup.api.API {{(pid=83324) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 25 15:51:08 devstack cinder-volume[83324]: DEBUG oslo_service.backend._eventlet.service [None req-0a9f9eed-f226-426b-90ba-01270c051175 None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=83324) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 25 15:51:08 devstack cinder-volume[83324]: DEBUG oslo_service.backend._eventlet.service [None req-0a9f9eed-f226-426b-90ba-01270c051175 None None] backup_name_template = backup-%s {{(pid=83324) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 25 15:51:08 devstack cinder-volume[83324]: DEBUG oslo_service.backend._eventlet.service [None req-0a9f9eed-f226-426b-90ba-01270c051175 None None] backup_use_same_host = False {{(pid=83324) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 25 15:51:08 devstack cinder-volume[83324]: DEBUG oslo_service.backend._eventlet.service [None req-0a9f9eed-f226-426b-90ba-01270c051175 None None] backup_use_temp_snapshot = False {{(pid=83324) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 25 15:51:08 devstack cinder-volume[83324]: DEBUG oslo_service.backend._eventlet.service [None req-0a9f9eed-f226-426b-90ba-01270c051175 None None] chap_password = **** {{(pid=83324) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 25 15:51:08 devstack cinder-volume[83324]: DEBUG oslo_service.backend._eventlet.service [None req-0a9f9eed-f226-426b-90ba-01270c051175 None None] chap_username = {{(pid=83324) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 25 15:51:08 devstack cinder-volume[83324]: DEBUG oslo_service.backend._eventlet.service [None req-0a9f9eed-f226-426b-90ba-01270c051175 None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=83324) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 25 15:51:08 devstack cinder-volume[83324]: DEBUG oslo_service.backend._eventlet.service [None req-0a9f9eed-f226-426b-90ba-01270c051175 None None] cinder_internal_tenant_project_id = 9bff5ba497904e8c9c68bb7bb7d98a5e {{(pid=83324) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 25 15:51:08 devstack cinder-volume[83324]: DEBUG oslo_service.backend._eventlet.service [None req-0a9f9eed-f226-426b-90ba-01270c051175 None None] cinder_internal_tenant_user_id = cdb38ed6699347eb86cca2ce6a17cfb5 {{(pid=83324) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 25 15:51:08 devstack cinder-volume[83324]: DEBUG oslo_service.backend._eventlet.service [None req-0a9f9eed-f226-426b-90ba-01270c051175 None None] cluster = None {{(pid=83324) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 25 15:51:08 devstack cinder-volume[83324]: DEBUG oslo_service.backend._eventlet.service [None req-0a9f9eed-f226-426b-90ba-01270c051175 None None] compression_format = gzip {{(pid=83324) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 25 15:51:08 devstack cinder-volume[83324]: DEBUG oslo_service.backend._eventlet.service [None req-0a9f9eed-f226-426b-90ba-01270c051175 None None] compute_api_class = cinder.compute.nova.API {{(pid=83324) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 25 15:51:08 devstack cinder-volume[83324]: DEBUG oslo_service.backend._eventlet.service [None req-0a9f9eed-f226-426b-90ba-01270c051175 None None] config_dir = [] {{(pid=83324) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 25 15:51:08 devstack cinder-volume[83324]: DEBUG oslo_service.backend._eventlet.service [None req-0a9f9eed-f226-426b-90ba-01270c051175 None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=83324) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 25 15:51:08 devstack cinder-volume[83324]: DEBUG oslo_service.backend._eventlet.service [None req-0a9f9eed-f226-426b-90ba-01270c051175 None None] config_source = [] {{(pid=83324) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 25 15:51:08 devstack cinder-volume[83324]: DEBUG oslo_service.backend._eventlet.service [None req-0a9f9eed-f226-426b-90ba-01270c051175 None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=83324) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 25 15:51:08 devstack cinder-volume[83324]: DEBUG oslo_service.backend._eventlet.service [None req-0a9f9eed-f226-426b-90ba-01270c051175 None None] control_exchange = openstack {{(pid=83324) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 25 15:51:08 devstack cinder-volume[83324]: DEBUG oslo_service.backend._eventlet.service [None req-0a9f9eed-f226-426b-90ba-01270c051175 None None] debug = True {{(pid=83324) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 25 15:51:08 devstack cinder-volume[83324]: DEBUG oslo_service.backend._eventlet.service [None req-0a9f9eed-f226-426b-90ba-01270c051175 None None] default_availability_zone = None {{(pid=83324) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 25 15:51:08 devstack cinder-volume[83324]: DEBUG oslo_service.backend._eventlet.service [None req-0a9f9eed-f226-426b-90ba-01270c051175 None None] default_group_type = None {{(pid=83324) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 25 15:51:08 devstack cinder-volume[83324]: DEBUG oslo_service.backend._eventlet.service [None req-0a9f9eed-f226-426b-90ba-01270c051175 None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=83324) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 25 15:51:08 devstack cinder-volume[83324]: DEBUG oslo_service.backend._eventlet.service [None req-0a9f9eed-f226-426b-90ba-01270c051175 None None] default_volume_type = QuobyteHD {{(pid=83324) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 25 15:51:08 devstack cinder-volume[83324]: DEBUG oslo_service.backend._eventlet.service [None req-0a9f9eed-f226-426b-90ba-01270c051175 None None] disk_geometry = None {{(pid=83324) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 25 15:51:08 devstack cinder-volume[83324]: DEBUG oslo_service.backend._eventlet.service [None req-0a9f9eed-f226-426b-90ba-01270c051175 None None] driver_client_cert = None {{(pid=83324) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 25 15:51:08 devstack cinder-volume[83324]: DEBUG oslo_service.backend._eventlet.service [None req-0a9f9eed-f226-426b-90ba-01270c051175 None None] driver_client_cert_key = None {{(pid=83324) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 25 15:51:08 devstack cinder-volume[83324]: DEBUG oslo_service.backend._eventlet.service [None req-0a9f9eed-f226-426b-90ba-01270c051175 None None] driver_data_namespace = None {{(pid=83324) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 25 15:51:08 devstack cinder-volume[83324]: DEBUG oslo_service.backend._eventlet.service [None req-0a9f9eed-f226-426b-90ba-01270c051175 None None] driver_ssl_cert_path = None {{(pid=83324) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 25 15:51:08 devstack cinder-volume[83324]: DEBUG oslo_service.backend._eventlet.service [None req-0a9f9eed-f226-426b-90ba-01270c051175 None None] driver_ssl_cert_verify = False {{(pid=83324) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 25 15:51:08 devstack cinder-volume[83324]: DEBUG oslo_service.backend._eventlet.service [None req-0a9f9eed-f226-426b-90ba-01270c051175 None None] driver_use_ssl = False {{(pid=83324) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 25 15:51:08 devstack cinder-volume[83324]: DEBUG oslo_service.backend._eventlet.service [None req-0a9f9eed-f226-426b-90ba-01270c051175 None None] enable_new_services = True {{(pid=83324) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 25 15:51:08 devstack cinder-volume[83324]: DEBUG oslo_service.backend._eventlet.service [None req-0a9f9eed-f226-426b-90ba-01270c051175 None None] enable_unsupported_driver = False {{(pid=83324) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 25 15:51:08 devstack cinder-volume[83324]: DEBUG oslo_service.backend._eventlet.service [None req-0a9f9eed-f226-426b-90ba-01270c051175 None None] enabled_backends = ['QuobyteHD'] {{(pid=83324) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 25 15:51:08 devstack cinder-volume[83324]: DEBUG oslo_service.backend._eventlet.service [None req-0a9f9eed-f226-426b-90ba-01270c051175 None None] enforce_multipath_for_image_xfer = False {{(pid=83324) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 25 15:51:08 devstack cinder-volume[83324]: DEBUG oslo_service.backend._eventlet.service [None req-0a9f9eed-f226-426b-90ba-01270c051175 None None] filter_function = None {{(pid=83324) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 25 15:51:08 devstack cinder-volume[83324]: DEBUG oslo_service.backend._eventlet.service [None req-0a9f9eed-f226-426b-90ba-01270c051175 None None] glance_api_insecure = False {{(pid=83324) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 25 15:51:08 devstack cinder-volume[83324]: DEBUG oslo_service.backend._eventlet.service [None req-0a9f9eed-f226-426b-90ba-01270c051175 None None] glance_api_servers = ['http://192.168.122.119/image'] {{(pid=83324) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 25 15:51:08 devstack cinder-volume[83324]: DEBUG oslo_service.backend._eventlet.service [None req-0a9f9eed-f226-426b-90ba-01270c051175 None None] glance_api_ssl_compression = False {{(pid=83324) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 25 15:51:08 devstack cinder-volume[83324]: DEBUG oslo_service.backend._eventlet.service [None req-0a9f9eed-f226-426b-90ba-01270c051175 None None] glance_ca_certificates_file = None {{(pid=83324) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 25 15:51:08 devstack cinder-volume[83324]: DEBUG oslo_service.backend._eventlet.service [None req-0a9f9eed-f226-426b-90ba-01270c051175 None None] glance_catalog_info = image:glance:publicURL {{(pid=83324) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 25 15:51:08 devstack cinder-volume[83324]: DEBUG oslo_service.backend._eventlet.service [None req-0a9f9eed-f226-426b-90ba-01270c051175 None None] glance_certfile = None {{(pid=83324) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 25 15:51:08 devstack cinder-volume[83324]: DEBUG oslo_service.backend._eventlet.service [None req-0a9f9eed-f226-426b-90ba-01270c051175 None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=83324) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 25 15:51:08 devstack cinder-volume[83324]: DEBUG oslo_service.backend._eventlet.service [None req-0a9f9eed-f226-426b-90ba-01270c051175 None None] glance_keyfile = None {{(pid=83324) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 25 15:51:08 devstack cinder-volume[83324]: DEBUG oslo_service.backend._eventlet.service [None req-0a9f9eed-f226-426b-90ba-01270c051175 None None] glance_num_retries = 3 {{(pid=83324) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 25 15:51:08 devstack cinder-volume[83324]: DEBUG oslo_service.backend._eventlet.service [None req-0a9f9eed-f226-426b-90ba-01270c051175 None None] glance_request_timeout = None {{(pid=83324) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 25 15:51:08 devstack cinder-volume[83324]: DEBUG oslo_service.backend._eventlet.service [None req-0a9f9eed-f226-426b-90ba-01270c051175 None None] goodness_function = None {{(pid=83324) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 25 15:51:08 devstack cinder-volume[83324]: DEBUG oslo_service.backend._eventlet.service [None req-0a9f9eed-f226-426b-90ba-01270c051175 None None] graceful_shutdown_timeout = 5 {{(pid=83324) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 25 15:51:08 devstack cinder-volume[83324]: DEBUG oslo_service.backend._eventlet.service [None req-0a9f9eed-f226-426b-90ba-01270c051175 None None] group_api_class = cinder.group.api.API {{(pid=83324) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 25 15:51:08 devstack cinder-volume[83324]: DEBUG oslo_service.backend._eventlet.service [None req-0a9f9eed-f226-426b-90ba-01270c051175 None None] host = devstack {{(pid=83324) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 25 15:51:08 devstack cinder-volume[83324]: DEBUG oslo_service.backend._eventlet.service [None req-0a9f9eed-f226-426b-90ba-01270c051175 None None] image_compress_on_upload = True {{(pid=83324) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 25 15:51:08 devstack cinder-volume[83324]: DEBUG oslo_service.backend._eventlet.service [None req-0a9f9eed-f226-426b-90ba-01270c051175 None None] image_conversion_address_space_limit = 1 {{(pid=83324) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 25 15:51:08 devstack cinder-volume[83324]: DEBUG oslo_service.backend._eventlet.service [None req-0a9f9eed-f226-426b-90ba-01270c051175 None None] image_conversion_cpu_limit = 60 {{(pid=83324) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 25 15:51:08 devstack cinder-volume[83324]: DEBUG oslo_service.backend._eventlet.service [None req-0a9f9eed-f226-426b-90ba-01270c051175 None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=83324) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 25 15:51:08 devstack cinder-volume[83324]: DEBUG oslo_service.backend._eventlet.service [None req-0a9f9eed-f226-426b-90ba-01270c051175 None None] image_conversion_disable = False {{(pid=83324) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 25 15:51:08 devstack cinder-volume[83324]: DEBUG oslo_service.backend._eventlet.service [None req-0a9f9eed-f226-426b-90ba-01270c051175 None None] image_upload_use_cinder_backend = False {{(pid=83324) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 25 15:51:08 devstack cinder-volume[83324]: DEBUG oslo_service.backend._eventlet.service [None req-0a9f9eed-f226-426b-90ba-01270c051175 None None] image_upload_use_internal_tenant = False {{(pid=83324) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 25 15:51:08 devstack cinder-volume[83324]: DEBUG oslo_service.backend._eventlet.service [None req-0a9f9eed-f226-426b-90ba-01270c051175 None None] image_volume_cache_enabled = False {{(pid=83324) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 25 15:51:08 devstack cinder-volume[83324]: DEBUG oslo_service.backend._eventlet.service [None req-0a9f9eed-f226-426b-90ba-01270c051175 None None] image_volume_cache_max_count = 0 {{(pid=83324) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 25 15:51:08 devstack cinder-volume[83324]: DEBUG oslo_service.backend._eventlet.service [None req-0a9f9eed-f226-426b-90ba-01270c051175 None None] image_volume_cache_max_size_gb = 0 {{(pid=83324) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 25 15:51:08 devstack cinder-volume[83324]: DEBUG oslo_service.backend._eventlet.service [None req-0a9f9eed-f226-426b-90ba-01270c051175 None None] init_host_max_objects_retrieval = 0 {{(pid=83324) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 25 15:51:08 devstack cinder-volume[83324]: DEBUG oslo_service.backend._eventlet.service [None req-0a9f9eed-f226-426b-90ba-01270c051175 None None] instance_format = [instance: %(uuid)s] {{(pid=83324) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 25 15:51:08 devstack cinder-volume[83324]: DEBUG oslo_service.backend._eventlet.service [None req-0a9f9eed-f226-426b-90ba-01270c051175 None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=83324) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 25 15:51:08 devstack cinder-volume[83324]: DEBUG oslo_service.backend._eventlet.service [None req-0a9f9eed-f226-426b-90ba-01270c051175 None None] iscsi_target_flags = {{(pid=83324) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 25 15:51:08 devstack cinder-volume[83324]: DEBUG oslo_service.backend._eventlet.service [None req-0a9f9eed-f226-426b-90ba-01270c051175 None None] iscsi_write_cache = on {{(pid=83324) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 25 15:51:08 devstack cinder-volume[83324]: DEBUG oslo_service.backend._eventlet.service [None req-0a9f9eed-f226-426b-90ba-01270c051175 None None] iser_helper = tgtadm {{(pid=83324) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 25 15:51:08 devstack cinder-volume[83324]: DEBUG oslo_service.backend._eventlet.service [None req-0a9f9eed-f226-426b-90ba-01270c051175 None None] iser_ip_address = 192.168.122.119 {{(pid=83324) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 25 15:51:08 devstack cinder-volume[83324]: DEBUG oslo_service.backend._eventlet.service [None req-0a9f9eed-f226-426b-90ba-01270c051175 None None] iser_port = 3260 {{(pid=83324) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 25 15:51:08 devstack cinder-volume[83324]: DEBUG oslo_service.backend._eventlet.service [None req-0a9f9eed-f226-426b-90ba-01270c051175 None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=83324) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 25 15:51:08 devstack cinder-volume[83324]: DEBUG oslo_service.backend._eventlet.service [None req-0a9f9eed-f226-426b-90ba-01270c051175 None None] log_color = False {{(pid=83324) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 25 15:51:08 devstack cinder-volume[83324]: DEBUG oslo_service.backend._eventlet.service [None req-0a9f9eed-f226-426b-90ba-01270c051175 None None] log_config_append = None {{(pid=83324) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 25 15:51:08 devstack cinder-volume[83324]: DEBUG oslo_service.backend._eventlet.service [None req-0a9f9eed-f226-426b-90ba-01270c051175 None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=83324) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 25 15:51:08 devstack cinder-volume[83324]: DEBUG oslo_service.backend._eventlet.service [None req-0a9f9eed-f226-426b-90ba-01270c051175 None None] log_dir = None {{(pid=83324) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 25 15:51:08 devstack cinder-volume[83324]: DEBUG oslo_service.backend._eventlet.service [None req-0a9f9eed-f226-426b-90ba-01270c051175 None None] log_file = None {{(pid=83324) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 25 15:51:08 devstack cinder-volume[83324]: DEBUG oslo_service.backend._eventlet.service [None req-0a9f9eed-f226-426b-90ba-01270c051175 None None] log_options = True {{(pid=83324) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 25 15:51:08 devstack cinder-volume[83324]: DEBUG oslo_service.backend._eventlet.service [None req-0a9f9eed-f226-426b-90ba-01270c051175 None None] log_rotate_interval = 1 {{(pid=83324) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 25 15:51:08 devstack cinder-volume[83324]: DEBUG oslo_service.backend._eventlet.service [None req-0a9f9eed-f226-426b-90ba-01270c051175 None None] log_rotate_interval_type = days {{(pid=83324) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 25 15:51:08 devstack cinder-volume[83528]: INFO cinder.volume.manager [None req-fcf75513-621e-45a1-964e-6b9fb943d91e None None] Starting volume driver QuobyteDriver (1.1.14) Feb 25 15:51:08 devstack cinder-volume[83324]: DEBUG oslo_service.backend._eventlet.service [None req-0a9f9eed-f226-426b-90ba-01270c051175 None None] log_rotation_type = none {{(pid=83324) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 25 15:51:08 devstack cinder-volume[83324]: DEBUG oslo_service.backend._eventlet.service [None req-0a9f9eed-f226-426b-90ba-01270c051175 None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=83324) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 25 15:51:08 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.remotefs [None req-fcf75513-621e-45a1-964e-6b9fb943d91e None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=83528) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}} Feb 25 15:51:08 devstack cinder-volume[83324]: DEBUG oslo_service.backend._eventlet.service [None req-0a9f9eed-f226-426b-90ba-01270c051175 None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=83324) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 25 15:51:08 devstack cinder-volume[83324]: DEBUG oslo_service.backend._eventlet.service [None req-0a9f9eed-f226-426b-90ba-01270c051175 None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=83324) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 25 15:51:08 devstack cinder-volume[83324]: DEBUG oslo_service.backend._eventlet.service [None req-0a9f9eed-f226-426b-90ba-01270c051175 None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=83324) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 25 15:51:08 devstack cinder-volume[83324]: DEBUG oslo_service.backend._eventlet.service [None req-0a9f9eed-f226-426b-90ba-01270c051175 None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=83324) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 25 15:51:08 devstack cinder-volume[83324]: DEBUG oslo_service.backend._eventlet.service [None req-0a9f9eed-f226-426b-90ba-01270c051175 None None] max_age = 0 {{(pid=83324) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 25 15:51:08 devstack cinder-volume[83324]: DEBUG oslo_service.backend._eventlet.service [None req-0a9f9eed-f226-426b-90ba-01270c051175 None None] max_logfile_count = 30 {{(pid=83324) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 25 15:51:08 devstack cinder-volume[83324]: DEBUG oslo_service.backend._eventlet.service [None req-0a9f9eed-f226-426b-90ba-01270c051175 None None] max_logfile_size_mb = 200 {{(pid=83324) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 25 15:51:08 devstack cinder-volume[83324]: DEBUG oslo_service.backend._eventlet.service [None req-0a9f9eed-f226-426b-90ba-01270c051175 None None] max_over_subscription_ratio = 20.0 {{(pid=83324) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 25 15:51:08 devstack cinder-volume[83324]: DEBUG oslo_service.backend._eventlet.service [None req-0a9f9eed-f226-426b-90ba-01270c051175 None None] message_reap_interval = 86400 {{(pid=83324) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 25 15:51:08 devstack cinder-volume[83324]: DEBUG oslo_service.backend._eventlet.service [None req-0a9f9eed-f226-426b-90ba-01270c051175 None None] message_ttl = 2592000 {{(pid=83324) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 25 15:51:08 devstack cinder-volume[83324]: DEBUG oslo_service.backend._eventlet.service [None req-0a9f9eed-f226-426b-90ba-01270c051175 None None] migration_create_volume_timeout_secs = 300 {{(pid=83324) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 25 15:51:08 devstack cinder-volume[83324]: DEBUG oslo_service.backend._eventlet.service [None req-0a9f9eed-f226-426b-90ba-01270c051175 None None] monkey_patch = False {{(pid=83324) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 25 15:51:08 devstack cinder-volume[83324]: DEBUG oslo_service.backend._eventlet.service [None req-0a9f9eed-f226-426b-90ba-01270c051175 None None] monkey_patch_modules = [] {{(pid=83324) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 25 15:51:08 devstack cinder-volume[83324]: DEBUG oslo_service.backend._eventlet.service [None req-0a9f9eed-f226-426b-90ba-01270c051175 None None] my_ip = 192.168.122.119 {{(pid=83324) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 25 15:51:08 devstack cinder-volume[83324]: DEBUG oslo_service.backend._eventlet.service [None req-0a9f9eed-f226-426b-90ba-01270c051175 None None] no_snapshot_gb_quota = False {{(pid=83324) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 25 15:51:08 devstack cinder-volume[83324]: DEBUG oslo_service.backend._eventlet.service [None req-0a9f9eed-f226-426b-90ba-01270c051175 None None] num_iser_scan_tries = 3 {{(pid=83324) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 25 15:51:08 devstack cinder-volume[83324]: DEBUG oslo_service.backend._eventlet.service [None req-0a9f9eed-f226-426b-90ba-01270c051175 None None] num_shell_tries = 3 {{(pid=83324) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 25 15:51:08 devstack cinder-volume[83324]: DEBUG oslo_service.backend._eventlet.service [None req-0a9f9eed-f226-426b-90ba-01270c051175 None None] num_volume_device_scan_tries = 3 {{(pid=83324) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 25 15:51:08 devstack cinder-volume[83324]: DEBUG oslo_service.backend._eventlet.service [None req-0a9f9eed-f226-426b-90ba-01270c051175 None None] nvmeof_conn_info_version = 1 {{(pid=83324) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 25 15:51:08 devstack cinder-volume[83324]: DEBUG oslo_service.backend._eventlet.service [None req-0a9f9eed-f226-426b-90ba-01270c051175 None None] nvmet_ns_id = 10 {{(pid=83324) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 25 15:51:08 devstack cinder-volume[83324]: DEBUG oslo_service.backend._eventlet.service [None req-0a9f9eed-f226-426b-90ba-01270c051175 None None] nvmet_port_id = 1 {{(pid=83324) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 25 15:51:08 devstack cinder-volume[83324]: DEBUG oslo_service.backend._eventlet.service [None req-0a9f9eed-f226-426b-90ba-01270c051175 None None] osapi_max_limit = 1000 {{(pid=83324) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 25 15:51:08 devstack cinder-volume[83324]: DEBUG oslo_service.backend._eventlet.service [None req-0a9f9eed-f226-426b-90ba-01270c051175 None None] osapi_volume_ext_list = [] {{(pid=83324) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 25 15:51:08 devstack cinder-volume[83324]: DEBUG oslo_service.backend._eventlet.service [None req-0a9f9eed-f226-426b-90ba-01270c051175 None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=83324) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 25 15:51:08 devstack cinder-volume[83324]: DEBUG oslo_service.backend._eventlet.service [None req-0a9f9eed-f226-426b-90ba-01270c051175 None None] osapi_volume_listen = 0.0.0.0 {{(pid=83324) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 25 15:51:08 devstack cinder-volume[83324]: DEBUG oslo_service.backend._eventlet.service [None req-0a9f9eed-f226-426b-90ba-01270c051175 None None] osapi_volume_listen_port = 8776 {{(pid=83324) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 25 15:51:08 devstack cinder-volume[83324]: DEBUG oslo_service.backend._eventlet.service [None req-0a9f9eed-f226-426b-90ba-01270c051175 None None] osapi_volume_use_ssl = False {{(pid=83324) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 25 15:51:08 devstack cinder-volume[83324]: DEBUG oslo_service.backend._eventlet.service [None req-0a9f9eed-f226-426b-90ba-01270c051175 None None] osapi_volume_workers = 2 {{(pid=83324) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 25 15:51:08 devstack cinder-volume[83324]: DEBUG oslo_service.backend._eventlet.service [None req-0a9f9eed-f226-426b-90ba-01270c051175 None None] per_volume_size_limit = -1 {{(pid=83324) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 25 15:51:08 devstack cinder-volume[83324]: DEBUG oslo_service.backend._eventlet.service [None req-0a9f9eed-f226-426b-90ba-01270c051175 None None] periodic_fuzzy_delay = 60 {{(pid=83324) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 25 15:51:08 devstack cinder-volume[83324]: DEBUG oslo_service.backend._eventlet.service [None req-0a9f9eed-f226-426b-90ba-01270c051175 None None] periodic_interval = 60 {{(pid=83324) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 25 15:51:08 devstack cinder-volume[83324]: DEBUG oslo_service.backend._eventlet.service [None req-0a9f9eed-f226-426b-90ba-01270c051175 None None] project_id_regex = [0-9a-f\-]+ {{(pid=83324) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 25 15:51:08 devstack cinder-volume[83324]: DEBUG oslo_service.backend._eventlet.service [None req-0a9f9eed-f226-426b-90ba-01270c051175 None None] public_endpoint = None {{(pid=83324) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 25 15:51:08 devstack cinder-volume[83324]: DEBUG oslo_service.backend._eventlet.service [None req-0a9f9eed-f226-426b-90ba-01270c051175 None None] publish_errors = False {{(pid=83324) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 25 15:51:08 devstack cinder-volume[83324]: DEBUG oslo_service.backend._eventlet.service [None req-0a9f9eed-f226-426b-90ba-01270c051175 None None] quota_backup_gigabytes = 1000 {{(pid=83324) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 25 15:51:08 devstack cinder-volume[83324]: DEBUG oslo_service.backend._eventlet.service [None req-0a9f9eed-f226-426b-90ba-01270c051175 None None] quota_backups = 10 {{(pid=83324) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 25 15:51:08 devstack cinder-volume[83324]: DEBUG oslo_service.backend._eventlet.service [None req-0a9f9eed-f226-426b-90ba-01270c051175 None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=83324) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 25 15:51:08 devstack cinder-volume[83324]: DEBUG oslo_service.backend._eventlet.service [None req-0a9f9eed-f226-426b-90ba-01270c051175 None None] quota_gigabytes = 1000 {{(pid=83324) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 25 15:51:08 devstack cinder-volume[83324]: DEBUG oslo_service.backend._eventlet.service [None req-0a9f9eed-f226-426b-90ba-01270c051175 None None] quota_groups = 10 {{(pid=83324) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 25 15:51:08 devstack cinder-volume[83324]: DEBUG oslo_service.backend._eventlet.service [None req-0a9f9eed-f226-426b-90ba-01270c051175 None None] quota_snapshots = 10 {{(pid=83324) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 25 15:51:08 devstack cinder-volume[83324]: DEBUG oslo_service.backend._eventlet.service [None req-0a9f9eed-f226-426b-90ba-01270c051175 None None] quota_volumes = 10 {{(pid=83324) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 25 15:51:08 devstack cinder-volume[83324]: DEBUG oslo_service.backend._eventlet.service [None req-0a9f9eed-f226-426b-90ba-01270c051175 None None] rate_limit_burst = 0 {{(pid=83324) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 25 15:51:08 devstack cinder-volume[83324]: DEBUG oslo_service.backend._eventlet.service [None req-0a9f9eed-f226-426b-90ba-01270c051175 None None] rate_limit_except_level = CRITICAL {{(pid=83324) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 25 15:51:08 devstack cinder-volume[83324]: DEBUG oslo_service.backend._eventlet.service [None req-0a9f9eed-f226-426b-90ba-01270c051175 None None] rate_limit_interval = 0 {{(pid=83324) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 25 15:51:08 devstack cinder-volume[83324]: DEBUG oslo_service.backend._eventlet.service [None req-0a9f9eed-f226-426b-90ba-01270c051175 None None] reinit_driver_count = 3 {{(pid=83324) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 25 15:51:08 devstack cinder-volume[83324]: DEBUG oslo_service.backend._eventlet.service [None req-0a9f9eed-f226-426b-90ba-01270c051175 None None] replication_device = **** {{(pid=83324) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 25 15:51:08 devstack cinder-volume[83324]: DEBUG oslo_service.backend._eventlet.service [None req-0a9f9eed-f226-426b-90ba-01270c051175 None None] report_discard_supported = False {{(pid=83324) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 25 15:51:08 devstack cinder-volume[83324]: DEBUG oslo_service.backend._eventlet.service [None req-0a9f9eed-f226-426b-90ba-01270c051175 None None] report_interval = 120 {{(pid=83324) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 25 15:51:08 devstack cinder-volume[83324]: DEBUG oslo_service.backend._eventlet.service [None req-0a9f9eed-f226-426b-90ba-01270c051175 None None] reservation_clean_interval = 86400 {{(pid=83324) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 25 15:51:08 devstack cinder-volume[83324]: DEBUG oslo_service.backend._eventlet.service [None req-0a9f9eed-f226-426b-90ba-01270c051175 None None] reservation_expire = 86400 {{(pid=83324) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 25 15:51:08 devstack cinder-volume[83324]: DEBUG oslo_service.backend._eventlet.service [None req-0a9f9eed-f226-426b-90ba-01270c051175 None None] reserved_image_namespaces = [] {{(pid=83324) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 25 15:51:08 devstack cinder-volume[83324]: DEBUG oslo_service.backend._eventlet.service [None req-0a9f9eed-f226-426b-90ba-01270c051175 None None] reserved_percentage = 0 {{(pid=83324) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 25 15:51:08 devstack cinder-volume[83324]: DEBUG oslo_service.backend._eventlet.service [None req-0a9f9eed-f226-426b-90ba-01270c051175 None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=83324) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 25 15:51:08 devstack cinder-volume[83324]: DEBUG oslo_service.backend._eventlet.service [None req-0a9f9eed-f226-426b-90ba-01270c051175 None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=83324) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 25 15:51:08 devstack cinder-volume[83324]: DEBUG oslo_service.backend._eventlet.service [None req-0a9f9eed-f226-426b-90ba-01270c051175 None None] rpc_response_timeout = 120 {{(pid=83324) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 25 15:51:08 devstack cinder-volume[83324]: DEBUG oslo_service.backend._eventlet.service [None req-0a9f9eed-f226-426b-90ba-01270c051175 None None] run_external_periodic_tasks = True {{(pid=83324) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 25 15:51:08 devstack cinder-volume[83324]: DEBUG oslo_service.backend._eventlet.service [None req-0a9f9eed-f226-426b-90ba-01270c051175 None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=83324) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 25 15:51:08 devstack cinder-volume[83324]: DEBUG oslo_service.backend._eventlet.service [None req-0a9f9eed-f226-426b-90ba-01270c051175 None None] scst_target_driver = iscsi {{(pid=83324) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 25 15:51:08 devstack cinder-volume[83324]: DEBUG oslo_service.backend._eventlet.service [None req-0a9f9eed-f226-426b-90ba-01270c051175 None None] scst_target_iqn_name = None {{(pid=83324) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 25 15:51:08 devstack cinder-volume[83324]: DEBUG oslo_service.backend._eventlet.service [None req-0a9f9eed-f226-426b-90ba-01270c051175 None None] service_down_time = 720 {{(pid=83324) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 25 15:51:08 devstack cinder-volume[83324]: DEBUG oslo_service.backend._eventlet.service [None req-0a9f9eed-f226-426b-90ba-01270c051175 None None] shell_completion = None {{(pid=83324) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 25 15:51:08 devstack cinder-volume[83324]: DEBUG oslo_service.backend._eventlet.service [None req-0a9f9eed-f226-426b-90ba-01270c051175 None None] snapshot_name_template = snapshot-%s {{(pid=83324) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 25 15:51:08 devstack cinder-volume[83324]: DEBUG oslo_service.backend._eventlet.service [None req-0a9f9eed-f226-426b-90ba-01270c051175 None None] split_loggers = False {{(pid=83324) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 25 15:51:08 devstack cinder-volume[83324]: DEBUG oslo_service.backend._eventlet.service [None req-0a9f9eed-f226-426b-90ba-01270c051175 None None] state_path = /opt/stack/data/cinder {{(pid=83324) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 25 15:51:08 devstack cinder-volume[83324]: DEBUG oslo_service.backend._eventlet.service [None req-0a9f9eed-f226-426b-90ba-01270c051175 None None] storage_availability_zone = nova {{(pid=83324) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 25 15:51:08 devstack cinder-volume[83324]: DEBUG oslo_service.backend._eventlet.service [None req-0a9f9eed-f226-426b-90ba-01270c051175 None None] storage_protocol = iSCSI {{(pid=83324) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 25 15:51:08 devstack cinder-volume[83324]: DEBUG oslo_service.backend._eventlet.service [None req-0a9f9eed-f226-426b-90ba-01270c051175 None None] syslog_log_facility = LOG_USER {{(pid=83324) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 25 15:51:08 devstack cinder-volume[83324]: DEBUG oslo_service.backend._eventlet.service [None req-0a9f9eed-f226-426b-90ba-01270c051175 None None] target_helper = lioadm {{(pid=83324) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 25 15:51:08 devstack cinder-volume[83324]: DEBUG oslo_service.backend._eventlet.service [None req-0a9f9eed-f226-426b-90ba-01270c051175 None None] target_ip_address = 192.168.122.119 {{(pid=83324) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 25 15:51:08 devstack cinder-volume[83324]: DEBUG oslo_service.backend._eventlet.service [None req-0a9f9eed-f226-426b-90ba-01270c051175 None None] target_port = 3260 {{(pid=83324) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 25 15:51:08 devstack cinder-volume[83324]: DEBUG oslo_service.backend._eventlet.service [None req-0a9f9eed-f226-426b-90ba-01270c051175 None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=83324) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 25 15:51:08 devstack cinder-volume[83324]: DEBUG oslo_service.backend._eventlet.service [None req-0a9f9eed-f226-426b-90ba-01270c051175 None None] target_protocol = iscsi {{(pid=83324) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 25 15:51:08 devstack cinder-volume[83324]: DEBUG oslo_service.backend._eventlet.service [None req-0a9f9eed-f226-426b-90ba-01270c051175 None None] target_secondary_ip_addresses = [] {{(pid=83324) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 25 15:51:08 devstack cinder-volume[83324]: DEBUG oslo_service.backend._eventlet.service [None req-0a9f9eed-f226-426b-90ba-01270c051175 None None] trace_flags = None {{(pid=83324) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 25 15:51:08 devstack cinder-volume[83324]: DEBUG oslo_service.backend._eventlet.service [None req-0a9f9eed-f226-426b-90ba-01270c051175 None None] transfer_api_class = cinder.transfer.api.API {{(pid=83324) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 25 15:51:08 devstack cinder-volume[83324]: DEBUG oslo_service.backend._eventlet.service [None req-0a9f9eed-f226-426b-90ba-01270c051175 None None] transport_url = **** {{(pid=83324) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 25 15:51:08 devstack cinder-volume[83324]: DEBUG oslo_service.backend._eventlet.service [None req-0a9f9eed-f226-426b-90ba-01270c051175 None None] until_refresh = 0 {{(pid=83324) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 25 15:51:08 devstack cinder-volume[83324]: DEBUG oslo_service.backend._eventlet.service [None req-0a9f9eed-f226-426b-90ba-01270c051175 None None] use_chap_auth = False {{(pid=83324) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 25 15:51:08 devstack cinder-volume[83324]: DEBUG oslo_service.backend._eventlet.service [None req-0a9f9eed-f226-426b-90ba-01270c051175 None None] use_default_quota_class = True {{(pid=83324) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 25 15:51:08 devstack cinder-volume[83324]: DEBUG oslo_service.backend._eventlet.service [None req-0a9f9eed-f226-426b-90ba-01270c051175 None None] use_journal = False {{(pid=83324) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 25 15:51:08 devstack cinder-volume[83324]: DEBUG oslo_service.backend._eventlet.service [None req-0a9f9eed-f226-426b-90ba-01270c051175 None None] use_json = False {{(pid=83324) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 25 15:51:08 devstack cinder-volume[83324]: DEBUG oslo_service.backend._eventlet.service [None req-0a9f9eed-f226-426b-90ba-01270c051175 None None] use_multipath_for_image_xfer = False {{(pid=83324) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 25 15:51:08 devstack cinder-volume[83324]: DEBUG oslo_service.backend._eventlet.service [None req-0a9f9eed-f226-426b-90ba-01270c051175 None None] use_stderr = False {{(pid=83324) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 25 15:51:08 devstack cinder-volume[83324]: DEBUG oslo_service.backend._eventlet.service [None req-0a9f9eed-f226-426b-90ba-01270c051175 None None] use_syslog = False {{(pid=83324) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 25 15:51:08 devstack cinder-volume[83324]: DEBUG oslo_service.backend._eventlet.service [None req-0a9f9eed-f226-426b-90ba-01270c051175 None None] verify_glance_signatures = enabled {{(pid=83324) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 25 15:51:08 devstack cinder-volume[83324]: DEBUG oslo_service.backend._eventlet.service [None req-0a9f9eed-f226-426b-90ba-01270c051175 None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=83324) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 25 15:51:08 devstack cinder-volume[83324]: DEBUG oslo_service.backend._eventlet.service [None req-0a9f9eed-f226-426b-90ba-01270c051175 None None] volume_api_class = cinder.volume.api.API {{(pid=83324) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 25 15:51:08 devstack cinder-volume[83324]: DEBUG oslo_service.backend._eventlet.service [None req-0a9f9eed-f226-426b-90ba-01270c051175 None None] volume_backend_name = None {{(pid=83324) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 25 15:51:08 devstack cinder-volume[83324]: DEBUG oslo_service.backend._eventlet.service [None req-0a9f9eed-f226-426b-90ba-01270c051175 None None] volume_clear = zero {{(pid=83324) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 25 15:51:08 devstack cinder-volume[83324]: DEBUG oslo_service.backend._eventlet.service [None req-0a9f9eed-f226-426b-90ba-01270c051175 None None] volume_clear_ionice = None {{(pid=83324) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 25 15:51:08 devstack cinder-volume[83324]: DEBUG oslo_service.backend._eventlet.service [None req-0a9f9eed-f226-426b-90ba-01270c051175 None None] volume_clear_size = 0 {{(pid=83324) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 25 15:51:08 devstack cinder-volume[83324]: DEBUG oslo_service.backend._eventlet.service [None req-0a9f9eed-f226-426b-90ba-01270c051175 None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=83324) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 25 15:51:08 devstack cinder-volume[83324]: DEBUG oslo_service.backend._eventlet.service [None req-0a9f9eed-f226-426b-90ba-01270c051175 None None] volume_copy_bps_limit = 0 {{(pid=83324) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 25 15:51:08 devstack cinder-volume[83324]: DEBUG oslo_service.backend._eventlet.service [None req-0a9f9eed-f226-426b-90ba-01270c051175 None None] volume_dd_blocksize = 1M {{(pid=83324) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 25 15:51:08 devstack cinder-volume[83324]: DEBUG oslo_service.backend._eventlet.service [None req-0a9f9eed-f226-426b-90ba-01270c051175 None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=83324) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 25 15:51:08 devstack cinder-volume[83324]: DEBUG oslo_service.backend._eventlet.service [None req-0a9f9eed-f226-426b-90ba-01270c051175 None None] volume_name_template = volume-%s {{(pid=83324) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 25 15:51:08 devstack cinder-volume[83324]: DEBUG oslo_service.backend._eventlet.service [None req-0a9f9eed-f226-426b-90ba-01270c051175 None None] volume_service_inithost_offload = False {{(pid=83324) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 25 15:51:08 devstack cinder-volume[83324]: DEBUG oslo_service.backend._eventlet.service [None req-0a9f9eed-f226-426b-90ba-01270c051175 None None] volume_usage_audit_period = month {{(pid=83324) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 25 15:51:08 devstack cinder-volume[83324]: DEBUG oslo_service.backend._eventlet.service [None req-0a9f9eed-f226-426b-90ba-01270c051175 None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=83324) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 25 15:51:08 devstack cinder-volume[83324]: DEBUG oslo_service.backend._eventlet.service [None req-0a9f9eed-f226-426b-90ba-01270c051175 None None] zoning_mode = None {{(pid=83324) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 25 15:51:08 devstack cinder-volume[83324]: DEBUG oslo_service.backend._eventlet.service [None req-0a9f9eed-f226-426b-90ba-01270c051175 None None] os_brick.lightos_discovery_client_address = localhost {{(pid=83324) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:51:08 devstack cinder-volume[83324]: DEBUG oslo_service.backend._eventlet.service [None req-0a9f9eed-f226-426b-90ba-01270c051175 None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=83324) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:51:08 devstack cinder-volume[83324]: DEBUG oslo_service.backend._eventlet.service [None req-0a9f9eed-f226-426b-90ba-01270c051175 None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=83324) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:51:08 devstack cinder-volume[83324]: DEBUG oslo_service.backend._eventlet.service [None req-0a9f9eed-f226-426b-90ba-01270c051175 None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=83324) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:51:08 devstack cinder-volume[83324]: DEBUG oslo_service.backend._eventlet.service [None req-0a9f9eed-f226-426b-90ba-01270c051175 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=83324) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:51:08 devstack cinder-volume[83324]: DEBUG oslo_service.backend._eventlet.service [None req-0a9f9eed-f226-426b-90ba-01270c051175 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=83324) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:51:08 devstack cinder-volume[83324]: DEBUG oslo_service.backend._eventlet.service [None req-0a9f9eed-f226-426b-90ba-01270c051175 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=83324) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:51:08 devstack cinder-volume[83324]: DEBUG oslo_service.backend._eventlet.service [None req-0a9f9eed-f226-426b-90ba-01270c051175 None None] oslo_concurrency.disable_process_locking = False {{(pid=83324) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:51:08 devstack cinder-volume[83324]: DEBUG oslo_service.backend._eventlet.service [None req-0a9f9eed-f226-426b-90ba-01270c051175 None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=83324) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:51:08 devstack cinder-volume[83324]: DEBUG oslo_service.backend._eventlet.service [None req-0a9f9eed-f226-426b-90ba-01270c051175 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=83324) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:51:08 devstack cinder-volume[83324]: DEBUG oslo_service.backend._eventlet.service [None req-0a9f9eed-f226-426b-90ba-01270c051175 None None] keystone_authtoken.admin_password = **** {{(pid=83324) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:51:08 devstack cinder-volume[83324]: DEBUG oslo_service.backend._eventlet.service [None req-0a9f9eed-f226-426b-90ba-01270c051175 None None] keystone_authtoken.admin_tenant_name = admin {{(pid=83324) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:51:08 devstack cinder-volume[83324]: DEBUG oslo_service.backend._eventlet.service [None req-0a9f9eed-f226-426b-90ba-01270c051175 None None] keystone_authtoken.admin_token = **** {{(pid=83324) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:51:08 devstack cinder-volume[83324]: DEBUG oslo_service.backend._eventlet.service [None req-0a9f9eed-f226-426b-90ba-01270c051175 None None] keystone_authtoken.admin_user = None {{(pid=83324) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:51:08 devstack cinder-volume[83324]: DEBUG oslo_service.backend._eventlet.service [None req-0a9f9eed-f226-426b-90ba-01270c051175 None None] keystone_authtoken.auth_admin_prefix = {{(pid=83324) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:51:08 devstack cinder-volume[83324]: DEBUG oslo_service.backend._eventlet.service [None req-0a9f9eed-f226-426b-90ba-01270c051175 None None] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=83324) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:51:08 devstack cinder-volume[83324]: DEBUG oslo_service.backend._eventlet.service [None req-0a9f9eed-f226-426b-90ba-01270c051175 None None] keystone_authtoken.auth_port = 35357 {{(pid=83324) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:51:08 devstack cinder-volume[83324]: DEBUG oslo_service.backend._eventlet.service [None req-0a9f9eed-f226-426b-90ba-01270c051175 None None] keystone_authtoken.auth_protocol = https {{(pid=83324) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:51:08 devstack cinder-volume[83324]: DEBUG oslo_service.backend._eventlet.service [None req-0a9f9eed-f226-426b-90ba-01270c051175 None None] keystone_authtoken.auth_section = None {{(pid=83324) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:51:08 devstack cinder-volume[83324]: DEBUG oslo_service.backend._eventlet.service [None req-0a9f9eed-f226-426b-90ba-01270c051175 None None] keystone_authtoken.auth_type = password {{(pid=83324) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:51:08 devstack cinder-volume[83324]: DEBUG oslo_service.backend._eventlet.service [None req-0a9f9eed-f226-426b-90ba-01270c051175 None None] keystone_authtoken.auth_uri = None {{(pid=83324) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:51:08 devstack cinder-volume[83324]: DEBUG oslo_service.backend._eventlet.service [None req-0a9f9eed-f226-426b-90ba-01270c051175 None None] keystone_authtoken.auth_version = None {{(pid=83324) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:51:08 devstack cinder-volume[83324]: DEBUG oslo_service.backend._eventlet.service [None req-0a9f9eed-f226-426b-90ba-01270c051175 None None] keystone_authtoken.cache = None {{(pid=83324) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:51:08 devstack cinder-volume[83324]: DEBUG oslo_service.backend._eventlet.service [None req-0a9f9eed-f226-426b-90ba-01270c051175 None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=83324) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:51:08 devstack cinder-volume[83324]: DEBUG oslo_service.backend._eventlet.service [None req-0a9f9eed-f226-426b-90ba-01270c051175 None None] keystone_authtoken.certfile = None {{(pid=83324) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:51:08 devstack cinder-volume[83324]: DEBUG oslo_service.backend._eventlet.service [None req-0a9f9eed-f226-426b-90ba-01270c051175 None None] keystone_authtoken.delay_auth_decision = False {{(pid=83324) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:51:08 devstack cinder-volume[83324]: DEBUG oslo_service.backend._eventlet.service [None req-0a9f9eed-f226-426b-90ba-01270c051175 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=83324) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:51:08 devstack cinder-volume[83324]: DEBUG oslo_service.backend._eventlet.service [None req-0a9f9eed-f226-426b-90ba-01270c051175 None None] keystone_authtoken.http_connect_timeout = None {{(pid=83324) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:51:08 devstack cinder-volume[83324]: DEBUG oslo_service.backend._eventlet.service [None req-0a9f9eed-f226-426b-90ba-01270c051175 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=83324) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:51:08 devstack cinder-volume[83324]: DEBUG oslo_service.backend._eventlet.service [None req-0a9f9eed-f226-426b-90ba-01270c051175 None None] keystone_authtoken.identity_uri = None {{(pid=83324) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:51:08 devstack cinder-volume[83324]: DEBUG oslo_service.backend._eventlet.service [None req-0a9f9eed-f226-426b-90ba-01270c051175 None None] keystone_authtoken.include_service_catalog = True {{(pid=83324) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:51:08 devstack cinder-volume[83324]: DEBUG oslo_service.backend._eventlet.service [None req-0a9f9eed-f226-426b-90ba-01270c051175 None None] keystone_authtoken.insecure = False {{(pid=83324) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:51:08 devstack cinder-volume[83324]: DEBUG oslo_service.backend._eventlet.service [None req-0a9f9eed-f226-426b-90ba-01270c051175 None None] keystone_authtoken.interface = public {{(pid=83324) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:51:08 devstack cinder-volume[83324]: DEBUG oslo_service.backend._eventlet.service [None req-0a9f9eed-f226-426b-90ba-01270c051175 None None] keystone_authtoken.keyfile = None {{(pid=83324) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:51:08 devstack cinder-volume[83324]: DEBUG oslo_service.backend._eventlet.service [None req-0a9f9eed-f226-426b-90ba-01270c051175 None None] keystone_authtoken.memcache_password = {{(pid=83324) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:51:08 devstack cinder-volume[83324]: DEBUG oslo_service.backend._eventlet.service [None req-0a9f9eed-f226-426b-90ba-01270c051175 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=83324) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:51:08 devstack cinder-volume[83324]: DEBUG oslo_service.backend._eventlet.service [None req-0a9f9eed-f226-426b-90ba-01270c051175 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=83324) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:51:08 devstack cinder-volume[83324]: DEBUG oslo_service.backend._eventlet.service [None req-0a9f9eed-f226-426b-90ba-01270c051175 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=83324) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:51:08 devstack cinder-volume[83324]: DEBUG oslo_service.backend._eventlet.service [None req-0a9f9eed-f226-426b-90ba-01270c051175 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=83324) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:51:08 devstack cinder-volume[83324]: DEBUG oslo_service.backend._eventlet.service [None req-0a9f9eed-f226-426b-90ba-01270c051175 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=83324) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:51:08 devstack cinder-volume[83324]: DEBUG oslo_service.backend._eventlet.service [None req-0a9f9eed-f226-426b-90ba-01270c051175 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=83324) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:51:08 devstack cinder-volume[83324]: DEBUG oslo_service.backend._eventlet.service [None req-0a9f9eed-f226-426b-90ba-01270c051175 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=83324) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:51:08 devstack cinder-volume[83324]: DEBUG oslo_service.backend._eventlet.service [None req-0a9f9eed-f226-426b-90ba-01270c051175 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=83324) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:51:08 devstack cinder-volume[83324]: DEBUG oslo_service.backend._eventlet.service [None req-0a9f9eed-f226-426b-90ba-01270c051175 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=83324) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:51:08 devstack cinder-volume[83324]: DEBUG oslo_service.backend._eventlet.service [None req-0a9f9eed-f226-426b-90ba-01270c051175 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=83324) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:51:08 devstack cinder-volume[83324]: DEBUG oslo_service.backend._eventlet.service [None req-0a9f9eed-f226-426b-90ba-01270c051175 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=83324) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:51:08 devstack cinder-volume[83324]: DEBUG oslo_service.backend._eventlet.service [None req-0a9f9eed-f226-426b-90ba-01270c051175 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=83324) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:51:08 devstack cinder-volume[83324]: DEBUG oslo_service.backend._eventlet.service [None req-0a9f9eed-f226-426b-90ba-01270c051175 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=83324) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:51:08 devstack cinder-volume[83324]: DEBUG oslo_service.backend._eventlet.service [None req-0a9f9eed-f226-426b-90ba-01270c051175 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=83324) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:51:08 devstack cinder-volume[83324]: DEBUG oslo_service.backend._eventlet.service [None req-0a9f9eed-f226-426b-90ba-01270c051175 None None] keystone_authtoken.memcache_username = {{(pid=83324) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:51:08 devstack cinder-volume[83324]: DEBUG oslo_service.backend._eventlet.service [None req-0a9f9eed-f226-426b-90ba-01270c051175 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=83324) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:51:08 devstack cinder-volume[83324]: DEBUG oslo_service.backend._eventlet.service [None req-0a9f9eed-f226-426b-90ba-01270c051175 None None] keystone_authtoken.region_name = None {{(pid=83324) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:51:08 devstack cinder-volume[83324]: DEBUG oslo_service.backend._eventlet.service [None req-0a9f9eed-f226-426b-90ba-01270c051175 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=83324) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:51:08 devstack cinder-volume[83324]: DEBUG oslo_service.backend._eventlet.service [None req-0a9f9eed-f226-426b-90ba-01270c051175 None None] keystone_authtoken.service_token_roles_required = False {{(pid=83324) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:51:08 devstack cinder-volume[83324]: DEBUG oslo_service.backend._eventlet.service [None req-0a9f9eed-f226-426b-90ba-01270c051175 None None] keystone_authtoken.service_type = None {{(pid=83324) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:51:08 devstack cinder-volume[83324]: DEBUG oslo_service.backend._eventlet.service [None req-0a9f9eed-f226-426b-90ba-01270c051175 None None] keystone_authtoken.token_cache_time = 300 {{(pid=83324) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:51:08 devstack cinder-volume[83324]: DEBUG oslo_service.backend._eventlet.service [None req-0a9f9eed-f226-426b-90ba-01270c051175 None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.119/identity {{(pid=83324) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:51:08 devstack cinder-volume[83324]: DEBUG oslo_service.backend._eventlet.service [None req-0a9f9eed-f226-426b-90ba-01270c051175 None None] cache.backend = dogpile.cache.null {{(pid=83324) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:51:08 devstack cinder-volume[83324]: DEBUG oslo_service.backend._eventlet.service [None req-0a9f9eed-f226-426b-90ba-01270c051175 None None] cache.backend_argument = **** {{(pid=83324) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:51:08 devstack cinder-volume[83324]: DEBUG oslo_service.backend._eventlet.service [None req-0a9f9eed-f226-426b-90ba-01270c051175 None None] cache.backend_expiration_time = None {{(pid=83324) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:51:08 devstack cinder-volume[83324]: DEBUG oslo_service.backend._eventlet.service [None req-0a9f9eed-f226-426b-90ba-01270c051175 None None] cache.config_prefix = cache.oslo {{(pid=83324) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:51:08 devstack cinder-volume[83324]: DEBUG oslo_service.backend._eventlet.service [None req-0a9f9eed-f226-426b-90ba-01270c051175 None None] cache.debug_cache_backend = False {{(pid=83324) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:51:08 devstack cinder-volume[83324]: DEBUG oslo_service.backend._eventlet.service [None req-0a9f9eed-f226-426b-90ba-01270c051175 None None] cache.enable_retry_client = False {{(pid=83324) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:51:08 devstack cinder-volume[83324]: DEBUG oslo_service.backend._eventlet.service [None req-0a9f9eed-f226-426b-90ba-01270c051175 None None] cache.enable_socket_keepalive = False {{(pid=83324) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:51:08 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.quobyte [None req-fcf75513-621e-45a1-964e-6b9fb943d91e None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=83528) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:305}} Feb 25 15:51:08 devstack cinder-volume[83324]: DEBUG oslo_service.backend._eventlet.service [None req-0a9f9eed-f226-426b-90ba-01270c051175 None None] cache.enabled = False {{(pid=83324) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:51:08 devstack cinder-volume[83528]: WARNING cinder.volume.drivers.quobyte [None req-fcf75513-621e-45a1-964e-6b9fb943d91e None None] The NAS file operations will be run as root, allowing root level access at the storage backend. Feb 25 15:51:08 devstack cinder-volume[83324]: DEBUG oslo_service.backend._eventlet.service [None req-0a9f9eed-f226-426b-90ba-01270c051175 None None] cache.enforce_fips_mode = False {{(pid=83324) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:51:08 devstack cinder-volume[83528]: WARNING cinder.volume.drivers.quobyte [None req-fcf75513-621e-45a1-964e-6b9fb943d91e None None] The NAS file permissions mode will be 666 (allowing other/world read & write access). Feb 25 15:51:08 devstack cinder-volume[83324]: DEBUG oslo_service.backend._eventlet.service [None req-0a9f9eed-f226-426b-90ba-01270c051175 None None] cache.expiration_time = 600 {{(pid=83324) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:51:08 devstack cinder-volume[83324]: DEBUG oslo_service.backend._eventlet.service [None req-0a9f9eed-f226-426b-90ba-01270c051175 None None] cache.hashclient_dead_timeout = 60.0 {{(pid=83324) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:51:08 devstack cinder-volume[83324]: DEBUG oslo_service.backend._eventlet.service [None req-0a9f9eed-f226-426b-90ba-01270c051175 None None] cache.hashclient_retry_attempts = 2 {{(pid=83324) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:51:08 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-fcf75513-621e-45a1-964e-6b9fb943d91e None None] Running cmd (subprocess): mount.quobyte {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 25 15:51:08 devstack cinder-volume[83324]: DEBUG oslo_service.backend._eventlet.service [None req-0a9f9eed-f226-426b-90ba-01270c051175 None None] cache.hashclient_retry_timeout = 1.0 {{(pid=83324) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:51:08 devstack cinder-volume[83324]: DEBUG oslo_service.backend._eventlet.service [None req-0a9f9eed-f226-426b-90ba-01270c051175 None None] cache.memcache_dead_retry = 300 {{(pid=83324) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:51:08 devstack cinder-volume[83324]: DEBUG oslo_service.backend._eventlet.service [None req-0a9f9eed-f226-426b-90ba-01270c051175 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=83324) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:51:08 devstack cinder-volume[83324]: DEBUG oslo_service.backend._eventlet.service [None req-0a9f9eed-f226-426b-90ba-01270c051175 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=83324) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:51:08 devstack cinder-volume[83324]: DEBUG oslo_service.backend._eventlet.service [None req-0a9f9eed-f226-426b-90ba-01270c051175 None None] cache.memcache_pool_maxsize = 10 {{(pid=83324) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:51:08 devstack cinder-volume[83324]: DEBUG oslo_service.backend._eventlet.service [None req-0a9f9eed-f226-426b-90ba-01270c051175 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=83324) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:51:08 devstack cinder-volume[83324]: DEBUG oslo_service.backend._eventlet.service [None req-0a9f9eed-f226-426b-90ba-01270c051175 None None] cache.memcache_sasl_enabled = False {{(pid=83324) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:51:08 devstack cinder-volume[83324]: DEBUG oslo_service.backend._eventlet.service [None req-0a9f9eed-f226-426b-90ba-01270c051175 None None] cache.memcache_servers = ['localhost:11211'] {{(pid=83324) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:51:08 devstack cinder-volume[83324]: DEBUG oslo_service.backend._eventlet.service [None req-0a9f9eed-f226-426b-90ba-01270c051175 None None] cache.password = **** {{(pid=83324) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:51:08 devstack cinder-volume[83324]: DEBUG oslo_service.backend._eventlet.service [None req-0a9f9eed-f226-426b-90ba-01270c051175 None None] cache.proxies = [] {{(pid=83324) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:51:08 devstack cinder-volume[83324]: DEBUG oslo_service.backend._eventlet.service [None req-0a9f9eed-f226-426b-90ba-01270c051175 None None] cache.redis_db = 0 {{(pid=83324) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:51:08 devstack cinder-volume[83324]: DEBUG oslo_service.backend._eventlet.service [None req-0a9f9eed-f226-426b-90ba-01270c051175 None None] cache.redis_sentinel_service_name = mymaster {{(pid=83324) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:51:08 devstack cinder-volume[83324]: DEBUG oslo_service.backend._eventlet.service [None req-0a9f9eed-f226-426b-90ba-01270c051175 None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=83324) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:51:08 devstack cinder-volume[83324]: DEBUG oslo_service.backend._eventlet.service [None req-0a9f9eed-f226-426b-90ba-01270c051175 None None] cache.redis_server = localhost:6379 {{(pid=83324) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:51:08 devstack cinder-volume[83324]: DEBUG oslo_service.backend._eventlet.service [None req-0a9f9eed-f226-426b-90ba-01270c051175 None None] cache.retry_attempts = 2 {{(pid=83324) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:51:08 devstack cinder-volume[83324]: DEBUG oslo_service.backend._eventlet.service [None req-0a9f9eed-f226-426b-90ba-01270c051175 None None] cache.retry_delay = 0.0 {{(pid=83324) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:51:08 devstack cinder-volume[83324]: DEBUG oslo_service.backend._eventlet.service [None req-0a9f9eed-f226-426b-90ba-01270c051175 None None] cache.socket_keepalive_count = 1 {{(pid=83324) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:51:08 devstack cinder-volume[83324]: DEBUG oslo_service.backend._eventlet.service [None req-0a9f9eed-f226-426b-90ba-01270c051175 None None] cache.socket_keepalive_idle = 1 {{(pid=83324) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:51:08 devstack cinder-volume[83324]: DEBUG oslo_service.backend._eventlet.service [None req-0a9f9eed-f226-426b-90ba-01270c051175 None None] cache.socket_keepalive_interval = 1 {{(pid=83324) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:51:08 devstack cinder-volume[83324]: DEBUG oslo_service.backend._eventlet.service [None req-0a9f9eed-f226-426b-90ba-01270c051175 None None] cache.socket_timeout = 1.0 {{(pid=83324) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:51:08 devstack cinder-volume[83324]: DEBUG oslo_service.backend._eventlet.service [None req-0a9f9eed-f226-426b-90ba-01270c051175 None None] cache.tls_allowed_ciphers = None {{(pid=83324) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:51:08 devstack cinder-volume[83324]: DEBUG oslo_service.backend._eventlet.service [None req-0a9f9eed-f226-426b-90ba-01270c051175 None None] cache.tls_cafile = None {{(pid=83324) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:51:08 devstack cinder-volume[83324]: DEBUG oslo_service.backend._eventlet.service [None req-0a9f9eed-f226-426b-90ba-01270c051175 None None] cache.tls_certfile = None {{(pid=83324) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:51:08 devstack cinder-volume[83324]: DEBUG oslo_service.backend._eventlet.service [None req-0a9f9eed-f226-426b-90ba-01270c051175 None None] cache.tls_enabled = False {{(pid=83324) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:51:08 devstack cinder-volume[83324]: DEBUG oslo_service.backend._eventlet.service [None req-0a9f9eed-f226-426b-90ba-01270c051175 None None] cache.tls_keyfile = None {{(pid=83324) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:51:08 devstack cinder-volume[83324]: DEBUG oslo_service.backend._eventlet.service [None req-0a9f9eed-f226-426b-90ba-01270c051175 None None] cache.username = None {{(pid=83324) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:51:08 devstack cinder-volume[83324]: DEBUG oslo_service.backend._eventlet.service [None req-0a9f9eed-f226-426b-90ba-01270c051175 None None] coordination.backend_url = **** {{(pid=83324) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:51:08 devstack cinder-volume[83324]: DEBUG oslo_service.backend._eventlet.service [None req-0a9f9eed-f226-426b-90ba-01270c051175 None None] database.asyncio_connection = **** {{(pid=83324) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:51:08 devstack cinder-volume[83324]: DEBUG oslo_service.backend._eventlet.service [None req-0a9f9eed-f226-426b-90ba-01270c051175 None None] database.asyncio_slave_connection = **** {{(pid=83324) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:51:08 devstack cinder-volume[83324]: DEBUG oslo_service.backend._eventlet.service [None req-0a9f9eed-f226-426b-90ba-01270c051175 None None] database.backend = sqlalchemy {{(pid=83324) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:51:08 devstack cinder-volume[83324]: DEBUG oslo_service.backend._eventlet.service [None req-0a9f9eed-f226-426b-90ba-01270c051175 None None] database.connection = **** {{(pid=83324) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:51:08 devstack cinder-volume[83324]: DEBUG oslo_service.backend._eventlet.service [None req-0a9f9eed-f226-426b-90ba-01270c051175 None None] database.connection_debug = 0 {{(pid=83324) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:51:08 devstack cinder-volume[83324]: DEBUG oslo_service.backend._eventlet.service [None req-0a9f9eed-f226-426b-90ba-01270c051175 None None] database.connection_parameters = {{(pid=83324) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:51:08 devstack cinder-volume[83324]: DEBUG oslo_service.backend._eventlet.service [None req-0a9f9eed-f226-426b-90ba-01270c051175 None None] database.connection_recycle_time = 3600 {{(pid=83324) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:51:08 devstack cinder-volume[83324]: DEBUG oslo_service.backend._eventlet.service [None req-0a9f9eed-f226-426b-90ba-01270c051175 None None] database.connection_trace = False {{(pid=83324) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:51:08 devstack cinder-volume[83324]: DEBUG oslo_service.backend._eventlet.service [None req-0a9f9eed-f226-426b-90ba-01270c051175 None None] database.db_inc_retry_interval = True {{(pid=83324) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:51:08 devstack cinder-volume[83324]: DEBUG oslo_service.backend._eventlet.service [None req-0a9f9eed-f226-426b-90ba-01270c051175 None None] database.db_max_retries = 20 {{(pid=83324) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:51:08 devstack cinder-volume[83324]: DEBUG oslo_service.backend._eventlet.service [None req-0a9f9eed-f226-426b-90ba-01270c051175 None None] database.db_max_retry_interval = 10 {{(pid=83324) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:51:08 devstack cinder-volume[83324]: DEBUG oslo_service.backend._eventlet.service [None req-0a9f9eed-f226-426b-90ba-01270c051175 None None] database.db_retry_interval = 1 {{(pid=83324) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:51:08 devstack cinder-volume[83324]: DEBUG oslo_service.backend._eventlet.service [None req-0a9f9eed-f226-426b-90ba-01270c051175 None None] database.max_overflow = 50 {{(pid=83324) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:51:08 devstack cinder-volume[83324]: DEBUG oslo_service.backend._eventlet.service [None req-0a9f9eed-f226-426b-90ba-01270c051175 None None] database.max_pool_size = 5 {{(pid=83324) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:51:08 devstack cinder-volume[83324]: DEBUG oslo_service.backend._eventlet.service [None req-0a9f9eed-f226-426b-90ba-01270c051175 None None] database.max_retries = 10 {{(pid=83324) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:51:08 devstack cinder-volume[83324]: DEBUG oslo_service.backend._eventlet.service [None req-0a9f9eed-f226-426b-90ba-01270c051175 None None] database.mysql_sql_mode = TRADITIONAL {{(pid=83324) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:51:08 devstack cinder-volume[83324]: DEBUG oslo_service.backend._eventlet.service [None req-0a9f9eed-f226-426b-90ba-01270c051175 None None] database.mysql_wsrep_sync_wait = None {{(pid=83324) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:51:08 devstack cinder-volume[83324]: DEBUG oslo_service.backend._eventlet.service [None req-0a9f9eed-f226-426b-90ba-01270c051175 None None] database.pool_timeout = None {{(pid=83324) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:51:08 devstack cinder-volume[83324]: DEBUG oslo_service.backend._eventlet.service [None req-0a9f9eed-f226-426b-90ba-01270c051175 None None] database.retry_interval = 10 {{(pid=83324) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:51:08 devstack cinder-volume[83324]: DEBUG oslo_service.backend._eventlet.service [None req-0a9f9eed-f226-426b-90ba-01270c051175 None None] database.slave_connection = **** {{(pid=83324) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:51:08 devstack cinder-volume[83324]: DEBUG oslo_service.backend._eventlet.service [None req-0a9f9eed-f226-426b-90ba-01270c051175 None None] database.sqlite_synchronous = True {{(pid=83324) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:51:08 devstack cinder-volume[83324]: DEBUG oslo_service.backend._eventlet.service [None req-0a9f9eed-f226-426b-90ba-01270c051175 None None] database.synchronous_reader = True {{(pid=83324) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:51:08 devstack cinder-volume[83324]: DEBUG oslo_service.backend._eventlet.service [None req-0a9f9eed-f226-426b-90ba-01270c051175 None None] database.use_db_reconnect = False {{(pid=83324) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:51:08 devstack cinder-volume[83324]: DEBUG oslo_service.backend._eventlet.service [None req-0a9f9eed-f226-426b-90ba-01270c051175 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=83324) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:51:08 devstack cinder-volume[83324]: DEBUG oslo_service.backend._eventlet.service [None req-0a9f9eed-f226-426b-90ba-01270c051175 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=83324) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:51:08 devstack cinder-volume[83324]: DEBUG oslo_service.backend._eventlet.service [None req-0a9f9eed-f226-426b-90ba-01270c051175 None None] oslo_messaging_metrics.metrics_process_name = {{(pid=83324) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:51:08 devstack cinder-volume[83324]: DEBUG oslo_service.backend._eventlet.service [None req-0a9f9eed-f226-426b-90ba-01270c051175 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=83324) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:51:08 devstack cinder-volume[83324]: DEBUG oslo_service.backend._eventlet.service [None req-0a9f9eed-f226-426b-90ba-01270c051175 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=83324) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:51:08 devstack cinder-volume[83324]: DEBUG oslo_service.backend._eventlet.service [None req-0a9f9eed-f226-426b-90ba-01270c051175 None None] profiler.connection_string = messaging:// {{(pid=83324) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:51:08 devstack cinder-volume[83324]: DEBUG oslo_service.backend._eventlet.service [None req-0a9f9eed-f226-426b-90ba-01270c051175 None None] profiler.enabled = False {{(pid=83324) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:51:08 devstack cinder-volume[83324]: DEBUG oslo_service.backend._eventlet.service [None req-0a9f9eed-f226-426b-90ba-01270c051175 None None] profiler.es_doc_type = notification {{(pid=83324) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:51:08 devstack cinder-volume[83324]: DEBUG oslo_service.backend._eventlet.service [None req-0a9f9eed-f226-426b-90ba-01270c051175 None None] profiler.es_scroll_size = 10000 {{(pid=83324) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:51:08 devstack cinder-volume[83324]: DEBUG oslo_service.backend._eventlet.service [None req-0a9f9eed-f226-426b-90ba-01270c051175 None None] profiler.es_scroll_time = 2m {{(pid=83324) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:51:08 devstack cinder-volume[83324]: DEBUG oslo_service.backend._eventlet.service [None req-0a9f9eed-f226-426b-90ba-01270c051175 None None] profiler.filter_error_trace = False {{(pid=83324) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:51:08 devstack cinder-volume[83324]: DEBUG oslo_service.backend._eventlet.service [None req-0a9f9eed-f226-426b-90ba-01270c051175 None None] profiler.hmac_keys = **** {{(pid=83324) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:51:08 devstack cinder-volume[83324]: DEBUG oslo_service.backend._eventlet.service [None req-0a9f9eed-f226-426b-90ba-01270c051175 None None] profiler.sentinel_service_name = mymaster {{(pid=83324) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:51:08 devstack cinder-volume[83324]: DEBUG oslo_service.backend._eventlet.service [None req-0a9f9eed-f226-426b-90ba-01270c051175 None None] profiler.socket_timeout = 0.1 {{(pid=83324) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:51:08 devstack cinder-volume[83324]: DEBUG oslo_service.backend._eventlet.service [None req-0a9f9eed-f226-426b-90ba-01270c051175 None None] profiler.trace_requests = False {{(pid=83324) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:51:08 devstack cinder-volume[83324]: DEBUG oslo_service.backend._eventlet.service [None req-0a9f9eed-f226-426b-90ba-01270c051175 None None] profiler.trace_sqlalchemy = False {{(pid=83324) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:51:08 devstack cinder-volume[83324]: DEBUG oslo_service.backend._eventlet.service [None req-0a9f9eed-f226-426b-90ba-01270c051175 None None] profiler_jaeger.process_tags = {} {{(pid=83324) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:51:08 devstack cinder-volume[83324]: DEBUG oslo_service.backend._eventlet.service [None req-0a9f9eed-f226-426b-90ba-01270c051175 None None] profiler_jaeger.service_name_prefix = None {{(pid=83324) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:51:08 devstack cinder-volume[83324]: DEBUG oslo_service.backend._eventlet.service [None req-0a9f9eed-f226-426b-90ba-01270c051175 None None] profiler_otlp.service_name_prefix = None {{(pid=83324) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:51:08 devstack cinder-volume[83324]: DEBUG oslo_service.backend._eventlet.service [None req-0a9f9eed-f226-426b-90ba-01270c051175 None None] oslo_policy.enforce_new_defaults = False {{(pid=83324) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:51:08 devstack cinder-volume[83324]: WARNING oslo_config.cfg [None req-0a9f9eed-f226-426b-90ba-01270c051175 None None] Deprecated: Option "enforce_scope" from group "oslo_policy" is deprecated for removal (This configuration was added temporarily to facilitate a smooth transition to the new RBAC. OpenStack will always enforce scope checks. This configuration option is deprecated and will be removed in the 2025.2 cycle.). Its value may be silently ignored in the future. Feb 25 15:51:08 devstack cinder-volume[83324]: DEBUG oslo_service.backend._eventlet.service [None req-0a9f9eed-f226-426b-90ba-01270c051175 None None] oslo_policy.enforce_scope = False {{(pid=83324) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:51:08 devstack cinder-volume[83324]: DEBUG oslo_service.backend._eventlet.service [None req-0a9f9eed-f226-426b-90ba-01270c051175 None None] oslo_policy.policy_default_rule = default {{(pid=83324) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:51:08 devstack cinder-volume[83324]: DEBUG oslo_service.backend._eventlet.service [None req-0a9f9eed-f226-426b-90ba-01270c051175 None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=83324) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:51:08 devstack cinder-volume[83324]: DEBUG oslo_service.backend._eventlet.service [None req-0a9f9eed-f226-426b-90ba-01270c051175 None None] oslo_policy.policy_file = policy.yaml {{(pid=83324) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:51:08 devstack cinder-volume[83324]: DEBUG oslo_service.backend._eventlet.service [None req-0a9f9eed-f226-426b-90ba-01270c051175 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=83324) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:51:08 devstack cinder-volume[83324]: DEBUG oslo_service.backend._eventlet.service [None req-0a9f9eed-f226-426b-90ba-01270c051175 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=83324) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:51:08 devstack cinder-volume[83324]: DEBUG oslo_service.backend._eventlet.service [None req-0a9f9eed-f226-426b-90ba-01270c051175 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=83324) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:51:08 devstack cinder-volume[83324]: DEBUG oslo_service.backend._eventlet.service [None req-0a9f9eed-f226-426b-90ba-01270c051175 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=83324) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:51:08 devstack cinder-volume[83324]: DEBUG oslo_service.backend._eventlet.service [None req-0a9f9eed-f226-426b-90ba-01270c051175 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=83324) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:51:08 devstack cinder-volume[83324]: DEBUG oslo_service.backend._eventlet.service [None req-0a9f9eed-f226-426b-90ba-01270c051175 None None] oslo_policy.remote_timeout = 60.0 {{(pid=83324) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:51:08 devstack cinder-volume[83324]: DEBUG oslo_service.backend._eventlet.service [None req-0a9f9eed-f226-426b-90ba-01270c051175 None None] privsep_osbrick.capabilities = [21, 2] {{(pid=83324) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:51:08 devstack cinder-volume[83324]: DEBUG oslo_service.backend._eventlet.service [None req-0a9f9eed-f226-426b-90ba-01270c051175 None None] privsep_osbrick.group = None {{(pid=83324) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:51:08 devstack cinder-volume[83324]: DEBUG oslo_service.backend._eventlet.service [None req-0a9f9eed-f226-426b-90ba-01270c051175 None None] privsep_osbrick.helper_command = None {{(pid=83324) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:51:08 devstack cinder-volume[83324]: DEBUG oslo_service.backend._eventlet.service [None req-0a9f9eed-f226-426b-90ba-01270c051175 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=83324) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:51:08 devstack cinder-volume[83324]: DEBUG oslo_service.backend._eventlet.service [None req-0a9f9eed-f226-426b-90ba-01270c051175 None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=83324) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:51:08 devstack cinder-volume[83324]: DEBUG oslo_service.backend._eventlet.service [None req-0a9f9eed-f226-426b-90ba-01270c051175 None None] privsep_osbrick.thread_pool_size = 4 {{(pid=83324) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:51:08 devstack cinder-volume[83324]: DEBUG oslo_service.backend._eventlet.service [None req-0a9f9eed-f226-426b-90ba-01270c051175 None None] privsep_osbrick.user = None {{(pid=83324) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:51:08 devstack cinder-volume[83324]: DEBUG oslo_service.backend._eventlet.service [None req-0a9f9eed-f226-426b-90ba-01270c051175 None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=83324) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:51:08 devstack cinder-volume[83324]: DEBUG oslo_service.backend._eventlet.service [None req-0a9f9eed-f226-426b-90ba-01270c051175 None None] cinder_sys_admin.group = None {{(pid=83324) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:51:08 devstack cinder-volume[83324]: DEBUG oslo_service.backend._eventlet.service [None req-0a9f9eed-f226-426b-90ba-01270c051175 None None] cinder_sys_admin.helper_command = None {{(pid=83324) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:51:08 devstack cinder-volume[83324]: DEBUG oslo_service.backend._eventlet.service [None req-0a9f9eed-f226-426b-90ba-01270c051175 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=83324) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:51:08 devstack cinder-volume[83324]: DEBUG oslo_service.backend._eventlet.service [None req-0a9f9eed-f226-426b-90ba-01270c051175 None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=83324) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:51:08 devstack cinder-volume[83324]: DEBUG oslo_service.backend._eventlet.service [None req-0a9f9eed-f226-426b-90ba-01270c051175 None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=83324) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:51:08 devstack cinder-volume[83324]: DEBUG oslo_service.backend._eventlet.service [None req-0a9f9eed-f226-426b-90ba-01270c051175 None None] cinder_sys_admin.user = None {{(pid=83324) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:51:08 devstack cinder-volume[83324]: DEBUG oslo_service.backend._eventlet.service [None req-0a9f9eed-f226-426b-90ba-01270c051175 None None] service_user.auth_section = None {{(pid=83324) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:51:08 devstack cinder-volume[83324]: DEBUG oslo_service.backend._eventlet.service [None req-0a9f9eed-f226-426b-90ba-01270c051175 None None] service_user.auth_type = password {{(pid=83324) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:51:08 devstack cinder-volume[83324]: DEBUG oslo_service.backend._eventlet.service [None req-0a9f9eed-f226-426b-90ba-01270c051175 None None] service_user.cafile = None {{(pid=83324) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:51:08 devstack cinder-volume[83324]: DEBUG oslo_service.backend._eventlet.service [None req-0a9f9eed-f226-426b-90ba-01270c051175 None None] service_user.certfile = None {{(pid=83324) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:51:08 devstack cinder-volume[83324]: DEBUG oslo_service.backend._eventlet.service [None req-0a9f9eed-f226-426b-90ba-01270c051175 None None] service_user.collect_timing = False {{(pid=83324) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:51:08 devstack cinder-volume[83324]: DEBUG oslo_service.backend._eventlet.service [None req-0a9f9eed-f226-426b-90ba-01270c051175 None None] service_user.insecure = False {{(pid=83324) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:51:08 devstack cinder-volume[83324]: DEBUG oslo_service.backend._eventlet.service [None req-0a9f9eed-f226-426b-90ba-01270c051175 None None] service_user.keyfile = None {{(pid=83324) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:51:08 devstack cinder-volume[83324]: DEBUG oslo_service.backend._eventlet.service [None req-0a9f9eed-f226-426b-90ba-01270c051175 None None] service_user.send_service_user_token = True {{(pid=83324) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:51:08 devstack cinder-volume[83324]: DEBUG oslo_service.backend._eventlet.service [None req-0a9f9eed-f226-426b-90ba-01270c051175 None None] service_user.split_loggers = False {{(pid=83324) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:51:08 devstack cinder-volume[83324]: DEBUG oslo_service.backend._eventlet.service [None req-0a9f9eed-f226-426b-90ba-01270c051175 None None] service_user.timeout = None {{(pid=83324) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:51:08 devstack cinder-volume[83324]: DEBUG oslo_service.backend._eventlet.service [None req-0a9f9eed-f226-426b-90ba-01270c051175 None None] glance.auth_section = None {{(pid=83324) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:51:08 devstack cinder-volume[83324]: DEBUG oslo_service.backend._eventlet.service [None req-0a9f9eed-f226-426b-90ba-01270c051175 None None] glance.auth_type = password {{(pid=83324) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:51:08 devstack cinder-volume[83324]: DEBUG oslo_service.backend._eventlet.service [None req-0a9f9eed-f226-426b-90ba-01270c051175 None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=83324) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:51:08 devstack cinder-volume[83324]: DEBUG oslo_service.backend._eventlet.service [None req-0a9f9eed-f226-426b-90ba-01270c051175 None None] glance.certfile = None {{(pid=83324) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:51:08 devstack cinder-volume[83324]: DEBUG oslo_service.backend._eventlet.service [None req-0a9f9eed-f226-426b-90ba-01270c051175 None None] glance.collect_timing = False {{(pid=83324) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:51:08 devstack cinder-volume[83324]: DEBUG oslo_service.backend._eventlet.service [None req-0a9f9eed-f226-426b-90ba-01270c051175 None None] glance.insecure = False {{(pid=83324) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:51:08 devstack cinder-volume[83324]: DEBUG oslo_service.backend._eventlet.service [None req-0a9f9eed-f226-426b-90ba-01270c051175 None None] glance.keyfile = None {{(pid=83324) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:51:08 devstack cinder-volume[83324]: DEBUG oslo_service.backend._eventlet.service [None req-0a9f9eed-f226-426b-90ba-01270c051175 None None] glance.region_name = None {{(pid=83324) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:51:08 devstack cinder-volume[83324]: DEBUG oslo_service.backend._eventlet.service [None req-0a9f9eed-f226-426b-90ba-01270c051175 None None] glance.split_loggers = False {{(pid=83324) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:51:08 devstack cinder-volume[83324]: DEBUG oslo_service.backend._eventlet.service [None req-0a9f9eed-f226-426b-90ba-01270c051175 None None] glance.timeout = None {{(pid=83324) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:51:08 devstack cinder-volume[83324]: DEBUG oslo_service.backend._eventlet.service [None req-0a9f9eed-f226-426b-90ba-01270c051175 None None] backend_defaults.backend_availability_zone = None {{(pid=83324) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:51:08 devstack cinder-volume[83324]: DEBUG oslo_service.backend._eventlet.service [None req-0a9f9eed-f226-426b-90ba-01270c051175 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=83324) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:51:08 devstack cinder-volume[83324]: DEBUG oslo_service.backend._eventlet.service [None req-0a9f9eed-f226-426b-90ba-01270c051175 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=83324) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:51:08 devstack cinder-volume[83324]: DEBUG oslo_service.backend._eventlet.service [None req-0a9f9eed-f226-426b-90ba-01270c051175 None None] backend_defaults.chap_password = **** {{(pid=83324) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:51:08 devstack cinder-volume[83324]: DEBUG oslo_service.backend._eventlet.service [None req-0a9f9eed-f226-426b-90ba-01270c051175 None None] backend_defaults.chap_username = {{(pid=83324) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:51:08 devstack cinder-volume[83324]: DEBUG oslo_service.backend._eventlet.service [None req-0a9f9eed-f226-426b-90ba-01270c051175 None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=83324) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:51:08 devstack cinder-volume[83324]: DEBUG oslo_service.backend._eventlet.service [None req-0a9f9eed-f226-426b-90ba-01270c051175 None None] backend_defaults.disk_geometry = None {{(pid=83324) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:51:08 devstack cinder-volume[83324]: DEBUG oslo_service.backend._eventlet.service [None req-0a9f9eed-f226-426b-90ba-01270c051175 None None] backend_defaults.driver_client_cert = None {{(pid=83324) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:51:08 devstack cinder-volume[83324]: DEBUG oslo_service.backend._eventlet.service [None req-0a9f9eed-f226-426b-90ba-01270c051175 None None] backend_defaults.driver_client_cert_key = None {{(pid=83324) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:51:08 devstack cinder-volume[83324]: DEBUG oslo_service.backend._eventlet.service [None req-0a9f9eed-f226-426b-90ba-01270c051175 None None] backend_defaults.driver_data_namespace = None {{(pid=83324) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:51:08 devstack cinder-volume[83324]: DEBUG oslo_service.backend._eventlet.service [None req-0a9f9eed-f226-426b-90ba-01270c051175 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=83324) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:51:08 devstack cinder-volume[83324]: DEBUG oslo_service.backend._eventlet.service [None req-0a9f9eed-f226-426b-90ba-01270c051175 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=83324) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:51:08 devstack cinder-volume[83324]: DEBUG oslo_service.backend._eventlet.service [None req-0a9f9eed-f226-426b-90ba-01270c051175 None None] backend_defaults.driver_use_ssl = False {{(pid=83324) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:51:08 devstack cinder-volume[83324]: DEBUG oslo_service.backend._eventlet.service [None req-0a9f9eed-f226-426b-90ba-01270c051175 None None] backend_defaults.enable_unsupported_driver = False {{(pid=83324) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:51:08 devstack cinder-volume[83324]: DEBUG oslo_service.backend._eventlet.service [None req-0a9f9eed-f226-426b-90ba-01270c051175 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=83324) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:51:08 devstack cinder-volume[83324]: DEBUG oslo_service.backend._eventlet.service [None req-0a9f9eed-f226-426b-90ba-01270c051175 None None] backend_defaults.extra_capabilities = {} {{(pid=83324) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:51:08 devstack cinder-volume[83324]: DEBUG oslo_service.backend._eventlet.service [None req-0a9f9eed-f226-426b-90ba-01270c051175 None None] backend_defaults.filter_function = None {{(pid=83324) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:51:08 devstack cinder-volume[83324]: DEBUG oslo_service.backend._eventlet.service [None req-0a9f9eed-f226-426b-90ba-01270c051175 None None] backend_defaults.goodness_function = None {{(pid=83324) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:51:08 devstack cinder-volume[83324]: DEBUG oslo_service.backend._eventlet.service [None req-0a9f9eed-f226-426b-90ba-01270c051175 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=83324) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:51:08 devstack cinder-volume[83324]: DEBUG oslo_service.backend._eventlet.service [None req-0a9f9eed-f226-426b-90ba-01270c051175 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=83324) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:51:08 devstack cinder-volume[83324]: DEBUG oslo_service.backend._eventlet.service [None req-0a9f9eed-f226-426b-90ba-01270c051175 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=83324) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:51:08 devstack cinder-volume[83324]: DEBUG oslo_service.backend._eventlet.service [None req-0a9f9eed-f226-426b-90ba-01270c051175 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=83324) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:51:08 devstack cinder-volume[83324]: DEBUG oslo_service.backend._eventlet.service [None req-0a9f9eed-f226-426b-90ba-01270c051175 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=83324) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:51:08 devstack cinder-volume[83324]: DEBUG oslo_service.backend._eventlet.service [None req-0a9f9eed-f226-426b-90ba-01270c051175 None None] backend_defaults.iscsi_target_flags = {{(pid=83324) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:51:08 devstack cinder-volume[83324]: DEBUG oslo_service.backend._eventlet.service [None req-0a9f9eed-f226-426b-90ba-01270c051175 None None] backend_defaults.iscsi_write_cache = on {{(pid=83324) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:51:08 devstack cinder-volume[83324]: DEBUG oslo_service.backend._eventlet.service [None req-0a9f9eed-f226-426b-90ba-01270c051175 None None] backend_defaults.iser_helper = tgtadm {{(pid=83324) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:51:08 devstack cinder-volume[83324]: DEBUG oslo_service.backend._eventlet.service [None req-0a9f9eed-f226-426b-90ba-01270c051175 None None] backend_defaults.iser_ip_address = 192.168.122.119 {{(pid=83324) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:51:08 devstack cinder-volume[83324]: DEBUG oslo_service.backend._eventlet.service [None req-0a9f9eed-f226-426b-90ba-01270c051175 None None] backend_defaults.iser_port = 3260 {{(pid=83324) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:51:08 devstack cinder-volume[83324]: DEBUG oslo_service.backend._eventlet.service [None req-0a9f9eed-f226-426b-90ba-01270c051175 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=83324) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:51:08 devstack cinder-volume[83324]: DEBUG oslo_service.backend._eventlet.service [None req-0a9f9eed-f226-426b-90ba-01270c051175 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=83324) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:51:08 devstack quobyte-client[83529]: Reading configuration file: /etc/quobyte/client.cfg Feb 25 15:51:08 devstack cinder-volume[83324]: DEBUG oslo_service.backend._eventlet.service [None req-0a9f9eed-f226-426b-90ba-01270c051175 None None] backend_defaults.nas_host = {{(pid=83324) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:51:08 devstack cinder-volume[83324]: DEBUG oslo_service.backend._eventlet.service [None req-0a9f9eed-f226-426b-90ba-01270c051175 None None] backend_defaults.nas_login = admin {{(pid=83324) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:51:08 devstack cinder-volume[83324]: DEBUG oslo_service.backend._eventlet.service [None req-0a9f9eed-f226-426b-90ba-01270c051175 None None] backend_defaults.nas_mount_options = None {{(pid=83324) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:51:08 devstack cinder-volume[83324]: DEBUG oslo_service.backend._eventlet.service [None req-0a9f9eed-f226-426b-90ba-01270c051175 None None] backend_defaults.nas_password = **** {{(pid=83324) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:51:08 devstack cinder-volume[83324]: DEBUG oslo_service.backend._eventlet.service [None req-0a9f9eed-f226-426b-90ba-01270c051175 None None] backend_defaults.nas_private_key = {{(pid=83324) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:51:08 devstack cinder-volume[83324]: DEBUG oslo_service.backend._eventlet.service [None req-0a9f9eed-f226-426b-90ba-01270c051175 None None] backend_defaults.nas_secure_file_operations = auto {{(pid=83324) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:51:08 devstack cinder-volume[83324]: DEBUG oslo_service.backend._eventlet.service [None req-0a9f9eed-f226-426b-90ba-01270c051175 None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=83324) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:51:08 devstack quobyte-client[83529]: Invalid parameters found, error: missing mount point. Feb 25 15:51:08 devstack cinder-volume[83324]: DEBUG oslo_service.backend._eventlet.service [None req-0a9f9eed-f226-426b-90ba-01270c051175 None None] backend_defaults.nas_share_path = {{(pid=83324) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:51:08 devstack cinder-volume[83324]: DEBUG oslo_service.backend._eventlet.service [None req-0a9f9eed-f226-426b-90ba-01270c051175 None None] backend_defaults.nas_ssh_port = 22 {{(pid=83324) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:51:08 devstack cinder-volume[83324]: DEBUG oslo_service.backend._eventlet.service [None req-0a9f9eed-f226-426b-90ba-01270c051175 None None] backend_defaults.nas_volume_prov_type = thin {{(pid=83324) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:51:08 devstack cinder-volume[83324]: DEBUG oslo_service.backend._eventlet.service [None req-0a9f9eed-f226-426b-90ba-01270c051175 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=83324) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:51:08 devstack cinder-volume[83324]: DEBUG oslo_service.backend._eventlet.service [None req-0a9f9eed-f226-426b-90ba-01270c051175 None None] backend_defaults.num_shell_tries = 3 {{(pid=83324) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:51:08 devstack cinder-volume[83324]: DEBUG oslo_service.backend._eventlet.service [None req-0a9f9eed-f226-426b-90ba-01270c051175 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=83324) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:51:08 devstack cinder-volume[83324]: DEBUG oslo_service.backend._eventlet.service [None req-0a9f9eed-f226-426b-90ba-01270c051175 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=83324) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:51:08 devstack quobyte-client[83529]: Quobyte logging to journald, you can use 'journalctl QUOBYTE_MOUNTPOINT=' to display the log. Feb 25 15:51:08 devstack cinder-volume[83324]: DEBUG oslo_service.backend._eventlet.service [None req-0a9f9eed-f226-426b-90ba-01270c051175 None None] backend_defaults.nvmet_ns_id = 10 {{(pid=83324) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:51:08 devstack cinder-volume[83324]: DEBUG oslo_service.backend._eventlet.service [None req-0a9f9eed-f226-426b-90ba-01270c051175 None None] backend_defaults.nvmet_port_id = 1 {{(pid=83324) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:51:08 devstack cinder-volume[83324]: DEBUG oslo_service.backend._eventlet.service [None req-0a9f9eed-f226-426b-90ba-01270c051175 None None] backend_defaults.quobyte_client_cfg = None {{(pid=83324) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:51:08 devstack cinder-volume[83324]: DEBUG oslo_service.backend._eventlet.service [None req-0a9f9eed-f226-426b-90ba-01270c051175 None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=83324) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:51:08 devstack cinder-volume[83324]: DEBUG oslo_service.backend._eventlet.service [None req-0a9f9eed-f226-426b-90ba-01270c051175 None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=83324) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:51:08 devstack cinder-volume[83324]: DEBUG oslo_service.backend._eventlet.service [None req-0a9f9eed-f226-426b-90ba-01270c051175 None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=83324) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:51:08 devstack quobyte-client[83529]: Failed to parse all commandline parameters, please use -h/--help to see available options. Feb 25 15:51:08 devstack cinder-volume[83324]: DEBUG oslo_service.backend._eventlet.service [None req-0a9f9eed-f226-426b-90ba-01270c051175 None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=83324) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:51:08 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-fcf75513-621e-45a1-964e-6b9fb943d91e None None] CMD "mount.quobyte" returned: 1 in 0.054s {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 25 15:51:08 devstack cinder-volume[83324]: DEBUG oslo_service.backend._eventlet.service [None req-0a9f9eed-f226-426b-90ba-01270c051175 None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=83324) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:51:08 devstack cinder-volume[83324]: DEBUG oslo_service.backend._eventlet.service [None req-0a9f9eed-f226-426b-90ba-01270c051175 None None] backend_defaults.quobyte_volume_url = None {{(pid=83324) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:51:08 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-fcf75513-621e-45a1-964e-6b9fb943d91e None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 25 15:51:08 devstack cinder-volume[83324]: DEBUG oslo_service.backend._eventlet.service [None req-0a9f9eed-f226-426b-90ba-01270c051175 None None] backend_defaults.replication_device = **** {{(pid=83324) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:51:08 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-fcf75513-621e-45a1-964e-6b9fb943d91e None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 25 15:51:08 devstack cinder-volume[83324]: DEBUG oslo_service.backend._eventlet.service [None req-0a9f9eed-f226-426b-90ba-01270c051175 None None] backend_defaults.report_discard_supported = False {{(pid=83324) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:51:08 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.quobyte [None req-fcf75513-621e-45a1-964e-6b9fb943d91e None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23e9d725-3e04-4cd9-bfe0-c8ef43305589': None} {{(pid=83528) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 25 15:51:08 devstack cinder-volume[83324]: DEBUG oslo_service.backend._eventlet.service [None req-0a9f9eed-f226-426b-90ba-01270c051175 None None] backend_defaults.reserved_percentage = 0 {{(pid=83324) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:51:08 devstack cinder-volume[83324]: DEBUG oslo_service.backend._eventlet.service [None req-0a9f9eed-f226-426b-90ba-01270c051175 None None] backend_defaults.scst_target_driver = iscsi {{(pid=83324) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:51:08 devstack cinder-volume[83324]: DEBUG oslo_service.backend._eventlet.service [None req-0a9f9eed-f226-426b-90ba-01270c051175 None None] backend_defaults.scst_target_iqn_name = None {{(pid=83324) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:51:08 devstack cinder-volume[83324]: DEBUG oslo_service.backend._eventlet.service [None req-0a9f9eed-f226-426b-90ba-01270c051175 None None] backend_defaults.storage_protocol = iSCSI {{(pid=83324) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:51:08 devstack cinder-volume[83324]: DEBUG oslo_service.backend._eventlet.service [None req-0a9f9eed-f226-426b-90ba-01270c051175 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=83324) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:51:08 devstack cinder-volume[83324]: DEBUG oslo_service.backend._eventlet.service [None req-0a9f9eed-f226-426b-90ba-01270c051175 None None] backend_defaults.target_helper = tgtadm {{(pid=83324) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:51:08 devstack cinder-volume[83324]: DEBUG oslo_service.backend._eventlet.service [None req-0a9f9eed-f226-426b-90ba-01270c051175 None None] backend_defaults.target_ip_address = 192.168.122.119 {{(pid=83324) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:51:08 devstack cinder-volume[83324]: DEBUG oslo_service.backend._eventlet.service [None req-0a9f9eed-f226-426b-90ba-01270c051175 None None] backend_defaults.target_port = 3260 {{(pid=83324) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:51:08 devstack cinder-volume[83324]: DEBUG oslo_service.backend._eventlet.service [None req-0a9f9eed-f226-426b-90ba-01270c051175 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=83324) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:51:08 devstack cinder-volume[83324]: DEBUG oslo_service.backend._eventlet.service [None req-0a9f9eed-f226-426b-90ba-01270c051175 None None] backend_defaults.target_protocol = iscsi {{(pid=83324) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:51:08 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.quobyte [None req-fcf75513-621e-45a1-964e-6b9fb943d91e None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23e9d725-3e04-4cd9-bfe0-c8ef43305589'] {{(pid=83528) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 25 15:51:08 devstack cinder-volume[83324]: DEBUG oslo_service.backend._eventlet.service [None req-0a9f9eed-f226-426b-90ba-01270c051175 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=83324) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:51:08 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-fcf75513-621e-45a1-964e-6b9fb943d91e None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 25 15:51:08 devstack cinder-volume[83324]: DEBUG oslo_service.backend._eventlet.service [None req-0a9f9eed-f226-426b-90ba-01270c051175 None None] backend_defaults.trace_flags = None {{(pid=83324) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:51:08 devstack cinder-volume[83324]: DEBUG oslo_service.backend._eventlet.service [None req-0a9f9eed-f226-426b-90ba-01270c051175 None None] backend_defaults.unique_fqdn_network = True {{(pid=83324) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:51:08 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-fcf75513-621e-45a1-964e-6b9fb943d91e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85 {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 25 15:51:08 devstack cinder-volume[83324]: DEBUG oslo_service.backend._eventlet.service [None req-0a9f9eed-f226-426b-90ba-01270c051175 None None] backend_defaults.use_chap_auth = False {{(pid=83324) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:51:08 devstack cinder-volume[83324]: DEBUG oslo_service.backend._eventlet.service [None req-0a9f9eed-f226-426b-90ba-01270c051175 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=83324) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:51:08 devstack cinder-volume[83324]: DEBUG oslo_service.backend._eventlet.service [None req-0a9f9eed-f226-426b-90ba-01270c051175 None None] backend_defaults.volume_backend_name = None {{(pid=83324) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:51:08 devstack cinder-volume[83324]: DEBUG oslo_service.backend._eventlet.service [None req-0a9f9eed-f226-426b-90ba-01270c051175 None None] backend_defaults.volume_clear = zero {{(pid=83324) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:51:08 devstack cinder-volume[83324]: DEBUG oslo_service.backend._eventlet.service [None req-0a9f9eed-f226-426b-90ba-01270c051175 None None] backend_defaults.volume_clear_ionice = None {{(pid=83324) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:51:08 devstack cinder-volume[83324]: DEBUG oslo_service.backend._eventlet.service [None req-0a9f9eed-f226-426b-90ba-01270c051175 None None] backend_defaults.volume_clear_size = 0 {{(pid=83324) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:51:08 devstack cinder-volume[83324]: DEBUG oslo_service.backend._eventlet.service [None req-0a9f9eed-f226-426b-90ba-01270c051175 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=83324) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:51:08 devstack cinder-volume[83324]: DEBUG oslo_service.backend._eventlet.service [None req-0a9f9eed-f226-426b-90ba-01270c051175 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=83324) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:51:08 devstack cinder-volume[83324]: DEBUG oslo_service.backend._eventlet.service [None req-0a9f9eed-f226-426b-90ba-01270c051175 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=83324) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:51:08 devstack cinder-volume[83324]: DEBUG oslo_service.backend._eventlet.service [None req-0a9f9eed-f226-426b-90ba-01270c051175 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=83324) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:51:08 devstack cinder-volume[83324]: DEBUG oslo_service.backend._eventlet.service [None req-0a9f9eed-f226-426b-90ba-01270c051175 None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=83324) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:51:08 devstack cinder-volume[83324]: DEBUG oslo_service.backend._eventlet.service [None req-0a9f9eed-f226-426b-90ba-01270c051175 None None] oslo_reports.file_event_handler = None {{(pid=83324) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:51:08 devstack cinder-volume[83324]: DEBUG oslo_service.backend._eventlet.service [None req-0a9f9eed-f226-426b-90ba-01270c051175 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=83324) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:51:08 devstack cinder-volume[83324]: DEBUG oslo_service.backend._eventlet.service [None req-0a9f9eed-f226-426b-90ba-01270c051175 None None] oslo_reports.log_dir = None {{(pid=83324) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:51:08 devstack cinder-volume[83324]: DEBUG oslo_service.backend._eventlet.service [None req-0a9f9eed-f226-426b-90ba-01270c051175 None None] QuobyteHD.backend_availability_zone = None {{(pid=83324) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:51:08 devstack cinder-volume[83324]: DEBUG oslo_service.backend._eventlet.service [None req-0a9f9eed-f226-426b-90ba-01270c051175 None None] QuobyteHD.backend_host = None {{(pid=83324) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:51:08 devstack cinder-volume[83324]: DEBUG oslo_service.backend._eventlet.service [None req-0a9f9eed-f226-426b-90ba-01270c051175 None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=83324) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:51:08 devstack cinder-volume[83324]: DEBUG oslo_service.backend._eventlet.service [None req-0a9f9eed-f226-426b-90ba-01270c051175 None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=83324) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:51:08 devstack cinder-volume[83324]: DEBUG oslo_service.backend._eventlet.service [None req-0a9f9eed-f226-426b-90ba-01270c051175 None None] QuobyteHD.chap_password = **** {{(pid=83324) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:51:08 devstack cinder-volume[83324]: DEBUG oslo_service.backend._eventlet.service [None req-0a9f9eed-f226-426b-90ba-01270c051175 None None] QuobyteHD.chap_username = None {{(pid=83324) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:51:08 devstack cinder-volume[83324]: DEBUG oslo_service.backend._eventlet.service [None req-0a9f9eed-f226-426b-90ba-01270c051175 None None] QuobyteHD.chiscsi_conf = None {{(pid=83324) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:51:08 devstack cinder-volume[83324]: DEBUG oslo_service.backend._eventlet.service [None req-0a9f9eed-f226-426b-90ba-01270c051175 None None] QuobyteHD.disk_geometry = None {{(pid=83324) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:51:08 devstack cinder-volume[83324]: DEBUG oslo_service.backend._eventlet.service [None req-0a9f9eed-f226-426b-90ba-01270c051175 None None] QuobyteHD.driver_client_cert = None {{(pid=83324) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:51:08 devstack cinder-volume[83324]: DEBUG oslo_service.backend._eventlet.service [None req-0a9f9eed-f226-426b-90ba-01270c051175 None None] QuobyteHD.driver_client_cert_key = None {{(pid=83324) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:51:08 devstack cinder-volume[83324]: DEBUG oslo_service.backend._eventlet.service [None req-0a9f9eed-f226-426b-90ba-01270c051175 None None] QuobyteHD.driver_data_namespace = None {{(pid=83324) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:51:08 devstack cinder-volume[83324]: DEBUG oslo_service.backend._eventlet.service [None req-0a9f9eed-f226-426b-90ba-01270c051175 None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=83324) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:51:08 devstack cinder-volume[83324]: DEBUG oslo_service.backend._eventlet.service [None req-0a9f9eed-f226-426b-90ba-01270c051175 None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=83324) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:51:08 devstack cinder-volume[83324]: DEBUG oslo_service.backend._eventlet.service [None req-0a9f9eed-f226-426b-90ba-01270c051175 None None] QuobyteHD.driver_use_ssl = None {{(pid=83324) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:51:08 devstack cinder-volume[83324]: DEBUG oslo_service.backend._eventlet.service [None req-0a9f9eed-f226-426b-90ba-01270c051175 None None] QuobyteHD.enable_unsupported_driver = True {{(pid=83324) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:51:08 devstack cinder-volume[83324]: DEBUG oslo_service.backend._eventlet.service [None req-0a9f9eed-f226-426b-90ba-01270c051175 None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=83324) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:51:08 devstack cinder-volume[83324]: DEBUG oslo_service.backend._eventlet.service [None req-0a9f9eed-f226-426b-90ba-01270c051175 None None] QuobyteHD.extra_capabilities = None {{(pid=83324) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:51:08 devstack cinder-volume[83324]: DEBUG oslo_service.backend._eventlet.service [None req-0a9f9eed-f226-426b-90ba-01270c051175 None None] QuobyteHD.filter_function = None {{(pid=83324) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:51:08 devstack cinder-volume[83324]: DEBUG oslo_service.backend._eventlet.service [None req-0a9f9eed-f226-426b-90ba-01270c051175 None None] QuobyteHD.goodness_function = None {{(pid=83324) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:51:08 devstack cinder-volume[83324]: DEBUG oslo_service.backend._eventlet.service [None req-0a9f9eed-f226-426b-90ba-01270c051175 None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=83324) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:51:08 devstack cinder-volume[83324]: DEBUG oslo_service.backend._eventlet.service [None req-0a9f9eed-f226-426b-90ba-01270c051175 None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=83324) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:51:08 devstack cinder-volume[83324]: DEBUG oslo_service.backend._eventlet.service [None req-0a9f9eed-f226-426b-90ba-01270c051175 None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=83324) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:51:08 devstack cinder-volume[83324]: DEBUG oslo_service.backend._eventlet.service [None req-0a9f9eed-f226-426b-90ba-01270c051175 None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=83324) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:51:08 devstack cinder-volume[83324]: DEBUG oslo_service.backend._eventlet.service [None req-0a9f9eed-f226-426b-90ba-01270c051175 None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=83324) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:51:08 devstack cinder-volume[83324]: DEBUG oslo_service.backend._eventlet.service [None req-0a9f9eed-f226-426b-90ba-01270c051175 None None] QuobyteHD.iscsi_target_flags = None {{(pid=83324) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:51:08 devstack cinder-volume[83324]: DEBUG oslo_service.backend._eventlet.service [None req-0a9f9eed-f226-426b-90ba-01270c051175 None None] QuobyteHD.iscsi_write_cache = None {{(pid=83324) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:51:08 devstack cinder-volume[83324]: DEBUG oslo_service.backend._eventlet.service [None req-0a9f9eed-f226-426b-90ba-01270c051175 None None] QuobyteHD.iser_helper = None {{(pid=83324) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:51:08 devstack cinder-volume[83324]: DEBUG oslo_service.backend._eventlet.service [None req-0a9f9eed-f226-426b-90ba-01270c051175 None None] QuobyteHD.iser_ip_address = None {{(pid=83324) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:51:08 devstack cinder-volume[83324]: DEBUG oslo_service.backend._eventlet.service [None req-0a9f9eed-f226-426b-90ba-01270c051175 None None] QuobyteHD.iser_port = None {{(pid=83324) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:51:08 devstack cinder-volume[83324]: DEBUG oslo_service.backend._eventlet.service [None req-0a9f9eed-f226-426b-90ba-01270c051175 None None] QuobyteHD.iser_target_prefix = None {{(pid=83324) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:51:08 devstack cinder-volume[83324]: DEBUG oslo_service.backend._eventlet.service [None req-0a9f9eed-f226-426b-90ba-01270c051175 None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=83324) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:51:08 devstack cinder-volume[83324]: DEBUG oslo_service.backend._eventlet.service [None req-0a9f9eed-f226-426b-90ba-01270c051175 None None] QuobyteHD.nas_host = None {{(pid=83324) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:51:08 devstack cinder-volume[83324]: DEBUG oslo_service.backend._eventlet.service [None req-0a9f9eed-f226-426b-90ba-01270c051175 None None] QuobyteHD.nas_login = None {{(pid=83324) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:51:08 devstack cinder-volume[83324]: DEBUG oslo_service.backend._eventlet.service [None req-0a9f9eed-f226-426b-90ba-01270c051175 None None] QuobyteHD.nas_mount_options = None {{(pid=83324) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:51:08 devstack cinder-volume[83324]: DEBUG oslo_service.backend._eventlet.service [None req-0a9f9eed-f226-426b-90ba-01270c051175 None None] QuobyteHD.nas_password = **** {{(pid=83324) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:51:08 devstack cinder-volume[83324]: DEBUG oslo_service.backend._eventlet.service [None req-0a9f9eed-f226-426b-90ba-01270c051175 None None] QuobyteHD.nas_private_key = None {{(pid=83324) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:51:08 devstack cinder-volume[83324]: DEBUG oslo_service.backend._eventlet.service [None req-0a9f9eed-f226-426b-90ba-01270c051175 None None] QuobyteHD.nas_secure_file_operations = false {{(pid=83324) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:51:08 devstack cinder-volume[83324]: DEBUG oslo_service.backend._eventlet.service [None req-0a9f9eed-f226-426b-90ba-01270c051175 None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=83324) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:51:08 devstack cinder-volume[83324]: DEBUG oslo_service.backend._eventlet.service [None req-0a9f9eed-f226-426b-90ba-01270c051175 None None] QuobyteHD.nas_share_path = None {{(pid=83324) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:51:08 devstack sudo[83532]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85 Feb 25 15:51:08 devstack sudo[83532]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 25 15:51:08 devstack cinder-volume[83324]: DEBUG oslo_service.backend._eventlet.service [None req-0a9f9eed-f226-426b-90ba-01270c051175 None None] QuobyteHD.nas_ssh_port = None {{(pid=83324) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:51:08 devstack cinder-volume[83324]: DEBUG oslo_service.backend._eventlet.service [None req-0a9f9eed-f226-426b-90ba-01270c051175 None None] QuobyteHD.nas_volume_prov_type = None {{(pid=83324) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:51:08 devstack cinder-volume[83324]: DEBUG oslo_service.backend._eventlet.service [None req-0a9f9eed-f226-426b-90ba-01270c051175 None None] QuobyteHD.num_iser_scan_tries = None {{(pid=83324) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:51:08 devstack cinder-volume[83324]: DEBUG oslo_service.backend._eventlet.service [None req-0a9f9eed-f226-426b-90ba-01270c051175 None None] QuobyteHD.num_shell_tries = None {{(pid=83324) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:51:08 devstack cinder-volume[83324]: DEBUG oslo_service.backend._eventlet.service [None req-0a9f9eed-f226-426b-90ba-01270c051175 None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=83324) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:51:08 devstack cinder-volume[83324]: DEBUG oslo_service.backend._eventlet.service [None req-0a9f9eed-f226-426b-90ba-01270c051175 None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=83324) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:51:08 devstack cinder-volume[83324]: DEBUG oslo_service.backend._eventlet.service [None req-0a9f9eed-f226-426b-90ba-01270c051175 None None] QuobyteHD.nvmet_ns_id = None {{(pid=83324) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:51:08 devstack cinder-volume[83324]: DEBUG oslo_service.backend._eventlet.service [None req-0a9f9eed-f226-426b-90ba-01270c051175 None None] QuobyteHD.nvmet_port_id = None {{(pid=83324) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:51:08 devstack cinder-volume[83324]: DEBUG oslo_service.backend._eventlet.service [None req-0a9f9eed-f226-426b-90ba-01270c051175 None None] QuobyteHD.quobyte_client_cfg = /etc/quobyte/client-cinder.cfg {{(pid=83324) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:51:08 devstack cinder-volume[83324]: DEBUG oslo_service.backend._eventlet.service [None req-0a9f9eed-f226-426b-90ba-01270c051175 None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=83324) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:51:08 devstack cinder-volume[83324]: DEBUG oslo_service.backend._eventlet.service [None req-0a9f9eed-f226-426b-90ba-01270c051175 None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=83324) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:51:08 devstack cinder-volume[83324]: DEBUG oslo_service.backend._eventlet.service [None req-0a9f9eed-f226-426b-90ba-01270c051175 None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=83324) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:51:08 devstack cinder-volume[83324]: DEBUG oslo_service.backend._eventlet.service [None req-0a9f9eed-f226-426b-90ba-01270c051175 None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=83324) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:51:08 devstack cinder-volume[83324]: DEBUG oslo_service.backend._eventlet.service [None req-0a9f9eed-f226-426b-90ba-01270c051175 None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=83324) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:51:08 devstack cinder-volume[83324]: DEBUG oslo_service.backend._eventlet.service [None req-0a9f9eed-f226-426b-90ba-01270c051175 None None] QuobyteHD.quobyte_volume_url = quobyte://osci02.corp.quobyte.com/cinder-vol-23e9d725-3e04-4cd9-bfe0-c8ef43305589 {{(pid=83324) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:51:08 devstack cinder-volume[83324]: DEBUG oslo_service.backend._eventlet.service [None req-0a9f9eed-f226-426b-90ba-01270c051175 None None] QuobyteHD.replication_device = **** {{(pid=83324) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:51:08 devstack cinder-volume[83324]: DEBUG oslo_service.backend._eventlet.service [None req-0a9f9eed-f226-426b-90ba-01270c051175 None None] QuobyteHD.report_discard_supported = None {{(pid=83324) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:51:08 devstack cinder-volume[83324]: DEBUG oslo_service.backend._eventlet.service [None req-0a9f9eed-f226-426b-90ba-01270c051175 None None] QuobyteHD.reserved_percentage = None {{(pid=83324) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:51:08 devstack cinder-volume[83324]: DEBUG oslo_service.backend._eventlet.service [None req-0a9f9eed-f226-426b-90ba-01270c051175 None None] QuobyteHD.scst_target_driver = None {{(pid=83324) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:51:08 devstack cinder-volume[83324]: DEBUG oslo_service.backend._eventlet.service [None req-0a9f9eed-f226-426b-90ba-01270c051175 None None] QuobyteHD.scst_target_iqn_name = None {{(pid=83324) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:51:08 devstack cinder-volume[83324]: DEBUG oslo_service.backend._eventlet.service [None req-0a9f9eed-f226-426b-90ba-01270c051175 None None] QuobyteHD.storage_protocol = None {{(pid=83324) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:51:08 devstack cinder-volume[83324]: DEBUG oslo_service.backend._eventlet.service [None req-0a9f9eed-f226-426b-90ba-01270c051175 None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=83324) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:51:08 devstack cinder-volume[83324]: DEBUG oslo_service.backend._eventlet.service [None req-0a9f9eed-f226-426b-90ba-01270c051175 None None] QuobyteHD.target_helper = None {{(pid=83324) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:51:08 devstack cinder-volume[83324]: DEBUG oslo_service.backend._eventlet.service [None req-0a9f9eed-f226-426b-90ba-01270c051175 None None] QuobyteHD.target_ip_address = None {{(pid=83324) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:51:08 devstack cinder-volume[83324]: DEBUG oslo_service.backend._eventlet.service [None req-0a9f9eed-f226-426b-90ba-01270c051175 None None] QuobyteHD.target_port = None {{(pid=83324) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:51:08 devstack cinder-volume[83324]: DEBUG oslo_service.backend._eventlet.service [None req-0a9f9eed-f226-426b-90ba-01270c051175 None None] QuobyteHD.target_prefix = None {{(pid=83324) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:51:08 devstack cinder-volume[83324]: DEBUG oslo_service.backend._eventlet.service [None req-0a9f9eed-f226-426b-90ba-01270c051175 None None] QuobyteHD.target_protocol = None {{(pid=83324) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:51:08 devstack cinder-volume[83324]: DEBUG oslo_service.backend._eventlet.service [None req-0a9f9eed-f226-426b-90ba-01270c051175 None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=83324) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:51:08 devstack cinder-volume[83324]: DEBUG oslo_service.backend._eventlet.service [None req-0a9f9eed-f226-426b-90ba-01270c051175 None None] QuobyteHD.trace_flags = None {{(pid=83324) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:51:08 devstack cinder-volume[83324]: DEBUG oslo_service.backend._eventlet.service [None req-0a9f9eed-f226-426b-90ba-01270c051175 None None] QuobyteHD.unique_fqdn_network = None {{(pid=83324) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:51:08 devstack cinder-volume[83324]: DEBUG oslo_service.backend._eventlet.service [None req-0a9f9eed-f226-426b-90ba-01270c051175 None None] QuobyteHD.use_chap_auth = None {{(pid=83324) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:51:08 devstack cinder-volume[83324]: DEBUG oslo_service.backend._eventlet.service [None req-0a9f9eed-f226-426b-90ba-01270c051175 None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=83324) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:51:08 devstack cinder-volume[83324]: DEBUG oslo_service.backend._eventlet.service [None req-0a9f9eed-f226-426b-90ba-01270c051175 None None] QuobyteHD.volume_backend_name = QuobyteHD {{(pid=83324) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:51:08 devstack cinder-volume[83324]: DEBUG oslo_service.backend._eventlet.service [None req-0a9f9eed-f226-426b-90ba-01270c051175 None None] QuobyteHD.volume_clear = None {{(pid=83324) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:51:08 devstack cinder-volume[83324]: DEBUG oslo_service.backend._eventlet.service [None req-0a9f9eed-f226-426b-90ba-01270c051175 None None] QuobyteHD.volume_clear_ionice = None {{(pid=83324) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:51:08 devstack cinder-volume[83324]: DEBUG oslo_service.backend._eventlet.service [None req-0a9f9eed-f226-426b-90ba-01270c051175 None None] QuobyteHD.volume_clear_size = None {{(pid=83324) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:51:08 devstack cinder-volume[83324]: DEBUG oslo_service.backend._eventlet.service [None req-0a9f9eed-f226-426b-90ba-01270c051175 None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=83324) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:51:08 devstack cinder-volume[83324]: DEBUG oslo_service.backend._eventlet.service [None req-0a9f9eed-f226-426b-90ba-01270c051175 None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=83324) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:51:08 devstack cinder-volume[83324]: DEBUG oslo_service.backend._eventlet.service [None req-0a9f9eed-f226-426b-90ba-01270c051175 None None] QuobyteHD.volume_dd_blocksize = None {{(pid=83324) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:51:08 devstack cinder-volume[83324]: DEBUG oslo_service.backend._eventlet.service [None req-0a9f9eed-f226-426b-90ba-01270c051175 None None] QuobyteHD.volume_driver = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=83324) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:51:08 devstack cinder-volume[83324]: DEBUG oslo_service.backend._eventlet.service [None req-0a9f9eed-f226-426b-90ba-01270c051175 None None] QuobyteHD.volumes_dir = None {{(pid=83324) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:51:08 devstack cinder-volume[83324]: DEBUG oslo_service.backend._eventlet.service [None req-0a9f9eed-f226-426b-90ba-01270c051175 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=83324) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:51:08 devstack cinder-volume[83324]: DEBUG oslo_service.backend._eventlet.service [None req-0a9f9eed-f226-426b-90ba-01270c051175 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=83324) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:51:08 devstack cinder-volume[83324]: DEBUG oslo_service.backend._eventlet.service [None req-0a9f9eed-f226-426b-90ba-01270c051175 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=83324) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:51:08 devstack cinder-volume[83324]: DEBUG oslo_service.backend._eventlet.service [None req-0a9f9eed-f226-426b-90ba-01270c051175 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=83324) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:51:08 devstack cinder-volume[83324]: DEBUG oslo_service.backend._eventlet.service [None req-0a9f9eed-f226-426b-90ba-01270c051175 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=83324) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:51:08 devstack cinder-volume[83324]: DEBUG oslo_service.backend._eventlet.service [None req-0a9f9eed-f226-426b-90ba-01270c051175 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=83324) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:51:08 devstack cinder-volume[83324]: DEBUG oslo_service.backend._eventlet.service [None req-0a9f9eed-f226-426b-90ba-01270c051175 None None] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=83324) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:51:08 devstack cinder-volume[83324]: DEBUG oslo_service.backend._eventlet.service [None req-0a9f9eed-f226-426b-90ba-01270c051175 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=83324) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:51:08 devstack cinder-volume[83324]: DEBUG oslo_service.backend._eventlet.service [None req-0a9f9eed-f226-426b-90ba-01270c051175 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=83324) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:51:08 devstack cinder-volume[83324]: DEBUG oslo_service.backend._eventlet.service [None req-0a9f9eed-f226-426b-90ba-01270c051175 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=83324) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:51:08 devstack cinder-volume[83324]: DEBUG oslo_service.backend._eventlet.service [None req-0a9f9eed-f226-426b-90ba-01270c051175 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=83324) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:51:08 devstack cinder-volume[83324]: DEBUG oslo_service.backend._eventlet.service [None req-0a9f9eed-f226-426b-90ba-01270c051175 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=83324) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:51:08 devstack cinder-volume[83324]: DEBUG oslo_service.backend._eventlet.service [None req-0a9f9eed-f226-426b-90ba-01270c051175 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=83324) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:51:08 devstack cinder-volume[83324]: DEBUG oslo_service.backend._eventlet.service [None req-0a9f9eed-f226-426b-90ba-01270c051175 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=83324) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:51:08 devstack cinder-volume[83324]: DEBUG oslo_service.backend._eventlet.service [None req-0a9f9eed-f226-426b-90ba-01270c051175 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=83324) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:51:08 devstack cinder-volume[83324]: DEBUG oslo_service.backend._eventlet.service [None req-0a9f9eed-f226-426b-90ba-01270c051175 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=83324) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:51:08 devstack cinder-volume[83324]: DEBUG oslo_service.backend._eventlet.service [None req-0a9f9eed-f226-426b-90ba-01270c051175 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=83324) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:51:08 devstack cinder-volume[83324]: DEBUG oslo_service.backend._eventlet.service [None req-0a9f9eed-f226-426b-90ba-01270c051175 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=83324) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:51:08 devstack cinder-volume[83324]: DEBUG oslo_service.backend._eventlet.service [None req-0a9f9eed-f226-426b-90ba-01270c051175 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=83324) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:51:08 devstack cinder-volume[83324]: DEBUG oslo_service.backend._eventlet.service [None req-0a9f9eed-f226-426b-90ba-01270c051175 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=83324) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:51:08 devstack cinder-volume[83324]: DEBUG oslo_service.backend._eventlet.service [None req-0a9f9eed-f226-426b-90ba-01270c051175 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=83324) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:51:08 devstack cinder-volume[83324]: DEBUG oslo_service.backend._eventlet.service [None req-0a9f9eed-f226-426b-90ba-01270c051175 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=83324) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:51:08 devstack cinder-volume[83324]: DEBUG oslo_service.backend._eventlet.service [None req-0a9f9eed-f226-426b-90ba-01270c051175 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=83324) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:51:08 devstack cinder-volume[83324]: DEBUG oslo_service.backend._eventlet.service [None req-0a9f9eed-f226-426b-90ba-01270c051175 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=83324) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:51:08 devstack cinder-volume[83324]: DEBUG oslo_service.backend._eventlet.service [None req-0a9f9eed-f226-426b-90ba-01270c051175 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=83324) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:51:08 devstack cinder-volume[83324]: DEBUG oslo_service.backend._eventlet.service [None req-0a9f9eed-f226-426b-90ba-01270c051175 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=83324) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:51:08 devstack cinder-volume[83324]: DEBUG oslo_service.backend._eventlet.service [None req-0a9f9eed-f226-426b-90ba-01270c051175 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=83324) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:51:08 devstack cinder-volume[83324]: DEBUG oslo_service.backend._eventlet.service [None req-0a9f9eed-f226-426b-90ba-01270c051175 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=83324) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:51:08 devstack cinder-volume[83324]: DEBUG oslo_service.backend._eventlet.service [None req-0a9f9eed-f226-426b-90ba-01270c051175 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=83324) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:51:08 devstack cinder-volume[83324]: DEBUG oslo_service.backend._eventlet.service [None req-0a9f9eed-f226-426b-90ba-01270c051175 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=83324) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:51:08 devstack cinder-volume[83324]: DEBUG oslo_service.backend._eventlet.service [None req-0a9f9eed-f226-426b-90ba-01270c051175 None None] oslo_messaging_rabbit.ssl = False {{(pid=83324) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:51:08 devstack cinder-volume[83324]: DEBUG oslo_service.backend._eventlet.service [None req-0a9f9eed-f226-426b-90ba-01270c051175 None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=83324) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:51:08 devstack cinder-volume[83324]: DEBUG oslo_service.backend._eventlet.service [None req-0a9f9eed-f226-426b-90ba-01270c051175 None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=83324) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:51:08 devstack cinder-volume[83324]: DEBUG oslo_service.backend._eventlet.service [None req-0a9f9eed-f226-426b-90ba-01270c051175 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=83324) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:51:08 devstack cinder-volume[83324]: DEBUG oslo_service.backend._eventlet.service [None req-0a9f9eed-f226-426b-90ba-01270c051175 None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=83324) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:51:08 devstack cinder-volume[83324]: DEBUG oslo_service.backend._eventlet.service [None req-0a9f9eed-f226-426b-90ba-01270c051175 None None] oslo_messaging_rabbit.ssl_version = {{(pid=83324) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:51:08 devstack cinder-volume[83324]: DEBUG oslo_service.backend._eventlet.service [None req-0a9f9eed-f226-426b-90ba-01270c051175 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=83324) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:51:08 devstack cinder-volume[83324]: DEBUG oslo_service.backend._eventlet.service [None req-0a9f9eed-f226-426b-90ba-01270c051175 None None] oslo_messaging_notifications.driver = [] {{(pid=83324) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:51:08 devstack cinder-volume[83324]: DEBUG oslo_service.backend._eventlet.service [None req-0a9f9eed-f226-426b-90ba-01270c051175 None None] oslo_messaging_notifications.retry = -1 {{(pid=83324) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:51:08 devstack cinder-volume[83324]: DEBUG oslo_service.backend._eventlet.service [None req-0a9f9eed-f226-426b-90ba-01270c051175 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=83324) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:51:08 devstack cinder-volume[83324]: DEBUG oslo_service.backend._eventlet.service [None req-0a9f9eed-f226-426b-90ba-01270c051175 None None] oslo_messaging_notifications.transport_url = **** {{(pid=83324) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:51:08 devstack cinder-volume[83324]: DEBUG oslo_service.backend._eventlet.service [None req-0a9f9eed-f226-426b-90ba-01270c051175 None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=83324) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:51:08 devstack cinder-volume[83324]: DEBUG oslo_service.backend._eventlet.service [None req-0a9f9eed-f226-426b-90ba-01270c051175 None None] key_manager.fixed_key = **** {{(pid=83324) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:51:08 devstack cinder-volume[83324]: DEBUG oslo_service.backend._eventlet.service [None req-0a9f9eed-f226-426b-90ba-01270c051175 None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=83324) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:51:08 devstack cinder-volume[83324]: DEBUG oslo_service.backend._eventlet.service [None req-0a9f9eed-f226-426b-90ba-01270c051175 None None] barbican.barbican_api_version = None {{(pid=83324) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:51:08 devstack cinder-volume[83324]: DEBUG oslo_service.backend._eventlet.service [None req-0a9f9eed-f226-426b-90ba-01270c051175 None None] barbican.barbican_endpoint = None {{(pid=83324) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:51:08 devstack cinder-volume[83324]: DEBUG oslo_service.backend._eventlet.service [None req-0a9f9eed-f226-426b-90ba-01270c051175 None None] barbican.barbican_endpoint_type = public {{(pid=83324) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:51:08 devstack cinder-volume[83324]: DEBUG oslo_service.backend._eventlet.service [None req-0a9f9eed-f226-426b-90ba-01270c051175 None None] barbican.barbican_region_name = None {{(pid=83324) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:51:08 devstack cinder-volume[83324]: DEBUG oslo_service.backend._eventlet.service [None req-0a9f9eed-f226-426b-90ba-01270c051175 None None] barbican.cafile = None {{(pid=83324) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:51:08 devstack cinder-volume[83324]: DEBUG oslo_service.backend._eventlet.service [None req-0a9f9eed-f226-426b-90ba-01270c051175 None None] barbican.certfile = None {{(pid=83324) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:51:08 devstack cinder-volume[83324]: DEBUG oslo_service.backend._eventlet.service [None req-0a9f9eed-f226-426b-90ba-01270c051175 None None] barbican.collect_timing = False {{(pid=83324) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:51:08 devstack cinder-volume[83324]: DEBUG oslo_service.backend._eventlet.service [None req-0a9f9eed-f226-426b-90ba-01270c051175 None None] barbican.insecure = False {{(pid=83324) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:51:08 devstack cinder-volume[83324]: DEBUG oslo_service.backend._eventlet.service [None req-0a9f9eed-f226-426b-90ba-01270c051175 None None] barbican.keyfile = None {{(pid=83324) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:51:08 devstack cinder-volume[83324]: DEBUG oslo_service.backend._eventlet.service [None req-0a9f9eed-f226-426b-90ba-01270c051175 None None] barbican.number_of_retries = 60 {{(pid=83324) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:51:08 devstack cinder-volume[83324]: DEBUG oslo_service.backend._eventlet.service [None req-0a9f9eed-f226-426b-90ba-01270c051175 None None] barbican.retry_delay = 1 {{(pid=83324) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:51:08 devstack cinder-volume[83324]: DEBUG oslo_service.backend._eventlet.service [None req-0a9f9eed-f226-426b-90ba-01270c051175 None None] barbican.send_service_user_token = False {{(pid=83324) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:51:08 devstack cinder-volume[83324]: DEBUG oslo_service.backend._eventlet.service [None req-0a9f9eed-f226-426b-90ba-01270c051175 None None] barbican.split_loggers = False {{(pid=83324) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:51:08 devstack cinder-volume[83324]: DEBUG oslo_service.backend._eventlet.service [None req-0a9f9eed-f226-426b-90ba-01270c051175 None None] barbican.timeout = None {{(pid=83324) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:51:08 devstack cinder-volume[83324]: DEBUG oslo_service.backend._eventlet.service [None req-0a9f9eed-f226-426b-90ba-01270c051175 None None] barbican.verify_ssl = True {{(pid=83324) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:51:08 devstack cinder-volume[83324]: DEBUG oslo_service.backend._eventlet.service [None req-0a9f9eed-f226-426b-90ba-01270c051175 None None] barbican.verify_ssl_path = None {{(pid=83324) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:51:08 devstack cinder-volume[83324]: DEBUG oslo_service.backend._eventlet.service [None req-0a9f9eed-f226-426b-90ba-01270c051175 None None] barbican_service_user.auth_section = None {{(pid=83324) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:51:08 devstack cinder-volume[83324]: DEBUG oslo_service.backend._eventlet.service [None req-0a9f9eed-f226-426b-90ba-01270c051175 None None] barbican_service_user.auth_type = None {{(pid=83324) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:51:08 devstack cinder-volume[83324]: DEBUG oslo_service.backend._eventlet.service [None req-0a9f9eed-f226-426b-90ba-01270c051175 None None] barbican_service_user.cafile = None {{(pid=83324) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:51:08 devstack cinder-volume[83324]: DEBUG oslo_service.backend._eventlet.service [None req-0a9f9eed-f226-426b-90ba-01270c051175 None None] barbican_service_user.certfile = None {{(pid=83324) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:51:08 devstack cinder-volume[83324]: DEBUG oslo_service.backend._eventlet.service [None req-0a9f9eed-f226-426b-90ba-01270c051175 None None] barbican_service_user.collect_timing = False {{(pid=83324) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:51:08 devstack cinder-volume[83324]: DEBUG oslo_service.backend._eventlet.service [None req-0a9f9eed-f226-426b-90ba-01270c051175 None None] barbican_service_user.insecure = False {{(pid=83324) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:51:08 devstack cinder-volume[83324]: DEBUG oslo_service.backend._eventlet.service [None req-0a9f9eed-f226-426b-90ba-01270c051175 None None] barbican_service_user.keyfile = None {{(pid=83324) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:51:08 devstack cinder-volume[83324]: DEBUG oslo_service.backend._eventlet.service [None req-0a9f9eed-f226-426b-90ba-01270c051175 None None] barbican_service_user.split_loggers = False {{(pid=83324) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:51:08 devstack cinder-volume[83324]: DEBUG oslo_service.backend._eventlet.service [None req-0a9f9eed-f226-426b-90ba-01270c051175 None None] barbican_service_user.timeout = None {{(pid=83324) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:51:08 devstack cinder-volume[83324]: DEBUG oslo_service.backend._eventlet.service [None req-0a9f9eed-f226-426b-90ba-01270c051175 None None] vault.approle_role_id = **** {{(pid=83324) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:51:08 devstack cinder-volume[83324]: DEBUG oslo_service.backend._eventlet.service [None req-0a9f9eed-f226-426b-90ba-01270c051175 None None] vault.approle_secret_id = **** {{(pid=83324) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:51:08 devstack cinder-volume[83324]: DEBUG oslo_service.backend._eventlet.service [None req-0a9f9eed-f226-426b-90ba-01270c051175 None None] vault.kv_mountpoint = secret {{(pid=83324) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:51:08 devstack cinder-volume[83324]: DEBUG oslo_service.backend._eventlet.service [None req-0a9f9eed-f226-426b-90ba-01270c051175 None None] vault.kv_path = None {{(pid=83324) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:51:08 devstack cinder-volume[83324]: DEBUG oslo_service.backend._eventlet.service [None req-0a9f9eed-f226-426b-90ba-01270c051175 None None] vault.kv_version = 2 {{(pid=83324) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:51:08 devstack cinder-volume[83324]: DEBUG oslo_service.backend._eventlet.service [None req-0a9f9eed-f226-426b-90ba-01270c051175 None None] vault.namespace = None {{(pid=83324) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:51:08 devstack cinder-volume[83324]: DEBUG oslo_service.backend._eventlet.service [None req-0a9f9eed-f226-426b-90ba-01270c051175 None None] vault.root_token_id = **** {{(pid=83324) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:51:08 devstack cinder-volume[83324]: DEBUG oslo_service.backend._eventlet.service [None req-0a9f9eed-f226-426b-90ba-01270c051175 None None] vault.ssl_ca_crt_file = None {{(pid=83324) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:51:08 devstack cinder-volume[83324]: DEBUG oslo_service.backend._eventlet.service [None req-0a9f9eed-f226-426b-90ba-01270c051175 None None] vault.timeout = 60.0 {{(pid=83324) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:51:08 devstack cinder-volume[83324]: DEBUG oslo_service.backend._eventlet.service [None req-0a9f9eed-f226-426b-90ba-01270c051175 None None] vault.use_ssl = False {{(pid=83324) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:51:08 devstack cinder-volume[83324]: DEBUG oslo_service.backend._eventlet.service [None req-0a9f9eed-f226-426b-90ba-01270c051175 None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=83324) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 25 15:51:08 devstack cinder-volume[83324]: DEBUG oslo_service.backend._eventlet.service [None req-0a9f9eed-f226-426b-90ba-01270c051175 None None] ******************************************************************************** {{(pid=83324) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3013}} Feb 25 15:51:08 devstack sudo[83532]: pam_unix(sudo:session): session closed for user root Feb 25 15:51:08 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-fcf75513-621e-45a1-964e-6b9fb943d91e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85" returned: 0 in 0.418s {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 25 15:51:08 devstack cinder-volume[83528]: INFO cinder.volume.driver [None req-fcf75513-621e-45a1-964e-6b9fb943d91e None None] Driver hasn't implemented _init_vendor_properties() Feb 25 15:51:08 devstack cinder-volume[83528]: DEBUG cinder.volume.driver [None req-fcf75513-621e-45a1-964e-6b9fb943d91e None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.6299057006836, 'free_capacity_gb': 1775.6299057006836, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=83528) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:873}} Feb 25 15:51:08 devstack cinder-volume[83528]: DEBUG oslo_db.sqlalchemy.engines [None req-fcf75513-621e-45a1-964e-6b9fb943d91e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=83528) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}} Feb 25 15:51:08 devstack cinder-volume[83528]: DEBUG dbcounter [-] [83528] Writer thread running {{(pid=83528) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:102}} Feb 25 15:51:08 devstack cinder-volume[83528]: DEBUG cinder.db.sqlalchemy.api [None req-fcf75513-621e-45a1-964e-6b9fb943d91e None None] Building query based on filter {{(pid=83528) _process_snaps_filters /opt/stack/cinder/cinder/db/sqlalchemy/api.py:3943}} Feb 25 15:51:08 devstack cinder-volume[83528]: DEBUG cinder.image.image_utils [None req-fcf75513-621e-45a1-964e-6b9fb943d91e None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=83528) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1298}} Feb 25 15:51:08 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-fcf75513-621e-45a1-964e-6b9fb943d91e None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 25 15:51:08 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-fcf75513-621e-45a1-964e-6b9fb943d91e None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 25 15:51:08 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.quobyte [None req-fcf75513-621e-45a1-964e-6b9fb943d91e None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23e9d725-3e04-4cd9-bfe0-c8ef43305589': None} {{(pid=83528) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 25 15:51:08 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.quobyte [None req-fcf75513-621e-45a1-964e-6b9fb943d91e None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23e9d725-3e04-4cd9-bfe0-c8ef43305589'] {{(pid=83528) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 25 15:51:08 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-fcf75513-621e-45a1-964e-6b9fb943d91e None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 25 15:51:08 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-fcf75513-621e-45a1-964e-6b9fb943d91e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85 {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 25 15:51:08 devstack cinder-volume[83528]: INFO cinder.keymgr.migration [None req-0e2bacfd-621b-4bc1-ac33-355b2b635c9a None None] Not migrating encryption keys because the ConfKeyManager is still in use. Feb 25 15:51:08 devstack sudo[83587]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85 Feb 25 15:51:08 devstack sudo[83587]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 25 15:51:09 devstack sudo[83587]: pam_unix(sudo:session): session closed for user root Feb 25 15:51:09 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-fcf75513-621e-45a1-964e-6b9fb943d91e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85" returned: 0 in 0.391s {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 25 15:51:09 devstack cinder-volume[83528]: DEBUG cinder.manager [None req-fcf75513-621e-45a1-964e-6b9fb943d91e None None] Notifying Schedulers of capabilities ... {{(pid=83528) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 25 15:51:09 devstack cinder-volume[83528]: INFO cinder.volume.manager [None req-fcf75513-621e-45a1-964e-6b9fb943d91e None None] Driver initialization completed successfully. Feb 25 15:51:09 devstack cinder-volume[83528]: INFO cinder.manager [None req-fcf75513-621e-45a1-964e-6b9fb943d91e None None] Initiating service 3 cleanup Feb 25 15:51:09 devstack cinder-volume[83528]: INFO cinder.manager [None req-fcf75513-621e-45a1-964e-6b9fb943d91e None None] Service 3 cleanup completed. Feb 25 15:51:09 devstack cinder-volume[83528]: DEBUG cinder.service [None req-fcf75513-621e-45a1-964e-6b9fb943d91e None None] Creating RPC server for service cinder-volume {{(pid=83528) start /opt/stack/cinder/cinder/service.py:231}} Feb 25 15:51:09 devstack cinder-volume[83528]: DEBUG cinder.service [None req-fcf75513-621e-45a1-964e-6b9fb943d91e None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=83528) start /opt/stack/cinder/cinder/service.py:237}} Feb 25 15:51:09 devstack cinder-volume[83528]: INFO cinder.volume.manager [None req-fcf75513-621e-45a1-964e-6b9fb943d91e None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.1.14) Feb 25 15:51:09 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-fcf75513-621e-45a1-964e-6b9fb943d91e None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 25 15:51:09 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-fcf75513-621e-45a1-964e-6b9fb943d91e None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 25 15:51:09 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.quobyte [None req-fcf75513-621e-45a1-964e-6b9fb943d91e None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23e9d725-3e04-4cd9-bfe0-c8ef43305589': None} {{(pid=83528) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 25 15:51:09 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.quobyte [None req-fcf75513-621e-45a1-964e-6b9fb943d91e None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23e9d725-3e04-4cd9-bfe0-c8ef43305589'] {{(pid=83528) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 25 15:51:09 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-fcf75513-621e-45a1-964e-6b9fb943d91e None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 25 15:51:09 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-fcf75513-621e-45a1-964e-6b9fb943d91e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85 {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 25 15:51:09 devstack sudo[83599]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85 Feb 25 15:51:09 devstack sudo[83599]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 25 15:51:09 devstack sudo[83599]: pam_unix(sudo:session): session closed for user root Feb 25 15:51:09 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-fcf75513-621e-45a1-964e-6b9fb943d91e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85" returned: 0 in 0.375s {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 25 15:51:09 devstack cinder-volume[83528]: INFO cinder.volume.manager [None req-fcf75513-621e-45a1-964e-6b9fb943d91e None None] Driver post RPC initialization completed successfully. Feb 25 15:51:18 devstack cinder-volume[83324]: DEBUG dbcounter [-] [83324] Writing DB stats cinder:SELECT=5,cinder:UPDATE=1 {{(pid=83324) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Feb 25 15:51:19 devstack cinder-volume[83528]: DEBUG dbcounter [-] [83528] Writing DB stats cinder:SELECT=2 {{(pid=83528) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Feb 25 15:51:19 devstack cinder-volume[83528]: DEBUG dbcounter [-] [83528] Writing DB stats cinder:SELECT=8,cinder:UPDATE=1 {{(pid=83528) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Feb 25 15:52:13 devstack cinder-volume[83528]: DEBUG cinder.volume.flows.manager.create_volume [None req-eb0adfc5-1b64-401c-aa70-4a334f5ef9fd tempest-VolumesAdminNegativeTest-2058396147 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83528) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 25 15:52:13 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-eb0adfc5-1b64-401c-aa70-4a334f5ef9fd tempest-VolumesAdminNegativeTest-2058396147 None] Flow 'volume_create_manager' (f1bb393f-9d2d-41ee-8484-8210112ebdc7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83528) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 25 15:52:13 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-eb0adfc5-1b64-401c-aa70-4a334f5ef9fd tempest-VolumesAdminNegativeTest-2058396147 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (555ffd7e-3779-421c-889f-a7570b39210f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 25 15:52:13 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-eb0adfc5-1b64-401c-aa70-4a334f5ef9fd tempest-VolumesAdminNegativeTest-2058396147 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (555ffd7e-3779-421c-889f-a7570b39210f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-25T14:52:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-112557688',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ebb93eab-e9a7-44d6-9750-9084be54e28e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5032ade70dbe474aa31f8d66b7dae6e2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-25T14:52:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-25T14:52:13Z,use_quota=True,user_id='2dd8a927671a44e7850052fdcdd6f075',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ce71c2f9-6543-4165-9653-a1529b2ea243),volume_type_id=ce71c2f9-6543-4165-9653-a1529b2ea243)' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 25 15:52:13 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-eb0adfc5-1b64-401c-aa70-4a334f5ef9fd tempest-VolumesAdminNegativeTest-2058396147 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (06bef5c6-0577-4ee6-8ad1-60ab8109f47d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 25 15:52:13 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-eb0adfc5-1b64-401c-aa70-4a334f5ef9fd tempest-VolumesAdminNegativeTest-2058396147 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (06bef5c6-0577-4ee6-8ad1-60ab8109f47d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 25 15:52:13 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-eb0adfc5-1b64-401c-aa70-4a334f5ef9fd tempest-VolumesAdminNegativeTest-2058396147 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (05ba50c0-fa7f-469c-8055-de790d4fab82) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 25 15:52:13 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-eb0adfc5-1b64-401c-aa70-4a334f5ef9fd tempest-VolumesAdminNegativeTest-2058396147 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (05ba50c0-fa7f-469c-8055-de790d4fab82) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ebb93eab-e9a7-44d6-9750-9084be54e28e', 'volume_name': 'volume-ebb93eab-e9a7-44d6-9750-9084be54e28e', 'volume_size': 1}' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 25 15:52:13 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-eb0adfc5-1b64-401c-aa70-4a334f5ef9fd tempest-VolumesAdminNegativeTest-2058396147 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fbfe413b-8e82-4481-a9af-699ab5e9a353) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 25 15:52:13 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-eb0adfc5-1b64-401c-aa70-4a334f5ef9fd tempest-VolumesAdminNegativeTest-2058396147 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fbfe413b-8e82-4481-a9af-699ab5e9a353) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 25 15:52:13 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-eb0adfc5-1b64-401c-aa70-4a334f5ef9fd tempest-VolumesAdminNegativeTest-2058396147 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c8906685-f065-41e1-91d6-eee167afdbae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 25 15:52:13 devstack cinder-volume[83528]: INFO cinder.volume.flows.manager.create_volume [None req-eb0adfc5-1b64-401c-aa70-4a334f5ef9fd tempest-VolumesAdminNegativeTest-2058396147 None] Volume ebb93eab-e9a7-44d6-9750-9084be54e28e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ebb93eab-e9a7-44d6-9750-9084be54e28e', 'volume_size': 1} Feb 25 15:52:13 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-eb0adfc5-1b64-401c-aa70-4a334f5ef9fd tempest-VolumesAdminNegativeTest-2058396147 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 25 15:52:13 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-eb0adfc5-1b64-401c-aa70-4a334f5ef9fd tempest-VolumesAdminNegativeTest-2058396147 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 25 15:52:13 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.quobyte [None req-eb0adfc5-1b64-401c-aa70-4a334f5ef9fd tempest-VolumesAdminNegativeTest-2058396147 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-25T14:52:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-112557688',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ebb93eab-e9a7-44d6-9750-9084be54e28e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5032ade70dbe474aa31f8d66b7dae6e2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-25T14:52:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-25T14:52:13Z,use_quota=True,user_id='2dd8a927671a44e7850052fdcdd6f075',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ce71c2f9-6543-4165-9653-a1529b2ea243),volume_type_id=ce71c2f9-6543-4165-9653-a1529b2ea243)}" {{(pid=83528) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 25 15:52:13 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.remotefs [None req-eb0adfc5-1b64-401c-aa70-4a334f5ef9fd tempest-VolumesAdminNegativeTest-2058396147 None] Creating volume ebb93eab-e9a7-44d6-9750-9084be54e28e {{(pid=83528) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 25 15:52:13 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-eb0adfc5-1b64-401c-aa70-4a334f5ef9fd tempest-VolumesAdminNegativeTest-2058396147 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 25 15:52:13 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-eb0adfc5-1b64-401c-aa70-4a334f5ef9fd tempest-VolumesAdminNegativeTest-2058396147 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 25 15:52:13 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.quobyte [None req-eb0adfc5-1b64-401c-aa70-4a334f5ef9fd tempest-VolumesAdminNegativeTest-2058396147 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23e9d725-3e04-4cd9-bfe0-c8ef43305589': None} {{(pid=83528) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 25 15:52:13 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.quobyte [None req-eb0adfc5-1b64-401c-aa70-4a334f5ef9fd tempest-VolumesAdminNegativeTest-2058396147 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23e9d725-3e04-4cd9-bfe0-c8ef43305589'] {{(pid=83528) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 25 15:52:13 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-eb0adfc5-1b64-401c-aa70-4a334f5ef9fd tempest-VolumesAdminNegativeTest-2058396147 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 25 15:52:13 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.quobyte [None req-eb0adfc5-1b64-401c-aa70-4a334f5ef9fd tempest-VolumesAdminNegativeTest-2058396147 None] Selected osci02.corp.quobyte.com/cinder-vol-23e9d725-3e04-4cd9-bfe0-c8ef43305589 as target Quobyte volume. {{(pid=83528) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 25 15:52:13 devstack cinder-volume[83528]: INFO cinder.volume.drivers.remotefs [None req-eb0adfc5-1b64-401c-aa70-4a334f5ef9fd tempest-VolumesAdminNegativeTest-2058396147 None] casted to osci02.corp.quobyte.com/cinder-vol-23e9d725-3e04-4cd9-bfe0-c8ef43305589 Feb 25 15:52:13 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-eb0adfc5-1b64-401c-aa70-4a334f5ef9fd tempest-VolumesAdminNegativeTest-2058396147 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-ebb93eab-e9a7-44d6-9750-9084be54e28e 1073741824 {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 25 15:52:13 devstack sudo[84003]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-ebb93eab-e9a7-44d6-9750-9084be54e28e 1073741824 Feb 25 15:52:13 devstack sudo[84003]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 25 15:52:15 devstack sudo[84003]: pam_unix(sudo:session): session closed for user root Feb 25 15:52:15 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-eb0adfc5-1b64-401c-aa70-4a334f5ef9fd tempest-VolumesAdminNegativeTest-2058396147 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-ebb93eab-e9a7-44d6-9750-9084be54e28e 1073741824" returned: 0 in 1.690s {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 25 15:52:15 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-eb0adfc5-1b64-401c-aa70-4a334f5ef9fd tempest-VolumesAdminNegativeTest-2058396147 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-ebb93eab-e9a7-44d6-9750-9084be54e28e {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 25 15:52:15 devstack sudo[84325]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-ebb93eab-e9a7-44d6-9750-9084be54e28e Feb 25 15:52:15 devstack sudo[84325]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 25 15:52:15 devstack sudo[84325]: pam_unix(sudo:session): session closed for user root Feb 25 15:52:15 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-eb0adfc5-1b64-401c-aa70-4a334f5ef9fd tempest-VolumesAdminNegativeTest-2058396147 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-ebb93eab-e9a7-44d6-9750-9084be54e28e" returned: 0 in 0.649s {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 25 15:52:15 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.quobyte [None req-eb0adfc5-1b64-401c-aa70-4a334f5ef9fd tempest-VolumesAdminNegativeTest-2058396147 None] <== create_volume: return (2405ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-23e9d725-3e04-4cd9-bfe0-c8ef43305589'} {{(pid=83528) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 25 15:52:15 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-eb0adfc5-1b64-401c-aa70-4a334f5ef9fd tempest-VolumesAdminNegativeTest-2058396147 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.407s {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 25 15:52:15 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-eb0adfc5-1b64-401c-aa70-4a334f5ef9fd tempest-VolumesAdminNegativeTest-2058396147 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c8906685-f065-41e1-91d6-eee167afdbae) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ebb93eab-e9a7-44d6-9750-9084be54e28e', 'volume_size': 1}' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 25 15:52:15 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-eb0adfc5-1b64-401c-aa70-4a334f5ef9fd tempest-VolumesAdminNegativeTest-2058396147 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (31a67867-e7c7-4491-82b8-f9e9d507df1d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 25 15:52:16 devstack cinder-volume[83528]: INFO cinder.volume.flows.manager.create_volume [None req-eb0adfc5-1b64-401c-aa70-4a334f5ef9fd tempest-VolumesAdminNegativeTest-2058396147 None] Volume volume-ebb93eab-e9a7-44d6-9750-9084be54e28e (ebb93eab-e9a7-44d6-9750-9084be54e28e): created successfully Feb 25 15:52:16 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-eb0adfc5-1b64-401c-aa70-4a334f5ef9fd tempest-VolumesAdminNegativeTest-2058396147 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (31a67867-e7c7-4491-82b8-f9e9d507df1d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 25 15:52:16 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-eb0adfc5-1b64-401c-aa70-4a334f5ef9fd tempest-VolumesAdminNegativeTest-2058396147 None] Flow 'volume_create_manager' (f1bb393f-9d2d-41ee-8484-8210112ebdc7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83528) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 25 15:52:16 devstack cinder-volume[83528]: INFO cinder.volume.manager [None req-eb0adfc5-1b64-401c-aa70-4a334f5ef9fd tempest-VolumesAdminNegativeTest-2058396147 None] Created volume successfully. Feb 25 15:52:18 devstack cinder-volume[83528]: DEBUG cinder.coordination [None req-0b33d337-25b1-4073-ac20-fbbafefe1b78 tempest-VolumesAdminNegativeTest-2058396147 None] Acquiring lock "cinder-ebb93eab-e9a7-44d6-9750-9084be54e28e-delete_volume" by "delete_volume" {{(pid=83528) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 25 15:52:18 devstack cinder-volume[83528]: DEBUG cinder.coordination [None req-0b33d337-25b1-4073-ac20-fbbafefe1b78 tempest-VolumesAdminNegativeTest-2058396147 None] Lock "cinder-ebb93eab-e9a7-44d6-9750-9084be54e28e-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=83528) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 25 15:52:18 devstack cinder-volume[83528]: DEBUG cinder.coordination [None req-0b33d337-25b1-4073-ac20-fbbafefe1b78 tempest-VolumesAdminNegativeTest-2058396147 None] Acquiring lock "cinder-quobyte-ebb93eab-e9a7-44d6-9750-9084be54e28e" by "delete_volume" {{(pid=83528) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 25 15:52:18 devstack cinder-volume[83528]: DEBUG cinder.coordination [None req-0b33d337-25b1-4073-ac20-fbbafefe1b78 tempest-VolumesAdminNegativeTest-2058396147 None] Lock "cinder-quobyte-ebb93eab-e9a7-44d6-9750-9084be54e28e" acquired by "delete_volume" :: waited 0.016s {{(pid=83528) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 25 15:52:18 devstack cinder-volume[83528]: INFO oslo.privsep.daemon [None req-0b33d337-25b1-4073-ac20-fbbafefe1b78 tempest-VolumesAdminNegativeTest-2058396147 None] Running privsep helper: ['sudo', 'cinder-rootwrap', '/etc/cinder/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/cinder/cinder.conf', '--privsep_context', 'cinder.privsep.sys_admin_pctxt', '--privsep_sock_path', '/tmp/tmpjzprrkjh/privsep.sock'] Feb 25 15:52:18 devstack sudo[84368]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf privsep-helper --config-file /etc/cinder/cinder.conf --privsep_context cinder.privsep.sys_admin_pctxt --privsep_sock_path /tmp/tmpjzprrkjh/privsep.sock Feb 25 15:52:18 devstack sudo[84368]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 25 15:52:21 devstack sudo[84368]: pam_unix(sudo:session): session closed for user root Feb 25 15:52:21 devstack cinder-volume[83528]: INFO oslo.privsep.daemon [None req-0b33d337-25b1-4073-ac20-fbbafefe1b78 tempest-VolumesAdminNegativeTest-2058396147 None] Spawned new privsep daemon via rootwrap Feb 25 15:52:21 devstack cinder-volume[83528]: DEBUG oslo.privsep.daemon [None req-0b33d337-25b1-4073-ac20-fbbafefe1b78 tempest-VolumesAdminNegativeTest-2058396147 None] Accepted privsep connection to /tmp/tmpjzprrkjh/privsep.sock {{(pid=83528) __init__ /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:418}} Feb 25 15:52:21 devstack cinder-volume[83528]: INFO oslo.privsep.daemon [-] privsep daemon starting Feb 25 15:52:21 devstack cinder-volume[83528]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0 Feb 25 15:52:21 devstack cinder-volume[83528]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/none Feb 25 15:52:21 devstack cinder-volume[83528]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 84389 Feb 25 15:52:21 devstack cinder-volume[83528]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2f07d0e-5c2b-44c7-b2aa-be3698fcf811]: (2,) {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 25 15:52:21 devstack cinder-volume[83528]: DEBUG oslo.privsep.daemon [-] privsep: reply[acfd4ede-fa1e-4525-914d-8fd792c5f133]: (4, 'qcow2') {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 25 15:52:21 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-0b33d337-25b1-4073-ac20-fbbafefe1b78 tempest-VolumesAdminNegativeTest-2058396147 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-ebb93eab-e9a7-44d6-9750-9084be54e28e {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 25 15:52:21 devstack sudo[84391]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-ebb93eab-e9a7-44d6-9750-9084be54e28e Feb 25 15:52:21 devstack sudo[84391]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 25 15:52:22 devstack sudo[84391]: pam_unix(sudo:session): session closed for user root Feb 25 15:52:22 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-0b33d337-25b1-4073-ac20-fbbafefe1b78 tempest-VolumesAdminNegativeTest-2058396147 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-ebb93eab-e9a7-44d6-9750-9084be54e28e" returned: 0 in 1.498s {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 25 15:52:22 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-0b33d337-25b1-4073-ac20-fbbafefe1b78 tempest-VolumesAdminNegativeTest-2058396147 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-ebb93eab-e9a7-44d6-9750-9084be54e28e {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 25 15:52:22 devstack sudo[84425]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-ebb93eab-e9a7-44d6-9750-9084be54e28e Feb 25 15:52:22 devstack sudo[84425]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 25 15:52:23 devstack sudo[84425]: pam_unix(sudo:session): session closed for user root Feb 25 15:52:23 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-0b33d337-25b1-4073-ac20-fbbafefe1b78 tempest-VolumesAdminNegativeTest-2058396147 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-ebb93eab-e9a7-44d6-9750-9084be54e28e" returned: 0 in 1.015s {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 25 15:52:23 devstack cinder-volume[83528]: DEBUG cinder.coordination [None req-0b33d337-25b1-4073-ac20-fbbafefe1b78 tempest-VolumesAdminNegativeTest-2058396147 None] Lock "cinder-quobyte-ebb93eab-e9a7-44d6-9750-9084be54e28e" released by "delete_volume" :: held 5.393s {{(pid=83528) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 25 15:52:23 devstack cinder-volume[83528]: WARNING cinder.quota [None req-0b33d337-25b1-4073-ac20-fbbafefe1b78 tempest-VolumesAdminNegativeTest-2058396147 None] Deprecated: Default quota for resource: volumes_QuobyteHD is set by the default quota flag: quota_volumes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Feb 25 15:52:23 devstack cinder-volume[83528]: WARNING cinder.quota [None req-0b33d337-25b1-4073-ac20-fbbafefe1b78 tempest-VolumesAdminNegativeTest-2058396147 None] Deprecated: Default quota for resource: gigabytes_QuobyteHD is set by the default quota flag: quota_gigabytes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Feb 25 15:52:23 devstack cinder-volume[83528]: DEBUG cinder.quota [None req-0b33d337-25b1-4073-ac20-fbbafefe1b78 tempest-VolumesAdminNegativeTest-2058396147 None] Created reservations ['04c6be49-dd0e-4282-ab4a-b9df17054ee0', 'faa18516-3af6-44b1-a832-c1ceff85ebe5', 'c9e9e02b-5c6b-468d-983a-fa18b86c616d', 'cc0c11e1-5b2d-48ae-989e-3a99423ffb29'] {{(pid=83528) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 25 15:52:24 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-0b33d337-25b1-4073-ac20-fbbafefe1b78 tempest-VolumesAdminNegativeTest-2058396147 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 25 15:52:24 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-0b33d337-25b1-4073-ac20-fbbafefe1b78 tempest-VolumesAdminNegativeTest-2058396147 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 25 15:52:24 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.quobyte [None req-0b33d337-25b1-4073-ac20-fbbafefe1b78 tempest-VolumesAdminNegativeTest-2058396147 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23e9d725-3e04-4cd9-bfe0-c8ef43305589': None} {{(pid=83528) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 25 15:52:24 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.quobyte [None req-0b33d337-25b1-4073-ac20-fbbafefe1b78 tempest-VolumesAdminNegativeTest-2058396147 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23e9d725-3e04-4cd9-bfe0-c8ef43305589'] {{(pid=83528) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 25 15:52:24 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-0b33d337-25b1-4073-ac20-fbbafefe1b78 tempest-VolumesAdminNegativeTest-2058396147 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.029s {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 25 15:52:24 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-0b33d337-25b1-4073-ac20-fbbafefe1b78 tempest-VolumesAdminNegativeTest-2058396147 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85 {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 25 15:52:24 devstack sudo[84429]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85 Feb 25 15:52:24 devstack sudo[84429]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 25 15:52:25 devstack sudo[84429]: pam_unix(sudo:session): session closed for user root Feb 25 15:52:25 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-0b33d337-25b1-4073-ac20-fbbafefe1b78 tempest-VolumesAdminNegativeTest-2058396147 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85" returned: 0 in 0.808s {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 25 15:52:25 devstack cinder-volume[83528]: DEBUG cinder.manager [None req-0b33d337-25b1-4073-ac20-fbbafefe1b78 tempest-VolumesAdminNegativeTest-2058396147 None] Notifying Schedulers of capabilities ... {{(pid=83528) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 25 15:52:25 devstack cinder-volume[83528]: INFO cinder.volume.manager [None req-0b33d337-25b1-4073-ac20-fbbafefe1b78 tempest-VolumesAdminNegativeTest-2058396147 None] Deleted volume successfully. Feb 25 15:52:25 devstack cinder-volume[83528]: DEBUG cinder.coordination [None req-0b33d337-25b1-4073-ac20-fbbafefe1b78 tempest-VolumesAdminNegativeTest-2058396147 None] Lock "cinder-ebb93eab-e9a7-44d6-9750-9084be54e28e-delete_volume" released by "delete_volume" :: held 6.866s {{(pid=83528) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 25 15:52:26 devstack cinder-volume[83528]: DEBUG cinder.volume.flows.manager.create_volume [None req-0a7d9157-8047-4ec9-9cc8-fc2c3b580dd7 tempest-ServerRescueNegativeTestJSON-1413502503 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83528) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 25 15:52:26 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-0a7d9157-8047-4ec9-9cc8-fc2c3b580dd7 tempest-ServerRescueNegativeTestJSON-1413502503 None] Flow 'volume_create_manager' (212e8705-a019-4d8c-ab89-b6bc7060746f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83528) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 25 15:52:26 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-0a7d9157-8047-4ec9-9cc8-fc2c3b580dd7 tempest-ServerRescueNegativeTestJSON-1413502503 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6006911c-a1a4-4fa5-b1b0-1fdfd9ff8a5a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 25 15:52:26 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-0a7d9157-8047-4ec9-9cc8-fc2c3b580dd7 tempest-ServerRescueNegativeTestJSON-1413502503 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6006911c-a1a4-4fa5-b1b0-1fdfd9ff8a5a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-25T14:52:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-896939442',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=704eab97-a5ab-4d85-adc4-8c27f05c0283,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ba7471b6cae547279e328afd44ff8fc7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-25T14:52:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-25T14:52:26Z,use_quota=True,user_id='ce85e4213af4446eaaad0c8361fc304f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ce71c2f9-6543-4165-9653-a1529b2ea243),volume_type_id=ce71c2f9-6543-4165-9653-a1529b2ea243)' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 25 15:52:26 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-0a7d9157-8047-4ec9-9cc8-fc2c3b580dd7 tempest-ServerRescueNegativeTestJSON-1413502503 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4b486f68-c855-412a-8fcd-a80a3da423a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 25 15:52:26 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-0a7d9157-8047-4ec9-9cc8-fc2c3b580dd7 tempest-ServerRescueNegativeTestJSON-1413502503 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4b486f68-c855-412a-8fcd-a80a3da423a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 25 15:52:26 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-0a7d9157-8047-4ec9-9cc8-fc2c3b580dd7 tempest-ServerRescueNegativeTestJSON-1413502503 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (38c2196a-cc59-4bbd-9ec0-1375330bb5c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 25 15:52:26 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-0a7d9157-8047-4ec9-9cc8-fc2c3b580dd7 tempest-ServerRescueNegativeTestJSON-1413502503 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (38c2196a-cc59-4bbd-9ec0-1375330bb5c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '704eab97-a5ab-4d85-adc4-8c27f05c0283', 'volume_name': 'volume-704eab97-a5ab-4d85-adc4-8c27f05c0283', 'volume_size': 1}' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 25 15:52:26 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-0a7d9157-8047-4ec9-9cc8-fc2c3b580dd7 tempest-ServerRescueNegativeTestJSON-1413502503 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (74efad3c-0bff-44f4-8ea4-e5e8eeb184ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 25 15:52:26 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-0a7d9157-8047-4ec9-9cc8-fc2c3b580dd7 tempest-ServerRescueNegativeTestJSON-1413502503 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (74efad3c-0bff-44f4-8ea4-e5e8eeb184ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 25 15:52:26 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-0a7d9157-8047-4ec9-9cc8-fc2c3b580dd7 tempest-ServerRescueNegativeTestJSON-1413502503 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8779c4af-b889-42d4-b7e6-7e62e62a6284) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 25 15:52:26 devstack cinder-volume[83528]: INFO cinder.volume.flows.manager.create_volume [None req-0a7d9157-8047-4ec9-9cc8-fc2c3b580dd7 tempest-ServerRescueNegativeTestJSON-1413502503 None] Volume 704eab97-a5ab-4d85-adc4-8c27f05c0283: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-704eab97-a5ab-4d85-adc4-8c27f05c0283', 'volume_size': 1} Feb 25 15:52:26 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-0a7d9157-8047-4ec9-9cc8-fc2c3b580dd7 tempest-ServerRescueNegativeTestJSON-1413502503 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 25 15:52:26 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-0a7d9157-8047-4ec9-9cc8-fc2c3b580dd7 tempest-ServerRescueNegativeTestJSON-1413502503 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 25 15:52:26 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.quobyte [None req-0a7d9157-8047-4ec9-9cc8-fc2c3b580dd7 tempest-ServerRescueNegativeTestJSON-1413502503 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-25T14:52:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-896939442',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=704eab97-a5ab-4d85-adc4-8c27f05c0283,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ba7471b6cae547279e328afd44ff8fc7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-25T14:52:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-25T14:52:26Z,use_quota=True,user_id='ce85e4213af4446eaaad0c8361fc304f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ce71c2f9-6543-4165-9653-a1529b2ea243),volume_type_id=ce71c2f9-6543-4165-9653-a1529b2ea243)}" {{(pid=83528) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 25 15:52:26 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.remotefs [None req-0a7d9157-8047-4ec9-9cc8-fc2c3b580dd7 tempest-ServerRescueNegativeTestJSON-1413502503 None] Creating volume 704eab97-a5ab-4d85-adc4-8c27f05c0283 {{(pid=83528) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 25 15:52:26 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-0a7d9157-8047-4ec9-9cc8-fc2c3b580dd7 tempest-ServerRescueNegativeTestJSON-1413502503 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 25 15:52:26 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-0a7d9157-8047-4ec9-9cc8-fc2c3b580dd7 tempest-ServerRescueNegativeTestJSON-1413502503 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 25 15:52:26 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.quobyte [None req-0a7d9157-8047-4ec9-9cc8-fc2c3b580dd7 tempest-ServerRescueNegativeTestJSON-1413502503 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23e9d725-3e04-4cd9-bfe0-c8ef43305589': None} {{(pid=83528) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 25 15:52:26 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.quobyte [None req-0a7d9157-8047-4ec9-9cc8-fc2c3b580dd7 tempest-ServerRescueNegativeTestJSON-1413502503 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23e9d725-3e04-4cd9-bfe0-c8ef43305589'] {{(pid=83528) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 25 15:52:26 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-0a7d9157-8047-4ec9-9cc8-fc2c3b580dd7 tempest-ServerRescueNegativeTestJSON-1413502503 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.029s {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 25 15:52:26 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.quobyte [None req-0a7d9157-8047-4ec9-9cc8-fc2c3b580dd7 tempest-ServerRescueNegativeTestJSON-1413502503 None] Selected osci02.corp.quobyte.com/cinder-vol-23e9d725-3e04-4cd9-bfe0-c8ef43305589 as target Quobyte volume. {{(pid=83528) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 25 15:52:26 devstack cinder-volume[83528]: INFO cinder.volume.drivers.remotefs [None req-0a7d9157-8047-4ec9-9cc8-fc2c3b580dd7 tempest-ServerRescueNegativeTestJSON-1413502503 None] casted to osci02.corp.quobyte.com/cinder-vol-23e9d725-3e04-4cd9-bfe0-c8ef43305589 Feb 25 15:52:26 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-0a7d9157-8047-4ec9-9cc8-fc2c3b580dd7 tempest-ServerRescueNegativeTestJSON-1413502503 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-704eab97-a5ab-4d85-adc4-8c27f05c0283 1073741824 {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 25 15:52:26 devstack sudo[84455]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-704eab97-a5ab-4d85-adc4-8c27f05c0283 1073741824 Feb 25 15:52:26 devstack sudo[84455]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 25 15:52:29 devstack sudo[84455]: pam_unix(sudo:session): session closed for user root Feb 25 15:52:29 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-0a7d9157-8047-4ec9-9cc8-fc2c3b580dd7 tempest-ServerRescueNegativeTestJSON-1413502503 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-704eab97-a5ab-4d85-adc4-8c27f05c0283 1073741824" returned: 0 in 2.302s {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 25 15:52:29 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-0a7d9157-8047-4ec9-9cc8-fc2c3b580dd7 tempest-ServerRescueNegativeTestJSON-1413502503 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-704eab97-a5ab-4d85-adc4-8c27f05c0283 {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 25 15:52:29 devstack sudo[84466]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-704eab97-a5ab-4d85-adc4-8c27f05c0283 Feb 25 15:52:29 devstack sudo[84466]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 25 15:52:30 devstack sudo[84466]: pam_unix(sudo:session): session closed for user root Feb 25 15:52:30 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-0a7d9157-8047-4ec9-9cc8-fc2c3b580dd7 tempest-ServerRescueNegativeTestJSON-1413502503 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-704eab97-a5ab-4d85-adc4-8c27f05c0283" returned: 0 in 0.882s {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 25 15:52:30 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.quobyte [None req-0a7d9157-8047-4ec9-9cc8-fc2c3b580dd7 tempest-ServerRescueNegativeTestJSON-1413502503 None] <== create_volume: return (3277ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-23e9d725-3e04-4cd9-bfe0-c8ef43305589'} {{(pid=83528) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 25 15:52:30 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-0a7d9157-8047-4ec9-9cc8-fc2c3b580dd7 tempest-ServerRescueNegativeTestJSON-1413502503 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 3.279s {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 25 15:52:30 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-0a7d9157-8047-4ec9-9cc8-fc2c3b580dd7 tempest-ServerRescueNegativeTestJSON-1413502503 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8779c4af-b889-42d4-b7e6-7e62e62a6284) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-704eab97-a5ab-4d85-adc4-8c27f05c0283', 'volume_size': 1}' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 25 15:52:30 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-0a7d9157-8047-4ec9-9cc8-fc2c3b580dd7 tempest-ServerRescueNegativeTestJSON-1413502503 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ac084e85-d4dc-47a8-8e1b-649d9583375d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 25 15:52:30 devstack cinder-volume[83528]: INFO cinder.volume.flows.manager.create_volume [None req-0a7d9157-8047-4ec9-9cc8-fc2c3b580dd7 tempest-ServerRescueNegativeTestJSON-1413502503 None] Volume volume-704eab97-a5ab-4d85-adc4-8c27f05c0283 (704eab97-a5ab-4d85-adc4-8c27f05c0283): created successfully Feb 25 15:52:30 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-0a7d9157-8047-4ec9-9cc8-fc2c3b580dd7 tempest-ServerRescueNegativeTestJSON-1413502503 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ac084e85-d4dc-47a8-8e1b-649d9583375d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 25 15:52:30 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-0a7d9157-8047-4ec9-9cc8-fc2c3b580dd7 tempest-ServerRescueNegativeTestJSON-1413502503 None] Flow 'volume_create_manager' (212e8705-a019-4d8c-ab89-b6bc7060746f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83528) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 25 15:52:30 devstack cinder-volume[83528]: INFO cinder.volume.manager [None req-0a7d9157-8047-4ec9-9cc8-fc2c3b580dd7 tempest-ServerRescueNegativeTestJSON-1413502503 None] Created volume successfully. Feb 25 15:52:34 devstack cinder-volume[83528]: DEBUG cinder.volume.flows.manager.create_volume [req-37fd991b-7132-4cb5-bd21-ebbedcdc0a6a req-fcddfa98-b9bc-4edd-bfc0-8c49d2159d3d tempest-ServerBootFromVolumeStableRescueTest-939682044 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83528) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 25 15:52:34 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [req-37fd991b-7132-4cb5-bd21-ebbedcdc0a6a req-fcddfa98-b9bc-4edd-bfc0-8c49d2159d3d tempest-ServerBootFromVolumeStableRescueTest-939682044 None] Flow 'volume_create_manager' (1fb0732f-31d7-4ec8-9c48-720519fabcde) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83528) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 25 15:52:34 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [req-37fd991b-7132-4cb5-bd21-ebbedcdc0a6a req-fcddfa98-b9bc-4edd-bfc0-8c49d2159d3d tempest-ServerBootFromVolumeStableRescueTest-939682044 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (81a1f6ad-eb7d-488a-adaa-0ce88defe6d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 25 15:52:34 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [req-37fd991b-7132-4cb5-bd21-ebbedcdc0a6a req-fcddfa98-b9bc-4edd-bfc0-8c49d2159d3d tempest-ServerBootFromVolumeStableRescueTest-939682044 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (81a1f6ad-eb7d-488a-adaa-0ce88defe6d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-25T14:52:35Z,deleted=False,deleted_at=None,display_description='',display_name='ab8cb013-8cf2-4078-9d72-2d727fd0c6c4-blank-vol',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8846575b-0b7c-4fe1-a314-bb6ceaabd0a8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d8907daf560042a1a6765383470d101e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-25T14:52:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-25T14:52:35Z,use_quota=True,user_id='ccac5f6631a3427584db00fdc9fa82c4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ce71c2f9-6543-4165-9653-a1529b2ea243),volume_type_id=ce71c2f9-6543-4165-9653-a1529b2ea243)' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 25 15:52:35 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [req-37fd991b-7132-4cb5-bd21-ebbedcdc0a6a req-fcddfa98-b9bc-4edd-bfc0-8c49d2159d3d tempest-ServerBootFromVolumeStableRescueTest-939682044 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0c9201ae-2a82-4b58-9b71-b3de0f936e4c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 25 15:52:35 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [req-37fd991b-7132-4cb5-bd21-ebbedcdc0a6a req-fcddfa98-b9bc-4edd-bfc0-8c49d2159d3d tempest-ServerBootFromVolumeStableRescueTest-939682044 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0c9201ae-2a82-4b58-9b71-b3de0f936e4c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 25 15:52:35 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [req-37fd991b-7132-4cb5-bd21-ebbedcdc0a6a req-fcddfa98-b9bc-4edd-bfc0-8c49d2159d3d tempest-ServerBootFromVolumeStableRescueTest-939682044 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b8c6838f-aa70-4d0b-b48e-0f729a5f2847) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 25 15:52:35 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [req-37fd991b-7132-4cb5-bd21-ebbedcdc0a6a req-fcddfa98-b9bc-4edd-bfc0-8c49d2159d3d tempest-ServerBootFromVolumeStableRescueTest-939682044 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b8c6838f-aa70-4d0b-b48e-0f729a5f2847) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8846575b-0b7c-4fe1-a314-bb6ceaabd0a8', 'volume_name': 'volume-8846575b-0b7c-4fe1-a314-bb6ceaabd0a8', 'volume_size': 1}' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 25 15:52:35 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [req-37fd991b-7132-4cb5-bd21-ebbedcdc0a6a req-fcddfa98-b9bc-4edd-bfc0-8c49d2159d3d tempest-ServerBootFromVolumeStableRescueTest-939682044 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (984bf73a-41f3-406d-84ab-06d4b25c624c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 25 15:52:35 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [req-37fd991b-7132-4cb5-bd21-ebbedcdc0a6a req-fcddfa98-b9bc-4edd-bfc0-8c49d2159d3d tempest-ServerBootFromVolumeStableRescueTest-939682044 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (984bf73a-41f3-406d-84ab-06d4b25c624c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 25 15:52:35 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [req-37fd991b-7132-4cb5-bd21-ebbedcdc0a6a req-fcddfa98-b9bc-4edd-bfc0-8c49d2159d3d tempest-ServerBootFromVolumeStableRescueTest-939682044 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (00e242b2-e994-470e-a1cd-be884ff3d2ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 25 15:52:35 devstack cinder-volume[83528]: INFO cinder.volume.flows.manager.create_volume [req-37fd991b-7132-4cb5-bd21-ebbedcdc0a6a req-fcddfa98-b9bc-4edd-bfc0-8c49d2159d3d tempest-ServerBootFromVolumeStableRescueTest-939682044 None] Volume 8846575b-0b7c-4fe1-a314-bb6ceaabd0a8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8846575b-0b7c-4fe1-a314-bb6ceaabd0a8', 'volume_size': 1} Feb 25 15:52:35 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [req-37fd991b-7132-4cb5-bd21-ebbedcdc0a6a req-fcddfa98-b9bc-4edd-bfc0-8c49d2159d3d tempest-ServerBootFromVolumeStableRescueTest-939682044 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 25 15:52:35 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [req-37fd991b-7132-4cb5-bd21-ebbedcdc0a6a req-fcddfa98-b9bc-4edd-bfc0-8c49d2159d3d tempest-ServerBootFromVolumeStableRescueTest-939682044 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.006s {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 25 15:52:35 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.quobyte [req-37fd991b-7132-4cb5-bd21-ebbedcdc0a6a req-fcddfa98-b9bc-4edd-bfc0-8c49d2159d3d tempest-ServerBootFromVolumeStableRescueTest-939682044 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-25T14:52:35Z,deleted=False,deleted_at=None,display_description='',display_name='ab8cb013-8cf2-4078-9d72-2d727fd0c6c4-blank-vol',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8846575b-0b7c-4fe1-a314-bb6ceaabd0a8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d8907daf560042a1a6765383470d101e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-25T14:52:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-25T14:52:35Z,use_quota=True,user_id='ccac5f6631a3427584db00fdc9fa82c4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ce71c2f9-6543-4165-9653-a1529b2ea243),volume_type_id=ce71c2f9-6543-4165-9653-a1529b2ea243)}" {{(pid=83528) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 25 15:52:35 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.remotefs [req-37fd991b-7132-4cb5-bd21-ebbedcdc0a6a req-fcddfa98-b9bc-4edd-bfc0-8c49d2159d3d tempest-ServerBootFromVolumeStableRescueTest-939682044 None] Creating volume 8846575b-0b7c-4fe1-a314-bb6ceaabd0a8 {{(pid=83528) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 25 15:52:35 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [req-37fd991b-7132-4cb5-bd21-ebbedcdc0a6a req-fcddfa98-b9bc-4edd-bfc0-8c49d2159d3d tempest-ServerBootFromVolumeStableRescueTest-939682044 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 25 15:52:35 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [req-37fd991b-7132-4cb5-bd21-ebbedcdc0a6a req-fcddfa98-b9bc-4edd-bfc0-8c49d2159d3d tempest-ServerBootFromVolumeStableRescueTest-939682044 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 25 15:52:35 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.quobyte [req-37fd991b-7132-4cb5-bd21-ebbedcdc0a6a req-fcddfa98-b9bc-4edd-bfc0-8c49d2159d3d tempest-ServerBootFromVolumeStableRescueTest-939682044 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23e9d725-3e04-4cd9-bfe0-c8ef43305589': None} {{(pid=83528) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 25 15:52:35 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.quobyte [req-37fd991b-7132-4cb5-bd21-ebbedcdc0a6a req-fcddfa98-b9bc-4edd-bfc0-8c49d2159d3d tempest-ServerBootFromVolumeStableRescueTest-939682044 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23e9d725-3e04-4cd9-bfe0-c8ef43305589'] {{(pid=83528) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 25 15:52:35 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [req-37fd991b-7132-4cb5-bd21-ebbedcdc0a6a req-fcddfa98-b9bc-4edd-bfc0-8c49d2159d3d tempest-ServerBootFromVolumeStableRescueTest-939682044 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 25 15:52:35 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.quobyte [req-37fd991b-7132-4cb5-bd21-ebbedcdc0a6a req-fcddfa98-b9bc-4edd-bfc0-8c49d2159d3d tempest-ServerBootFromVolumeStableRescueTest-939682044 None] Selected osci02.corp.quobyte.com/cinder-vol-23e9d725-3e04-4cd9-bfe0-c8ef43305589 as target Quobyte volume. {{(pid=83528) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 25 15:52:35 devstack cinder-volume[83528]: INFO cinder.volume.drivers.remotefs [req-37fd991b-7132-4cb5-bd21-ebbedcdc0a6a req-fcddfa98-b9bc-4edd-bfc0-8c49d2159d3d tempest-ServerBootFromVolumeStableRescueTest-939682044 None] casted to osci02.corp.quobyte.com/cinder-vol-23e9d725-3e04-4cd9-bfe0-c8ef43305589 Feb 25 15:52:35 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [req-37fd991b-7132-4cb5-bd21-ebbedcdc0a6a req-fcddfa98-b9bc-4edd-bfc0-8c49d2159d3d tempest-ServerBootFromVolumeStableRescueTest-939682044 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-8846575b-0b7c-4fe1-a314-bb6ceaabd0a8 1073741824 {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 25 15:52:35 devstack sudo[84482]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-8846575b-0b7c-4fe1-a314-bb6ceaabd0a8 1073741824 Feb 25 15:52:35 devstack sudo[84482]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 25 15:52:36 devstack sudo[84482]: pam_unix(sudo:session): session closed for user root Feb 25 15:52:36 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [req-37fd991b-7132-4cb5-bd21-ebbedcdc0a6a req-fcddfa98-b9bc-4edd-bfc0-8c49d2159d3d tempest-ServerBootFromVolumeStableRescueTest-939682044 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-8846575b-0b7c-4fe1-a314-bb6ceaabd0a8 1073741824" returned: 0 in 1.769s {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 25 15:52:36 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [req-37fd991b-7132-4cb5-bd21-ebbedcdc0a6a req-fcddfa98-b9bc-4edd-bfc0-8c49d2159d3d tempest-ServerBootFromVolumeStableRescueTest-939682044 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-8846575b-0b7c-4fe1-a314-bb6ceaabd0a8 {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 25 15:52:37 devstack sudo[84488]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-8846575b-0b7c-4fe1-a314-bb6ceaabd0a8 Feb 25 15:52:37 devstack sudo[84488]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 25 15:52:38 devstack sudo[84488]: pam_unix(sudo:session): session closed for user root Feb 25 15:52:38 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [req-37fd991b-7132-4cb5-bd21-ebbedcdc0a6a req-fcddfa98-b9bc-4edd-bfc0-8c49d2159d3d tempest-ServerBootFromVolumeStableRescueTest-939682044 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-8846575b-0b7c-4fe1-a314-bb6ceaabd0a8" returned: 0 in 1.297s {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 25 15:52:38 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.quobyte [req-37fd991b-7132-4cb5-bd21-ebbedcdc0a6a req-fcddfa98-b9bc-4edd-bfc0-8c49d2159d3d tempest-ServerBootFromVolumeStableRescueTest-939682044 None] <== create_volume: return (3168ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-23e9d725-3e04-4cd9-bfe0-c8ef43305589'} {{(pid=83528) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 25 15:52:38 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [req-37fd991b-7132-4cb5-bd21-ebbedcdc0a6a req-fcddfa98-b9bc-4edd-bfc0-8c49d2159d3d tempest-ServerBootFromVolumeStableRescueTest-939682044 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 3.175s {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 25 15:52:38 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [req-37fd991b-7132-4cb5-bd21-ebbedcdc0a6a req-fcddfa98-b9bc-4edd-bfc0-8c49d2159d3d tempest-ServerBootFromVolumeStableRescueTest-939682044 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (00e242b2-e994-470e-a1cd-be884ff3d2ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8846575b-0b7c-4fe1-a314-bb6ceaabd0a8', 'volume_size': 1}' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 25 15:52:38 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [req-37fd991b-7132-4cb5-bd21-ebbedcdc0a6a req-fcddfa98-b9bc-4edd-bfc0-8c49d2159d3d tempest-ServerBootFromVolumeStableRescueTest-939682044 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (17fa84e5-1a33-4ede-88ab-a2c4e34791fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 25 15:52:38 devstack cinder-volume[83528]: INFO cinder.volume.flows.manager.create_volume [req-37fd991b-7132-4cb5-bd21-ebbedcdc0a6a req-fcddfa98-b9bc-4edd-bfc0-8c49d2159d3d tempest-ServerBootFromVolumeStableRescueTest-939682044 None] Volume volume-8846575b-0b7c-4fe1-a314-bb6ceaabd0a8 (8846575b-0b7c-4fe1-a314-bb6ceaabd0a8): created successfully Feb 25 15:52:38 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [req-37fd991b-7132-4cb5-bd21-ebbedcdc0a6a req-fcddfa98-b9bc-4edd-bfc0-8c49d2159d3d tempest-ServerBootFromVolumeStableRescueTest-939682044 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (17fa84e5-1a33-4ede-88ab-a2c4e34791fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 25 15:52:38 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [req-37fd991b-7132-4cb5-bd21-ebbedcdc0a6a req-fcddfa98-b9bc-4edd-bfc0-8c49d2159d3d tempest-ServerBootFromVolumeStableRescueTest-939682044 None] Flow 'volume_create_manager' (1fb0732f-31d7-4ec8-9c48-720519fabcde) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83528) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 25 15:52:38 devstack cinder-volume[83528]: INFO cinder.volume.manager [req-37fd991b-7132-4cb5-bd21-ebbedcdc0a6a req-fcddfa98-b9bc-4edd-bfc0-8c49d2159d3d tempest-ServerBootFromVolumeStableRescueTest-939682044 None] Created volume successfully. Feb 25 15:52:38 devstack cinder-volume[83528]: DEBUG oslo_service.periodic_task [None req-d4c764ec-0ebb-4b31-b534-c9a53c1ab0dd None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=83528) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Feb 25 15:52:38 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-d4c764ec-0ebb-4b31-b534-c9a53c1ab0dd None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 25 15:52:38 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-d4c764ec-0ebb-4b31-b534-c9a53c1ab0dd None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 25 15:52:38 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.quobyte [None req-d4c764ec-0ebb-4b31-b534-c9a53c1ab0dd None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23e9d725-3e04-4cd9-bfe0-c8ef43305589': None} {{(pid=83528) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 25 15:52:38 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.quobyte [None req-d4c764ec-0ebb-4b31-b534-c9a53c1ab0dd None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23e9d725-3e04-4cd9-bfe0-c8ef43305589'] {{(pid=83528) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 25 15:52:38 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-d4c764ec-0ebb-4b31-b534-c9a53c1ab0dd None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 25 15:52:38 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-d4c764ec-0ebb-4b31-b534-c9a53c1ab0dd None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85 {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 25 15:52:38 devstack sudo[84491]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85 Feb 25 15:52:38 devstack sudo[84491]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 25 15:52:39 devstack sudo[84491]: pam_unix(sudo:session): session closed for user root Feb 25 15:52:39 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-d4c764ec-0ebb-4b31-b534-c9a53c1ab0dd None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85" returned: 0 in 0.889s {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 25 15:52:39 devstack cinder-volume[83528]: DEBUG cinder.manager [None req-d4c764ec-0ebb-4b31-b534-c9a53c1ab0dd None None] Notifying Schedulers of capabilities ... {{(pid=83528) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 25 15:52:44 devstack cinder-volume[83528]: WARNING py.warnings [req-37fd991b-7132-4cb5-bd21-ebbedcdc0a6a req-81c1cb7c-a41f-4d3e-b38e-23a8b4d008c7 tempest-ServerBootFromVolumeStableRescueTest-939682044 None] /opt/stack/cinder/cinder/db/sqlalchemy/api.py:2470: SAWarning: SELECT statement has a cartesian product between FROM element(s) "volumes" and FROM element "volume_attachment". Apply join condition(s) between each element to resolve. Feb 25 15:52:44 devstack cinder-volume[83528]: .first() Feb 25 15:52:44 devstack cinder-volume[83528]: Feb 25 15:52:44 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [req-37fd991b-7132-4cb5-bd21-ebbedcdc0a6a req-81c1cb7c-a41f-4d3e-b38e-23a8b4d008c7 tempest-ServerBootFromVolumeStableRescueTest-939682044 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 25 15:52:44 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [req-37fd991b-7132-4cb5-bd21-ebbedcdc0a6a req-81c1cb7c-a41f-4d3e-b38e-23a8b4d008c7 tempest-ServerBootFromVolumeStableRescueTest-939682044 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 25 15:52:45 devstack cinder-volume[83528]: DEBUG oslo.privsep.daemon [-] privsep: reply[49578709-369a-4ce4-93a5-bc613c979048]: (4, 'qcow2') {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 25 15:52:45 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [req-37fd991b-7132-4cb5-bd21-ebbedcdc0a6a req-81c1cb7c-a41f-4d3e-b38e-23a8b4d008c7 tempest-ServerBootFromVolumeStableRescueTest-939682044 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-8846575b-0b7c-4fe1-a314-bb6ceaabd0a8 {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 25 15:52:45 devstack sudo[84556]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-8846575b-0b7c-4fe1-a314-bb6ceaabd0a8 Feb 25 15:52:45 devstack sudo[84556]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 25 15:52:46 devstack sudo[84556]: pam_unix(sudo:session): session closed for user root Feb 25 15:52:46 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [req-37fd991b-7132-4cb5-bd21-ebbedcdc0a6a req-81c1cb7c-a41f-4d3e-b38e-23a8b4d008c7 tempest-ServerBootFromVolumeStableRescueTest-939682044 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-8846575b-0b7c-4fe1-a314-bb6ceaabd0a8" returned: 0 in 1.754s {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 25 15:52:46 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [req-37fd991b-7132-4cb5-bd21-ebbedcdc0a6a req-81c1cb7c-a41f-4d3e-b38e-23a8b4d008c7 tempest-ServerBootFromVolumeStableRescueTest-939682044 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.888s {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 25 15:52:46 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [req-37fd991b-7132-4cb5-bd21-ebbedcdc0a6a req-81c1cb7c-a41f-4d3e-b38e-23a8b4d008c7 tempest-ServerBootFromVolumeStableRescueTest-939682044 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-23e9d725-3e04-4cd9-bfe0-c8ef43305589', 'name': 'volume-8846575b-0b7c-4fe1-a314-bb6ceaabd0a8', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'a2e68d77-2090-454c-ba0d-46b183ac17f2', 'enforce_multipath': True} {{(pid=83528) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Feb 25 15:52:47 devstack cinder-volume[83528]: INFO cinder.volume.manager [req-37fd991b-7132-4cb5-bd21-ebbedcdc0a6a req-81c1cb7c-a41f-4d3e-b38e-23a8b4d008c7 tempest-ServerBootFromVolumeStableRescueTest-939682044 None] attachment_update completed successfully. Feb 25 15:52:56 devstack cinder-volume[83528]: DEBUG cinder.coordination [None req-2819ecc8-7b6d-4b69-903b-1da593ec4974 tempest-ServerRescueNegativeTestJSON-1413502503 None] Acquiring lock "cinder-704eab97-a5ab-4d85-adc4-8c27f05c0283-delete_volume" by "delete_volume" {{(pid=83528) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 25 15:52:56 devstack cinder-volume[83528]: DEBUG cinder.coordination [None req-2819ecc8-7b6d-4b69-903b-1da593ec4974 tempest-ServerRescueNegativeTestJSON-1413502503 None] Lock "cinder-704eab97-a5ab-4d85-adc4-8c27f05c0283-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=83528) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 25 15:52:56 devstack cinder-volume[83528]: DEBUG cinder.coordination [None req-2819ecc8-7b6d-4b69-903b-1da593ec4974 tempest-ServerRescueNegativeTestJSON-1413502503 None] Acquiring lock "cinder-quobyte-704eab97-a5ab-4d85-adc4-8c27f05c0283" by "delete_volume" {{(pid=83528) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 25 15:52:56 devstack cinder-volume[83528]: DEBUG cinder.coordination [None req-2819ecc8-7b6d-4b69-903b-1da593ec4974 tempest-ServerRescueNegativeTestJSON-1413502503 None] Lock "cinder-quobyte-704eab97-a5ab-4d85-adc4-8c27f05c0283" acquired by "delete_volume" :: waited 0.018s {{(pid=83528) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 25 15:52:56 devstack cinder-volume[83528]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ece7b2d-87e1-4c91-a7fc-09b367ed6201]: (4, 'qcow2') {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 25 15:52:56 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-2819ecc8-7b6d-4b69-903b-1da593ec4974 tempest-ServerRescueNegativeTestJSON-1413502503 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-704eab97-a5ab-4d85-adc4-8c27f05c0283 {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 25 15:52:56 devstack sudo[85133]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-704eab97-a5ab-4d85-adc4-8c27f05c0283 Feb 25 15:52:56 devstack sudo[85133]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 25 15:52:57 devstack sudo[85133]: pam_unix(sudo:session): session closed for user root Feb 25 15:52:57 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-2819ecc8-7b6d-4b69-903b-1da593ec4974 tempest-ServerRescueNegativeTestJSON-1413502503 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-704eab97-a5ab-4d85-adc4-8c27f05c0283" returned: 0 in 1.265s {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 25 15:52:57 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-2819ecc8-7b6d-4b69-903b-1da593ec4974 tempest-ServerRescueNegativeTestJSON-1413502503 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-704eab97-a5ab-4d85-adc4-8c27f05c0283 {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 25 15:52:57 devstack sudo[85141]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-704eab97-a5ab-4d85-adc4-8c27f05c0283 Feb 25 15:52:57 devstack sudo[85141]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 25 15:52:58 devstack sudo[85141]: pam_unix(sudo:session): session closed for user root Feb 25 15:52:58 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-2819ecc8-7b6d-4b69-903b-1da593ec4974 tempest-ServerRescueNegativeTestJSON-1413502503 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-704eab97-a5ab-4d85-adc4-8c27f05c0283" returned: 0 in 0.918s {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 25 15:52:58 devstack cinder-volume[83528]: DEBUG cinder.coordination [None req-2819ecc8-7b6d-4b69-903b-1da593ec4974 tempest-ServerRescueNegativeTestJSON-1413502503 None] Lock "cinder-quobyte-704eab97-a5ab-4d85-adc4-8c27f05c0283" released by "delete_volume" :: held 2.288s {{(pid=83528) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 25 15:52:58 devstack cinder-volume[83528]: DEBUG cinder.quota [None req-2819ecc8-7b6d-4b69-903b-1da593ec4974 tempest-ServerRescueNegativeTestJSON-1413502503 None] Created reservations ['31ff930d-9689-4f14-a46f-5c3d7ca1707a', '2cc4e191-ff70-44b3-b0f9-1e126ed0bd92', '81206747-2dd2-47fa-8440-5b20ff3832a6', '9bd18cbd-847e-4c97-b463-d5d760216cd0'] {{(pid=83528) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 25 15:52:59 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-2819ecc8-7b6d-4b69-903b-1da593ec4974 tempest-ServerRescueNegativeTestJSON-1413502503 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 25 15:52:59 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-2819ecc8-7b6d-4b69-903b-1da593ec4974 tempest-ServerRescueNegativeTestJSON-1413502503 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 25 15:52:59 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.quobyte [None req-2819ecc8-7b6d-4b69-903b-1da593ec4974 tempest-ServerRescueNegativeTestJSON-1413502503 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23e9d725-3e04-4cd9-bfe0-c8ef43305589': None} {{(pid=83528) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 25 15:52:59 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.quobyte [None req-2819ecc8-7b6d-4b69-903b-1da593ec4974 tempest-ServerRescueNegativeTestJSON-1413502503 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23e9d725-3e04-4cd9-bfe0-c8ef43305589'] {{(pid=83528) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 25 15:52:59 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-2819ecc8-7b6d-4b69-903b-1da593ec4974 tempest-ServerRescueNegativeTestJSON-1413502503 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 25 15:52:59 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-2819ecc8-7b6d-4b69-903b-1da593ec4974 tempest-ServerRescueNegativeTestJSON-1413502503 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85 {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 25 15:52:59 devstack sudo[85144]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85 Feb 25 15:52:59 devstack sudo[85144]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 25 15:53:00 devstack cinder-volume[83528]: DEBUG cinder.volume.flows.manager.create_volume [None req-b5604aea-e995-4e4e-ba35-bce58746b160 tempest-DeleteServersTestJSON-1303484918 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83528) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 25 15:53:00 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-b5604aea-e995-4e4e-ba35-bce58746b160 tempest-DeleteServersTestJSON-1303484918 None] Flow 'volume_create_manager' (fda2a400-0fdc-4c40-8ea4-1094df662a27) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83528) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 25 15:53:00 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-b5604aea-e995-4e4e-ba35-bce58746b160 tempest-DeleteServersTestJSON-1303484918 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c9e12418-eab8-46ef-bd77-763b8a681911) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 25 15:53:00 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-b5604aea-e995-4e4e-ba35-bce58746b160 tempest-DeleteServersTestJSON-1303484918 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c9e12418-eab8-46ef-bd77-763b8a681911) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-25T14:52:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-1181553363',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c8004545-abad-47aa-b19f-8ad72ca17dbf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c15024cc3cec468ca2476bc7e8cf2ac9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-25T14:53:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-25T14:53:00Z,use_quota=True,user_id='d3229c7327fd49e680582636139d9fe5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ce71c2f9-6543-4165-9653-a1529b2ea243),volume_type_id=ce71c2f9-6543-4165-9653-a1529b2ea243)' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 25 15:53:00 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-b5604aea-e995-4e4e-ba35-bce58746b160 tempest-DeleteServersTestJSON-1303484918 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (843e9097-e37d-4a0a-933a-da00d72ed9c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 25 15:53:00 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-b5604aea-e995-4e4e-ba35-bce58746b160 tempest-DeleteServersTestJSON-1303484918 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (843e9097-e37d-4a0a-933a-da00d72ed9c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 25 15:53:00 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-b5604aea-e995-4e4e-ba35-bce58746b160 tempest-DeleteServersTestJSON-1303484918 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dc6afdfd-bda5-41c8-aa7e-cfe0e11db8c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 25 15:53:00 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-b5604aea-e995-4e4e-ba35-bce58746b160 tempest-DeleteServersTestJSON-1303484918 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dc6afdfd-bda5-41c8-aa7e-cfe0e11db8c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c8004545-abad-47aa-b19f-8ad72ca17dbf', 'volume_name': 'volume-c8004545-abad-47aa-b19f-8ad72ca17dbf', 'volume_size': 1}' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 25 15:53:00 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-b5604aea-e995-4e4e-ba35-bce58746b160 tempest-DeleteServersTestJSON-1303484918 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e1c895e9-f360-48cf-b214-88cf7e1425e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 25 15:53:00 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-b5604aea-e995-4e4e-ba35-bce58746b160 tempest-DeleteServersTestJSON-1303484918 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e1c895e9-f360-48cf-b214-88cf7e1425e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 25 15:53:00 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-b5604aea-e995-4e4e-ba35-bce58746b160 tempest-DeleteServersTestJSON-1303484918 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (691714f0-c901-4cd1-884d-626b27b0f9cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 25 15:53:00 devstack cinder-volume[83528]: INFO cinder.volume.flows.manager.create_volume [None req-b5604aea-e995-4e4e-ba35-bce58746b160 tempest-DeleteServersTestJSON-1303484918 None] Volume c8004545-abad-47aa-b19f-8ad72ca17dbf: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c8004545-abad-47aa-b19f-8ad72ca17dbf', 'volume_size': 1} Feb 25 15:53:00 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-b5604aea-e995-4e4e-ba35-bce58746b160 tempest-DeleteServersTestJSON-1303484918 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 25 15:53:00 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-b5604aea-e995-4e4e-ba35-bce58746b160 tempest-DeleteServersTestJSON-1303484918 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 25 15:53:00 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.quobyte [None req-b5604aea-e995-4e4e-ba35-bce58746b160 tempest-DeleteServersTestJSON-1303484918 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-25T14:52:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-1181553363',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c8004545-abad-47aa-b19f-8ad72ca17dbf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c15024cc3cec468ca2476bc7e8cf2ac9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-25T14:53:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-25T14:53:00Z,use_quota=True,user_id='d3229c7327fd49e680582636139d9fe5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ce71c2f9-6543-4165-9653-a1529b2ea243),volume_type_id=ce71c2f9-6543-4165-9653-a1529b2ea243)}" {{(pid=83528) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 25 15:53:00 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.remotefs [None req-b5604aea-e995-4e4e-ba35-bce58746b160 tempest-DeleteServersTestJSON-1303484918 None] Creating volume c8004545-abad-47aa-b19f-8ad72ca17dbf {{(pid=83528) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 25 15:53:00 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-b5604aea-e995-4e4e-ba35-bce58746b160 tempest-DeleteServersTestJSON-1303484918 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 25 15:53:00 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-b5604aea-e995-4e4e-ba35-bce58746b160 tempest-DeleteServersTestJSON-1303484918 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 25 15:53:00 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.quobyte [None req-b5604aea-e995-4e4e-ba35-bce58746b160 tempest-DeleteServersTestJSON-1303484918 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23e9d725-3e04-4cd9-bfe0-c8ef43305589': None} {{(pid=83528) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 25 15:53:00 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.quobyte [None req-b5604aea-e995-4e4e-ba35-bce58746b160 tempest-DeleteServersTestJSON-1303484918 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23e9d725-3e04-4cd9-bfe0-c8ef43305589'] {{(pid=83528) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 25 15:53:00 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-b5604aea-e995-4e4e-ba35-bce58746b160 tempest-DeleteServersTestJSON-1303484918 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 25 15:53:00 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.quobyte [None req-b5604aea-e995-4e4e-ba35-bce58746b160 tempest-DeleteServersTestJSON-1303484918 None] Selected osci02.corp.quobyte.com/cinder-vol-23e9d725-3e04-4cd9-bfe0-c8ef43305589 as target Quobyte volume. {{(pid=83528) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 25 15:53:00 devstack cinder-volume[83528]: INFO cinder.volume.drivers.remotefs [None req-b5604aea-e995-4e4e-ba35-bce58746b160 tempest-DeleteServersTestJSON-1303484918 None] casted to osci02.corp.quobyte.com/cinder-vol-23e9d725-3e04-4cd9-bfe0-c8ef43305589 Feb 25 15:53:00 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-b5604aea-e995-4e4e-ba35-bce58746b160 tempest-DeleteServersTestJSON-1303484918 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-c8004545-abad-47aa-b19f-8ad72ca17dbf 1073741824 {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 25 15:53:00 devstack sudo[85153]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-c8004545-abad-47aa-b19f-8ad72ca17dbf 1073741824 Feb 25 15:53:00 devstack sudo[85153]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 25 15:53:00 devstack sudo[85144]: pam_unix(sudo:session): session closed for user root Feb 25 15:53:00 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-2819ecc8-7b6d-4b69-903b-1da593ec4974 tempest-ServerRescueNegativeTestJSON-1413502503 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85" returned: 0 in 1.384s {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 25 15:53:00 devstack cinder-volume[83528]: DEBUG cinder.manager [None req-2819ecc8-7b6d-4b69-903b-1da593ec4974 tempest-ServerRescueNegativeTestJSON-1413502503 None] Notifying Schedulers of capabilities ... {{(pid=83528) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 25 15:53:00 devstack cinder-volume[83528]: INFO cinder.volume.manager [None req-2819ecc8-7b6d-4b69-903b-1da593ec4974 tempest-ServerRescueNegativeTestJSON-1413502503 None] Deleted volume successfully. Feb 25 15:53:00 devstack cinder-volume[83528]: DEBUG cinder.coordination [None req-2819ecc8-7b6d-4b69-903b-1da593ec4974 tempest-ServerRescueNegativeTestJSON-1413502503 None] Lock "cinder-704eab97-a5ab-4d85-adc4-8c27f05c0283-delete_volume" released by "delete_volume" :: held 4.170s {{(pid=83528) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 25 15:53:02 devstack sudo[85153]: pam_unix(sudo:session): session closed for user root Feb 25 15:53:02 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-b5604aea-e995-4e4e-ba35-bce58746b160 tempest-DeleteServersTestJSON-1303484918 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-c8004545-abad-47aa-b19f-8ad72ca17dbf 1073741824" returned: 0 in 2.451s {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 25 15:53:02 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-b5604aea-e995-4e4e-ba35-bce58746b160 tempest-DeleteServersTestJSON-1303484918 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-c8004545-abad-47aa-b19f-8ad72ca17dbf {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 25 15:53:02 devstack sudo[85190]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-c8004545-abad-47aa-b19f-8ad72ca17dbf Feb 25 15:53:02 devstack sudo[85190]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 25 15:53:03 devstack sudo[85190]: pam_unix(sudo:session): session closed for user root Feb 25 15:53:03 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-b5604aea-e995-4e4e-ba35-bce58746b160 tempest-DeleteServersTestJSON-1303484918 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-c8004545-abad-47aa-b19f-8ad72ca17dbf" returned: 0 in 0.853s {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 25 15:53:03 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.quobyte [None req-b5604aea-e995-4e4e-ba35-bce58746b160 tempest-DeleteServersTestJSON-1303484918 None] <== create_volume: return (3364ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-23e9d725-3e04-4cd9-bfe0-c8ef43305589'} {{(pid=83528) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 25 15:53:03 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-b5604aea-e995-4e4e-ba35-bce58746b160 tempest-DeleteServersTestJSON-1303484918 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 3.366s {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 25 15:53:03 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-b5604aea-e995-4e4e-ba35-bce58746b160 tempest-DeleteServersTestJSON-1303484918 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (691714f0-c901-4cd1-884d-626b27b0f9cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c8004545-abad-47aa-b19f-8ad72ca17dbf', 'volume_size': 1}' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 25 15:53:03 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-b5604aea-e995-4e4e-ba35-bce58746b160 tempest-DeleteServersTestJSON-1303484918 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (07479551-7f8f-4daf-8cca-4af199b5fa30) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 25 15:53:03 devstack cinder-volume[83528]: INFO cinder.volume.flows.manager.create_volume [None req-b5604aea-e995-4e4e-ba35-bce58746b160 tempest-DeleteServersTestJSON-1303484918 None] Volume volume-c8004545-abad-47aa-b19f-8ad72ca17dbf (c8004545-abad-47aa-b19f-8ad72ca17dbf): created successfully Feb 25 15:53:03 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-b5604aea-e995-4e4e-ba35-bce58746b160 tempest-DeleteServersTestJSON-1303484918 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (07479551-7f8f-4daf-8cca-4af199b5fa30) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 25 15:53:03 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-b5604aea-e995-4e4e-ba35-bce58746b160 tempest-DeleteServersTestJSON-1303484918 None] Flow 'volume_create_manager' (fda2a400-0fdc-4c40-8ea4-1094df662a27) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83528) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 25 15:53:03 devstack cinder-volume[83528]: INFO cinder.volume.manager [None req-b5604aea-e995-4e4e-ba35-bce58746b160 tempest-DeleteServersTestJSON-1303484918 None] Created volume successfully. Feb 25 15:53:05 devstack cinder-volume[83528]: DEBUG cinder.volume.flows.manager.create_volume [req-eefd3c60-236f-4404-b786-b546bc2acf8d req-ace98fa6-841d-4d1c-8a0f-28cd0548f416 tempest-VolumesSnapshotsTestJSON-233960619 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83528) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 25 15:53:05 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [req-eefd3c60-236f-4404-b786-b546bc2acf8d req-ace98fa6-841d-4d1c-8a0f-28cd0548f416 tempest-VolumesSnapshotsTestJSON-233960619 None] Flow 'volume_create_manager' (5e79ce0b-715e-406e-8bca-eee3331ebd7b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83528) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 25 15:53:05 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [req-eefd3c60-236f-4404-b786-b546bc2acf8d req-ace98fa6-841d-4d1c-8a0f-28cd0548f416 tempest-VolumesSnapshotsTestJSON-233960619 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b919a211-60f5-42d0-83e3-7b18e657ab9f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 25 15:53:05 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [req-eefd3c60-236f-4404-b786-b546bc2acf8d req-ace98fa6-841d-4d1c-8a0f-28cd0548f416 tempest-VolumesSnapshotsTestJSON-233960619 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b919a211-60f5-42d0-83e3-7b18e657ab9f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-25T14:53:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-786732357',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d87ac27b-2b0b-432d-8b49-029f8d5d7243,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d2d204a80dc84e7987048f1ebdd4eefb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-25T14:53:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-25T14:53:05Z,use_quota=True,user_id='c81b399cb58947a59a40eea5c69b0623',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ce71c2f9-6543-4165-9653-a1529b2ea243),volume_type_id=ce71c2f9-6543-4165-9653-a1529b2ea243)' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 25 15:53:05 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [req-eefd3c60-236f-4404-b786-b546bc2acf8d req-ace98fa6-841d-4d1c-8a0f-28cd0548f416 tempest-VolumesSnapshotsTestJSON-233960619 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (26d22bfb-73e4-477b-93eb-38295daec73e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 25 15:53:05 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [req-eefd3c60-236f-4404-b786-b546bc2acf8d req-ace98fa6-841d-4d1c-8a0f-28cd0548f416 tempest-VolumesSnapshotsTestJSON-233960619 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (26d22bfb-73e4-477b-93eb-38295daec73e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 25 15:53:05 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [req-eefd3c60-236f-4404-b786-b546bc2acf8d req-ace98fa6-841d-4d1c-8a0f-28cd0548f416 tempest-VolumesSnapshotsTestJSON-233960619 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (71d0087d-3a78-4164-8c13-ba288acbcc6c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 25 15:53:05 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [req-eefd3c60-236f-4404-b786-b546bc2acf8d req-ace98fa6-841d-4d1c-8a0f-28cd0548f416 tempest-VolumesSnapshotsTestJSON-233960619 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (71d0087d-3a78-4164-8c13-ba288acbcc6c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd87ac27b-2b0b-432d-8b49-029f8d5d7243', 'volume_name': 'volume-d87ac27b-2b0b-432d-8b49-029f8d5d7243', 'volume_size': 1}' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 25 15:53:05 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [req-eefd3c60-236f-4404-b786-b546bc2acf8d req-ace98fa6-841d-4d1c-8a0f-28cd0548f416 tempest-VolumesSnapshotsTestJSON-233960619 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (be44a488-df1d-4c4a-8d25-bfb7ed95dbac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 25 15:53:05 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [req-eefd3c60-236f-4404-b786-b546bc2acf8d req-ace98fa6-841d-4d1c-8a0f-28cd0548f416 tempest-VolumesSnapshotsTestJSON-233960619 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (be44a488-df1d-4c4a-8d25-bfb7ed95dbac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 25 15:53:05 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [req-eefd3c60-236f-4404-b786-b546bc2acf8d req-ace98fa6-841d-4d1c-8a0f-28cd0548f416 tempest-VolumesSnapshotsTestJSON-233960619 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5180282e-e5a7-4eb3-ba4d-1a65532b8131) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 25 15:53:05 devstack cinder-volume[83528]: INFO cinder.volume.flows.manager.create_volume [req-eefd3c60-236f-4404-b786-b546bc2acf8d req-ace98fa6-841d-4d1c-8a0f-28cd0548f416 tempest-VolumesSnapshotsTestJSON-233960619 None] Volume d87ac27b-2b0b-432d-8b49-029f8d5d7243: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d87ac27b-2b0b-432d-8b49-029f8d5d7243', 'volume_size': 1} Feb 25 15:53:05 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [req-eefd3c60-236f-4404-b786-b546bc2acf8d req-ace98fa6-841d-4d1c-8a0f-28cd0548f416 tempest-VolumesSnapshotsTestJSON-233960619 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 25 15:53:05 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [req-eefd3c60-236f-4404-b786-b546bc2acf8d req-ace98fa6-841d-4d1c-8a0f-28cd0548f416 tempest-VolumesSnapshotsTestJSON-233960619 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 25 15:53:05 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.quobyte [req-eefd3c60-236f-4404-b786-b546bc2acf8d req-ace98fa6-841d-4d1c-8a0f-28cd0548f416 tempest-VolumesSnapshotsTestJSON-233960619 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-25T14:53:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-786732357',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d87ac27b-2b0b-432d-8b49-029f8d5d7243,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d2d204a80dc84e7987048f1ebdd4eefb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-25T14:53:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-25T14:53:05Z,use_quota=True,user_id='c81b399cb58947a59a40eea5c69b0623',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ce71c2f9-6543-4165-9653-a1529b2ea243),volume_type_id=ce71c2f9-6543-4165-9653-a1529b2ea243)}" {{(pid=83528) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 25 15:53:05 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.remotefs [req-eefd3c60-236f-4404-b786-b546bc2acf8d req-ace98fa6-841d-4d1c-8a0f-28cd0548f416 tempest-VolumesSnapshotsTestJSON-233960619 None] Creating volume d87ac27b-2b0b-432d-8b49-029f8d5d7243 {{(pid=83528) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 25 15:53:05 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [req-eefd3c60-236f-4404-b786-b546bc2acf8d req-ace98fa6-841d-4d1c-8a0f-28cd0548f416 tempest-VolumesSnapshotsTestJSON-233960619 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 25 15:53:05 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [req-eefd3c60-236f-4404-b786-b546bc2acf8d req-ace98fa6-841d-4d1c-8a0f-28cd0548f416 tempest-VolumesSnapshotsTestJSON-233960619 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 25 15:53:05 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.quobyte [req-eefd3c60-236f-4404-b786-b546bc2acf8d req-ace98fa6-841d-4d1c-8a0f-28cd0548f416 tempest-VolumesSnapshotsTestJSON-233960619 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23e9d725-3e04-4cd9-bfe0-c8ef43305589': None} {{(pid=83528) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 25 15:53:05 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.quobyte [req-eefd3c60-236f-4404-b786-b546bc2acf8d req-ace98fa6-841d-4d1c-8a0f-28cd0548f416 tempest-VolumesSnapshotsTestJSON-233960619 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23e9d725-3e04-4cd9-bfe0-c8ef43305589'] {{(pid=83528) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 25 15:53:05 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [req-eefd3c60-236f-4404-b786-b546bc2acf8d req-ace98fa6-841d-4d1c-8a0f-28cd0548f416 tempest-VolumesSnapshotsTestJSON-233960619 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 25 15:53:05 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.quobyte [req-eefd3c60-236f-4404-b786-b546bc2acf8d req-ace98fa6-841d-4d1c-8a0f-28cd0548f416 tempest-VolumesSnapshotsTestJSON-233960619 None] Selected osci02.corp.quobyte.com/cinder-vol-23e9d725-3e04-4cd9-bfe0-c8ef43305589 as target Quobyte volume. {{(pid=83528) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 25 15:53:05 devstack cinder-volume[83528]: INFO cinder.volume.drivers.remotefs [req-eefd3c60-236f-4404-b786-b546bc2acf8d req-ace98fa6-841d-4d1c-8a0f-28cd0548f416 tempest-VolumesSnapshotsTestJSON-233960619 None] casted to osci02.corp.quobyte.com/cinder-vol-23e9d725-3e04-4cd9-bfe0-c8ef43305589 Feb 25 15:53:05 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [req-eefd3c60-236f-4404-b786-b546bc2acf8d req-ace98fa6-841d-4d1c-8a0f-28cd0548f416 tempest-VolumesSnapshotsTestJSON-233960619 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-d87ac27b-2b0b-432d-8b49-029f8d5d7243 1073741824 {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 25 15:53:05 devstack sudo[85197]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-d87ac27b-2b0b-432d-8b49-029f8d5d7243 1073741824 Feb 25 15:53:05 devstack sudo[85197]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 25 15:53:06 devstack sudo[85197]: pam_unix(sudo:session): session closed for user root Feb 25 15:53:06 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [req-eefd3c60-236f-4404-b786-b546bc2acf8d req-ace98fa6-841d-4d1c-8a0f-28cd0548f416 tempest-VolumesSnapshotsTestJSON-233960619 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-d87ac27b-2b0b-432d-8b49-029f8d5d7243 1073741824" returned: 0 in 0.569s {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 25 15:53:06 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [req-eefd3c60-236f-4404-b786-b546bc2acf8d req-ace98fa6-841d-4d1c-8a0f-28cd0548f416 tempest-VolumesSnapshotsTestJSON-233960619 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-d87ac27b-2b0b-432d-8b49-029f8d5d7243 {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 25 15:53:06 devstack sudo[85202]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-d87ac27b-2b0b-432d-8b49-029f8d5d7243 Feb 25 15:53:06 devstack sudo[85202]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 25 15:53:06 devstack sudo[85202]: pam_unix(sudo:session): session closed for user root Feb 25 15:53:06 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [req-eefd3c60-236f-4404-b786-b546bc2acf8d req-ace98fa6-841d-4d1c-8a0f-28cd0548f416 tempest-VolumesSnapshotsTestJSON-233960619 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-d87ac27b-2b0b-432d-8b49-029f8d5d7243" returned: 0 in 0.575s {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 25 15:53:06 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.quobyte [req-eefd3c60-236f-4404-b786-b546bc2acf8d req-ace98fa6-841d-4d1c-8a0f-28cd0548f416 tempest-VolumesSnapshotsTestJSON-233960619 None] <== create_volume: return (1185ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-23e9d725-3e04-4cd9-bfe0-c8ef43305589'} {{(pid=83528) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 25 15:53:06 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [req-eefd3c60-236f-4404-b786-b546bc2acf8d req-ace98fa6-841d-4d1c-8a0f-28cd0548f416 tempest-VolumesSnapshotsTestJSON-233960619 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.187s {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 25 15:53:06 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [req-eefd3c60-236f-4404-b786-b546bc2acf8d req-ace98fa6-841d-4d1c-8a0f-28cd0548f416 tempest-VolumesSnapshotsTestJSON-233960619 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5180282e-e5a7-4eb3-ba4d-1a65532b8131) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d87ac27b-2b0b-432d-8b49-029f8d5d7243', 'volume_size': 1}' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 25 15:53:06 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [req-eefd3c60-236f-4404-b786-b546bc2acf8d req-ace98fa6-841d-4d1c-8a0f-28cd0548f416 tempest-VolumesSnapshotsTestJSON-233960619 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4dcc452f-1df6-4f0c-8ede-9f61b425f1fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 25 15:53:06 devstack cinder-volume[83528]: INFO cinder.volume.flows.manager.create_volume [req-eefd3c60-236f-4404-b786-b546bc2acf8d req-ace98fa6-841d-4d1c-8a0f-28cd0548f416 tempest-VolumesSnapshotsTestJSON-233960619 None] Volume volume-d87ac27b-2b0b-432d-8b49-029f8d5d7243 (d87ac27b-2b0b-432d-8b49-029f8d5d7243): created successfully Feb 25 15:53:06 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [req-eefd3c60-236f-4404-b786-b546bc2acf8d req-ace98fa6-841d-4d1c-8a0f-28cd0548f416 tempest-VolumesSnapshotsTestJSON-233960619 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4dcc452f-1df6-4f0c-8ede-9f61b425f1fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 25 15:53:06 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [req-eefd3c60-236f-4404-b786-b546bc2acf8d req-ace98fa6-841d-4d1c-8a0f-28cd0548f416 tempest-VolumesSnapshotsTestJSON-233960619 None] Flow 'volume_create_manager' (5e79ce0b-715e-406e-8bca-eee3331ebd7b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83528) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 25 15:53:06 devstack cinder-volume[83528]: INFO cinder.volume.manager [req-eefd3c60-236f-4404-b786-b546bc2acf8d req-ace98fa6-841d-4d1c-8a0f-28cd0548f416 tempest-VolumesSnapshotsTestJSON-233960619 None] Created volume successfully. Feb 25 15:53:07 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [req-e3e3d1dd-fbff-47ef-b162-a5df722b3eb7 req-5e3b2f62-21df-4f2a-8540-d96f661cee5e tempest-DeleteServersTestJSON-1303484918 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 25 15:53:07 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [req-e3e3d1dd-fbff-47ef-b162-a5df722b3eb7 req-5e3b2f62-21df-4f2a-8540-d96f661cee5e tempest-DeleteServersTestJSON-1303484918 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 25 15:53:07 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [req-19cec815-7b71-4e39-a525-db8a3569af25 req-e9d3365a-f22f-4e20-a260-85882bc9f1de tempest-VolumesSnapshotsTestJSON-233960619 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 25 15:53:07 devstack cinder-volume[83528]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2c8a750-d277-4330-9ca1-11050f55cde2]: (4, 'qcow2') {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 25 15:53:07 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [req-e3e3d1dd-fbff-47ef-b162-a5df722b3eb7 req-5e3b2f62-21df-4f2a-8540-d96f661cee5e tempest-DeleteServersTestJSON-1303484918 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-c8004545-abad-47aa-b19f-8ad72ca17dbf {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 25 15:53:07 devstack sudo[85237]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-c8004545-abad-47aa-b19f-8ad72ca17dbf Feb 25 15:53:07 devstack sudo[85237]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 25 15:53:08 devstack sudo[85237]: pam_unix(sudo:session): session closed for user root Feb 25 15:53:08 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [req-e3e3d1dd-fbff-47ef-b162-a5df722b3eb7 req-5e3b2f62-21df-4f2a-8540-d96f661cee5e tempest-DeleteServersTestJSON-1303484918 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-c8004545-abad-47aa-b19f-8ad72ca17dbf" returned: 0 in 0.932s {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 25 15:53:08 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [req-e3e3d1dd-fbff-47ef-b162-a5df722b3eb7 req-5e3b2f62-21df-4f2a-8540-d96f661cee5e tempest-DeleteServersTestJSON-1303484918 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.962s {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 25 15:53:08 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [req-19cec815-7b71-4e39-a525-db8a3569af25 req-e9d3365a-f22f-4e20-a260-85882bc9f1de tempest-VolumesSnapshotsTestJSON-233960619 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.951s {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 25 15:53:08 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.remotefs [req-19cec815-7b71-4e39-a525-db8a3569af25 req-e9d3365a-f22f-4e20-a260-85882bc9f1de tempest-VolumesSnapshotsTestJSON-233960619 None] Creating offline snapshot 5199eb46-ccff-4965-987a-87c71f3c6e9d of volume d87ac27b-2b0b-432d-8b49-029f8d5d7243 {{(pid=83528) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Feb 25 15:53:08 devstack cinder-volume[83528]: DEBUG oslo.privsep.daemon [-] privsep: reply[823f3209-0e5f-460c-aee1-5f3805abb52b]: (4, 'qcow2') {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 25 15:53:08 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [req-19cec815-7b71-4e39-a525-db8a3569af25 req-e9d3365a-f22f-4e20-a260-85882bc9f1de tempest-VolumesSnapshotsTestJSON-233960619 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-d87ac27b-2b0b-432d-8b49-029f8d5d7243 {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 25 15:53:08 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [req-e3e3d1dd-fbff-47ef-b162-a5df722b3eb7 req-5e3b2f62-21df-4f2a-8540-d96f661cee5e tempest-DeleteServersTestJSON-1303484918 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-23e9d725-3e04-4cd9-bfe0-c8ef43305589', 'name': 'volume-c8004545-abad-47aa-b19f-8ad72ca17dbf', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '1159dcc5-5a9c-495b-9703-67f8367672d6', 'enforce_multipath': True} {{(pid=83528) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Feb 25 15:53:08 devstack cinder-volume[83528]: INFO cinder.volume.manager [req-e3e3d1dd-fbff-47ef-b162-a5df722b3eb7 req-5e3b2f62-21df-4f2a-8540-d96f661cee5e tempest-DeleteServersTestJSON-1303484918 None] attachment_update completed successfully. Feb 25 15:53:08 devstack sudo[85245]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-d87ac27b-2b0b-432d-8b49-029f8d5d7243 Feb 25 15:53:08 devstack sudo[85245]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 25 15:53:09 devstack sudo[85245]: pam_unix(sudo:session): session closed for user root Feb 25 15:53:09 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [req-19cec815-7b71-4e39-a525-db8a3569af25 req-e9d3365a-f22f-4e20-a260-85882bc9f1de tempest-VolumesSnapshotsTestJSON-233960619 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-d87ac27b-2b0b-432d-8b49-029f8d5d7243" returned: 0 in 0.751s {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 25 15:53:09 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [req-19cec815-7b71-4e39-a525-db8a3569af25 req-e9d3365a-f22f-4e20-a260-85882bc9f1de tempest-VolumesSnapshotsTestJSON-233960619 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-d87ac27b-2b0b-432d-8b49-029f8d5d7243,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-d87ac27b-2b0b-432d-8b49-029f8d5d7243.5199eb46-ccff-4965-987a-87c71f3c6e9d 1G {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 25 15:53:09 devstack sudo[85252]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-d87ac27b-2b0b-432d-8b49-029f8d5d7243,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-d87ac27b-2b0b-432d-8b49-029f8d5d7243.5199eb46-ccff-4965-987a-87c71f3c6e9d 1G Feb 25 15:53:09 devstack sudo[85252]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 25 15:53:09 devstack cinder-volume[83528]: DEBUG dbcounter [-] [83528] Writing DB stats cinder:SELECT=36,cinder:UPDATE=27,cinder:DELETE=4,cinder:INSERT=8 {{(pid=83528) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Feb 25 15:53:09 devstack cinder-volume[83528]: DEBUG dbcounter [-] [83528] Writing DB stats cinder:UPDATE=43,cinder:SELECT=29,cinder:INSERT=5,cinder:DELETE=3 {{(pid=83528) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Feb 25 15:53:10 devstack sudo[85252]: pam_unix(sudo:session): session closed for user root Feb 25 15:53:10 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [req-19cec815-7b71-4e39-a525-db8a3569af25 req-e9d3365a-f22f-4e20-a260-85882bc9f1de tempest-VolumesSnapshotsTestJSON-233960619 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-d87ac27b-2b0b-432d-8b49-029f8d5d7243,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-d87ac27b-2b0b-432d-8b49-029f8d5d7243.5199eb46-ccff-4965-987a-87c71f3c6e9d 1G" returned: 0 in 1.132s {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 25 15:53:10 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [req-19cec815-7b71-4e39-a525-db8a3569af25 req-e9d3365a-f22f-4e20-a260-85882bc9f1de tempest-VolumesSnapshotsTestJSON-233960619 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d87ac27b-2b0b-432d-8b49-029f8d5d7243 -F qcow2 /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-d87ac27b-2b0b-432d-8b49-029f8d5d7243.5199eb46-ccff-4965-987a-87c71f3c6e9d {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 25 15:53:10 devstack sudo[85362]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d87ac27b-2b0b-432d-8b49-029f8d5d7243 -F qcow2 /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-d87ac27b-2b0b-432d-8b49-029f8d5d7243.5199eb46-ccff-4965-987a-87c71f3c6e9d Feb 25 15:53:10 devstack sudo[85362]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 25 15:53:10 devstack sudo[85362]: pam_unix(sudo:session): session closed for user root Feb 25 15:53:10 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [req-19cec815-7b71-4e39-a525-db8a3569af25 req-e9d3365a-f22f-4e20-a260-85882bc9f1de tempest-VolumesSnapshotsTestJSON-233960619 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d87ac27b-2b0b-432d-8b49-029f8d5d7243 -F qcow2 /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-d87ac27b-2b0b-432d-8b49-029f8d5d7243.5199eb46-ccff-4965-987a-87c71f3c6e9d" returned: 0 in 0.670s {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 25 15:53:10 devstack cinder-volume[83528]: WARNING cinder.volume.drivers.remotefs [req-19cec815-7b71-4e39-a525-db8a3569af25 req-e9d3365a-f22f-4e20-a260-85882bc9f1de tempest-VolumesSnapshotsTestJSON-233960619 None] /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-d87ac27b-2b0b-432d-8b49-029f8d5d7243.5199eb46-ccff-4965-987a-87c71f3c6e9d is being set with open permissions: ugo+rw Feb 25 15:53:10 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [req-19cec815-7b71-4e39-a525-db8a3569af25 req-e9d3365a-f22f-4e20-a260-85882bc9f1de tempest-VolumesSnapshotsTestJSON-233960619 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-d87ac27b-2b0b-432d-8b49-029f8d5d7243.5199eb46-ccff-4965-987a-87c71f3c6e9d {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 25 15:53:10 devstack sudo[85374]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-d87ac27b-2b0b-432d-8b49-029f8d5d7243.5199eb46-ccff-4965-987a-87c71f3c6e9d Feb 25 15:53:10 devstack sudo[85374]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 25 15:53:11 devstack sudo[85374]: pam_unix(sudo:session): session closed for user root Feb 25 15:53:11 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [req-19cec815-7b71-4e39-a525-db8a3569af25 req-e9d3365a-f22f-4e20-a260-85882bc9f1de tempest-VolumesSnapshotsTestJSON-233960619 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-d87ac27b-2b0b-432d-8b49-029f8d5d7243.5199eb46-ccff-4965-987a-87c71f3c6e9d" returned: 0 in 0.541s {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 25 15:53:11 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [req-19cec815-7b71-4e39-a525-db8a3569af25 req-e9d3365a-f22f-4e20-a260-85882bc9f1de tempest-VolumesSnapshotsTestJSON-233960619 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-d87ac27b-2b0b-432d-8b49-029f8d5d7243.info {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 25 15:53:11 devstack sudo[85387]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-d87ac27b-2b0b-432d-8b49-029f8d5d7243.info Feb 25 15:53:11 devstack sudo[85387]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 25 15:53:11 devstack sudo[85387]: pam_unix(sudo:session): session closed for user root Feb 25 15:53:11 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [req-19cec815-7b71-4e39-a525-db8a3569af25 req-e9d3365a-f22f-4e20-a260-85882bc9f1de tempest-VolumesSnapshotsTestJSON-233960619 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-d87ac27b-2b0b-432d-8b49-029f8d5d7243.info" returned: 0 in 0.564s {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 25 15:53:11 devstack cinder-volume[83528]: WARNING cinder.volume.drivers.remotefs [req-19cec815-7b71-4e39-a525-db8a3569af25 req-e9d3365a-f22f-4e20-a260-85882bc9f1de tempest-VolumesSnapshotsTestJSON-233960619 None] /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-d87ac27b-2b0b-432d-8b49-029f8d5d7243.info is being set with open permissions: ugo+rw Feb 25 15:53:11 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [req-19cec815-7b71-4e39-a525-db8a3569af25 req-e9d3365a-f22f-4e20-a260-85882bc9f1de tempest-VolumesSnapshotsTestJSON-233960619 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-d87ac27b-2b0b-432d-8b49-029f8d5d7243.info {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 25 15:53:12 devstack sudo[85394]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-d87ac27b-2b0b-432d-8b49-029f8d5d7243.info Feb 25 15:53:12 devstack sudo[85394]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 25 15:53:12 devstack sudo[85394]: pam_unix(sudo:session): session closed for user root Feb 25 15:53:12 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [req-19cec815-7b71-4e39-a525-db8a3569af25 req-e9d3365a-f22f-4e20-a260-85882bc9f1de tempest-VolumesSnapshotsTestJSON-233960619 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-d87ac27b-2b0b-432d-8b49-029f8d5d7243.info" returned: 0 in 0.466s {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 25 15:53:12 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [req-19cec815-7b71-4e39-a525-db8a3569af25 req-e9d3365a-f22f-4e20-a260-85882bc9f1de tempest-VolumesSnapshotsTestJSON-233960619 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.248s {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 25 15:53:12 devstack cinder-volume[83528]: INFO cinder.volume.manager [req-19cec815-7b71-4e39-a525-db8a3569af25 req-e9d3365a-f22f-4e20-a260-85882bc9f1de tempest-VolumesSnapshotsTestJSON-233960619 None] Create snapshot completed successfully Feb 25 15:53:13 devstack cinder-volume[83528]: DEBUG cinder.coordination [req-cf2bc7b1-9221-40e4-8e15-818ce87c0ccc req-39f2b5fa-c923-4e04-9a2e-152dcb369b98 tempest-VolumesSnapshotsTestJSON-233960619 None] Acquiring lock "cinder-5199eb46-ccff-4965-987a-87c71f3c6e9d-delete_snapshot" by "delete_snapshot" {{(pid=83528) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 25 15:53:13 devstack cinder-volume[83528]: DEBUG cinder.coordination [req-cf2bc7b1-9221-40e4-8e15-818ce87c0ccc req-39f2b5fa-c923-4e04-9a2e-152dcb369b98 tempest-VolumesSnapshotsTestJSON-233960619 None] Lock "cinder-5199eb46-ccff-4965-987a-87c71f3c6e9d-delete_snapshot" acquired by "delete_snapshot" :: waited 0.014s {{(pid=83528) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 25 15:53:13 devstack cinder-volume[83528]: DEBUG cinder.coordination [req-cf2bc7b1-9221-40e4-8e15-818ce87c0ccc req-39f2b5fa-c923-4e04-9a2e-152dcb369b98 tempest-VolumesSnapshotsTestJSON-233960619 None] Acquiring lock "cinder-quobyte-d87ac27b-2b0b-432d-8b49-029f8d5d7243" by "delete_snapshot" {{(pid=83528) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 25 15:53:13 devstack cinder-volume[83528]: DEBUG cinder.coordination [req-cf2bc7b1-9221-40e4-8e15-818ce87c0ccc req-39f2b5fa-c923-4e04-9a2e-152dcb369b98 tempest-VolumesSnapshotsTestJSON-233960619 None] Lock "cinder-quobyte-d87ac27b-2b0b-432d-8b49-029f8d5d7243" acquired by "delete_snapshot" :: waited 0.009s {{(pid=83528) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 25 15:53:13 devstack cinder-volume[83528]: DEBUG cinder.coordination [req-cf2bc7b1-9221-40e4-8e15-818ce87c0ccc req-39f2b5fa-c923-4e04-9a2e-152dcb369b98 tempest-VolumesSnapshotsTestJSON-233960619 None] Acquiring lock "cinder-quobyte-5199eb46-ccff-4965-987a-87c71f3c6e9d" by "_delete_snapshot" {{(pid=83528) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 25 15:53:13 devstack cinder-volume[83528]: DEBUG cinder.coordination [req-cf2bc7b1-9221-40e4-8e15-818ce87c0ccc req-39f2b5fa-c923-4e04-9a2e-152dcb369b98 tempest-VolumesSnapshotsTestJSON-233960619 None] Lock "cinder-quobyte-5199eb46-ccff-4965-987a-87c71f3c6e9d" acquired by "_delete_snapshot" :: waited 0.008s {{(pid=83528) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 25 15:53:13 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.remotefs [req-cf2bc7b1-9221-40e4-8e15-818ce87c0ccc req-39f2b5fa-c923-4e04-9a2e-152dcb369b98 tempest-VolumesSnapshotsTestJSON-233960619 None] Deleting offline snapshot 5199eb46-ccff-4965-987a-87c71f3c6e9d of volume d87ac27b-2b0b-432d-8b49-029f8d5d7243 {{(pid=83528) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Feb 25 15:53:13 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.remotefs [req-cf2bc7b1-9221-40e4-8e15-818ce87c0ccc req-39f2b5fa-c923-4e04-9a2e-152dcb369b98 tempest-VolumesSnapshotsTestJSON-233960619 None] snapshot_file for this snap is: volume-d87ac27b-2b0b-432d-8b49-029f8d5d7243.5199eb46-ccff-4965-987a-87c71f3c6e9d {{(pid=83528) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Feb 25 15:53:13 devstack cinder-volume[83528]: DEBUG oslo.privsep.daemon [-] privsep: reply[74a16071-b570-4791-833e-09020fa2645b]: (4, 'qcow2') {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 25 15:53:13 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [req-cf2bc7b1-9221-40e4-8e15-818ce87c0ccc req-39f2b5fa-c923-4e04-9a2e-152dcb369b98 tempest-VolumesSnapshotsTestJSON-233960619 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-d87ac27b-2b0b-432d-8b49-029f8d5d7243.5199eb46-ccff-4965-987a-87c71f3c6e9d {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 25 15:53:13 devstack sudo[85403]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-d87ac27b-2b0b-432d-8b49-029f8d5d7243.5199eb46-ccff-4965-987a-87c71f3c6e9d Feb 25 15:53:13 devstack sudo[85403]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 25 15:53:13 devstack sudo[85403]: pam_unix(sudo:session): session closed for user root Feb 25 15:53:13 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [req-cf2bc7b1-9221-40e4-8e15-818ce87c0ccc req-39f2b5fa-c923-4e04-9a2e-152dcb369b98 tempest-VolumesSnapshotsTestJSON-233960619 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-d87ac27b-2b0b-432d-8b49-029f8d5d7243.5199eb46-ccff-4965-987a-87c71f3c6e9d" returned: 0 in 0.669s {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 25 15:53:13 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.remotefs [req-cf2bc7b1-9221-40e4-8e15-818ce87c0ccc req-39f2b5fa-c923-4e04-9a2e-152dcb369b98 tempest-VolumesSnapshotsTestJSON-233960619 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d87ac27b-2b0b-432d-8b49-029f8d5d7243(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83528) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Feb 25 15:53:13 devstack cinder-volume[83528]: DEBUG oslo.privsep.daemon [-] privsep: reply[41c6bfc6-4dab-43d5-9073-362a80a9eb24]: (4, 'qcow2') {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 25 15:53:13 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [req-cf2bc7b1-9221-40e4-8e15-818ce87c0ccc req-39f2b5fa-c923-4e04-9a2e-152dcb369b98 tempest-VolumesSnapshotsTestJSON-233960619 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-d87ac27b-2b0b-432d-8b49-029f8d5d7243 {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 25 15:53:14 devstack sudo[85408]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-d87ac27b-2b0b-432d-8b49-029f8d5d7243 Feb 25 15:53:14 devstack sudo[85408]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 25 15:53:14 devstack sudo[85408]: pam_unix(sudo:session): session closed for user root Feb 25 15:53:14 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [req-cf2bc7b1-9221-40e4-8e15-818ce87c0ccc req-39f2b5fa-c923-4e04-9a2e-152dcb369b98 tempest-VolumesSnapshotsTestJSON-233960619 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-d87ac27b-2b0b-432d-8b49-029f8d5d7243" returned: 0 in 0.678s {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 25 15:53:14 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [req-cf2bc7b1-9221-40e4-8e15-818ce87c0ccc req-39f2b5fa-c923-4e04-9a2e-152dcb369b98 tempest-VolumesSnapshotsTestJSON-233960619 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-d87ac27b-2b0b-432d-8b49-029f8d5d7243.5199eb46-ccff-4965-987a-87c71f3c6e9d {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 25 15:53:14 devstack sudo[85460]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-d87ac27b-2b0b-432d-8b49-029f8d5d7243.5199eb46-ccff-4965-987a-87c71f3c6e9d Feb 25 15:53:14 devstack sudo[85460]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 25 15:53:15 devstack sudo[85460]: pam_unix(sudo:session): session closed for user root Feb 25 15:53:15 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [req-cf2bc7b1-9221-40e4-8e15-818ce87c0ccc req-39f2b5fa-c923-4e04-9a2e-152dcb369b98 tempest-VolumesSnapshotsTestJSON-233960619 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-d87ac27b-2b0b-432d-8b49-029f8d5d7243.5199eb46-ccff-4965-987a-87c71f3c6e9d" returned: 0 in 0.810s {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 25 15:53:15 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [req-cf2bc7b1-9221-40e4-8e15-818ce87c0ccc req-39f2b5fa-c923-4e04-9a2e-152dcb369b98 tempest-VolumesSnapshotsTestJSON-233960619 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-d87ac27b-2b0b-432d-8b49-029f8d5d7243.5199eb46-ccff-4965-987a-87c71f3c6e9d {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 25 15:53:15 devstack sudo[85469]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-d87ac27b-2b0b-432d-8b49-029f8d5d7243.5199eb46-ccff-4965-987a-87c71f3c6e9d Feb 25 15:53:15 devstack sudo[85469]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 25 15:53:15 devstack sudo[85469]: pam_unix(sudo:session): session closed for user root Feb 25 15:53:15 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [req-cf2bc7b1-9221-40e4-8e15-818ce87c0ccc req-39f2b5fa-c923-4e04-9a2e-152dcb369b98 tempest-VolumesSnapshotsTestJSON-233960619 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-d87ac27b-2b0b-432d-8b49-029f8d5d7243.5199eb46-ccff-4965-987a-87c71f3c6e9d" returned: 0 in 0.464s {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 25 15:53:15 devstack cinder-volume[83528]: DEBUG cinder.coordination [req-cf2bc7b1-9221-40e4-8e15-818ce87c0ccc req-39f2b5fa-c923-4e04-9a2e-152dcb369b98 tempest-VolumesSnapshotsTestJSON-233960619 None] Lock "cinder-quobyte-5199eb46-ccff-4965-987a-87c71f3c6e9d" released by "_delete_snapshot" :: held 2.717s {{(pid=83528) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 25 15:53:15 devstack cinder-volume[83528]: DEBUG cinder.coordination [req-cf2bc7b1-9221-40e4-8e15-818ce87c0ccc req-39f2b5fa-c923-4e04-9a2e-152dcb369b98 tempest-VolumesSnapshotsTestJSON-233960619 None] Lock "cinder-quobyte-d87ac27b-2b0b-432d-8b49-029f8d5d7243" released by "delete_snapshot" :: held 2.734s {{(pid=83528) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 25 15:53:16 devstack cinder-volume[83528]: WARNING cinder.quota [req-cf2bc7b1-9221-40e4-8e15-818ce87c0ccc req-39f2b5fa-c923-4e04-9a2e-152dcb369b98 tempest-VolumesSnapshotsTestJSON-233960619 None] Deprecated: Default quota for resource: snapshots_QuobyteHD is set by the default quota flag: quota_snapshots_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Feb 25 15:53:16 devstack cinder-volume[83528]: DEBUG cinder.quota [req-cf2bc7b1-9221-40e4-8e15-818ce87c0ccc req-39f2b5fa-c923-4e04-9a2e-152dcb369b98 tempest-VolumesSnapshotsTestJSON-233960619 None] Created reservations ['d1cc3cc1-6ddd-4750-b032-5c096ade1d27', '6544916b-31ae-45d8-9d49-4a6247a2a2c7', '960c2f15-987c-4033-afa4-502956e40e75', '500c33b4-679e-43b3-a42c-d92a134fe6fb'] {{(pid=83528) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 25 15:53:16 devstack cinder-volume[83528]: INFO cinder.volume.manager [req-cf2bc7b1-9221-40e4-8e15-818ce87c0ccc req-39f2b5fa-c923-4e04-9a2e-152dcb369b98 tempest-VolumesSnapshotsTestJSON-233960619 None] Delete snapshot completed successfully. Feb 25 15:53:16 devstack cinder-volume[83528]: DEBUG cinder.coordination [req-cf2bc7b1-9221-40e4-8e15-818ce87c0ccc req-39f2b5fa-c923-4e04-9a2e-152dcb369b98 tempest-VolumesSnapshotsTestJSON-233960619 None] Lock "cinder-5199eb46-ccff-4965-987a-87c71f3c6e9d-delete_snapshot" released by "delete_snapshot" :: held 2.876s {{(pid=83528) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 25 15:53:16 devstack cinder-volume[83528]: DEBUG cinder.coordination [req-8518d464-3047-42d3-a134-3d4ec92704c5 req-97e7d8bd-f8a4-4a68-91ea-51cd8ab58556 tempest-VolumesSnapshotsTestJSON-233960619 None] Acquiring lock "cinder-d87ac27b-2b0b-432d-8b49-029f8d5d7243-delete_volume" by "delete_volume" {{(pid=83528) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 25 15:53:16 devstack cinder-volume[83528]: DEBUG cinder.coordination [req-8518d464-3047-42d3-a134-3d4ec92704c5 req-97e7d8bd-f8a4-4a68-91ea-51cd8ab58556 tempest-VolumesSnapshotsTestJSON-233960619 None] Lock "cinder-d87ac27b-2b0b-432d-8b49-029f8d5d7243-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=83528) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 25 15:53:16 devstack cinder-volume[83528]: DEBUG cinder.coordination [req-8518d464-3047-42d3-a134-3d4ec92704c5 req-97e7d8bd-f8a4-4a68-91ea-51cd8ab58556 tempest-VolumesSnapshotsTestJSON-233960619 None] Acquiring lock "cinder-quobyte-d87ac27b-2b0b-432d-8b49-029f8d5d7243" by "delete_volume" {{(pid=83528) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 25 15:53:16 devstack cinder-volume[83528]: DEBUG cinder.coordination [req-8518d464-3047-42d3-a134-3d4ec92704c5 req-97e7d8bd-f8a4-4a68-91ea-51cd8ab58556 tempest-VolumesSnapshotsTestJSON-233960619 None] Lock "cinder-quobyte-d87ac27b-2b0b-432d-8b49-029f8d5d7243" acquired by "delete_volume" :: waited 0.009s {{(pid=83528) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 25 15:53:16 devstack cinder-volume[83528]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c5969a1-6f87-417f-97aa-e860e43e09a7]: (4, 'qcow2') {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 25 15:53:16 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [req-8518d464-3047-42d3-a134-3d4ec92704c5 req-97e7d8bd-f8a4-4a68-91ea-51cd8ab58556 tempest-VolumesSnapshotsTestJSON-233960619 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-d87ac27b-2b0b-432d-8b49-029f8d5d7243 {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 25 15:53:16 devstack sudo[85474]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-d87ac27b-2b0b-432d-8b49-029f8d5d7243 Feb 25 15:53:16 devstack sudo[85474]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 25 15:53:17 devstack sudo[85474]: pam_unix(sudo:session): session closed for user root Feb 25 15:53:17 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [req-8518d464-3047-42d3-a134-3d4ec92704c5 req-97e7d8bd-f8a4-4a68-91ea-51cd8ab58556 tempest-VolumesSnapshotsTestJSON-233960619 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-d87ac27b-2b0b-432d-8b49-029f8d5d7243" returned: 0 in 0.569s {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 25 15:53:17 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [req-8518d464-3047-42d3-a134-3d4ec92704c5 req-97e7d8bd-f8a4-4a68-91ea-51cd8ab58556 tempest-VolumesSnapshotsTestJSON-233960619 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-d87ac27b-2b0b-432d-8b49-029f8d5d7243 {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 25 15:53:17 devstack sudo[85479]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-d87ac27b-2b0b-432d-8b49-029f8d5d7243 Feb 25 15:53:17 devstack sudo[85479]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 25 15:53:17 devstack cinder-volume[83528]: INFO cinder.volume.manager [req-bd60fa53-320c-4e54-aed9-2ee9269ab30b req-eb67e734-dd48-4113-838b-b48a0053764b tempest-DeleteServersTestJSON-1303484918 None] Terminate volume connection completed successfully. Feb 25 15:53:17 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [req-bd60fa53-320c-4e54-aed9-2ee9269ab30b req-eb67e734-dd48-4113-838b-b48a0053764b tempest-DeleteServersTestJSON-1303484918 None] Deleting attachment 1159dcc5-5a9c-495b-9703-67f8367672d6. {{(pid=83528) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Feb 25 15:53:18 devstack sudo[85479]: pam_unix(sudo:session): session closed for user root Feb 25 15:53:18 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [req-8518d464-3047-42d3-a134-3d4ec92704c5 req-97e7d8bd-f8a4-4a68-91ea-51cd8ab58556 tempest-VolumesSnapshotsTestJSON-233960619 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-d87ac27b-2b0b-432d-8b49-029f8d5d7243" returned: 0 in 0.630s {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 25 15:53:18 devstack cinder-volume[83528]: DEBUG cinder.coordination [req-8518d464-3047-42d3-a134-3d4ec92704c5 req-97e7d8bd-f8a4-4a68-91ea-51cd8ab58556 tempest-VolumesSnapshotsTestJSON-233960619 None] Lock "cinder-quobyte-d87ac27b-2b0b-432d-8b49-029f8d5d7243" released by "delete_volume" :: held 1.259s {{(pid=83528) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 25 15:53:18 devstack cinder-volume[83528]: DEBUG cinder.quota [req-8518d464-3047-42d3-a134-3d4ec92704c5 req-97e7d8bd-f8a4-4a68-91ea-51cd8ab58556 tempest-VolumesSnapshotsTestJSON-233960619 None] Created reservations ['f5675102-2ab6-4fba-9ac6-afe36abc1578', '41c04b17-b8ef-4d50-9646-7123263f3a7a', 'bf683802-6736-401e-a0f5-6ce6ce3cdb42', '5d637a4f-b761-418c-b4e5-0ca8be466ac3'] {{(pid=83528) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 25 15:53:18 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [req-8518d464-3047-42d3-a134-3d4ec92704c5 req-97e7d8bd-f8a4-4a68-91ea-51cd8ab58556 tempest-VolumesSnapshotsTestJSON-233960619 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 25 15:53:18 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [req-8518d464-3047-42d3-a134-3d4ec92704c5 req-97e7d8bd-f8a4-4a68-91ea-51cd8ab58556 tempest-VolumesSnapshotsTestJSON-233960619 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 25 15:53:18 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.quobyte [req-8518d464-3047-42d3-a134-3d4ec92704c5 req-97e7d8bd-f8a4-4a68-91ea-51cd8ab58556 tempest-VolumesSnapshotsTestJSON-233960619 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23e9d725-3e04-4cd9-bfe0-c8ef43305589': None} {{(pid=83528) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 25 15:53:18 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.quobyte [req-8518d464-3047-42d3-a134-3d4ec92704c5 req-97e7d8bd-f8a4-4a68-91ea-51cd8ab58556 tempest-VolumesSnapshotsTestJSON-233960619 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23e9d725-3e04-4cd9-bfe0-c8ef43305589'] {{(pid=83528) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 25 15:53:18 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [req-8518d464-3047-42d3-a134-3d4ec92704c5 req-97e7d8bd-f8a4-4a68-91ea-51cd8ab58556 tempest-VolumesSnapshotsTestJSON-233960619 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 25 15:53:18 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [req-8518d464-3047-42d3-a134-3d4ec92704c5 req-97e7d8bd-f8a4-4a68-91ea-51cd8ab58556 tempest-VolumesSnapshotsTestJSON-233960619 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85 {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 25 15:53:18 devstack sudo[85483]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85 Feb 25 15:53:18 devstack sudo[85483]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 25 15:53:18 devstack sudo[85483]: pam_unix(sudo:session): session closed for user root Feb 25 15:53:18 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [req-8518d464-3047-42d3-a134-3d4ec92704c5 req-97e7d8bd-f8a4-4a68-91ea-51cd8ab58556 tempest-VolumesSnapshotsTestJSON-233960619 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85" returned: 0 in 0.461s {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 25 15:53:18 devstack cinder-volume[83528]: DEBUG cinder.manager [req-8518d464-3047-42d3-a134-3d4ec92704c5 req-97e7d8bd-f8a4-4a68-91ea-51cd8ab58556 tempest-VolumesSnapshotsTestJSON-233960619 None] Notifying Schedulers of capabilities ... {{(pid=83528) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 25 15:53:18 devstack cinder-volume[83528]: INFO cinder.volume.manager [req-8518d464-3047-42d3-a134-3d4ec92704c5 req-97e7d8bd-f8a4-4a68-91ea-51cd8ab58556 tempest-VolumesSnapshotsTestJSON-233960619 None] Deleted volume successfully. Feb 25 15:53:18 devstack cinder-volume[83528]: DEBUG cinder.coordination [req-8518d464-3047-42d3-a134-3d4ec92704c5 req-97e7d8bd-f8a4-4a68-91ea-51cd8ab58556 tempest-VolumesSnapshotsTestJSON-233960619 None] Lock "cinder-d87ac27b-2b0b-432d-8b49-029f8d5d7243-delete_volume" released by "delete_volume" :: held 1.926s {{(pid=83528) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 25 15:53:21 devstack cinder-volume[83528]: DEBUG cinder.coordination [None req-371af7e9-0351-49f6-8463-f7d5df5e71fa tempest-DeleteServersTestJSON-1303484918 None] Acquiring lock "cinder-c8004545-abad-47aa-b19f-8ad72ca17dbf-delete_volume" by "delete_volume" {{(pid=83528) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 25 15:53:21 devstack cinder-volume[83528]: DEBUG cinder.coordination [None req-371af7e9-0351-49f6-8463-f7d5df5e71fa tempest-DeleteServersTestJSON-1303484918 None] Lock "cinder-c8004545-abad-47aa-b19f-8ad72ca17dbf-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=83528) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 25 15:53:21 devstack cinder-volume[83528]: DEBUG cinder.coordination [None req-371af7e9-0351-49f6-8463-f7d5df5e71fa tempest-DeleteServersTestJSON-1303484918 None] Acquiring lock "cinder-quobyte-c8004545-abad-47aa-b19f-8ad72ca17dbf" by "delete_volume" {{(pid=83528) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 25 15:53:21 devstack cinder-volume[83528]: DEBUG cinder.coordination [None req-371af7e9-0351-49f6-8463-f7d5df5e71fa tempest-DeleteServersTestJSON-1303484918 None] Lock "cinder-quobyte-c8004545-abad-47aa-b19f-8ad72ca17dbf" acquired by "delete_volume" :: waited 0.006s {{(pid=83528) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 25 15:53:21 devstack cinder-volume[83528]: DEBUG oslo.privsep.daemon [-] privsep: reply[9144223f-7e8b-4bdd-9a16-719ae89cc1c2]: (4, 'qcow2') {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 25 15:53:21 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-371af7e9-0351-49f6-8463-f7d5df5e71fa tempest-DeleteServersTestJSON-1303484918 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-c8004545-abad-47aa-b19f-8ad72ca17dbf {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 25 15:53:21 devstack sudo[85534]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-c8004545-abad-47aa-b19f-8ad72ca17dbf Feb 25 15:53:21 devstack sudo[85534]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 25 15:53:22 devstack sudo[85534]: pam_unix(sudo:session): session closed for user root Feb 25 15:53:22 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-371af7e9-0351-49f6-8463-f7d5df5e71fa tempest-DeleteServersTestJSON-1303484918 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-c8004545-abad-47aa-b19f-8ad72ca17dbf" returned: 0 in 0.635s {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 25 15:53:22 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-371af7e9-0351-49f6-8463-f7d5df5e71fa tempest-DeleteServersTestJSON-1303484918 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-c8004545-abad-47aa-b19f-8ad72ca17dbf {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 25 15:53:22 devstack sudo[85542]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-c8004545-abad-47aa-b19f-8ad72ca17dbf Feb 25 15:53:22 devstack sudo[85542]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 25 15:53:22 devstack sudo[85542]: pam_unix(sudo:session): session closed for user root Feb 25 15:53:22 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-371af7e9-0351-49f6-8463-f7d5df5e71fa tempest-DeleteServersTestJSON-1303484918 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-c8004545-abad-47aa-b19f-8ad72ca17dbf" returned: 0 in 0.494s {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 25 15:53:22 devstack cinder-volume[83528]: DEBUG cinder.coordination [None req-371af7e9-0351-49f6-8463-f7d5df5e71fa tempest-DeleteServersTestJSON-1303484918 None] Lock "cinder-quobyte-c8004545-abad-47aa-b19f-8ad72ca17dbf" released by "delete_volume" :: held 1.167s {{(pid=83528) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 25 15:53:22 devstack cinder-volume[83528]: DEBUG cinder.quota [None req-371af7e9-0351-49f6-8463-f7d5df5e71fa tempest-DeleteServersTestJSON-1303484918 None] Created reservations ['417c6bc8-28f3-44b2-941a-d558a9ed9ca8', '9b057366-5ca8-4d3d-abe5-78891883d6f0', '2f0396fe-4b4c-42dc-8863-06905cb3e256', 'bc34d37b-ccfb-4e45-bb10-1019cf81e360'] {{(pid=83528) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 25 15:53:22 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-371af7e9-0351-49f6-8463-f7d5df5e71fa tempest-DeleteServersTestJSON-1303484918 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 25 15:53:22 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-371af7e9-0351-49f6-8463-f7d5df5e71fa tempest-DeleteServersTestJSON-1303484918 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 25 15:53:22 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.quobyte [None req-371af7e9-0351-49f6-8463-f7d5df5e71fa tempest-DeleteServersTestJSON-1303484918 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23e9d725-3e04-4cd9-bfe0-c8ef43305589': None} {{(pid=83528) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 25 15:53:22 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.quobyte [None req-371af7e9-0351-49f6-8463-f7d5df5e71fa tempest-DeleteServersTestJSON-1303484918 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23e9d725-3e04-4cd9-bfe0-c8ef43305589'] {{(pid=83528) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 25 15:53:22 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-371af7e9-0351-49f6-8463-f7d5df5e71fa tempest-DeleteServersTestJSON-1303484918 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 25 15:53:22 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-371af7e9-0351-49f6-8463-f7d5df5e71fa tempest-DeleteServersTestJSON-1303484918 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85 {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 25 15:53:22 devstack sudo[85545]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85 Feb 25 15:53:22 devstack sudo[85545]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 25 15:53:23 devstack cinder-volume[83528]: DEBUG cinder.volume.flows.manager.create_volume [req-63d1d273-0332-4bca-8326-cdff68670766 req-e89a3304-6c37-4760-a506-52de7fa61cec tempest-VolumesGetTestJSON-1212703739 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83528) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 25 15:53:23 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [req-63d1d273-0332-4bca-8326-cdff68670766 req-e89a3304-6c37-4760-a506-52de7fa61cec tempest-VolumesGetTestJSON-1212703739 None] Flow 'volume_create_manager' (d2a14ffc-ab40-461a-ad17-27c5fe098d24) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83528) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 25 15:53:23 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [req-63d1d273-0332-4bca-8326-cdff68670766 req-e89a3304-6c37-4760-a506-52de7fa61cec tempest-VolumesGetTestJSON-1212703739 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (809107bb-cfe3-4c69-88af-787837957556) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 25 15:53:23 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [req-63d1d273-0332-4bca-8326-cdff68670766 req-e89a3304-6c37-4760-a506-52de7fa61cec tempest-VolumesGetTestJSON-1212703739 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (809107bb-cfe3-4c69-88af-787837957556) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-25T14:53:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-2122652331',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=34512588-1b2f-46e0-a4fb-930bdb05b456,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='b6426033d30d4a3cbabe3e6c1da95965',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-25T14:53:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-25T14:53:23Z,use_quota=True,user_id='c15c5298d2584faeba1ffd29f555d11d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ce71c2f9-6543-4165-9653-a1529b2ea243),volume_type_id=ce71c2f9-6543-4165-9653-a1529b2ea243)' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 25 15:53:23 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [req-63d1d273-0332-4bca-8326-cdff68670766 req-e89a3304-6c37-4760-a506-52de7fa61cec tempest-VolumesGetTestJSON-1212703739 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1787d33c-9b0a-4d90-b87e-7e75a65eb248) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 25 15:53:23 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [req-63d1d273-0332-4bca-8326-cdff68670766 req-e89a3304-6c37-4760-a506-52de7fa61cec tempest-VolumesGetTestJSON-1212703739 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1787d33c-9b0a-4d90-b87e-7e75a65eb248) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 25 15:53:23 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [req-63d1d273-0332-4bca-8326-cdff68670766 req-e89a3304-6c37-4760-a506-52de7fa61cec tempest-VolumesGetTestJSON-1212703739 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (54c61a11-a28e-499c-9185-9c6ee7dcfb8b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 25 15:53:23 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [req-63d1d273-0332-4bca-8326-cdff68670766 req-e89a3304-6c37-4760-a506-52de7fa61cec tempest-VolumesGetTestJSON-1212703739 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (54c61a11-a28e-499c-9185-9c6ee7dcfb8b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '34512588-1b2f-46e0-a4fb-930bdb05b456', 'volume_name': 'volume-34512588-1b2f-46e0-a4fb-930bdb05b456', 'volume_size': 1}' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 25 15:53:23 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [req-63d1d273-0332-4bca-8326-cdff68670766 req-e89a3304-6c37-4760-a506-52de7fa61cec tempest-VolumesGetTestJSON-1212703739 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (afdd6138-27ad-4dcd-bfce-64bf2c05dfee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 25 15:53:23 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [req-63d1d273-0332-4bca-8326-cdff68670766 req-e89a3304-6c37-4760-a506-52de7fa61cec tempest-VolumesGetTestJSON-1212703739 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (afdd6138-27ad-4dcd-bfce-64bf2c05dfee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 25 15:53:23 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [req-63d1d273-0332-4bca-8326-cdff68670766 req-e89a3304-6c37-4760-a506-52de7fa61cec tempest-VolumesGetTestJSON-1212703739 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d99fdcac-8ddf-45a2-a5cc-8a64dafc9130) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 25 15:53:23 devstack cinder-volume[83528]: INFO cinder.volume.flows.manager.create_volume [req-63d1d273-0332-4bca-8326-cdff68670766 req-e89a3304-6c37-4760-a506-52de7fa61cec tempest-VolumesGetTestJSON-1212703739 None] Volume 34512588-1b2f-46e0-a4fb-930bdb05b456: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-34512588-1b2f-46e0-a4fb-930bdb05b456', 'volume_size': 1} Feb 25 15:53:23 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [req-63d1d273-0332-4bca-8326-cdff68670766 req-e89a3304-6c37-4760-a506-52de7fa61cec tempest-VolumesGetTestJSON-1212703739 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 25 15:53:23 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [req-63d1d273-0332-4bca-8326-cdff68670766 req-e89a3304-6c37-4760-a506-52de7fa61cec tempest-VolumesGetTestJSON-1212703739 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 25 15:53:23 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.quobyte [req-63d1d273-0332-4bca-8326-cdff68670766 req-e89a3304-6c37-4760-a506-52de7fa61cec tempest-VolumesGetTestJSON-1212703739 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-25T14:53:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-2122652331',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=34512588-1b2f-46e0-a4fb-930bdb05b456,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='b6426033d30d4a3cbabe3e6c1da95965',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-25T14:53:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-25T14:53:23Z,use_quota=True,user_id='c15c5298d2584faeba1ffd29f555d11d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ce71c2f9-6543-4165-9653-a1529b2ea243),volume_type_id=ce71c2f9-6543-4165-9653-a1529b2ea243)}" {{(pid=83528) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 25 15:53:23 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.remotefs [req-63d1d273-0332-4bca-8326-cdff68670766 req-e89a3304-6c37-4760-a506-52de7fa61cec tempest-VolumesGetTestJSON-1212703739 None] Creating volume 34512588-1b2f-46e0-a4fb-930bdb05b456 {{(pid=83528) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 25 15:53:23 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [req-63d1d273-0332-4bca-8326-cdff68670766 req-e89a3304-6c37-4760-a506-52de7fa61cec tempest-VolumesGetTestJSON-1212703739 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 25 15:53:23 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [req-63d1d273-0332-4bca-8326-cdff68670766 req-e89a3304-6c37-4760-a506-52de7fa61cec tempest-VolumesGetTestJSON-1212703739 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 25 15:53:23 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.quobyte [req-63d1d273-0332-4bca-8326-cdff68670766 req-e89a3304-6c37-4760-a506-52de7fa61cec tempest-VolumesGetTestJSON-1212703739 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23e9d725-3e04-4cd9-bfe0-c8ef43305589': None} {{(pid=83528) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 25 15:53:23 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.quobyte [req-63d1d273-0332-4bca-8326-cdff68670766 req-e89a3304-6c37-4760-a506-52de7fa61cec tempest-VolumesGetTestJSON-1212703739 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23e9d725-3e04-4cd9-bfe0-c8ef43305589'] {{(pid=83528) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 25 15:53:23 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [req-63d1d273-0332-4bca-8326-cdff68670766 req-e89a3304-6c37-4760-a506-52de7fa61cec tempest-VolumesGetTestJSON-1212703739 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 25 15:53:23 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.quobyte [req-63d1d273-0332-4bca-8326-cdff68670766 req-e89a3304-6c37-4760-a506-52de7fa61cec tempest-VolumesGetTestJSON-1212703739 None] Selected osci02.corp.quobyte.com/cinder-vol-23e9d725-3e04-4cd9-bfe0-c8ef43305589 as target Quobyte volume. {{(pid=83528) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 25 15:53:23 devstack cinder-volume[83528]: INFO cinder.volume.drivers.remotefs [req-63d1d273-0332-4bca-8326-cdff68670766 req-e89a3304-6c37-4760-a506-52de7fa61cec tempest-VolumesGetTestJSON-1212703739 None] casted to osci02.corp.quobyte.com/cinder-vol-23e9d725-3e04-4cd9-bfe0-c8ef43305589 Feb 25 15:53:23 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [req-63d1d273-0332-4bca-8326-cdff68670766 req-e89a3304-6c37-4760-a506-52de7fa61cec tempest-VolumesGetTestJSON-1212703739 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-34512588-1b2f-46e0-a4fb-930bdb05b456 1073741824 {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 25 15:53:23 devstack sudo[85547]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-34512588-1b2f-46e0-a4fb-930bdb05b456 1073741824 Feb 25 15:53:23 devstack sudo[85547]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 25 15:53:23 devstack sudo[85545]: pam_unix(sudo:session): session closed for user root Feb 25 15:53:23 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-371af7e9-0351-49f6-8463-f7d5df5e71fa tempest-DeleteServersTestJSON-1303484918 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85" returned: 0 in 0.508s {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 25 15:53:23 devstack cinder-volume[83528]: DEBUG cinder.manager [None req-371af7e9-0351-49f6-8463-f7d5df5e71fa tempest-DeleteServersTestJSON-1303484918 None] Notifying Schedulers of capabilities ... {{(pid=83528) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 25 15:53:23 devstack cinder-volume[83528]: INFO cinder.volume.manager [None req-371af7e9-0351-49f6-8463-f7d5df5e71fa tempest-DeleteServersTestJSON-1303484918 None] Deleted volume successfully. Feb 25 15:53:23 devstack cinder-volume[83528]: DEBUG cinder.coordination [None req-371af7e9-0351-49f6-8463-f7d5df5e71fa tempest-DeleteServersTestJSON-1303484918 None] Lock "cinder-c8004545-abad-47aa-b19f-8ad72ca17dbf-delete_volume" released by "delete_volume" :: held 1.837s {{(pid=83528) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 25 15:53:23 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-e7e77735-ab2e-4147-9f5d-1fc800382217 tempest-BackendsCapabilitiesAdminTestsJSON-1378984651 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.6299057006836, 'free_capacity_gb': 1775.6299057006836, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=83528) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Feb 25 15:53:23 devstack sudo[85547]: pam_unix(sudo:session): session closed for user root Feb 25 15:53:23 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [req-63d1d273-0332-4bca-8326-cdff68670766 req-e89a3304-6c37-4760-a506-52de7fa61cec tempest-VolumesGetTestJSON-1212703739 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-34512588-1b2f-46e0-a4fb-930bdb05b456 1073741824" returned: 0 in 0.569s {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 25 15:53:23 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [req-63d1d273-0332-4bca-8326-cdff68670766 req-e89a3304-6c37-4760-a506-52de7fa61cec tempest-VolumesGetTestJSON-1212703739 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-34512588-1b2f-46e0-a4fb-930bdb05b456 {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 25 15:53:23 devstack sudo[85553]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-34512588-1b2f-46e0-a4fb-930bdb05b456 Feb 25 15:53:23 devstack sudo[85553]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 25 15:53:24 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-c97f9ca2-c559-4b65-bd27-5be99dc901a9 tempest-BackendsCapabilitiesAdminTestsJSON-1378984651 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.6299057006836, 'free_capacity_gb': 1775.6299057006836, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=83528) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Feb 25 15:53:24 devstack sudo[85553]: pam_unix(sudo:session): session closed for user root Feb 25 15:53:24 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [req-63d1d273-0332-4bca-8326-cdff68670766 req-e89a3304-6c37-4760-a506-52de7fa61cec tempest-VolumesGetTestJSON-1212703739 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-34512588-1b2f-46e0-a4fb-930bdb05b456" returned: 0 in 0.480s {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 25 15:53:24 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.quobyte [req-63d1d273-0332-4bca-8326-cdff68670766 req-e89a3304-6c37-4760-a506-52de7fa61cec tempest-VolumesGetTestJSON-1212703739 None] <== create_volume: return (1077ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-23e9d725-3e04-4cd9-bfe0-c8ef43305589'} {{(pid=83528) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 25 15:53:24 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [req-63d1d273-0332-4bca-8326-cdff68670766 req-e89a3304-6c37-4760-a506-52de7fa61cec tempest-VolumesGetTestJSON-1212703739 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.079s {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 25 15:53:24 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [req-63d1d273-0332-4bca-8326-cdff68670766 req-e89a3304-6c37-4760-a506-52de7fa61cec tempest-VolumesGetTestJSON-1212703739 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d99fdcac-8ddf-45a2-a5cc-8a64dafc9130) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-34512588-1b2f-46e0-a4fb-930bdb05b456', 'volume_size': 1}' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 25 15:53:24 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [req-63d1d273-0332-4bca-8326-cdff68670766 req-e89a3304-6c37-4760-a506-52de7fa61cec tempest-VolumesGetTestJSON-1212703739 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (68d11af0-9f94-4d31-8ff3-3003e2a69112) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 25 15:53:24 devstack cinder-volume[83528]: INFO cinder.volume.flows.manager.create_volume [req-63d1d273-0332-4bca-8326-cdff68670766 req-e89a3304-6c37-4760-a506-52de7fa61cec tempest-VolumesGetTestJSON-1212703739 None] Volume volume-34512588-1b2f-46e0-a4fb-930bdb05b456 (34512588-1b2f-46e0-a4fb-930bdb05b456): created successfully Feb 25 15:53:24 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [req-63d1d273-0332-4bca-8326-cdff68670766 req-e89a3304-6c37-4760-a506-52de7fa61cec tempest-VolumesGetTestJSON-1212703739 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (68d11af0-9f94-4d31-8ff3-3003e2a69112) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 25 15:53:24 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [req-63d1d273-0332-4bca-8326-cdff68670766 req-e89a3304-6c37-4760-a506-52de7fa61cec tempest-VolumesGetTestJSON-1212703739 None] Flow 'volume_create_manager' (d2a14ffc-ab40-461a-ad17-27c5fe098d24) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83528) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 25 15:53:24 devstack cinder-volume[83528]: INFO cinder.volume.manager [req-63d1d273-0332-4bca-8326-cdff68670766 req-e89a3304-6c37-4760-a506-52de7fa61cec tempest-VolumesGetTestJSON-1212703739 None] Created volume successfully. Feb 25 15:53:25 devstack cinder-volume[83528]: DEBUG cinder.coordination [req-8e0ff8da-c011-469d-a0ce-98ac66c6a2c7 req-f9e0bf62-4fe0-40f1-84ae-35c8d947075f tempest-VolumesGetTestJSON-1212703739 None] Acquiring lock "cinder-34512588-1b2f-46e0-a4fb-930bdb05b456-delete_volume" by "delete_volume" {{(pid=83528) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 25 15:53:25 devstack cinder-volume[83528]: DEBUG cinder.coordination [req-8e0ff8da-c011-469d-a0ce-98ac66c6a2c7 req-f9e0bf62-4fe0-40f1-84ae-35c8d947075f tempest-VolumesGetTestJSON-1212703739 None] Lock "cinder-34512588-1b2f-46e0-a4fb-930bdb05b456-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=83528) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 25 15:53:25 devstack cinder-volume[83528]: DEBUG cinder.coordination [req-8e0ff8da-c011-469d-a0ce-98ac66c6a2c7 req-f9e0bf62-4fe0-40f1-84ae-35c8d947075f tempest-VolumesGetTestJSON-1212703739 None] Acquiring lock "cinder-quobyte-34512588-1b2f-46e0-a4fb-930bdb05b456" by "delete_volume" {{(pid=83528) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 25 15:53:25 devstack cinder-volume[83528]: DEBUG cinder.coordination [req-8e0ff8da-c011-469d-a0ce-98ac66c6a2c7 req-f9e0bf62-4fe0-40f1-84ae-35c8d947075f tempest-VolumesGetTestJSON-1212703739 None] Lock "cinder-quobyte-34512588-1b2f-46e0-a4fb-930bdb05b456" acquired by "delete_volume" :: waited 0.010s {{(pid=83528) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 25 15:53:25 devstack cinder-volume[83528]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd89fe3c-ee0f-48a8-af58-ab8be37f0f01]: (4, 'qcow2') {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 25 15:53:25 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [req-8e0ff8da-c011-469d-a0ce-98ac66c6a2c7 req-f9e0bf62-4fe0-40f1-84ae-35c8d947075f tempest-VolumesGetTestJSON-1212703739 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-34512588-1b2f-46e0-a4fb-930bdb05b456 {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 25 15:53:25 devstack sudo[85558]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-34512588-1b2f-46e0-a4fb-930bdb05b456 Feb 25 15:53:25 devstack sudo[85558]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 25 15:53:26 devstack sudo[85558]: pam_unix(sudo:session): session closed for user root Feb 25 15:53:26 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [req-8e0ff8da-c011-469d-a0ce-98ac66c6a2c7 req-f9e0bf62-4fe0-40f1-84ae-35c8d947075f tempest-VolumesGetTestJSON-1212703739 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-34512588-1b2f-46e0-a4fb-930bdb05b456" returned: 0 in 0.576s {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 25 15:53:26 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [req-8e0ff8da-c011-469d-a0ce-98ac66c6a2c7 req-f9e0bf62-4fe0-40f1-84ae-35c8d947075f tempest-VolumesGetTestJSON-1212703739 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-34512588-1b2f-46e0-a4fb-930bdb05b456 {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 25 15:53:26 devstack sudo[85563]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-34512588-1b2f-46e0-a4fb-930bdb05b456 Feb 25 15:53:26 devstack sudo[85563]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 25 15:53:26 devstack sudo[85563]: pam_unix(sudo:session): session closed for user root Feb 25 15:53:26 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [req-8e0ff8da-c011-469d-a0ce-98ac66c6a2c7 req-f9e0bf62-4fe0-40f1-84ae-35c8d947075f tempest-VolumesGetTestJSON-1212703739 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-34512588-1b2f-46e0-a4fb-930bdb05b456" returned: 0 in 0.573s {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 25 15:53:26 devstack cinder-volume[83528]: DEBUG cinder.coordination [req-8e0ff8da-c011-469d-a0ce-98ac66c6a2c7 req-f9e0bf62-4fe0-40f1-84ae-35c8d947075f tempest-VolumesGetTestJSON-1212703739 None] Lock "cinder-quobyte-34512588-1b2f-46e0-a4fb-930bdb05b456" released by "delete_volume" :: held 1.178s {{(pid=83528) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 25 15:53:26 devstack cinder-volume[83528]: DEBUG cinder.quota [req-8e0ff8da-c011-469d-a0ce-98ac66c6a2c7 req-f9e0bf62-4fe0-40f1-84ae-35c8d947075f tempest-VolumesGetTestJSON-1212703739 None] Created reservations ['79500695-59eb-4719-b793-7268c1edbe95', '35a188c5-0df0-46a1-83dc-ded3d84e967c', '2b64238f-9eae-4ac4-8658-c65707dc38f4', 'fd3fbfb8-08d9-4352-abec-152496bea2c0'] {{(pid=83528) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 25 15:53:26 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [req-8e0ff8da-c011-469d-a0ce-98ac66c6a2c7 req-f9e0bf62-4fe0-40f1-84ae-35c8d947075f tempest-VolumesGetTestJSON-1212703739 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 25 15:53:26 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [req-8e0ff8da-c011-469d-a0ce-98ac66c6a2c7 req-f9e0bf62-4fe0-40f1-84ae-35c8d947075f tempest-VolumesGetTestJSON-1212703739 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 25 15:53:26 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.quobyte [req-8e0ff8da-c011-469d-a0ce-98ac66c6a2c7 req-f9e0bf62-4fe0-40f1-84ae-35c8d947075f tempest-VolumesGetTestJSON-1212703739 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23e9d725-3e04-4cd9-bfe0-c8ef43305589': None} {{(pid=83528) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 25 15:53:26 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.quobyte [req-8e0ff8da-c011-469d-a0ce-98ac66c6a2c7 req-f9e0bf62-4fe0-40f1-84ae-35c8d947075f tempest-VolumesGetTestJSON-1212703739 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23e9d725-3e04-4cd9-bfe0-c8ef43305589'] {{(pid=83528) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 25 15:53:26 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [req-8e0ff8da-c011-469d-a0ce-98ac66c6a2c7 req-f9e0bf62-4fe0-40f1-84ae-35c8d947075f tempest-VolumesGetTestJSON-1212703739 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 25 15:53:26 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [req-8e0ff8da-c011-469d-a0ce-98ac66c6a2c7 req-f9e0bf62-4fe0-40f1-84ae-35c8d947075f tempest-VolumesGetTestJSON-1212703739 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85 {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 25 15:53:26 devstack sudo[85566]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85 Feb 25 15:53:26 devstack sudo[85566]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 25 15:53:27 devstack sudo[85566]: pam_unix(sudo:session): session closed for user root Feb 25 15:53:27 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [req-8e0ff8da-c011-469d-a0ce-98ac66c6a2c7 req-f9e0bf62-4fe0-40f1-84ae-35c8d947075f tempest-VolumesGetTestJSON-1212703739 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85" returned: 0 in 0.503s {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 25 15:53:27 devstack cinder-volume[83528]: DEBUG cinder.manager [req-8e0ff8da-c011-469d-a0ce-98ac66c6a2c7 req-f9e0bf62-4fe0-40f1-84ae-35c8d947075f tempest-VolumesGetTestJSON-1212703739 None] Notifying Schedulers of capabilities ... {{(pid=83528) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 25 15:53:27 devstack cinder-volume[83528]: INFO cinder.volume.manager [req-8e0ff8da-c011-469d-a0ce-98ac66c6a2c7 req-f9e0bf62-4fe0-40f1-84ae-35c8d947075f tempest-VolumesGetTestJSON-1212703739 None] Deleted volume successfully. Feb 25 15:53:27 devstack cinder-volume[83528]: DEBUG cinder.coordination [req-8e0ff8da-c011-469d-a0ce-98ac66c6a2c7 req-f9e0bf62-4fe0-40f1-84ae-35c8d947075f tempest-VolumesGetTestJSON-1212703739 None] Lock "cinder-34512588-1b2f-46e0-a4fb-930bdb05b456-delete_volume" released by "delete_volume" :: held 1.874s {{(pid=83528) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 25 15:53:29 devstack cinder-volume[83528]: INFO cinder.volume.manager [None req-4fd2bdff-1862-45a3-8a24-8de119d52367 tempest-GroupSnapshotsTest-1779717395 None] Group tempest-GroupSnapshotsTest-Group-1657025960: creating Feb 25 15:53:29 devstack cinder-volume[83528]: INFO cinder.volume.manager [None req-4fd2bdff-1862-45a3-8a24-8de119d52367 tempest-GroupSnapshotsTest-1779717395 None] Group tempest-GroupSnapshotsTest-Group-1657025960: created successfully Feb 25 15:53:29 devstack cinder-volume[83528]: INFO cinder.volume.manager [None req-4fd2bdff-1862-45a3-8a24-8de119d52367 tempest-GroupSnapshotsTest-1779717395 None] Create group completed successfully. Feb 25 15:53:30 devstack cinder-volume[83528]: DEBUG cinder.volume.flows.manager.create_volume [None req-b4c20c5a-52c1-49ec-8224-46c7512b7161 tempest-GroupSnapshotsTest-1779717395 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83528) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 25 15:53:30 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-b4c20c5a-52c1-49ec-8224-46c7512b7161 tempest-GroupSnapshotsTest-1779717395 None] Flow 'volume_create_manager' (23f56774-a19c-474a-b5dc-d9bcf8f12bd7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83528) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 25 15:53:30 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-b4c20c5a-52c1-49ec-8224-46c7512b7161 tempest-GroupSnapshotsTest-1779717395 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (443948ca-4a64-4c54-89f6-60f0c7010644) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 25 15:53:30 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-b4c20c5a-52c1-49ec-8224-46c7512b7161 tempest-GroupSnapshotsTest-1779717395 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (443948ca-4a64-4c54-89f6-60f0c7010644) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-25T14:53:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-58301028',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=71c51051-01ed-4b7c-8b01-7818b0801b23,host='devstack@QuobyteHD#QuobyteHD',id=f8e0e2db-f0ad-421c-bb36-a1d39b35fb1c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3827b9375d3e4b44a95020c555372a80',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-25T14:53:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-25T14:53:31Z,use_quota=True,user_id='99d268450fcd419cab908aed8018b7e2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a4c05e58-9468-433b-80d3-c397548225d2),volume_type_id=a4c05e58-9468-433b-80d3-c397548225d2)' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 25 15:53:30 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-b4c20c5a-52c1-49ec-8224-46c7512b7161 tempest-GroupSnapshotsTest-1779717395 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (781a9d56-7c0c-47bb-aa84-5d86e6bc8ed2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 25 15:53:30 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-b4c20c5a-52c1-49ec-8224-46c7512b7161 tempest-GroupSnapshotsTest-1779717395 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (781a9d56-7c0c-47bb-aa84-5d86e6bc8ed2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 25 15:53:30 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-b4c20c5a-52c1-49ec-8224-46c7512b7161 tempest-GroupSnapshotsTest-1779717395 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f221af58-f273-42b8-bc3a-ce75a4e599ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 25 15:53:30 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-b4c20c5a-52c1-49ec-8224-46c7512b7161 tempest-GroupSnapshotsTest-1779717395 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f221af58-f273-42b8-bc3a-ce75a4e599ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f8e0e2db-f0ad-421c-bb36-a1d39b35fb1c', 'volume_name': 'volume-f8e0e2db-f0ad-421c-bb36-a1d39b35fb1c', 'volume_size': 1}' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 25 15:53:30 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-b4c20c5a-52c1-49ec-8224-46c7512b7161 tempest-GroupSnapshotsTest-1779717395 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a0134e2c-0c00-4ea7-b1e4-8b2f510ccd00) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 25 15:53:30 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-b4c20c5a-52c1-49ec-8224-46c7512b7161 tempest-GroupSnapshotsTest-1779717395 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a0134e2c-0c00-4ea7-b1e4-8b2f510ccd00) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 25 15:53:30 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-b4c20c5a-52c1-49ec-8224-46c7512b7161 tempest-GroupSnapshotsTest-1779717395 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2ecdad51-dd85-42fc-b308-940df74f786a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 25 15:53:30 devstack cinder-volume[83528]: INFO cinder.volume.flows.manager.create_volume [None req-b4c20c5a-52c1-49ec-8224-46c7512b7161 tempest-GroupSnapshotsTest-1779717395 None] Volume f8e0e2db-f0ad-421c-bb36-a1d39b35fb1c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f8e0e2db-f0ad-421c-bb36-a1d39b35fb1c', 'volume_size': 1} Feb 25 15:53:30 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-b4c20c5a-52c1-49ec-8224-46c7512b7161 tempest-GroupSnapshotsTest-1779717395 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 25 15:53:30 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-b4c20c5a-52c1-49ec-8224-46c7512b7161 tempest-GroupSnapshotsTest-1779717395 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 25 15:53:30 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.quobyte [None req-b4c20c5a-52c1-49ec-8224-46c7512b7161 tempest-GroupSnapshotsTest-1779717395 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=71c51051-01ed-4b7c-8b01-7818b0801b23,created_at=2026-02-25T14:53:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-58301028',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=71c51051-01ed-4b7c-8b01-7818b0801b23,host='devstack@QuobyteHD#QuobyteHD',id=f8e0e2db-f0ad-421c-bb36-a1d39b35fb1c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3827b9375d3e4b44a95020c555372a80',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-25T14:53:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-25T14:53:31Z,use_quota=True,user_id='99d268450fcd419cab908aed8018b7e2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a4c05e58-9468-433b-80d3-c397548225d2),volume_type_id=a4c05e58-9468-433b-80d3-c397548225d2)}" {{(pid=83528) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 25 15:53:30 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.remotefs [None req-b4c20c5a-52c1-49ec-8224-46c7512b7161 tempest-GroupSnapshotsTest-1779717395 None] Creating volume f8e0e2db-f0ad-421c-bb36-a1d39b35fb1c {{(pid=83528) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 25 15:53:30 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-b4c20c5a-52c1-49ec-8224-46c7512b7161 tempest-GroupSnapshotsTest-1779717395 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 25 15:53:30 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-b4c20c5a-52c1-49ec-8224-46c7512b7161 tempest-GroupSnapshotsTest-1779717395 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 25 15:53:30 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.quobyte [None req-b4c20c5a-52c1-49ec-8224-46c7512b7161 tempest-GroupSnapshotsTest-1779717395 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23e9d725-3e04-4cd9-bfe0-c8ef43305589': None} {{(pid=83528) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 25 15:53:30 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.quobyte [None req-b4c20c5a-52c1-49ec-8224-46c7512b7161 tempest-GroupSnapshotsTest-1779717395 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23e9d725-3e04-4cd9-bfe0-c8ef43305589'] {{(pid=83528) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 25 15:53:30 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-b4c20c5a-52c1-49ec-8224-46c7512b7161 tempest-GroupSnapshotsTest-1779717395 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 25 15:53:30 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.quobyte [None req-b4c20c5a-52c1-49ec-8224-46c7512b7161 tempest-GroupSnapshotsTest-1779717395 None] Selected osci02.corp.quobyte.com/cinder-vol-23e9d725-3e04-4cd9-bfe0-c8ef43305589 as target Quobyte volume. {{(pid=83528) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 25 15:53:30 devstack cinder-volume[83528]: INFO cinder.volume.drivers.remotefs [None req-b4c20c5a-52c1-49ec-8224-46c7512b7161 tempest-GroupSnapshotsTest-1779717395 None] casted to osci02.corp.quobyte.com/cinder-vol-23e9d725-3e04-4cd9-bfe0-c8ef43305589 Feb 25 15:53:30 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-b4c20c5a-52c1-49ec-8224-46c7512b7161 tempest-GroupSnapshotsTest-1779717395 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-f8e0e2db-f0ad-421c-bb36-a1d39b35fb1c 1073741824 {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 25 15:53:30 devstack sudo[85587]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-f8e0e2db-f0ad-421c-bb36-a1d39b35fb1c 1073741824 Feb 25 15:53:30 devstack sudo[85587]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 25 15:53:31 devstack cinder-volume[83528]: DEBUG cinder.volume.flows.manager.create_volume [None req-b628020c-795d-490b-b260-0a46846e130d tempest-VolumesTestJSON-1115907172 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83528) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 25 15:53:31 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-b628020c-795d-490b-b260-0a46846e130d tempest-VolumesTestJSON-1115907172 None] Flow 'volume_create_manager' (54da97a9-deec-46c9-8cfa-83cbeae88305) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83528) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 25 15:53:31 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-b628020c-795d-490b-b260-0a46846e130d tempest-VolumesTestJSON-1115907172 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (19a5e7c0-1fe0-4376-9f06-32cc60dc3be1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 25 15:53:31 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-b628020c-795d-490b-b260-0a46846e130d tempest-VolumesTestJSON-1115907172 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (19a5e7c0-1fe0-4376-9f06-32cc60dc3be1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-25T14:53:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1157634821',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=de2b4aad-ea86-4277-9515-6bb0c66d63c6,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='65bfee69eeef4d49b0c1914aba9c4b44',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-25T14:53:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-25T14:53:31Z,use_quota=True,user_id='30394fa5276a41fd9a95ca3f6bb9f2a4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ce71c2f9-6543-4165-9653-a1529b2ea243),volume_type_id=ce71c2f9-6543-4165-9653-a1529b2ea243)' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 25 15:53:31 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-b628020c-795d-490b-b260-0a46846e130d tempest-VolumesTestJSON-1115907172 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (573637ec-7e84-418a-8bfc-9a15ccbcf062) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 25 15:53:31 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-b628020c-795d-490b-b260-0a46846e130d tempest-VolumesTestJSON-1115907172 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (573637ec-7e84-418a-8bfc-9a15ccbcf062) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 25 15:53:31 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-b628020c-795d-490b-b260-0a46846e130d tempest-VolumesTestJSON-1115907172 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0ef4b43e-e6bd-4175-9372-387fa254f660) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 25 15:53:31 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-b628020c-795d-490b-b260-0a46846e130d tempest-VolumesTestJSON-1115907172 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0ef4b43e-e6bd-4175-9372-387fa254f660) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'de2b4aad-ea86-4277-9515-6bb0c66d63c6', 'volume_name': 'volume-de2b4aad-ea86-4277-9515-6bb0c66d63c6', 'volume_size': 1}' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 25 15:53:31 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-b628020c-795d-490b-b260-0a46846e130d tempest-VolumesTestJSON-1115907172 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f2dd91ef-1cda-419b-bf26-4f64062e7728) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 25 15:53:31 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-b628020c-795d-490b-b260-0a46846e130d tempest-VolumesTestJSON-1115907172 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f2dd91ef-1cda-419b-bf26-4f64062e7728) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 25 15:53:31 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-b628020c-795d-490b-b260-0a46846e130d tempest-VolumesTestJSON-1115907172 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d6a86191-3f16-4fde-8fc6-2e58aaee3d7b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 25 15:53:31 devstack cinder-volume[83528]: INFO cinder.volume.flows.manager.create_volume [None req-b628020c-795d-490b-b260-0a46846e130d tempest-VolumesTestJSON-1115907172 None] Volume de2b4aad-ea86-4277-9515-6bb0c66d63c6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-de2b4aad-ea86-4277-9515-6bb0c66d63c6', 'volume_size': 1} Feb 25 15:53:31 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-b628020c-795d-490b-b260-0a46846e130d tempest-VolumesTestJSON-1115907172 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 25 15:53:31 devstack sudo[85587]: pam_unix(sudo:session): session closed for user root Feb 25 15:53:31 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-b4c20c5a-52c1-49ec-8224-46c7512b7161 tempest-GroupSnapshotsTest-1779717395 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-f8e0e2db-f0ad-421c-bb36-a1d39b35fb1c 1073741824" returned: 0 in 0.710s {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 25 15:53:31 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-b4c20c5a-52c1-49ec-8224-46c7512b7161 tempest-GroupSnapshotsTest-1779717395 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-f8e0e2db-f0ad-421c-bb36-a1d39b35fb1c {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 25 15:53:31 devstack sudo[85592]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-f8e0e2db-f0ad-421c-bb36-a1d39b35fb1c Feb 25 15:53:31 devstack sudo[85592]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 25 15:53:31 devstack sudo[85592]: pam_unix(sudo:session): session closed for user root Feb 25 15:53:31 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-b4c20c5a-52c1-49ec-8224-46c7512b7161 tempest-GroupSnapshotsTest-1779717395 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-f8e0e2db-f0ad-421c-bb36-a1d39b35fb1c" returned: 0 in 0.443s {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 25 15:53:31 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.quobyte [None req-b4c20c5a-52c1-49ec-8224-46c7512b7161 tempest-GroupSnapshotsTest-1779717395 None] <== create_volume: return (1202ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-23e9d725-3e04-4cd9-bfe0-c8ef43305589'} {{(pid=83528) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 25 15:53:31 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-b4c20c5a-52c1-49ec-8224-46c7512b7161 tempest-GroupSnapshotsTest-1779717395 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.205s {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 25 15:53:31 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-b628020c-795d-490b-b260-0a46846e130d tempest-VolumesTestJSON-1115907172 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.594s {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 25 15:53:31 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.quobyte [None req-b628020c-795d-490b-b260-0a46846e130d tempest-VolumesTestJSON-1115907172 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-25T14:53:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1157634821',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=de2b4aad-ea86-4277-9515-6bb0c66d63c6,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='65bfee69eeef4d49b0c1914aba9c4b44',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-25T14:53:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-25T14:53:31Z,use_quota=True,user_id='30394fa5276a41fd9a95ca3f6bb9f2a4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ce71c2f9-6543-4165-9653-a1529b2ea243),volume_type_id=ce71c2f9-6543-4165-9653-a1529b2ea243)}" {{(pid=83528) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 25 15:53:31 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.remotefs [None req-b628020c-795d-490b-b260-0a46846e130d tempest-VolumesTestJSON-1115907172 None] Creating volume de2b4aad-ea86-4277-9515-6bb0c66d63c6 {{(pid=83528) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 25 15:53:31 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-b628020c-795d-490b-b260-0a46846e130d tempest-VolumesTestJSON-1115907172 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 25 15:53:31 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-b628020c-795d-490b-b260-0a46846e130d tempest-VolumesTestJSON-1115907172 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 25 15:53:31 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.quobyte [None req-b628020c-795d-490b-b260-0a46846e130d tempest-VolumesTestJSON-1115907172 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23e9d725-3e04-4cd9-bfe0-c8ef43305589': None} {{(pid=83528) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 25 15:53:31 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.quobyte [None req-b628020c-795d-490b-b260-0a46846e130d tempest-VolumesTestJSON-1115907172 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23e9d725-3e04-4cd9-bfe0-c8ef43305589'] {{(pid=83528) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 25 15:53:31 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-b628020c-795d-490b-b260-0a46846e130d tempest-VolumesTestJSON-1115907172 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 25 15:53:31 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.quobyte [None req-b628020c-795d-490b-b260-0a46846e130d tempest-VolumesTestJSON-1115907172 None] Selected osci02.corp.quobyte.com/cinder-vol-23e9d725-3e04-4cd9-bfe0-c8ef43305589 as target Quobyte volume. {{(pid=83528) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 25 15:53:31 devstack cinder-volume[83528]: INFO cinder.volume.drivers.remotefs [None req-b628020c-795d-490b-b260-0a46846e130d tempest-VolumesTestJSON-1115907172 None] casted to osci02.corp.quobyte.com/cinder-vol-23e9d725-3e04-4cd9-bfe0-c8ef43305589 Feb 25 15:53:31 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-b628020c-795d-490b-b260-0a46846e130d tempest-VolumesTestJSON-1115907172 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-de2b4aad-ea86-4277-9515-6bb0c66d63c6 1073741824 {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 25 15:53:31 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-b4c20c5a-52c1-49ec-8224-46c7512b7161 tempest-GroupSnapshotsTest-1779717395 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2ecdad51-dd85-42fc-b308-940df74f786a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f8e0e2db-f0ad-421c-bb36-a1d39b35fb1c', 'volume_size': 1}' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 25 15:53:31 devstack sudo[85595]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-de2b4aad-ea86-4277-9515-6bb0c66d63c6 1073741824 Feb 25 15:53:31 devstack sudo[85595]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 25 15:53:31 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-b4c20c5a-52c1-49ec-8224-46c7512b7161 tempest-GroupSnapshotsTest-1779717395 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (97e9c00a-bc31-43b6-b305-ff7faf2a5521) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 25 15:53:31 devstack cinder-volume[83528]: INFO cinder.volume.flows.manager.create_volume [None req-b4c20c5a-52c1-49ec-8224-46c7512b7161 tempest-GroupSnapshotsTest-1779717395 None] Volume volume-f8e0e2db-f0ad-421c-bb36-a1d39b35fb1c (f8e0e2db-f0ad-421c-bb36-a1d39b35fb1c): created successfully Feb 25 15:53:31 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-b4c20c5a-52c1-49ec-8224-46c7512b7161 tempest-GroupSnapshotsTest-1779717395 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (97e9c00a-bc31-43b6-b305-ff7faf2a5521) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 25 15:53:31 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-b4c20c5a-52c1-49ec-8224-46c7512b7161 tempest-GroupSnapshotsTest-1779717395 None] Flow 'volume_create_manager' (23f56774-a19c-474a-b5dc-d9bcf8f12bd7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83528) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 25 15:53:31 devstack cinder-volume[83528]: INFO cinder.volume.manager [None req-b4c20c5a-52c1-49ec-8224-46c7512b7161 tempest-GroupSnapshotsTest-1779717395 None] Created volume successfully. Feb 25 15:53:32 devstack sudo[85595]: pam_unix(sudo:session): session closed for user root Feb 25 15:53:32 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-b628020c-795d-490b-b260-0a46846e130d tempest-VolumesTestJSON-1115907172 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-de2b4aad-ea86-4277-9515-6bb0c66d63c6 1073741824" returned: 0 in 0.569s {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 25 15:53:32 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-b628020c-795d-490b-b260-0a46846e130d tempest-VolumesTestJSON-1115907172 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-de2b4aad-ea86-4277-9515-6bb0c66d63c6 {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 25 15:53:32 devstack sudo[85605]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-de2b4aad-ea86-4277-9515-6bb0c66d63c6 Feb 25 15:53:32 devstack sudo[85605]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 25 15:53:33 devstack sudo[85605]: pam_unix(sudo:session): session closed for user root Feb 25 15:53:33 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-b628020c-795d-490b-b260-0a46846e130d tempest-VolumesTestJSON-1115907172 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-de2b4aad-ea86-4277-9515-6bb0c66d63c6" returned: 0 in 0.485s {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 25 15:53:33 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.quobyte [None req-b628020c-795d-490b-b260-0a46846e130d tempest-VolumesTestJSON-1115907172 None] <== create_volume: return (1083ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-23e9d725-3e04-4cd9-bfe0-c8ef43305589'} {{(pid=83528) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 25 15:53:33 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-b628020c-795d-490b-b260-0a46846e130d tempest-VolumesTestJSON-1115907172 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.085s {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 25 15:53:33 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-b628020c-795d-490b-b260-0a46846e130d tempest-VolumesTestJSON-1115907172 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d6a86191-3f16-4fde-8fc6-2e58aaee3d7b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-de2b4aad-ea86-4277-9515-6bb0c66d63c6', 'volume_size': 1}' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 25 15:53:33 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-b628020c-795d-490b-b260-0a46846e130d tempest-VolumesTestJSON-1115907172 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (abf4049e-4058-499f-aa36-fcf56e3a700e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 25 15:53:33 devstack cinder-volume[83528]: INFO cinder.volume.manager [None req-6db488a8-ab16-4174-8304-ad7ad22249a8 tempest-GroupSnapshotsTest-1779717395 None] GroupSnapshot 0c600445-9182-477a-8eea-e808f382e961: creating. Feb 25 15:53:33 devstack cinder-volume[83528]: INFO cinder.volume.flows.manager.create_volume [None req-b628020c-795d-490b-b260-0a46846e130d tempest-VolumesTestJSON-1115907172 None] Volume volume-de2b4aad-ea86-4277-9515-6bb0c66d63c6 (de2b4aad-ea86-4277-9515-6bb0c66d63c6): created successfully Feb 25 15:53:33 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-b628020c-795d-490b-b260-0a46846e130d tempest-VolumesTestJSON-1115907172 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (abf4049e-4058-499f-aa36-fcf56e3a700e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 25 15:53:33 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-b628020c-795d-490b-b260-0a46846e130d tempest-VolumesTestJSON-1115907172 None] Flow 'volume_create_manager' (54da97a9-deec-46c9-8cfa-83cbeae88305) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83528) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 25 15:53:33 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-6db488a8-ab16-4174-8304-ad7ad22249a8 tempest-GroupSnapshotsTest-1779717395 None] Group snapshot 0c600445-9182-477a-8eea-e808f382e961: creating. {{(pid=83528) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Feb 25 15:53:33 devstack cinder-volume[83528]: INFO cinder.volume.manager [None req-b628020c-795d-490b-b260-0a46846e130d tempest-VolumesTestJSON-1115907172 None] Created volume successfully. Feb 25 15:53:33 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-6db488a8-ab16-4174-8304-ad7ad22249a8 tempest-GroupSnapshotsTest-1779717395 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 25 15:53:33 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-6db488a8-ab16-4174-8304-ad7ad22249a8 tempest-GroupSnapshotsTest-1779717395 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 25 15:53:33 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.remotefs [None req-6db488a8-ab16-4174-8304-ad7ad22249a8 tempest-GroupSnapshotsTest-1779717395 None] Creating offline snapshot 817d378d-7215-4fcb-bc05-3fe4f44ebda1 of volume f8e0e2db-f0ad-421c-bb36-a1d39b35fb1c {{(pid=83528) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Feb 25 15:53:33 devstack cinder-volume[83528]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1537198-4fdd-48de-a273-226c2ce7c05d]: (4, 'qcow2') {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 25 15:53:33 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-6db488a8-ab16-4174-8304-ad7ad22249a8 tempest-GroupSnapshotsTest-1779717395 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-f8e0e2db-f0ad-421c-bb36-a1d39b35fb1c {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 25 15:53:33 devstack sudo[85608]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-f8e0e2db-f0ad-421c-bb36-a1d39b35fb1c Feb 25 15:53:33 devstack sudo[85608]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 25 15:53:33 devstack sudo[85608]: pam_unix(sudo:session): session closed for user root Feb 25 15:53:33 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-6db488a8-ab16-4174-8304-ad7ad22249a8 tempest-GroupSnapshotsTest-1779717395 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-f8e0e2db-f0ad-421c-bb36-a1d39b35fb1c" returned: 0 in 0.583s {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 25 15:53:33 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-6db488a8-ab16-4174-8304-ad7ad22249a8 tempest-GroupSnapshotsTest-1779717395 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-f8e0e2db-f0ad-421c-bb36-a1d39b35fb1c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-f8e0e2db-f0ad-421c-bb36-a1d39b35fb1c.817d378d-7215-4fcb-bc05-3fe4f44ebda1 1G {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 25 15:53:33 devstack sudo[85613]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-f8e0e2db-f0ad-421c-bb36-a1d39b35fb1c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-f8e0e2db-f0ad-421c-bb36-a1d39b35fb1c.817d378d-7215-4fcb-bc05-3fe4f44ebda1 1G Feb 25 15:53:33 devstack sudo[85613]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 25 15:53:33 devstack cinder-volume[83528]: DEBUG cinder.volume.flows.manager.create_volume [None req-bde1920c-c108-41f3-b745-e276d375e924 tempest-VolumesTestJSON-1115907172 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83528) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 25 15:53:33 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-bde1920c-c108-41f3-b745-e276d375e924 tempest-VolumesTestJSON-1115907172 None] Flow 'volume_create_manager' (cbc920d2-4de6-467a-9370-39a8b97aacdd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83528) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 25 15:53:33 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-bde1920c-c108-41f3-b745-e276d375e924 tempest-VolumesTestJSON-1115907172 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5e8a90f9-0efc-47dd-aec8-74a721c5fb1f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 25 15:53:33 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-bde1920c-c108-41f3-b745-e276d375e924 tempest-VolumesTestJSON-1115907172 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5e8a90f9-0efc-47dd-aec8-74a721c5fb1f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-25T14:53:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1389787900',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bc92d814-5f60-417c-8382-68a183583c6d,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='65bfee69eeef4d49b0c1914aba9c4b44',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-25T14:53:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-25T14:53:34Z,use_quota=True,user_id='30394fa5276a41fd9a95ca3f6bb9f2a4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ce71c2f9-6543-4165-9653-a1529b2ea243),volume_type_id=ce71c2f9-6543-4165-9653-a1529b2ea243)' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 25 15:53:33 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-bde1920c-c108-41f3-b745-e276d375e924 tempest-VolumesTestJSON-1115907172 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9b1d1304-d0e6-46f8-a3e1-1b6eecb0e761) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 25 15:53:33 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-bde1920c-c108-41f3-b745-e276d375e924 tempest-VolumesTestJSON-1115907172 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9b1d1304-d0e6-46f8-a3e1-1b6eecb0e761) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 25 15:53:33 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-bde1920c-c108-41f3-b745-e276d375e924 tempest-VolumesTestJSON-1115907172 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1acbf9fe-95d6-4f65-a6cb-1ed3255a0726) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 25 15:53:33 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-bde1920c-c108-41f3-b745-e276d375e924 tempest-VolumesTestJSON-1115907172 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1acbf9fe-95d6-4f65-a6cb-1ed3255a0726) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bc92d814-5f60-417c-8382-68a183583c6d', 'volume_name': 'volume-bc92d814-5f60-417c-8382-68a183583c6d', 'volume_size': 1}' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 25 15:53:33 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-bde1920c-c108-41f3-b745-e276d375e924 tempest-VolumesTestJSON-1115907172 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3ccb2672-6d7c-4437-bca1-6259ab7bdb00) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 25 15:53:33 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-bde1920c-c108-41f3-b745-e276d375e924 tempest-VolumesTestJSON-1115907172 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3ccb2672-6d7c-4437-bca1-6259ab7bdb00) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 25 15:53:33 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-bde1920c-c108-41f3-b745-e276d375e924 tempest-VolumesTestJSON-1115907172 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f72581f1-6198-4ae8-9d52-2fcdccbc041e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 25 15:53:33 devstack cinder-volume[83528]: INFO cinder.volume.flows.manager.create_volume [None req-bde1920c-c108-41f3-b745-e276d375e924 tempest-VolumesTestJSON-1115907172 None] Volume bc92d814-5f60-417c-8382-68a183583c6d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bc92d814-5f60-417c-8382-68a183583c6d', 'volume_size': 1} Feb 25 15:53:33 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-bde1920c-c108-41f3-b745-e276d375e924 tempest-VolumesTestJSON-1115907172 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 25 15:53:34 devstack sudo[85613]: pam_unix(sudo:session): session closed for user root Feb 25 15:53:34 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-6db488a8-ab16-4174-8304-ad7ad22249a8 tempest-GroupSnapshotsTest-1779717395 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-f8e0e2db-f0ad-421c-bb36-a1d39b35fb1c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-f8e0e2db-f0ad-421c-bb36-a1d39b35fb1c.817d378d-7215-4fcb-bc05-3fe4f44ebda1 1G" returned: 0 in 0.958s {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 25 15:53:34 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-6db488a8-ab16-4174-8304-ad7ad22249a8 tempest-GroupSnapshotsTest-1779717395 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f8e0e2db-f0ad-421c-bb36-a1d39b35fb1c -F qcow2 /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-f8e0e2db-f0ad-421c-bb36-a1d39b35fb1c.817d378d-7215-4fcb-bc05-3fe4f44ebda1 {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 25 15:53:34 devstack sudo[85644]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f8e0e2db-f0ad-421c-bb36-a1d39b35fb1c -F qcow2 /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-f8e0e2db-f0ad-421c-bb36-a1d39b35fb1c.817d378d-7215-4fcb-bc05-3fe4f44ebda1 Feb 25 15:53:34 devstack sudo[85644]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 25 15:53:35 devstack sudo[85644]: pam_unix(sudo:session): session closed for user root Feb 25 15:53:35 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-6db488a8-ab16-4174-8304-ad7ad22249a8 tempest-GroupSnapshotsTest-1779717395 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f8e0e2db-f0ad-421c-bb36-a1d39b35fb1c -F qcow2 /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-f8e0e2db-f0ad-421c-bb36-a1d39b35fb1c.817d378d-7215-4fcb-bc05-3fe4f44ebda1" returned: 0 in 0.647s {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 25 15:53:35 devstack cinder-volume[83528]: WARNING cinder.volume.drivers.remotefs [None req-6db488a8-ab16-4174-8304-ad7ad22249a8 tempest-GroupSnapshotsTest-1779717395 None] /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-f8e0e2db-f0ad-421c-bb36-a1d39b35fb1c.817d378d-7215-4fcb-bc05-3fe4f44ebda1 is being set with open permissions: ugo+rw: NotImplementedError Feb 25 15:53:35 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-6db488a8-ab16-4174-8304-ad7ad22249a8 tempest-GroupSnapshotsTest-1779717395 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-f8e0e2db-f0ad-421c-bb36-a1d39b35fb1c.817d378d-7215-4fcb-bc05-3fe4f44ebda1 {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 25 15:53:35 devstack sudo[85649]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-f8e0e2db-f0ad-421c-bb36-a1d39b35fb1c.817d378d-7215-4fcb-bc05-3fe4f44ebda1 Feb 25 15:53:35 devstack sudo[85649]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 25 15:53:35 devstack sudo[85649]: pam_unix(sudo:session): session closed for user root Feb 25 15:53:35 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-6db488a8-ab16-4174-8304-ad7ad22249a8 tempest-GroupSnapshotsTest-1779717395 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-f8e0e2db-f0ad-421c-bb36-a1d39b35fb1c.817d378d-7215-4fcb-bc05-3fe4f44ebda1" returned: 0 in 0.525s {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 25 15:53:35 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-6db488a8-ab16-4174-8304-ad7ad22249a8 tempest-GroupSnapshotsTest-1779717395 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-f8e0e2db-f0ad-421c-bb36-a1d39b35fb1c.info {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 25 15:53:35 devstack sudo[85652]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-f8e0e2db-f0ad-421c-bb36-a1d39b35fb1c.info Feb 25 15:53:35 devstack sudo[85652]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 25 15:53:36 devstack sudo[85652]: pam_unix(sudo:session): session closed for user root Feb 25 15:53:36 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-6db488a8-ab16-4174-8304-ad7ad22249a8 tempest-GroupSnapshotsTest-1779717395 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-f8e0e2db-f0ad-421c-bb36-a1d39b35fb1c.info" returned: 0 in 0.523s {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 25 15:53:36 devstack cinder-volume[83528]: WARNING cinder.volume.drivers.remotefs [None req-6db488a8-ab16-4174-8304-ad7ad22249a8 tempest-GroupSnapshotsTest-1779717395 None] /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-f8e0e2db-f0ad-421c-bb36-a1d39b35fb1c.info is being set with open permissions: ugo+rw: NotImplementedError Feb 25 15:53:36 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-6db488a8-ab16-4174-8304-ad7ad22249a8 tempest-GroupSnapshotsTest-1779717395 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-f8e0e2db-f0ad-421c-bb36-a1d39b35fb1c.info {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 25 15:53:36 devstack sudo[85655]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-f8e0e2db-f0ad-421c-bb36-a1d39b35fb1c.info Feb 25 15:53:36 devstack sudo[85655]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 25 15:53:36 devstack sudo[85655]: pam_unix(sudo:session): session closed for user root Feb 25 15:53:36 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-6db488a8-ab16-4174-8304-ad7ad22249a8 tempest-GroupSnapshotsTest-1779717395 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-f8e0e2db-f0ad-421c-bb36-a1d39b35fb1c.info" returned: 0 in 0.555s {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 25 15:53:36 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-6db488a8-ab16-4174-8304-ad7ad22249a8 tempest-GroupSnapshotsTest-1779717395 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.844s {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 25 15:53:36 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-bde1920c-c108-41f3-b745-e276d375e924 tempest-VolumesTestJSON-1115907172 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.141s {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 25 15:53:36 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.quobyte [None req-bde1920c-c108-41f3-b745-e276d375e924 tempest-VolumesTestJSON-1115907172 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-25T14:53:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1389787900',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bc92d814-5f60-417c-8382-68a183583c6d,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='65bfee69eeef4d49b0c1914aba9c4b44',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-25T14:53:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-25T14:53:34Z,use_quota=True,user_id='30394fa5276a41fd9a95ca3f6bb9f2a4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ce71c2f9-6543-4165-9653-a1529b2ea243),volume_type_id=ce71c2f9-6543-4165-9653-a1529b2ea243)}" {{(pid=83528) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 25 15:53:36 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.remotefs [None req-bde1920c-c108-41f3-b745-e276d375e924 tempest-VolumesTestJSON-1115907172 None] Creating volume bc92d814-5f60-417c-8382-68a183583c6d {{(pid=83528) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 25 15:53:36 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-bde1920c-c108-41f3-b745-e276d375e924 tempest-VolumesTestJSON-1115907172 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 25 15:53:36 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-bde1920c-c108-41f3-b745-e276d375e924 tempest-VolumesTestJSON-1115907172 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 25 15:53:36 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.quobyte [None req-bde1920c-c108-41f3-b745-e276d375e924 tempest-VolumesTestJSON-1115907172 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23e9d725-3e04-4cd9-bfe0-c8ef43305589': None} {{(pid=83528) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 25 15:53:36 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.quobyte [None req-bde1920c-c108-41f3-b745-e276d375e924 tempest-VolumesTestJSON-1115907172 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23e9d725-3e04-4cd9-bfe0-c8ef43305589'] {{(pid=83528) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 25 15:53:36 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-bde1920c-c108-41f3-b745-e276d375e924 tempest-VolumesTestJSON-1115907172 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 25 15:53:36 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.quobyte [None req-bde1920c-c108-41f3-b745-e276d375e924 tempest-VolumesTestJSON-1115907172 None] Selected osci02.corp.quobyte.com/cinder-vol-23e9d725-3e04-4cd9-bfe0-c8ef43305589 as target Quobyte volume. {{(pid=83528) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 25 15:53:36 devstack cinder-volume[83528]: INFO cinder.volume.drivers.remotefs [None req-bde1920c-c108-41f3-b745-e276d375e924 tempest-VolumesTestJSON-1115907172 None] casted to osci02.corp.quobyte.com/cinder-vol-23e9d725-3e04-4cd9-bfe0-c8ef43305589 Feb 25 15:53:36 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-bde1920c-c108-41f3-b745-e276d375e924 tempest-VolumesTestJSON-1115907172 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-bc92d814-5f60-417c-8382-68a183583c6d 1073741824 {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 25 15:53:36 devstack sudo[85658]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-bc92d814-5f60-417c-8382-68a183583c6d 1073741824 Feb 25 15:53:36 devstack sudo[85658]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 25 15:53:37 devstack cinder-volume[83528]: INFO cinder.volume.manager [None req-6db488a8-ab16-4174-8304-ad7ad22249a8 tempest-GroupSnapshotsTest-1779717395 None] group_snapshot 0c600445-9182-477a-8eea-e808f382e961: created successfully Feb 25 15:53:37 devstack sudo[85658]: pam_unix(sudo:session): session closed for user root Feb 25 15:53:37 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-bde1920c-c108-41f3-b745-e276d375e924 tempest-VolumesTestJSON-1115907172 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-bc92d814-5f60-417c-8382-68a183583c6d 1073741824" returned: 0 in 0.796s {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 25 15:53:37 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-bde1920c-c108-41f3-b745-e276d375e924 tempest-VolumesTestJSON-1115907172 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-bc92d814-5f60-417c-8382-68a183583c6d {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 25 15:53:37 devstack sudo[85665]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-bc92d814-5f60-417c-8382-68a183583c6d Feb 25 15:53:37 devstack sudo[85665]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 25 15:53:38 devstack sudo[85665]: pam_unix(sudo:session): session closed for user root Feb 25 15:53:38 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-86b4e72a-41b6-4c90-a43a-b14b5155cfd5 tempest-GroupSnapshotsTest-1779717395 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 25 15:53:38 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-bde1920c-c108-41f3-b745-e276d375e924 tempest-VolumesTestJSON-1115907172 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-bc92d814-5f60-417c-8382-68a183583c6d" returned: 0 in 0.825s {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 25 15:53:38 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.quobyte [None req-bde1920c-c108-41f3-b745-e276d375e924 tempest-VolumesTestJSON-1115907172 None] <== create_volume: return (1659ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-23e9d725-3e04-4cd9-bfe0-c8ef43305589'} {{(pid=83528) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 25 15:53:38 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-bde1920c-c108-41f3-b745-e276d375e924 tempest-VolumesTestJSON-1115907172 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.661s {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 25 15:53:38 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-86b4e72a-41b6-4c90-a43a-b14b5155cfd5 tempest-GroupSnapshotsTest-1779717395 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.023s {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 25 15:53:38 devstack cinder-volume[83528]: DEBUG cinder.coordination [None req-86b4e72a-41b6-4c90-a43a-b14b5155cfd5 tempest-GroupSnapshotsTest-1779717395 None] Acquiring lock "cinder-quobyte-817d378d-7215-4fcb-bc05-3fe4f44ebda1-e828df16-8f13-4a27-95f2-603bf8c048fe" by "_create_volume_from_snapshot" {{(pid=83528) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 25 15:53:38 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-bde1920c-c108-41f3-b745-e276d375e924 tempest-VolumesTestJSON-1115907172 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f72581f1-6198-4ae8-9d52-2fcdccbc041e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bc92d814-5f60-417c-8382-68a183583c6d', 'volume_size': 1}' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 25 15:53:38 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-bde1920c-c108-41f3-b745-e276d375e924 tempest-VolumesTestJSON-1115907172 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2daaa763-f536-44b1-a37a-fd9b6d45d293) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 25 15:53:38 devstack cinder-volume[83528]: DEBUG cinder.coordination [None req-86b4e72a-41b6-4c90-a43a-b14b5155cfd5 tempest-GroupSnapshotsTest-1779717395 None] Lock "cinder-quobyte-817d378d-7215-4fcb-bc05-3fe4f44ebda1-e828df16-8f13-4a27-95f2-603bf8c048fe" acquired by "_create_volume_from_snapshot" :: waited 0.038s {{(pid=83528) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 25 15:53:38 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.quobyte [None req-86b4e72a-41b6-4c90-a43a-b14b5155cfd5 tempest-GroupSnapshotsTest-1779717395 None] Creating volume e828df16-8f13-4a27-95f2-603bf8c048fe from snapshot 817d378d-7215-4fcb-bc05-3fe4f44ebda1 {{(pid=83528) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Feb 25 15:53:38 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-86b4e72a-41b6-4c90-a43a-b14b5155cfd5 tempest-GroupSnapshotsTest-1779717395 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 25 15:53:38 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-86b4e72a-41b6-4c90-a43a-b14b5155cfd5 tempest-GroupSnapshotsTest-1779717395 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 25 15:53:38 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.quobyte [None req-86b4e72a-41b6-4c90-a43a-b14b5155cfd5 tempest-GroupSnapshotsTest-1779717395 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23e9d725-3e04-4cd9-bfe0-c8ef43305589': None} {{(pid=83528) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 25 15:53:38 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.quobyte [None req-86b4e72a-41b6-4c90-a43a-b14b5155cfd5 tempest-GroupSnapshotsTest-1779717395 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23e9d725-3e04-4cd9-bfe0-c8ef43305589'] {{(pid=83528) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 25 15:53:38 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-86b4e72a-41b6-4c90-a43a-b14b5155cfd5 tempest-GroupSnapshotsTest-1779717395 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 25 15:53:38 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.quobyte [None req-86b4e72a-41b6-4c90-a43a-b14b5155cfd5 tempest-GroupSnapshotsTest-1779717395 None] Selected osci02.corp.quobyte.com/cinder-vol-23e9d725-3e04-4cd9-bfe0-c8ef43305589 as target Quobyte volume. {{(pid=83528) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 25 15:53:38 devstack cinder-volume[83528]: DEBUG cinder.coordination [None req-86b4e72a-41b6-4c90-a43a-b14b5155cfd5 tempest-GroupSnapshotsTest-1779717395 None] Acquiring lock "cinder-quobyte-e828df16-8f13-4a27-95f2-603bf8c048fe" by "_copy_volume_from_snapshot" {{(pid=83528) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 25 15:53:38 devstack cinder-volume[83528]: INFO cinder.volume.flows.manager.create_volume [None req-bde1920c-c108-41f3-b745-e276d375e924 tempest-VolumesTestJSON-1115907172 None] Volume volume-bc92d814-5f60-417c-8382-68a183583c6d (bc92d814-5f60-417c-8382-68a183583c6d): created successfully Feb 25 15:53:38 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-bde1920c-c108-41f3-b745-e276d375e924 tempest-VolumesTestJSON-1115907172 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2daaa763-f536-44b1-a37a-fd9b6d45d293) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 25 15:53:38 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-bde1920c-c108-41f3-b745-e276d375e924 tempest-VolumesTestJSON-1115907172 None] Flow 'volume_create_manager' (cbc920d2-4de6-467a-9370-39a8b97aacdd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83528) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 25 15:53:38 devstack cinder-volume[83528]: DEBUG oslo_service.periodic_task [None req-d4c764ec-0ebb-4b31-b534-c9a53c1ab0dd None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=83528) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Feb 25 15:53:38 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-d4c764ec-0ebb-4b31-b534-c9a53c1ab0dd None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 25 15:53:38 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-d4c764ec-0ebb-4b31-b534-c9a53c1ab0dd None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 25 15:53:38 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.quobyte [None req-d4c764ec-0ebb-4b31-b534-c9a53c1ab0dd None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23e9d725-3e04-4cd9-bfe0-c8ef43305589': None} {{(pid=83528) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 25 15:53:38 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.quobyte [None req-d4c764ec-0ebb-4b31-b534-c9a53c1ab0dd None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23e9d725-3e04-4cd9-bfe0-c8ef43305589'] {{(pid=83528) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 25 15:53:38 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-d4c764ec-0ebb-4b31-b534-c9a53c1ab0dd None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 25 15:53:38 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-d4c764ec-0ebb-4b31-b534-c9a53c1ab0dd None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85 {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 25 15:53:38 devstack cinder-volume[83528]: INFO cinder.volume.manager [None req-bde1920c-c108-41f3-b745-e276d375e924 tempest-VolumesTestJSON-1115907172 None] Created volume successfully. Feb 25 15:53:38 devstack sudo[85668]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85 Feb 25 15:53:38 devstack sudo[85668]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 25 15:53:38 devstack cinder-volume[83528]: DEBUG cinder.coordination [None req-86b4e72a-41b6-4c90-a43a-b14b5155cfd5 tempest-GroupSnapshotsTest-1779717395 None] Lock "cinder-quobyte-e828df16-8f13-4a27-95f2-603bf8c048fe" acquired by "_copy_volume_from_snapshot" :: waited 0.082s {{(pid=83528) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 25 15:53:38 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.quobyte [None req-86b4e72a-41b6-4c90-a43a-b14b5155cfd5 tempest-GroupSnapshotsTest-1779717395 None] snapshot: 817d378d-7215-4fcb-bc05-3fe4f44ebda1, volume: e828df16-8f13-4a27-95f2-603bf8c048fe, {{(pid=83528) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Feb 25 15:53:38 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-86b4e72a-41b6-4c90-a43a-b14b5155cfd5 tempest-GroupSnapshotsTest-1779717395 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 25 15:53:38 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-86b4e72a-41b6-4c90-a43a-b14b5155cfd5 tempest-GroupSnapshotsTest-1779717395 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 25 15:53:38 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.quobyte [None req-86b4e72a-41b6-4c90-a43a-b14b5155cfd5 tempest-GroupSnapshotsTest-1779717395 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23e9d725-3e04-4cd9-bfe0-c8ef43305589': None} {{(pid=83528) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 25 15:53:38 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.quobyte [None req-86b4e72a-41b6-4c90-a43a-b14b5155cfd5 tempest-GroupSnapshotsTest-1779717395 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23e9d725-3e04-4cd9-bfe0-c8ef43305589'] {{(pid=83528) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 25 15:53:38 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-86b4e72a-41b6-4c90-a43a-b14b5155cfd5 tempest-GroupSnapshotsTest-1779717395 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 25 15:53:38 devstack cinder-volume[83528]: DEBUG oslo.privsep.daemon [-] privsep: reply[5654a6c2-f21f-4038-b31a-67e95fd773d5]: (4, 'qcow2') {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 25 15:53:38 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-86b4e72a-41b6-4c90-a43a-b14b5155cfd5 tempest-GroupSnapshotsTest-1779717395 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-f8e0e2db-f0ad-421c-bb36-a1d39b35fb1c.817d378d-7215-4fcb-bc05-3fe4f44ebda1 {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 25 15:53:39 devstack sudo[85670]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-f8e0e2db-f0ad-421c-bb36-a1d39b35fb1c.817d378d-7215-4fcb-bc05-3fe4f44ebda1 Feb 25 15:53:39 devstack sudo[85670]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 25 15:53:39 devstack sudo[85668]: pam_unix(sudo:session): session closed for user root Feb 25 15:53:39 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-d4c764ec-0ebb-4b31-b534-c9a53c1ab0dd None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85" returned: 0 in 0.573s {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 25 15:53:39 devstack cinder-volume[83528]: DEBUG cinder.manager [None req-d4c764ec-0ebb-4b31-b534-c9a53c1ab0dd None None] Notifying Schedulers of capabilities ... {{(pid=83528) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 25 15:53:39 devstack cinder-volume[83528]: DEBUG cinder.volume.flows.manager.create_volume [None req-b47b7fcd-517c-4cd4-9add-64a887a031f1 tempest-VolumesTestJSON-1115907172 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83528) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 25 15:53:39 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-b47b7fcd-517c-4cd4-9add-64a887a031f1 tempest-VolumesTestJSON-1115907172 None] Flow 'volume_create_manager' (c76dc44c-71bc-4fb7-8ac1-8cb5ed37dca6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83528) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 25 15:53:39 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-b47b7fcd-517c-4cd4-9add-64a887a031f1 tempest-VolumesTestJSON-1115907172 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dcf629f3-1cfa-4f8e-ad83-1c76f277ddc1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 25 15:53:39 devstack sudo[85670]: pam_unix(sudo:session): session closed for user root Feb 25 15:53:39 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-86b4e72a-41b6-4c90-a43a-b14b5155cfd5 tempest-GroupSnapshotsTest-1779717395 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-f8e0e2db-f0ad-421c-bb36-a1d39b35fb1c.817d378d-7215-4fcb-bc05-3fe4f44ebda1" returned: 0 in 0.957s {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 25 15:53:39 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.remotefs [None req-86b4e72a-41b6-4c90-a43a-b14b5155cfd5 tempest-GroupSnapshotsTest-1779717395 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f8e0e2db-f0ad-421c-bb36-a1d39b35fb1c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83528) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Feb 25 15:53:39 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.quobyte [None req-86b4e72a-41b6-4c90-a43a-b14b5155cfd5 tempest-GroupSnapshotsTest-1779717395 None] will copy from snapshot at /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-f8e0e2db-f0ad-421c-bb36-a1d39b35fb1c {{(pid=83528) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Feb 25 15:53:39 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.quobyte [None req-86b4e72a-41b6-4c90-a43a-b14b5155cfd5 tempest-GroupSnapshotsTest-1779717395 None] Creating direct copy from snapshot {{(pid=83528) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Feb 25 15:53:39 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-b47b7fcd-517c-4cd4-9add-64a887a031f1 tempest-VolumesTestJSON-1115907172 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dcf629f3-1cfa-4f8e-ad83-1c76f277ddc1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-25T14:53:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1322977346',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c697fbe1-7026-4e4b-838d-7c8158c499ca,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='65bfee69eeef4d49b0c1914aba9c4b44',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-25T14:53:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-25T14:53:40Z,use_quota=True,user_id='30394fa5276a41fd9a95ca3f6bb9f2a4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ce71c2f9-6543-4165-9653-a1529b2ea243),volume_type_id=ce71c2f9-6543-4165-9653-a1529b2ea243)' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 25 15:53:39 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-b47b7fcd-517c-4cd4-9add-64a887a031f1 tempest-VolumesTestJSON-1115907172 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1016aec0-0758-49b1-aff3-dbf26038c752) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 25 15:53:39 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-b47b7fcd-517c-4cd4-9add-64a887a031f1 tempest-VolumesTestJSON-1115907172 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1016aec0-0758-49b1-aff3-dbf26038c752) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 25 15:53:39 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-b47b7fcd-517c-4cd4-9add-64a887a031f1 tempest-VolumesTestJSON-1115907172 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (88157f62-bed5-4795-8196-3636e13df834) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 25 15:53:39 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-b47b7fcd-517c-4cd4-9add-64a887a031f1 tempest-VolumesTestJSON-1115907172 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (88157f62-bed5-4795-8196-3636e13df834) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c697fbe1-7026-4e4b-838d-7c8158c499ca', 'volume_name': 'volume-c697fbe1-7026-4e4b-838d-7c8158c499ca', 'volume_size': 1}' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 25 15:53:39 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-b47b7fcd-517c-4cd4-9add-64a887a031f1 tempest-VolumesTestJSON-1115907172 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6f86789a-711b-41d3-8eb4-3d5b0616ff6c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 25 15:53:39 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-b47b7fcd-517c-4cd4-9add-64a887a031f1 tempest-VolumesTestJSON-1115907172 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6f86789a-711b-41d3-8eb4-3d5b0616ff6c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 25 15:53:39 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-b47b7fcd-517c-4cd4-9add-64a887a031f1 tempest-VolumesTestJSON-1115907172 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4d857d86-46a4-47ae-994e-b55a2d6105f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 25 15:53:39 devstack cinder-volume[83528]: INFO cinder.volume.flows.manager.create_volume [None req-b47b7fcd-517c-4cd4-9add-64a887a031f1 tempest-VolumesTestJSON-1115907172 None] Volume c697fbe1-7026-4e4b-838d-7c8158c499ca: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c697fbe1-7026-4e4b-838d-7c8158c499ca', 'volume_size': 1} Feb 25 15:53:39 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-b47b7fcd-517c-4cd4-9add-64a887a031f1 tempest-VolumesTestJSON-1115907172 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 25 15:53:39 devstack cinder-volume[83528]: DEBUG oslo.privsep.daemon [-] privsep: reply[462fa53b-b6eb-4a98-9942-31dba3266ed9]: (4, 'qcow2') {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 25 15:53:39 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-86b4e72a-41b6-4c90-a43a-b14b5155cfd5 tempest-GroupSnapshotsTest-1779717395 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-f8e0e2db-f0ad-421c-bb36-a1d39b35fb1c {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 25 15:53:39 devstack sudo[85679]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-f8e0e2db-f0ad-421c-bb36-a1d39b35fb1c Feb 25 15:53:39 devstack sudo[85679]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 25 15:53:40 devstack sudo[85679]: pam_unix(sudo:session): session closed for user root Feb 25 15:53:40 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-86b4e72a-41b6-4c90-a43a-b14b5155cfd5 tempest-GroupSnapshotsTest-1779717395 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-f8e0e2db-f0ad-421c-bb36-a1d39b35fb1c" returned: 0 in 0.627s {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 25 15:53:40 devstack cinder-volume[83528]: DEBUG cinder.utils [None req-86b4e72a-41b6-4c90-a43a-b14b5155cfd5 tempest-GroupSnapshotsTest-1779717395 None] Path /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-e828df16-8f13-4a27-95f2-603bf8c048fe not found in is_blk_device check {{(pid=83528) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Feb 25 15:53:40 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-86b4e72a-41b6-4c90-a43a-b14b5155cfd5 tempest-GroupSnapshotsTest-1779717395 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-f8e0e2db-f0ad-421c-bb36-a1d39b35fb1c /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-e828df16-8f13-4a27-95f2-603bf8c048fe {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 25 15:53:40 devstack sudo[85684]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-f8e0e2db-f0ad-421c-bb36-a1d39b35fb1c /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-e828df16-8f13-4a27-95f2-603bf8c048fe Feb 25 15:53:40 devstack sudo[85684]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 25 15:53:43 devstack sudo[85684]: pam_unix(sudo:session): session closed for user root Feb 25 15:53:43 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-86b4e72a-41b6-4c90-a43a-b14b5155cfd5 tempest-GroupSnapshotsTest-1779717395 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-f8e0e2db-f0ad-421c-bb36-a1d39b35fb1c /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-e828df16-8f13-4a27-95f2-603bf8c048fe" returned: 0 in 3.091s {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 25 15:53:43 devstack cinder-volume[83528]: DEBUG oslo.privsep.daemon [-] privsep: reply[292f4261-a69a-4660-9ec4-cac763489ba2]: (4, 'qcow2') {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 25 15:53:43 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-86b4e72a-41b6-4c90-a43a-b14b5155cfd5 tempest-GroupSnapshotsTest-1779717395 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-f8e0e2db-f0ad-421c-bb36-a1d39b35fb1c {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 25 15:53:43 devstack sudo[85711]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-f8e0e2db-f0ad-421c-bb36-a1d39b35fb1c Feb 25 15:53:43 devstack sudo[85711]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 25 15:53:44 devstack sudo[85711]: pam_unix(sudo:session): session closed for user root Feb 25 15:53:44 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-86b4e72a-41b6-4c90-a43a-b14b5155cfd5 tempest-GroupSnapshotsTest-1779717395 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-f8e0e2db-f0ad-421c-bb36-a1d39b35fb1c" returned: 0 in 0.754s {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 25 15:53:44 devstack cinder-volume[83528]: DEBUG cinder.image.image_utils [None req-86b4e72a-41b6-4c90-a43a-b14b5155cfd5 tempest-GroupSnapshotsTest-1779717395 None] Image conversion details: src /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-f8e0e2db-f0ad-421c-bb36-a1d39b35fb1c, size 1024.00 MB, duration 3.09 sec, destination /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-e828df16-8f13-4a27-95f2-603bf8c048fe {{(pid=83528) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Feb 25 15:53:44 devstack cinder-volume[83528]: INFO cinder.image.image_utils [None req-86b4e72a-41b6-4c90-a43a-b14b5155cfd5 tempest-GroupSnapshotsTest-1779717395 None] Converted 1024.00 MB image at 331.03 MB/s Feb 25 15:53:44 devstack cinder-volume[83528]: WARNING cinder.volume.drivers.remotefs [None req-86b4e72a-41b6-4c90-a43a-b14b5155cfd5 tempest-GroupSnapshotsTest-1779717395 None] /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-e828df16-8f13-4a27-95f2-603bf8c048fe is being set with open permissions: ugo+rw: NotImplementedError Feb 25 15:53:44 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-86b4e72a-41b6-4c90-a43a-b14b5155cfd5 tempest-GroupSnapshotsTest-1779717395 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-e828df16-8f13-4a27-95f2-603bf8c048fe {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 25 15:53:44 devstack sudo[85741]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-e828df16-8f13-4a27-95f2-603bf8c048fe Feb 25 15:53:44 devstack sudo[85741]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 25 15:53:44 devstack sudo[85741]: pam_unix(sudo:session): session closed for user root Feb 25 15:53:44 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-86b4e72a-41b6-4c90-a43a-b14b5155cfd5 tempest-GroupSnapshotsTest-1779717395 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-e828df16-8f13-4a27-95f2-603bf8c048fe" returned: 0 in 0.521s {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 25 15:53:44 devstack cinder-volume[83528]: DEBUG cinder.coordination [None req-86b4e72a-41b6-4c90-a43a-b14b5155cfd5 tempest-GroupSnapshotsTest-1779717395 None] Lock "cinder-quobyte-e828df16-8f13-4a27-95f2-603bf8c048fe" released by "_copy_volume_from_snapshot" :: held 6.097s {{(pid=83528) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 25 15:53:44 devstack cinder-volume[83528]: DEBUG cinder.coordination [None req-86b4e72a-41b6-4c90-a43a-b14b5155cfd5 tempest-GroupSnapshotsTest-1779717395 None] Lock "cinder-quobyte-817d378d-7215-4fcb-bc05-3fe4f44ebda1-e828df16-8f13-4a27-95f2-603bf8c048fe" released by "_create_volume_from_snapshot" :: held 6.191s {{(pid=83528) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 25 15:53:44 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-86b4e72a-41b6-4c90-a43a-b14b5155cfd5 tempest-GroupSnapshotsTest-1779717395 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 6.232s {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 25 15:53:44 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-b47b7fcd-517c-4cd4-9add-64a887a031f1 tempest-VolumesTestJSON-1115907172 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.031s {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 25 15:53:44 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.quobyte [None req-b47b7fcd-517c-4cd4-9add-64a887a031f1 tempest-VolumesTestJSON-1115907172 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-25T14:53:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1322977346',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c697fbe1-7026-4e4b-838d-7c8158c499ca,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='65bfee69eeef4d49b0c1914aba9c4b44',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-25T14:53:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-25T14:53:40Z,use_quota=True,user_id='30394fa5276a41fd9a95ca3f6bb9f2a4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ce71c2f9-6543-4165-9653-a1529b2ea243),volume_type_id=ce71c2f9-6543-4165-9653-a1529b2ea243)}" {{(pid=83528) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 25 15:53:44 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.remotefs [None req-b47b7fcd-517c-4cd4-9add-64a887a031f1 tempest-VolumesTestJSON-1115907172 None] Creating volume c697fbe1-7026-4e4b-838d-7c8158c499ca {{(pid=83528) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 25 15:53:44 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-b47b7fcd-517c-4cd4-9add-64a887a031f1 tempest-VolumesTestJSON-1115907172 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 25 15:53:44 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-b47b7fcd-517c-4cd4-9add-64a887a031f1 tempest-VolumesTestJSON-1115907172 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 25 15:53:44 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.quobyte [None req-b47b7fcd-517c-4cd4-9add-64a887a031f1 tempest-VolumesTestJSON-1115907172 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23e9d725-3e04-4cd9-bfe0-c8ef43305589': None} {{(pid=83528) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 25 15:53:44 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.quobyte [None req-b47b7fcd-517c-4cd4-9add-64a887a031f1 tempest-VolumesTestJSON-1115907172 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23e9d725-3e04-4cd9-bfe0-c8ef43305589'] {{(pid=83528) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 25 15:53:44 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-b47b7fcd-517c-4cd4-9add-64a887a031f1 tempest-VolumesTestJSON-1115907172 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 25 15:53:44 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.quobyte [None req-b47b7fcd-517c-4cd4-9add-64a887a031f1 tempest-VolumesTestJSON-1115907172 None] Selected osci02.corp.quobyte.com/cinder-vol-23e9d725-3e04-4cd9-bfe0-c8ef43305589 as target Quobyte volume. {{(pid=83528) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 25 15:53:44 devstack cinder-volume[83528]: INFO cinder.volume.drivers.remotefs [None req-b47b7fcd-517c-4cd4-9add-64a887a031f1 tempest-VolumesTestJSON-1115907172 None] casted to osci02.corp.quobyte.com/cinder-vol-23e9d725-3e04-4cd9-bfe0-c8ef43305589 Feb 25 15:53:44 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-b47b7fcd-517c-4cd4-9add-64a887a031f1 tempest-VolumesTestJSON-1115907172 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-c697fbe1-7026-4e4b-838d-7c8158c499ca 1073741824 {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 25 15:53:44 devstack sudo[85745]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-c697fbe1-7026-4e4b-838d-7c8158c499ca 1073741824 Feb 25 15:53:44 devstack sudo[85745]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 25 15:53:44 devstack cinder-volume[83528]: INFO cinder.volume.manager [None req-86b4e72a-41b6-4c90-a43a-b14b5155cfd5 tempest-GroupSnapshotsTest-1779717395 None] Create group from source-snapshot-0c600445-9182-477a-8eea-e808f382e961 completed successfully. Feb 25 15:53:46 devstack cinder-volume[83528]: DEBUG cinder.coordination [None req-f88d050b-61af-4777-8ea9-64a96afccccd tempest-GroupSnapshotsTest-1779717395 None] Acquiring lock "cinder-quobyte-e828df16-8f13-4a27-95f2-603bf8c048fe" by "delete_volume" {{(pid=83528) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 25 15:53:46 devstack cinder-volume[83528]: DEBUG cinder.coordination [None req-f88d050b-61af-4777-8ea9-64a96afccccd tempest-GroupSnapshotsTest-1779717395 None] Lock "cinder-quobyte-e828df16-8f13-4a27-95f2-603bf8c048fe" acquired by "delete_volume" :: waited 0.039s {{(pid=83528) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 25 15:53:46 devstack cinder-volume[83528]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa7c8c6a-3ae4-4bf5-904f-0c17335544af]: (4, 'qcow2') {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 25 15:53:46 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-f88d050b-61af-4777-8ea9-64a96afccccd tempest-GroupSnapshotsTest-1779717395 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-e828df16-8f13-4a27-95f2-603bf8c048fe {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 25 15:53:46 devstack sudo[85745]: pam_unix(sudo:session): session closed for user root Feb 25 15:53:46 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-b47b7fcd-517c-4cd4-9add-64a887a031f1 tempest-VolumesTestJSON-1115907172 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-c697fbe1-7026-4e4b-838d-7c8158c499ca 1073741824" returned: 0 in 1.530s {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 25 15:53:46 devstack sudo[85750]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-e828df16-8f13-4a27-95f2-603bf8c048fe Feb 25 15:53:46 devstack sudo[85750]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 25 15:53:46 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-b47b7fcd-517c-4cd4-9add-64a887a031f1 tempest-VolumesTestJSON-1115907172 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-c697fbe1-7026-4e4b-838d-7c8158c499ca {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 25 15:53:46 devstack sudo[85752]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-c697fbe1-7026-4e4b-838d-7c8158c499ca Feb 25 15:53:46 devstack sudo[85752]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 25 15:53:47 devstack sudo[85752]: pam_unix(sudo:session): session closed for user root Feb 25 15:53:47 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-b47b7fcd-517c-4cd4-9add-64a887a031f1 tempest-VolumesTestJSON-1115907172 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-c697fbe1-7026-4e4b-838d-7c8158c499ca" returned: 0 in 0.781s {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 25 15:53:47 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.quobyte [None req-b47b7fcd-517c-4cd4-9add-64a887a031f1 tempest-VolumesTestJSON-1115907172 None] <== create_volume: return (2350ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-23e9d725-3e04-4cd9-bfe0-c8ef43305589'} {{(pid=83528) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 25 15:53:47 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-b47b7fcd-517c-4cd4-9add-64a887a031f1 tempest-VolumesTestJSON-1115907172 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.355s {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 25 15:53:47 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-b47b7fcd-517c-4cd4-9add-64a887a031f1 tempest-VolumesTestJSON-1115907172 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4d857d86-46a4-47ae-994e-b55a2d6105f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c697fbe1-7026-4e4b-838d-7c8158c499ca', 'volume_size': 1}' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 25 15:53:47 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-b47b7fcd-517c-4cd4-9add-64a887a031f1 tempest-VolumesTestJSON-1115907172 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3f313b5a-0410-4e70-8976-af4a556b7da4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 25 15:53:47 devstack sudo[85750]: pam_unix(sudo:session): session closed for user root Feb 25 15:53:47 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-f88d050b-61af-4777-8ea9-64a96afccccd tempest-GroupSnapshotsTest-1779717395 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-e828df16-8f13-4a27-95f2-603bf8c048fe" returned: 0 in 1.058s {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 25 15:53:47 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-f88d050b-61af-4777-8ea9-64a96afccccd tempest-GroupSnapshotsTest-1779717395 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-e828df16-8f13-4a27-95f2-603bf8c048fe {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 25 15:53:47 devstack cinder-volume[83528]: INFO cinder.volume.flows.manager.create_volume [None req-b47b7fcd-517c-4cd4-9add-64a887a031f1 tempest-VolumesTestJSON-1115907172 None] Volume volume-c697fbe1-7026-4e4b-838d-7c8158c499ca (c697fbe1-7026-4e4b-838d-7c8158c499ca): created successfully Feb 25 15:53:47 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-b47b7fcd-517c-4cd4-9add-64a887a031f1 tempest-VolumesTestJSON-1115907172 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3f313b5a-0410-4e70-8976-af4a556b7da4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 25 15:53:47 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-b47b7fcd-517c-4cd4-9add-64a887a031f1 tempest-VolumesTestJSON-1115907172 None] Flow 'volume_create_manager' (c76dc44c-71bc-4fb7-8ac1-8cb5ed37dca6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83528) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 25 15:53:47 devstack sudo[85772]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-e828df16-8f13-4a27-95f2-603bf8c048fe Feb 25 15:53:47 devstack cinder-volume[83528]: INFO cinder.volume.manager [None req-b47b7fcd-517c-4cd4-9add-64a887a031f1 tempest-VolumesTestJSON-1115907172 None] Created volume successfully. Feb 25 15:53:47 devstack sudo[85772]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 25 15:53:48 devstack sudo[85772]: pam_unix(sudo:session): session closed for user root Feb 25 15:53:48 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-f88d050b-61af-4777-8ea9-64a96afccccd tempest-GroupSnapshotsTest-1779717395 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-e828df16-8f13-4a27-95f2-603bf8c048fe" returned: 0 in 0.871s {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 25 15:53:48 devstack cinder-volume[83528]: DEBUG cinder.coordination [None req-f88d050b-61af-4777-8ea9-64a96afccccd tempest-GroupSnapshotsTest-1779717395 None] Lock "cinder-quobyte-e828df16-8f13-4a27-95f2-603bf8c048fe" released by "delete_volume" :: held 1.989s {{(pid=83528) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 25 15:53:48 devstack cinder-volume[83528]: DEBUG cinder.quota [None req-f88d050b-61af-4777-8ea9-64a96afccccd tempest-GroupSnapshotsTest-1779717395 None] Created reservations ['1489f6b3-85fb-4ce3-a0cf-ad003a892009'] {{(pid=83528) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 25 15:53:48 devstack cinder-volume[83528]: WARNING cinder.quota [None req-f88d050b-61af-4777-8ea9-64a96afccccd tempest-GroupSnapshotsTest-1779717395 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-1244973938 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-1244973938, it is now deprecated. Please use the default quota class for default quota. Feb 25 15:53:48 devstack cinder-volume[83528]: WARNING cinder.quota [None req-f88d050b-61af-4777-8ea9-64a96afccccd tempest-GroupSnapshotsTest-1779717395 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-1244973938 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-1244973938, it is now deprecated. Please use the default quota class for default quota. Feb 25 15:53:48 devstack cinder-volume[83528]: DEBUG cinder.quota [None req-f88d050b-61af-4777-8ea9-64a96afccccd tempest-GroupSnapshotsTest-1779717395 None] Created reservations ['9cc62aca-06ef-4285-b895-fcb411d4a8c8', 'a841429d-edf7-47fa-9d82-39b5d64616e6', 'fd4dd516-0ee3-48e8-a70d-0e8395fdf4a0', '50e9e3db-a1fa-430d-9aab-7d76ad66225c'] {{(pid=83528) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 25 15:53:48 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-f88d050b-61af-4777-8ea9-64a96afccccd tempest-GroupSnapshotsTest-1779717395 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 25 15:53:48 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-f88d050b-61af-4777-8ea9-64a96afccccd tempest-GroupSnapshotsTest-1779717395 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 25 15:53:48 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.quobyte [None req-f88d050b-61af-4777-8ea9-64a96afccccd tempest-GroupSnapshotsTest-1779717395 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23e9d725-3e04-4cd9-bfe0-c8ef43305589': None} {{(pid=83528) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 25 15:53:48 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.quobyte [None req-f88d050b-61af-4777-8ea9-64a96afccccd tempest-GroupSnapshotsTest-1779717395 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23e9d725-3e04-4cd9-bfe0-c8ef43305589'] {{(pid=83528) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 25 15:53:48 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-f88d050b-61af-4777-8ea9-64a96afccccd tempest-GroupSnapshotsTest-1779717395 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 25 15:53:48 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-f88d050b-61af-4777-8ea9-64a96afccccd tempest-GroupSnapshotsTest-1779717395 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85 {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 25 15:53:48 devstack cinder-volume[83528]: DEBUG cinder.coordination [None req-86b231a9-c0a3-40cf-8373-64198f267816 tempest-VolumesTestJSON-1115907172 None] Acquiring lock "cinder-c697fbe1-7026-4e4b-838d-7c8158c499ca-delete_volume" by "delete_volume" {{(pid=83528) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 25 15:53:48 devstack cinder-volume[83528]: DEBUG cinder.coordination [None req-86b231a9-c0a3-40cf-8373-64198f267816 tempest-VolumesTestJSON-1115907172 None] Lock "cinder-c697fbe1-7026-4e4b-838d-7c8158c499ca-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=83528) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 25 15:53:48 devstack sudo[85794]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85 Feb 25 15:53:48 devstack sudo[85794]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 25 15:53:48 devstack cinder-volume[83528]: DEBUG cinder.coordination [None req-86b231a9-c0a3-40cf-8373-64198f267816 tempest-VolumesTestJSON-1115907172 None] Acquiring lock "cinder-quobyte-c697fbe1-7026-4e4b-838d-7c8158c499ca" by "delete_volume" {{(pid=83528) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 25 15:53:48 devstack cinder-volume[83528]: DEBUG cinder.coordination [None req-86b231a9-c0a3-40cf-8373-64198f267816 tempest-VolumesTestJSON-1115907172 None] Lock "cinder-quobyte-c697fbe1-7026-4e4b-838d-7c8158c499ca" acquired by "delete_volume" :: waited 0.010s {{(pid=83528) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 25 15:53:48 devstack cinder-volume[83528]: DEBUG oslo.privsep.daemon [-] privsep: reply[71458691-75b3-43fe-b376-e2011d8a63cf]: (4, 'qcow2') {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 25 15:53:48 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-86b231a9-c0a3-40cf-8373-64198f267816 tempest-VolumesTestJSON-1115907172 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-c697fbe1-7026-4e4b-838d-7c8158c499ca {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 25 15:53:48 devstack sudo[85796]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-c697fbe1-7026-4e4b-838d-7c8158c499ca Feb 25 15:53:48 devstack sudo[85796]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 25 15:53:48 devstack cinder-volume[83528]: INFO cinder.volume.manager [None req-b0af7e67-3d2f-4123-87d9-56bd54410968 tempest-GroupSnapshotsTest-1779717395 None] group_snapshot 0c600445-9182-477a-8eea-e808f382e961: deleting Feb 25 15:53:48 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-b0af7e67-3d2f-4123-87d9-56bd54410968 tempest-GroupSnapshotsTest-1779717395 None] group_snapshot 0c600445-9182-477a-8eea-e808f382e961: deleting {{(pid=83528) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Feb 25 15:53:48 devstack cinder-volume[83528]: DEBUG cinder.coordination [None req-b0af7e67-3d2f-4123-87d9-56bd54410968 tempest-GroupSnapshotsTest-1779717395 None] Acquiring lock "cinder-quobyte-f8e0e2db-f0ad-421c-bb36-a1d39b35fb1c" by "delete_snapshot" {{(pid=83528) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 25 15:53:48 devstack cinder-volume[83528]: DEBUG cinder.coordination [None req-b0af7e67-3d2f-4123-87d9-56bd54410968 tempest-GroupSnapshotsTest-1779717395 None] Lock "cinder-quobyte-f8e0e2db-f0ad-421c-bb36-a1d39b35fb1c" acquired by "delete_snapshot" :: waited 0.024s {{(pid=83528) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 25 15:53:48 devstack cinder-volume[83528]: DEBUG cinder.coordination [None req-b0af7e67-3d2f-4123-87d9-56bd54410968 tempest-GroupSnapshotsTest-1779717395 None] Acquiring lock "cinder-quobyte-817d378d-7215-4fcb-bc05-3fe4f44ebda1" by "_delete_snapshot" {{(pid=83528) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 25 15:53:48 devstack cinder-volume[83528]: DEBUG cinder.coordination [None req-b0af7e67-3d2f-4123-87d9-56bd54410968 tempest-GroupSnapshotsTest-1779717395 None] Lock "cinder-quobyte-817d378d-7215-4fcb-bc05-3fe4f44ebda1" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=83528) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 25 15:53:48 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.remotefs [None req-b0af7e67-3d2f-4123-87d9-56bd54410968 tempest-GroupSnapshotsTest-1779717395 None] Deleting offline snapshot 817d378d-7215-4fcb-bc05-3fe4f44ebda1 of volume f8e0e2db-f0ad-421c-bb36-a1d39b35fb1c {{(pid=83528) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Feb 25 15:53:48 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.remotefs [None req-b0af7e67-3d2f-4123-87d9-56bd54410968 tempest-GroupSnapshotsTest-1779717395 None] snapshot_file for this snap is: volume-f8e0e2db-f0ad-421c-bb36-a1d39b35fb1c.817d378d-7215-4fcb-bc05-3fe4f44ebda1 {{(pid=83528) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Feb 25 15:53:48 devstack cinder-volume[83528]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c95d097-4b17-497b-a289-dc7771d17a47]: (4, 'qcow2') {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 25 15:53:49 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-b0af7e67-3d2f-4123-87d9-56bd54410968 tempest-GroupSnapshotsTest-1779717395 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-f8e0e2db-f0ad-421c-bb36-a1d39b35fb1c.817d378d-7215-4fcb-bc05-3fe4f44ebda1 {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 25 15:53:49 devstack sudo[85799]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-f8e0e2db-f0ad-421c-bb36-a1d39b35fb1c.817d378d-7215-4fcb-bc05-3fe4f44ebda1 Feb 25 15:53:49 devstack sudo[85799]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 25 15:53:49 devstack sudo[85794]: pam_unix(sudo:session): session closed for user root Feb 25 15:53:49 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-f88d050b-61af-4777-8ea9-64a96afccccd tempest-GroupSnapshotsTest-1779717395 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85" returned: 0 in 0.832s {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 25 15:53:49 devstack cinder-volume[83528]: DEBUG cinder.manager [None req-f88d050b-61af-4777-8ea9-64a96afccccd tempest-GroupSnapshotsTest-1779717395 None] Notifying Schedulers of capabilities ... {{(pid=83528) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 25 15:53:49 devstack cinder-volume[83528]: INFO cinder.volume.manager [None req-f88d050b-61af-4777-8ea9-64a96afccccd tempest-GroupSnapshotsTest-1779717395 None] Delete group completed successfully. Feb 25 15:53:49 devstack sudo[85796]: pam_unix(sudo:session): session closed for user root Feb 25 15:53:49 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-86b231a9-c0a3-40cf-8373-64198f267816 tempest-VolumesTestJSON-1115907172 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-c697fbe1-7026-4e4b-838d-7c8158c499ca" returned: 0 in 1.039s {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 25 15:53:49 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-86b231a9-c0a3-40cf-8373-64198f267816 tempest-VolumesTestJSON-1115907172 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-c697fbe1-7026-4e4b-838d-7c8158c499ca {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 25 15:53:49 devstack sudo[85805]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-c697fbe1-7026-4e4b-838d-7c8158c499ca Feb 25 15:53:49 devstack sudo[85805]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 25 15:53:49 devstack sudo[85799]: pam_unix(sudo:session): session closed for user root Feb 25 15:53:49 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-b0af7e67-3d2f-4123-87d9-56bd54410968 tempest-GroupSnapshotsTest-1779717395 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-f8e0e2db-f0ad-421c-bb36-a1d39b35fb1c.817d378d-7215-4fcb-bc05-3fe4f44ebda1" returned: 0 in 0.884s {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 25 15:53:49 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.remotefs [None req-b0af7e67-3d2f-4123-87d9-56bd54410968 tempest-GroupSnapshotsTest-1779717395 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f8e0e2db-f0ad-421c-bb36-a1d39b35fb1c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83528) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Feb 25 15:53:49 devstack cinder-volume[83528]: DEBUG oslo.privsep.daemon [-] privsep: reply[deaf8cb9-c186-4d9f-8146-4847240e3d9a]: (4, 'qcow2') {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 25 15:53:49 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-b0af7e67-3d2f-4123-87d9-56bd54410968 tempest-GroupSnapshotsTest-1779717395 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-f8e0e2db-f0ad-421c-bb36-a1d39b35fb1c {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 25 15:53:49 devstack sudo[85810]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-f8e0e2db-f0ad-421c-bb36-a1d39b35fb1c Feb 25 15:53:49 devstack sudo[85810]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 25 15:53:50 devstack sudo[85805]: pam_unix(sudo:session): session closed for user root Feb 25 15:53:50 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-86b231a9-c0a3-40cf-8373-64198f267816 tempest-VolumesTestJSON-1115907172 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-c697fbe1-7026-4e4b-838d-7c8158c499ca" returned: 0 in 0.602s {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 25 15:53:50 devstack cinder-volume[83528]: DEBUG cinder.coordination [None req-86b231a9-c0a3-40cf-8373-64198f267816 tempest-VolumesTestJSON-1115907172 None] Lock "cinder-quobyte-c697fbe1-7026-4e4b-838d-7c8158c499ca" released by "delete_volume" :: held 1.674s {{(pid=83528) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 25 15:53:50 devstack cinder-volume[83528]: DEBUG cinder.quota [None req-86b231a9-c0a3-40cf-8373-64198f267816 tempest-VolumesTestJSON-1115907172 None] Created reservations ['eea732a7-d5e4-4250-a769-5b4f4ef32fd4', '94517201-dfe1-4c84-b072-ba2bb1a930f9', '46e27153-c3dd-4104-8719-19f10e387e0c', '8cbc80c3-1d9d-4907-876f-22608e4b4ff4'] {{(pid=83528) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 25 15:53:50 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-86b231a9-c0a3-40cf-8373-64198f267816 tempest-VolumesTestJSON-1115907172 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 25 15:53:50 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-86b231a9-c0a3-40cf-8373-64198f267816 tempest-VolumesTestJSON-1115907172 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 25 15:53:50 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.quobyte [None req-86b231a9-c0a3-40cf-8373-64198f267816 tempest-VolumesTestJSON-1115907172 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23e9d725-3e04-4cd9-bfe0-c8ef43305589': None} {{(pid=83528) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 25 15:53:50 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.quobyte [None req-86b231a9-c0a3-40cf-8373-64198f267816 tempest-VolumesTestJSON-1115907172 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23e9d725-3e04-4cd9-bfe0-c8ef43305589'] {{(pid=83528) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 25 15:53:50 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-86b231a9-c0a3-40cf-8373-64198f267816 tempest-VolumesTestJSON-1115907172 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 25 15:53:50 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-86b231a9-c0a3-40cf-8373-64198f267816 tempest-VolumesTestJSON-1115907172 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85 {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 25 15:53:50 devstack sudo[85816]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85 Feb 25 15:53:50 devstack sudo[85816]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 25 15:53:50 devstack sudo[85810]: pam_unix(sudo:session): session closed for user root Feb 25 15:53:50 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-b0af7e67-3d2f-4123-87d9-56bd54410968 tempest-GroupSnapshotsTest-1779717395 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-f8e0e2db-f0ad-421c-bb36-a1d39b35fb1c" returned: 0 in 0.604s {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 25 15:53:50 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-b0af7e67-3d2f-4123-87d9-56bd54410968 tempest-GroupSnapshotsTest-1779717395 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-f8e0e2db-f0ad-421c-bb36-a1d39b35fb1c.817d378d-7215-4fcb-bc05-3fe4f44ebda1 {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 25 15:53:50 devstack sudo[85822]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-f8e0e2db-f0ad-421c-bb36-a1d39b35fb1c.817d378d-7215-4fcb-bc05-3fe4f44ebda1 Feb 25 15:53:50 devstack sudo[85822]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 25 15:53:50 devstack cinder-volume[83528]: DEBUG cinder.coordination [None req-01548f26-4f39-4258-8b64-3226a333345d tempest-VolumesTestJSON-1115907172 None] Acquiring lock "cinder-bc92d814-5f60-417c-8382-68a183583c6d-delete_volume" by "delete_volume" {{(pid=83528) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 25 15:53:50 devstack cinder-volume[83528]: DEBUG cinder.coordination [None req-01548f26-4f39-4258-8b64-3226a333345d tempest-VolumesTestJSON-1115907172 None] Lock "cinder-bc92d814-5f60-417c-8382-68a183583c6d-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=83528) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 25 15:53:50 devstack cinder-volume[83528]: DEBUG cinder.coordination [None req-01548f26-4f39-4258-8b64-3226a333345d tempest-VolumesTestJSON-1115907172 None] Acquiring lock "cinder-quobyte-bc92d814-5f60-417c-8382-68a183583c6d" by "delete_volume" {{(pid=83528) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 25 15:53:50 devstack cinder-volume[83528]: DEBUG cinder.coordination [None req-01548f26-4f39-4258-8b64-3226a333345d tempest-VolumesTestJSON-1115907172 None] Lock "cinder-quobyte-bc92d814-5f60-417c-8382-68a183583c6d" acquired by "delete_volume" :: waited 0.008s {{(pid=83528) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 25 15:53:50 devstack cinder-volume[83528]: DEBUG oslo.privsep.daemon [-] privsep: reply[39961992-3bab-4795-8cf9-298ff6282a1b]: (4, 'qcow2') {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 25 15:53:50 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-01548f26-4f39-4258-8b64-3226a333345d tempest-VolumesTestJSON-1115907172 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-bc92d814-5f60-417c-8382-68a183583c6d {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 25 15:53:50 devstack sudo[85824]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-bc92d814-5f60-417c-8382-68a183583c6d Feb 25 15:53:50 devstack sudo[85824]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 25 15:53:51 devstack sudo[85816]: pam_unix(sudo:session): session closed for user root Feb 25 15:53:51 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-86b231a9-c0a3-40cf-8373-64198f267816 tempest-VolumesTestJSON-1115907172 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85" returned: 0 in 0.850s {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 25 15:53:51 devstack cinder-volume[83528]: DEBUG cinder.manager [None req-86b231a9-c0a3-40cf-8373-64198f267816 tempest-VolumesTestJSON-1115907172 None] Notifying Schedulers of capabilities ... {{(pid=83528) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 25 15:53:51 devstack cinder-volume[83528]: INFO cinder.volume.manager [None req-86b231a9-c0a3-40cf-8373-64198f267816 tempest-VolumesTestJSON-1115907172 None] Deleted volume successfully. Feb 25 15:53:51 devstack cinder-volume[83528]: DEBUG cinder.coordination [None req-86b231a9-c0a3-40cf-8373-64198f267816 tempest-VolumesTestJSON-1115907172 None] Lock "cinder-c697fbe1-7026-4e4b-838d-7c8158c499ca-delete_volume" released by "delete_volume" :: held 2.700s {{(pid=83528) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 25 15:53:51 devstack sudo[85822]: pam_unix(sudo:session): session closed for user root Feb 25 15:53:51 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-b0af7e67-3d2f-4123-87d9-56bd54410968 tempest-GroupSnapshotsTest-1779717395 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-f8e0e2db-f0ad-421c-bb36-a1d39b35fb1c.817d378d-7215-4fcb-bc05-3fe4f44ebda1" returned: 0 in 0.747s {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 25 15:53:51 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-b0af7e67-3d2f-4123-87d9-56bd54410968 tempest-GroupSnapshotsTest-1779717395 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-f8e0e2db-f0ad-421c-bb36-a1d39b35fb1c.817d378d-7215-4fcb-bc05-3fe4f44ebda1 {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 25 15:53:51 devstack sudo[85830]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-f8e0e2db-f0ad-421c-bb36-a1d39b35fb1c.817d378d-7215-4fcb-bc05-3fe4f44ebda1 Feb 25 15:53:51 devstack sudo[85830]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 25 15:53:51 devstack sudo[85824]: pam_unix(sudo:session): session closed for user root Feb 25 15:53:51 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-01548f26-4f39-4258-8b64-3226a333345d tempest-VolumesTestJSON-1115907172 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-bc92d814-5f60-417c-8382-68a183583c6d" returned: 0 in 0.752s {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 25 15:53:51 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-01548f26-4f39-4258-8b64-3226a333345d tempest-VolumesTestJSON-1115907172 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-bc92d814-5f60-417c-8382-68a183583c6d {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 25 15:53:51 devstack sudo[85835]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-bc92d814-5f60-417c-8382-68a183583c6d Feb 25 15:53:51 devstack sudo[85835]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 25 15:53:51 devstack sudo[85830]: pam_unix(sudo:session): session closed for user root Feb 25 15:53:51 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-b0af7e67-3d2f-4123-87d9-56bd54410968 tempest-GroupSnapshotsTest-1779717395 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-f8e0e2db-f0ad-421c-bb36-a1d39b35fb1c.817d378d-7215-4fcb-bc05-3fe4f44ebda1" returned: 0 in 0.482s {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 25 15:53:51 devstack cinder-volume[83528]: DEBUG cinder.coordination [None req-b0af7e67-3d2f-4123-87d9-56bd54410968 tempest-GroupSnapshotsTest-1779717395 None] Lock "cinder-quobyte-817d378d-7215-4fcb-bc05-3fe4f44ebda1" released by "_delete_snapshot" :: held 2.803s {{(pid=83528) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 25 15:53:51 devstack cinder-volume[83528]: DEBUG cinder.coordination [None req-b0af7e67-3d2f-4123-87d9-56bd54410968 tempest-GroupSnapshotsTest-1779717395 None] Lock "cinder-quobyte-f8e0e2db-f0ad-421c-bb36-a1d39b35fb1c" released by "delete_snapshot" :: held 2.823s {{(pid=83528) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 25 15:53:51 devstack cinder-volume[83528]: WARNING cinder.quota [None req-b0af7e67-3d2f-4123-87d9-56bd54410968 tempest-GroupSnapshotsTest-1779717395 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-1244973938 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-1244973938, it is now deprecated. Please use the default quota class for default quota. Feb 25 15:53:51 devstack cinder-volume[83528]: DEBUG cinder.quota [None req-b0af7e67-3d2f-4123-87d9-56bd54410968 tempest-GroupSnapshotsTest-1779717395 None] Created reservations ['c90ce8e2-89a4-45ef-ae8d-a1dc9c8751d8', '6190f032-0690-4285-9fc1-c3125dc8031f', 'd7312d8f-0d6c-4fdd-a367-eb668633ac14', 'ed39f610-b008-4189-9ef3-ddb562eddacc'] {{(pid=83528) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 25 15:53:51 devstack cinder-volume[83528]: INFO cinder.volume.manager [None req-b0af7e67-3d2f-4123-87d9-56bd54410968 tempest-GroupSnapshotsTest-1779717395 None] group_snapshot 0c600445-9182-477a-8eea-e808f382e961: deleted successfully Feb 25 15:53:52 devstack sudo[85835]: pam_unix(sudo:session): session closed for user root Feb 25 15:53:52 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-01548f26-4f39-4258-8b64-3226a333345d tempest-VolumesTestJSON-1115907172 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-bc92d814-5f60-417c-8382-68a183583c6d" returned: 0 in 0.669s {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 25 15:53:52 devstack cinder-volume[83528]: DEBUG cinder.coordination [None req-01548f26-4f39-4258-8b64-3226a333345d tempest-VolumesTestJSON-1115907172 None] Lock "cinder-quobyte-bc92d814-5f60-417c-8382-68a183583c6d" released by "delete_volume" :: held 1.461s {{(pid=83528) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 25 15:53:52 devstack cinder-volume[83528]: DEBUG cinder.quota [None req-01548f26-4f39-4258-8b64-3226a333345d tempest-VolumesTestJSON-1115907172 None] Created reservations ['a57595a8-e582-47d1-b6af-c4ba8055ce01', '4a4216a1-a5db-4396-9924-233ef65376c9', 'd45c2a03-fd54-4df2-8847-f5282a58a9be', '2fd05f18-3274-4d02-ad25-0f4e0961880b'] {{(pid=83528) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 25 15:53:52 devstack cinder-volume[83528]: DEBUG cinder.coordination [None req-346e8402-09a9-4e08-acb0-edc81d7e8bdd tempest-GroupSnapshotsTest-1779717395 None] Acquiring lock "cinder-quobyte-f8e0e2db-f0ad-421c-bb36-a1d39b35fb1c" by "delete_volume" {{(pid=83528) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 25 15:53:52 devstack cinder-volume[83528]: DEBUG cinder.coordination [None req-346e8402-09a9-4e08-acb0-edc81d7e8bdd tempest-GroupSnapshotsTest-1779717395 None] Lock "cinder-quobyte-f8e0e2db-f0ad-421c-bb36-a1d39b35fb1c" acquired by "delete_volume" :: waited 0.075s {{(pid=83528) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 25 15:53:52 devstack cinder-volume[83528]: DEBUG oslo.privsep.daemon [-] privsep: reply[30770b85-ad95-4a69-baef-82e6074899ae]: (4, 'qcow2') {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 25 15:53:52 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-346e8402-09a9-4e08-acb0-edc81d7e8bdd tempest-GroupSnapshotsTest-1779717395 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-f8e0e2db-f0ad-421c-bb36-a1d39b35fb1c {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 25 15:53:52 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-01548f26-4f39-4258-8b64-3226a333345d tempest-VolumesTestJSON-1115907172 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 25 15:53:52 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-01548f26-4f39-4258-8b64-3226a333345d tempest-VolumesTestJSON-1115907172 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 25 15:53:52 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.quobyte [None req-01548f26-4f39-4258-8b64-3226a333345d tempest-VolumesTestJSON-1115907172 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23e9d725-3e04-4cd9-bfe0-c8ef43305589': None} {{(pid=83528) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 25 15:53:52 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.quobyte [None req-01548f26-4f39-4258-8b64-3226a333345d tempest-VolumesTestJSON-1115907172 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23e9d725-3e04-4cd9-bfe0-c8ef43305589'] {{(pid=83528) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 25 15:53:52 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-01548f26-4f39-4258-8b64-3226a333345d tempest-VolumesTestJSON-1115907172 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 25 15:53:52 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-01548f26-4f39-4258-8b64-3226a333345d tempest-VolumesTestJSON-1115907172 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85 {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 25 15:53:52 devstack sudo[85843]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85 Feb 25 15:53:52 devstack sudo[85843]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 25 15:53:52 devstack sudo[85842]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-f8e0e2db-f0ad-421c-bb36-a1d39b35fb1c Feb 25 15:53:52 devstack sudo[85842]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 25 15:53:52 devstack sudo[85843]: pam_unix(sudo:session): session closed for user root Feb 25 15:53:52 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-01548f26-4f39-4258-8b64-3226a333345d tempest-VolumesTestJSON-1115907172 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85" returned: 0 in 0.483s {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 25 15:53:52 devstack cinder-volume[83528]: DEBUG cinder.manager [None req-01548f26-4f39-4258-8b64-3226a333345d tempest-VolumesTestJSON-1115907172 None] Notifying Schedulers of capabilities ... {{(pid=83528) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 25 15:53:52 devstack cinder-volume[83528]: INFO cinder.volume.manager [None req-01548f26-4f39-4258-8b64-3226a333345d tempest-VolumesTestJSON-1115907172 None] Deleted volume successfully. Feb 25 15:53:52 devstack cinder-volume[83528]: DEBUG cinder.coordination [None req-447234a0-9886-4e1e-a448-5f6e4a453dd5 tempest-VolumesTestJSON-1115907172 None] Acquiring lock "cinder-de2b4aad-ea86-4277-9515-6bb0c66d63c6-delete_volume" by "delete_volume" {{(pid=83528) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 25 15:53:53 devstack cinder-volume[83528]: DEBUG cinder.coordination [None req-01548f26-4f39-4258-8b64-3226a333345d tempest-VolumesTestJSON-1115907172 None] Lock "cinder-bc92d814-5f60-417c-8382-68a183583c6d-delete_volume" released by "delete_volume" :: held 2.293s {{(pid=83528) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 25 15:53:53 devstack cinder-volume[83528]: DEBUG cinder.coordination [None req-447234a0-9886-4e1e-a448-5f6e4a453dd5 tempest-VolumesTestJSON-1115907172 None] Lock "cinder-de2b4aad-ea86-4277-9515-6bb0c66d63c6-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=83528) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 25 15:53:53 devstack cinder-volume[83528]: DEBUG cinder.coordination [None req-447234a0-9886-4e1e-a448-5f6e4a453dd5 tempest-VolumesTestJSON-1115907172 None] Acquiring lock "cinder-quobyte-de2b4aad-ea86-4277-9515-6bb0c66d63c6" by "delete_volume" {{(pid=83528) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 25 15:53:53 devstack cinder-volume[83528]: DEBUG cinder.coordination [None req-447234a0-9886-4e1e-a448-5f6e4a453dd5 tempest-VolumesTestJSON-1115907172 None] Lock "cinder-quobyte-de2b4aad-ea86-4277-9515-6bb0c66d63c6" acquired by "delete_volume" :: waited 0.008s {{(pid=83528) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 25 15:53:53 devstack cinder-volume[83528]: DEBUG oslo.privsep.daemon [-] privsep: reply[d233a527-e90b-4126-bf64-05ad857e0f36]: (4, 'qcow2') {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 25 15:53:53 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-447234a0-9886-4e1e-a448-5f6e4a453dd5 tempest-VolumesTestJSON-1115907172 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-de2b4aad-ea86-4277-9515-6bb0c66d63c6 {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 25 15:53:53 devstack sudo[85842]: pam_unix(sudo:session): session closed for user root Feb 25 15:53:53 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-346e8402-09a9-4e08-acb0-edc81d7e8bdd tempest-GroupSnapshotsTest-1779717395 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-f8e0e2db-f0ad-421c-bb36-a1d39b35fb1c" returned: 0 in 0.658s {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 25 15:53:53 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-346e8402-09a9-4e08-acb0-edc81d7e8bdd tempest-GroupSnapshotsTest-1779717395 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-f8e0e2db-f0ad-421c-bb36-a1d39b35fb1c {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 25 15:53:53 devstack sudo[85851]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-f8e0e2db-f0ad-421c-bb36-a1d39b35fb1c Feb 25 15:53:53 devstack sudo[85851]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 25 15:53:53 devstack sudo[85850]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-de2b4aad-ea86-4277-9515-6bb0c66d63c6 Feb 25 15:53:53 devstack sudo[85850]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 25 15:53:53 devstack sudo[85850]: pam_unix(sudo:session): session closed for user root Feb 25 15:53:53 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-447234a0-9886-4e1e-a448-5f6e4a453dd5 tempest-VolumesTestJSON-1115907172 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-de2b4aad-ea86-4277-9515-6bb0c66d63c6" returned: 0 in 0.629s {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 25 15:53:53 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-447234a0-9886-4e1e-a448-5f6e4a453dd5 tempest-VolumesTestJSON-1115907172 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-de2b4aad-ea86-4277-9515-6bb0c66d63c6 {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 25 15:53:53 devstack sudo[85851]: pam_unix(sudo:session): session closed for user root Feb 25 15:53:53 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-346e8402-09a9-4e08-acb0-edc81d7e8bdd tempest-GroupSnapshotsTest-1779717395 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-f8e0e2db-f0ad-421c-bb36-a1d39b35fb1c" returned: 0 in 0.584s {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 25 15:53:53 devstack cinder-volume[83528]: DEBUG cinder.coordination [None req-346e8402-09a9-4e08-acb0-edc81d7e8bdd tempest-GroupSnapshotsTest-1779717395 None] Lock "cinder-quobyte-f8e0e2db-f0ad-421c-bb36-a1d39b35fb1c" released by "delete_volume" :: held 1.290s {{(pid=83528) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 25 15:53:53 devstack sudo[85858]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-de2b4aad-ea86-4277-9515-6bb0c66d63c6 Feb 25 15:53:53 devstack sudo[85858]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 25 15:53:53 devstack cinder-volume[83528]: DEBUG cinder.quota [None req-346e8402-09a9-4e08-acb0-edc81d7e8bdd tempest-GroupSnapshotsTest-1779717395 None] Created reservations ['e518a9ca-9ee9-4707-967a-45de1e75726e'] {{(pid=83528) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 25 15:53:53 devstack cinder-volume[83528]: WARNING cinder.db.sqlalchemy.api [None req-346e8402-09a9-4e08-acb0-edc81d7e8bdd tempest-GroupSnapshotsTest-1779717395 None] Reservation would make usage less than 0 for the following resources, so on commit they will be limited to prevent going below 0: ['gigabytes', 'gigabytes_tempest-GroupSnapshotsTest-volume-type-1244973938'] Feb 25 15:53:53 devstack cinder-volume[83528]: DEBUG cinder.quota [None req-346e8402-09a9-4e08-acb0-edc81d7e8bdd tempest-GroupSnapshotsTest-1779717395 None] Created reservations ['24af7f73-67d4-4c94-b65d-8793bd323ad3', 'a4458486-551f-468e-b574-becbb7cef468', '9cec62d0-5b54-41b1-8633-81de498d3696', 'fe62f36b-b188-47f5-bc5b-743adbfd8a9b'] {{(pid=83528) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 25 15:53:53 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-346e8402-09a9-4e08-acb0-edc81d7e8bdd tempest-GroupSnapshotsTest-1779717395 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 25 15:53:53 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-346e8402-09a9-4e08-acb0-edc81d7e8bdd tempest-GroupSnapshotsTest-1779717395 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 25 15:53:53 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.quobyte [None req-346e8402-09a9-4e08-acb0-edc81d7e8bdd tempest-GroupSnapshotsTest-1779717395 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23e9d725-3e04-4cd9-bfe0-c8ef43305589': None} {{(pid=83528) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 25 15:53:53 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.quobyte [None req-346e8402-09a9-4e08-acb0-edc81d7e8bdd tempest-GroupSnapshotsTest-1779717395 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23e9d725-3e04-4cd9-bfe0-c8ef43305589'] {{(pid=83528) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 25 15:53:53 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-346e8402-09a9-4e08-acb0-edc81d7e8bdd tempest-GroupSnapshotsTest-1779717395 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 25 15:53:53 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-346e8402-09a9-4e08-acb0-edc81d7e8bdd tempest-GroupSnapshotsTest-1779717395 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85 {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 25 15:53:53 devstack sudo[85860]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85 Feb 25 15:53:53 devstack sudo[85860]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 25 15:53:54 devstack sudo[85858]: pam_unix(sudo:session): session closed for user root Feb 25 15:53:54 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-447234a0-9886-4e1e-a448-5f6e4a453dd5 tempest-VolumesTestJSON-1115907172 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-de2b4aad-ea86-4277-9515-6bb0c66d63c6" returned: 0 in 0.658s {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 25 15:53:54 devstack cinder-volume[83528]: DEBUG cinder.coordination [None req-447234a0-9886-4e1e-a448-5f6e4a453dd5 tempest-VolumesTestJSON-1115907172 None] Lock "cinder-quobyte-de2b4aad-ea86-4277-9515-6bb0c66d63c6" released by "delete_volume" :: held 1.327s {{(pid=83528) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 25 15:53:54 devstack cinder-volume[83528]: DEBUG cinder.quota [None req-447234a0-9886-4e1e-a448-5f6e4a453dd5 tempest-VolumesTestJSON-1115907172 None] Created reservations ['0a57893c-e04d-439a-86ae-e0c116c1dd4c', 'b12a3cce-af47-4990-a8f0-8b75f46298d8', '229bd3e0-10a7-4ad1-b651-d044cb8a8f66', '7daed058-22d3-407b-b230-b8a600290fe9'] {{(pid=83528) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 25 15:53:54 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-447234a0-9886-4e1e-a448-5f6e4a453dd5 tempest-VolumesTestJSON-1115907172 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 25 15:53:54 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-447234a0-9886-4e1e-a448-5f6e4a453dd5 tempest-VolumesTestJSON-1115907172 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 25 15:53:54 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.quobyte [None req-447234a0-9886-4e1e-a448-5f6e4a453dd5 tempest-VolumesTestJSON-1115907172 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23e9d725-3e04-4cd9-bfe0-c8ef43305589': None} {{(pid=83528) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 25 15:53:54 devstack sudo[85860]: pam_unix(sudo:session): session closed for user root Feb 25 15:53:54 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.quobyte [None req-447234a0-9886-4e1e-a448-5f6e4a453dd5 tempest-VolumesTestJSON-1115907172 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23e9d725-3e04-4cd9-bfe0-c8ef43305589'] {{(pid=83528) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 25 15:53:54 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-447234a0-9886-4e1e-a448-5f6e4a453dd5 tempest-VolumesTestJSON-1115907172 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.056s {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 25 15:53:54 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-447234a0-9886-4e1e-a448-5f6e4a453dd5 tempest-VolumesTestJSON-1115907172 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85 {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 25 15:53:54 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-346e8402-09a9-4e08-acb0-edc81d7e8bdd tempest-GroupSnapshotsTest-1779717395 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85" returned: 0 in 0.882s {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 25 15:53:54 devstack cinder-volume[83528]: DEBUG cinder.manager [None req-346e8402-09a9-4e08-acb0-edc81d7e8bdd tempest-GroupSnapshotsTest-1779717395 None] Notifying Schedulers of capabilities ... {{(pid=83528) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 25 15:53:54 devstack cinder-volume[83528]: INFO cinder.volume.manager [None req-346e8402-09a9-4e08-acb0-edc81d7e8bdd tempest-GroupSnapshotsTest-1779717395 None] Delete group completed successfully. Feb 25 15:53:54 devstack sudo[85891]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85 Feb 25 15:53:54 devstack sudo[85891]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 25 15:53:55 devstack cinder-volume[83528]: INFO cinder.volume.manager [None req-ae112356-7314-43eb-af31-2723756daf10 tempest-GroupSnapshotsTest-1779717395 None] Group tempest-GroupSnapshotsTest-Group-1416849227: creating Feb 25 15:53:55 devstack cinder-volume[83528]: INFO cinder.volume.manager [None req-ae112356-7314-43eb-af31-2723756daf10 tempest-GroupSnapshotsTest-1779717395 None] Group tempest-GroupSnapshotsTest-Group-1416849227: created successfully Feb 25 15:53:55 devstack cinder-volume[83528]: INFO cinder.volume.manager [None req-ae112356-7314-43eb-af31-2723756daf10 tempest-GroupSnapshotsTest-1779717395 None] Create group completed successfully. Feb 25 15:53:56 devstack sudo[85891]: pam_unix(sudo:session): session closed for user root Feb 25 15:53:56 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-447234a0-9886-4e1e-a448-5f6e4a453dd5 tempest-VolumesTestJSON-1115907172 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85" returned: 0 in 1.423s {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 25 15:53:56 devstack cinder-volume[83528]: DEBUG cinder.manager [None req-447234a0-9886-4e1e-a448-5f6e4a453dd5 tempest-VolumesTestJSON-1115907172 None] Notifying Schedulers of capabilities ... {{(pid=83528) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 25 15:53:56 devstack cinder-volume[83528]: INFO cinder.volume.manager [None req-447234a0-9886-4e1e-a448-5f6e4a453dd5 tempest-VolumesTestJSON-1115907172 None] Deleted volume successfully. Feb 25 15:53:56 devstack cinder-volume[83528]: DEBUG cinder.coordination [None req-447234a0-9886-4e1e-a448-5f6e4a453dd5 tempest-VolumesTestJSON-1115907172 None] Lock "cinder-de2b4aad-ea86-4277-9515-6bb0c66d63c6-delete_volume" released by "delete_volume" :: held 3.182s {{(pid=83528) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 25 15:53:57 devstack cinder-volume[83528]: DEBUG cinder.volume.flows.manager.create_volume [None req-d6273387-911d-4113-93c5-97427d893084 tempest-GroupSnapshotsTest-1779717395 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83528) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 25 15:53:57 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-d6273387-911d-4113-93c5-97427d893084 tempest-GroupSnapshotsTest-1779717395 None] Flow 'volume_create_manager' (82db3baf-7cdf-44a7-8ead-3fd88de3e7ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83528) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 25 15:53:57 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-d6273387-911d-4113-93c5-97427d893084 tempest-GroupSnapshotsTest-1779717395 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (23707a30-62fc-495e-8857-ad1b72aef7a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 25 15:53:58 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-d6273387-911d-4113-93c5-97427d893084 tempest-GroupSnapshotsTest-1779717395 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (23707a30-62fc-495e-8857-ad1b72aef7a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-25T14:53:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-102497972',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=743b181b-80b4-4249-ac53-411033a45b22,host='devstack@QuobyteHD#QuobyteHD',id=5153a222-bd7e-4e1e-8ff9-1b0c4d8bcba9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3827b9375d3e4b44a95020c555372a80',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-25T14:53:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-25T14:53:58Z,use_quota=True,user_id='99d268450fcd419cab908aed8018b7e2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0fa4f385-2d8c-4b47-95ee-bdea08e984db),volume_type_id=0fa4f385-2d8c-4b47-95ee-bdea08e984db)' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 25 15:53:58 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-d6273387-911d-4113-93c5-97427d893084 tempest-GroupSnapshotsTest-1779717395 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fdba855c-daf8-41ed-9ae8-210ffb919434) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 25 15:53:58 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-d6273387-911d-4113-93c5-97427d893084 tempest-GroupSnapshotsTest-1779717395 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fdba855c-daf8-41ed-9ae8-210ffb919434) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 25 15:53:58 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-d6273387-911d-4113-93c5-97427d893084 tempest-GroupSnapshotsTest-1779717395 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f5ab1824-ec8d-42df-946f-519cf93503c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 25 15:53:58 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-d6273387-911d-4113-93c5-97427d893084 tempest-GroupSnapshotsTest-1779717395 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f5ab1824-ec8d-42df-946f-519cf93503c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5153a222-bd7e-4e1e-8ff9-1b0c4d8bcba9', 'volume_name': 'volume-5153a222-bd7e-4e1e-8ff9-1b0c4d8bcba9', 'volume_size': 1}' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 25 15:53:58 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-d6273387-911d-4113-93c5-97427d893084 tempest-GroupSnapshotsTest-1779717395 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1eb9f619-996f-4b1f-b8d1-d90c1b24971f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 25 15:53:58 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-d6273387-911d-4113-93c5-97427d893084 tempest-GroupSnapshotsTest-1779717395 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1eb9f619-996f-4b1f-b8d1-d90c1b24971f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 25 15:53:58 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-d6273387-911d-4113-93c5-97427d893084 tempest-GroupSnapshotsTest-1779717395 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a1ed29e8-436b-40db-a833-c5d8f0f33999) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 25 15:53:58 devstack cinder-volume[83528]: INFO cinder.volume.flows.manager.create_volume [None req-d6273387-911d-4113-93c5-97427d893084 tempest-GroupSnapshotsTest-1779717395 None] Volume 5153a222-bd7e-4e1e-8ff9-1b0c4d8bcba9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5153a222-bd7e-4e1e-8ff9-1b0c4d8bcba9', 'volume_size': 1} Feb 25 15:53:58 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-d6273387-911d-4113-93c5-97427d893084 tempest-GroupSnapshotsTest-1779717395 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 25 15:53:58 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-d6273387-911d-4113-93c5-97427d893084 tempest-GroupSnapshotsTest-1779717395 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 25 15:53:58 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.quobyte [None req-d6273387-911d-4113-93c5-97427d893084 tempest-GroupSnapshotsTest-1779717395 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=743b181b-80b4-4249-ac53-411033a45b22,created_at=2026-02-25T14:53:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-102497972',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=743b181b-80b4-4249-ac53-411033a45b22,host='devstack@QuobyteHD#QuobyteHD',id=5153a222-bd7e-4e1e-8ff9-1b0c4d8bcba9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3827b9375d3e4b44a95020c555372a80',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-25T14:53:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-25T14:53:58Z,use_quota=True,user_id='99d268450fcd419cab908aed8018b7e2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0fa4f385-2d8c-4b47-95ee-bdea08e984db),volume_type_id=0fa4f385-2d8c-4b47-95ee-bdea08e984db)}" {{(pid=83528) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 25 15:53:58 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.remotefs [None req-d6273387-911d-4113-93c5-97427d893084 tempest-GroupSnapshotsTest-1779717395 None] Creating volume 5153a222-bd7e-4e1e-8ff9-1b0c4d8bcba9 {{(pid=83528) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 25 15:53:58 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-d6273387-911d-4113-93c5-97427d893084 tempest-GroupSnapshotsTest-1779717395 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 25 15:53:58 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-d6273387-911d-4113-93c5-97427d893084 tempest-GroupSnapshotsTest-1779717395 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 25 15:53:58 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.quobyte [None req-d6273387-911d-4113-93c5-97427d893084 tempest-GroupSnapshotsTest-1779717395 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23e9d725-3e04-4cd9-bfe0-c8ef43305589': None} {{(pid=83528) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 25 15:53:58 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.quobyte [None req-d6273387-911d-4113-93c5-97427d893084 tempest-GroupSnapshotsTest-1779717395 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23e9d725-3e04-4cd9-bfe0-c8ef43305589'] {{(pid=83528) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 25 15:53:58 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-d6273387-911d-4113-93c5-97427d893084 tempest-GroupSnapshotsTest-1779717395 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 25 15:53:58 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.quobyte [None req-d6273387-911d-4113-93c5-97427d893084 tempest-GroupSnapshotsTest-1779717395 None] Selected osci02.corp.quobyte.com/cinder-vol-23e9d725-3e04-4cd9-bfe0-c8ef43305589 as target Quobyte volume. {{(pid=83528) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 25 15:53:58 devstack cinder-volume[83528]: INFO cinder.volume.drivers.remotefs [None req-d6273387-911d-4113-93c5-97427d893084 tempest-GroupSnapshotsTest-1779717395 None] casted to osci02.corp.quobyte.com/cinder-vol-23e9d725-3e04-4cd9-bfe0-c8ef43305589 Feb 25 15:53:58 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-d6273387-911d-4113-93c5-97427d893084 tempest-GroupSnapshotsTest-1779717395 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-5153a222-bd7e-4e1e-8ff9-1b0c4d8bcba9 1073741824 {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 25 15:53:58 devstack sudo[85897]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-5153a222-bd7e-4e1e-8ff9-1b0c4d8bcba9 1073741824 Feb 25 15:53:58 devstack sudo[85897]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 25 15:53:58 devstack cinder-volume[83528]: DEBUG cinder.volume.flows.manager.create_volume [req-7d534b89-3d4d-4917-b497-2ddd040b93e5 req-9aadbd4c-0dbf-437e-89e0-3c6670d207b1 tempest-ServerBootFromVolumeStableRescueTest-939682044 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83528) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 25 15:53:58 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [req-7d534b89-3d4d-4917-b497-2ddd040b93e5 req-9aadbd4c-0dbf-437e-89e0-3c6670d207b1 tempest-ServerBootFromVolumeStableRescueTest-939682044 None] Flow 'volume_create_manager' (665b9c88-dd2f-4488-80d6-bb3376a207eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83528) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 25 15:53:58 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [req-7d534b89-3d4d-4917-b497-2ddd040b93e5 req-9aadbd4c-0dbf-437e-89e0-3c6670d207b1 tempest-ServerBootFromVolumeStableRescueTest-939682044 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cf599a95-a76c-41a2-b73b-da320f3fe26f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 25 15:53:58 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [req-7d534b89-3d4d-4917-b497-2ddd040b93e5 req-9aadbd4c-0dbf-437e-89e0-3c6670d207b1 tempest-ServerBootFromVolumeStableRescueTest-939682044 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cf599a95-a76c-41a2-b73b-da320f3fe26f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-25T14:53:57Z,deleted=False,deleted_at=None,display_description='',display_name='',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bd62c213-e65c-4ced-a207-704de8f3bc88,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d8907daf560042a1a6765383470d101e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-25T14:53:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-25T14:53:58Z,use_quota=True,user_id='ccac5f6631a3427584db00fdc9fa82c4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ce71c2f9-6543-4165-9653-a1529b2ea243),volume_type_id=ce71c2f9-6543-4165-9653-a1529b2ea243)' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 25 15:53:58 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [req-7d534b89-3d4d-4917-b497-2ddd040b93e5 req-9aadbd4c-0dbf-437e-89e0-3c6670d207b1 tempest-ServerBootFromVolumeStableRescueTest-939682044 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1a3fd4a8-bbfe-4d46-b21e-3b99dd82f0ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 25 15:53:58 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [req-7d534b89-3d4d-4917-b497-2ddd040b93e5 req-9aadbd4c-0dbf-437e-89e0-3c6670d207b1 tempest-ServerBootFromVolumeStableRescueTest-939682044 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1a3fd4a8-bbfe-4d46-b21e-3b99dd82f0ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 25 15:53:58 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [req-7d534b89-3d4d-4917-b497-2ddd040b93e5 req-9aadbd4c-0dbf-437e-89e0-3c6670d207b1 tempest-ServerBootFromVolumeStableRescueTest-939682044 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7d2f7a15-6a20-4dde-9715-1d2590320bed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 25 15:53:58 devstack cinder-volume[83528]: DEBUG cinder.image.glance [req-7d534b89-3d4d-4917-b497-2ddd040b93e5 req-9aadbd4c-0dbf-437e-89e0-3c6670d207b1 tempest-ServerBootFromVolumeStableRescueTest-939682044 None] Creating Keystone auth plugin from conf {{(pid=83528) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Feb 25 15:53:59 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [req-7d534b89-3d4d-4917-b497-2ddd040b93e5 req-9aadbd4c-0dbf-437e-89e0-3c6670d207b1 tempest-ServerBootFromVolumeStableRescueTest-939682044 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7d2f7a15-6a20-4dde-9715-1d2590320bed) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'bd62c213-e65c-4ced-a207-704de8f3bc88', 'volume_name': 'volume-bd62c213-e65c-4ced-a207-704de8f3bc88', 'volume_size': 1, 'image_id': 'c50f3ecd-5e88-4737-aa36-6e073ce70c60', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/c50f3ecd-5e88-4737-aa36-6e073ce70c60', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '75f8571da0ad46ec8e734ab2a4fa231d', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'c50f3ecd-5e88-4737-aa36-6e073ce70c60', 'created_at': datetime.datetime(2026, 2, 25, 14, 47, 16, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 2, 25, 14, 47, 18, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/c50f3ecd-5e88-4737-aa36-6e073ce70c60/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 25 15:53:59 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [req-7d534b89-3d4d-4917-b497-2ddd040b93e5 req-9aadbd4c-0dbf-437e-89e0-3c6670d207b1 tempest-ServerBootFromVolumeStableRescueTest-939682044 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (599eba8a-af86-4db2-ad79-f305c2e61cc4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 25 15:53:59 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [req-7d534b89-3d4d-4917-b497-2ddd040b93e5 req-9aadbd4c-0dbf-437e-89e0-3c6670d207b1 tempest-ServerBootFromVolumeStableRescueTest-939682044 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (599eba8a-af86-4db2-ad79-f305c2e61cc4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 25 15:53:59 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [req-7d534b89-3d4d-4917-b497-2ddd040b93e5 req-9aadbd4c-0dbf-437e-89e0-3c6670d207b1 tempest-ServerBootFromVolumeStableRescueTest-939682044 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (649333aa-718c-4e6a-a894-7398349ef0e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 25 15:53:59 devstack cinder-volume[83528]: INFO cinder.volume.flows.manager.create_volume [req-7d534b89-3d4d-4917-b497-2ddd040b93e5 req-9aadbd4c-0dbf-437e-89e0-3c6670d207b1 tempest-ServerBootFromVolumeStableRescueTest-939682044 None] Volume bd62c213-e65c-4ced-a207-704de8f3bc88: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-bd62c213-e65c-4ced-a207-704de8f3bc88', 'volume_size': 1, 'image_id': 'c50f3ecd-5e88-4737-aa36-6e073ce70c60', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/c50f3ecd-5e88-4737-aa36-6e073ce70c60', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '75f8571da0ad46ec8e734ab2a4fa231d', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'c50f3ecd-5e88-4737-aa36-6e073ce70c60', 'created_at': datetime.datetime(2026, 2, 25, 14, 47, 16, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 2, 25, 14, 47, 18, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/c50f3ecd-5e88-4737-aa36-6e073ce70c60/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Feb 25 15:53:59 devstack cinder-volume[83528]: DEBUG cinder.volume.flows.manager.create_volume [req-7d534b89-3d4d-4917-b497-2ddd040b93e5 req-9aadbd4c-0dbf-437e-89e0-3c6670d207b1 tempest-ServerBootFromVolumeStableRescueTest-939682044 None] Trying to clone bd62c213-e65c-4ced-a207-704de8f3bc88 from image c50f3ecd-5e88-4737-aa36-6e073ce70c60 at location (None, [{'url': 'file:///opt/stack/data/glance/images/c50f3ecd-5e88-4737-aa36-6e073ce70c60', 'metadata': {}}]). {{(pid=83528) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1082}} Feb 25 15:53:59 devstack sudo[85897]: pam_unix(sudo:session): session closed for user root Feb 25 15:53:59 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-d6273387-911d-4113-93c5-97427d893084 tempest-GroupSnapshotsTest-1779717395 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-5153a222-bd7e-4e1e-8ff9-1b0c4d8bcba9 1073741824" returned: 0 in 1.748s {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 25 15:53:59 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-d6273387-911d-4113-93c5-97427d893084 tempest-GroupSnapshotsTest-1779717395 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-5153a222-bd7e-4e1e-8ff9-1b0c4d8bcba9 {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 25 15:53:59 devstack sudo[85927]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-5153a222-bd7e-4e1e-8ff9-1b0c4d8bcba9 Feb 25 15:53:59 devstack sudo[85927]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 25 15:54:00 devstack cinder-volume[83528]: DEBUG cinder.image.image_utils [req-7d534b89-3d4d-4917-b497-2ddd040b93e5 req-9aadbd4c-0dbf-437e-89e0-3c6670d207b1 tempest-ServerBootFromVolumeStableRescueTest-939682044 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_c50f3ecd-5e88-4737-aa36-6e073ce70c60_tefo1gz7devstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=83528) fetch /opt/stack/cinder/cinder/image/image_utils.py:732}} Feb 25 15:54:00 devstack cinder-volume[83528]: INFO cinder.image.image_utils [req-7d534b89-3d4d-4917-b497-2ddd040b93e5 req-9aadbd4c-0dbf-437e-89e0-3c6670d207b1 tempest-ServerBootFromVolumeStableRescueTest-939682044 None] Image download 20.69 MB at 20.69 MB/s Feb 25 15:54:00 devstack cinder-volume[83528]: DEBUG oslo.privsep.daemon [-] privsep: reply[178a8578-6e4c-4749-94d7-d4a4a1a86da6]: (4, 'qcow2') {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 25 15:54:00 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [req-7d534b89-3d4d-4917-b497-2ddd040b93e5 req-9aadbd4c-0dbf-437e-89e0-3c6670d207b1 tempest-ServerBootFromVolumeStableRescueTest-939682044 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c50f3ecd-5e88-4737-aa36-6e073ce70c60_tefo1gz7devstack@QuobyteHD {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 25 15:54:00 devstack sudo[85930]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c50f3ecd-5e88-4737-aa36-6e073ce70c60_tefo1gz7devstack@QuobyteHD Feb 25 15:54:00 devstack sudo[85930]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 25 15:54:00 devstack sudo[85927]: pam_unix(sudo:session): session closed for user root Feb 25 15:54:00 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-d6273387-911d-4113-93c5-97427d893084 tempest-GroupSnapshotsTest-1779717395 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-5153a222-bd7e-4e1e-8ff9-1b0c4d8bcba9" returned: 0 in 1.023s {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 25 15:54:00 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.quobyte [None req-d6273387-911d-4113-93c5-97427d893084 tempest-GroupSnapshotsTest-1779717395 None] <== create_volume: return (2823ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-23e9d725-3e04-4cd9-bfe0-c8ef43305589'} {{(pid=83528) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 25 15:54:00 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-d6273387-911d-4113-93c5-97427d893084 tempest-GroupSnapshotsTest-1779717395 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.827s {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 25 15:54:00 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-d6273387-911d-4113-93c5-97427d893084 tempest-GroupSnapshotsTest-1779717395 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a1ed29e8-436b-40db-a833-c5d8f0f33999) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5153a222-bd7e-4e1e-8ff9-1b0c4d8bcba9', 'volume_size': 1}' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 25 15:54:00 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-d6273387-911d-4113-93c5-97427d893084 tempest-GroupSnapshotsTest-1779717395 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1e1cc4f9-8e9a-4662-a20d-c7d7c2429fe5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 25 15:54:00 devstack cinder-volume[83528]: INFO cinder.volume.flows.manager.create_volume [None req-d6273387-911d-4113-93c5-97427d893084 tempest-GroupSnapshotsTest-1779717395 None] Volume volume-5153a222-bd7e-4e1e-8ff9-1b0c4d8bcba9 (5153a222-bd7e-4e1e-8ff9-1b0c4d8bcba9): created successfully Feb 25 15:54:01 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-d6273387-911d-4113-93c5-97427d893084 tempest-GroupSnapshotsTest-1779717395 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1e1cc4f9-8e9a-4662-a20d-c7d7c2429fe5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 25 15:54:01 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-d6273387-911d-4113-93c5-97427d893084 tempest-GroupSnapshotsTest-1779717395 None] Flow 'volume_create_manager' (82db3baf-7cdf-44a7-8ead-3fd88de3e7ef) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83528) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 25 15:54:01 devstack cinder-volume[83528]: INFO cinder.volume.manager [None req-d6273387-911d-4113-93c5-97427d893084 tempest-GroupSnapshotsTest-1779717395 None] Created volume successfully. Feb 25 15:54:01 devstack sudo[85930]: pam_unix(sudo:session): session closed for user root Feb 25 15:54:01 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [req-7d534b89-3d4d-4917-b497-2ddd040b93e5 req-9aadbd4c-0dbf-437e-89e0-3c6670d207b1 tempest-ServerBootFromVolumeStableRescueTest-939682044 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c50f3ecd-5e88-4737-aa36-6e073ce70c60_tefo1gz7devstack@QuobyteHD" returned: 0 in 1.033s {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 25 15:54:01 devstack cinder-volume[83528]: DEBUG cinder.image.image_utils [req-7d534b89-3d4d-4917-b497-2ddd040b93e5 req-9aadbd4c-0dbf-437e-89e0-3c6670d207b1 tempest-ServerBootFromVolumeStableRescueTest-939682044 None] Temporary image c50f3ecd-5e88-4737-aa36-6e073ce70c60 is fetched for user ccac5f6631a3427584db00fdc9fa82c4. {{(pid=83528) fetch /opt/stack/cinder/cinder/image/image_utils.py:1431}} Feb 25 15:54:01 devstack cinder-volume[83528]: INFO cinder.volume.manager [None req-df1689b1-ec48-4fb3-b8ea-8de5e29632dc tempest-GroupSnapshotsV319Test-1296641229 None] Group tempest-GroupSnapshotsV319Test-Group-1045886047: creating Feb 25 15:54:01 devstack cinder-volume[83528]: INFO cinder.volume.manager [None req-df1689b1-ec48-4fb3-b8ea-8de5e29632dc tempest-GroupSnapshotsV319Test-1296641229 None] Group tempest-GroupSnapshotsV319Test-Group-1045886047: created successfully Feb 25 15:54:01 devstack cinder-volume[83528]: INFO cinder.volume.manager [None req-df1689b1-ec48-4fb3-b8ea-8de5e29632dc tempest-GroupSnapshotsV319Test-1296641229 None] Create group completed successfully. Feb 25 15:54:01 devstack cinder-volume[83528]: DEBUG oslo.privsep.daemon [-] privsep: reply[411db7bc-fcda-4faf-81b3-e4e9dd98c84a]: (4, 'qcow2') {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 25 15:54:01 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [req-7d534b89-3d4d-4917-b497-2ddd040b93e5 req-9aadbd4c-0dbf-437e-89e0-3c6670d207b1 tempest-ServerBootFromVolumeStableRescueTest-939682044 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c50f3ecd-5e88-4737-aa36-6e073ce70c60_tefo1gz7devstack@QuobyteHD {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 25 15:54:01 devstack cinder-volume[83528]: DEBUG cinder.volume.flows.manager.create_volume [None req-e9b2ccc1-a013-4e18-8359-d9dc3297c735 tempest-GroupSnapshotsTest-1779717395 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83528) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 25 15:54:01 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-e9b2ccc1-a013-4e18-8359-d9dc3297c735 tempest-GroupSnapshotsTest-1779717395 None] Flow 'volume_create_manager' (e91139bb-9df2-4263-9c1d-6e51e04ac1a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83528) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 25 15:54:01 devstack sudo[85939]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c50f3ecd-5e88-4737-aa36-6e073ce70c60_tefo1gz7devstack@QuobyteHD Feb 25 15:54:01 devstack sudo[85939]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 25 15:54:01 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-e9b2ccc1-a013-4e18-8359-d9dc3297c735 tempest-GroupSnapshotsTest-1779717395 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (39dfa1f5-fbc8-4c01-88ac-46131be9eab1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 25 15:54:01 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-e9b2ccc1-a013-4e18-8359-d9dc3297c735 tempest-GroupSnapshotsTest-1779717395 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (39dfa1f5-fbc8-4c01-88ac-46131be9eab1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-25T14:54:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-929145039',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=743b181b-80b4-4249-ac53-411033a45b22,host='devstack@QuobyteHD#QuobyteHD',id=c96adca3-9875-40e8-aa3e-3b7f6d371d46,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3827b9375d3e4b44a95020c555372a80',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-25T14:54:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-25T14:54:02Z,use_quota=True,user_id='99d268450fcd419cab908aed8018b7e2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0fa4f385-2d8c-4b47-95ee-bdea08e984db),volume_type_id=0fa4f385-2d8c-4b47-95ee-bdea08e984db)' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 25 15:54:01 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-e9b2ccc1-a013-4e18-8359-d9dc3297c735 tempest-GroupSnapshotsTest-1779717395 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1cbe1712-4148-4eb7-a4a9-7bbf90a9d542) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 25 15:54:01 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-e9b2ccc1-a013-4e18-8359-d9dc3297c735 tempest-GroupSnapshotsTest-1779717395 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1cbe1712-4148-4eb7-a4a9-7bbf90a9d542) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 25 15:54:01 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-e9b2ccc1-a013-4e18-8359-d9dc3297c735 tempest-GroupSnapshotsTest-1779717395 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (544a5056-a2c0-419f-ad12-2c9e2b365d75) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 25 15:54:01 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-e9b2ccc1-a013-4e18-8359-d9dc3297c735 tempest-GroupSnapshotsTest-1779717395 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (544a5056-a2c0-419f-ad12-2c9e2b365d75) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c96adca3-9875-40e8-aa3e-3b7f6d371d46', 'volume_name': 'volume-c96adca3-9875-40e8-aa3e-3b7f6d371d46', 'volume_size': 1}' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 25 15:54:01 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-e9b2ccc1-a013-4e18-8359-d9dc3297c735 tempest-GroupSnapshotsTest-1779717395 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c7cb313a-7d2f-405a-89f8-878aaac453dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 25 15:54:01 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-e9b2ccc1-a013-4e18-8359-d9dc3297c735 tempest-GroupSnapshotsTest-1779717395 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c7cb313a-7d2f-405a-89f8-878aaac453dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 25 15:54:01 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-e9b2ccc1-a013-4e18-8359-d9dc3297c735 tempest-GroupSnapshotsTest-1779717395 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dcfed570-a175-46f1-8aa3-49da24e7360a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 25 15:54:02 devstack cinder-volume[83528]: INFO cinder.volume.flows.manager.create_volume [None req-e9b2ccc1-a013-4e18-8359-d9dc3297c735 tempest-GroupSnapshotsTest-1779717395 None] Volume c96adca3-9875-40e8-aa3e-3b7f6d371d46: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c96adca3-9875-40e8-aa3e-3b7f6d371d46', 'volume_size': 1} Feb 25 15:54:02 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-e9b2ccc1-a013-4e18-8359-d9dc3297c735 tempest-GroupSnapshotsTest-1779717395 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 25 15:54:02 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-e9b2ccc1-a013-4e18-8359-d9dc3297c735 tempest-GroupSnapshotsTest-1779717395 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 25 15:54:02 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.quobyte [None req-e9b2ccc1-a013-4e18-8359-d9dc3297c735 tempest-GroupSnapshotsTest-1779717395 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=743b181b-80b4-4249-ac53-411033a45b22,created_at=2026-02-25T14:54:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-929145039',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=743b181b-80b4-4249-ac53-411033a45b22,host='devstack@QuobyteHD#QuobyteHD',id=c96adca3-9875-40e8-aa3e-3b7f6d371d46,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3827b9375d3e4b44a95020c555372a80',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-25T14:54:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-25T14:54:02Z,use_quota=True,user_id='99d268450fcd419cab908aed8018b7e2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0fa4f385-2d8c-4b47-95ee-bdea08e984db),volume_type_id=0fa4f385-2d8c-4b47-95ee-bdea08e984db)}" {{(pid=83528) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 25 15:54:02 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.remotefs [None req-e9b2ccc1-a013-4e18-8359-d9dc3297c735 tempest-GroupSnapshotsTest-1779717395 None] Creating volume c96adca3-9875-40e8-aa3e-3b7f6d371d46 {{(pid=83528) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 25 15:54:02 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-e9b2ccc1-a013-4e18-8359-d9dc3297c735 tempest-GroupSnapshotsTest-1779717395 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 25 15:54:02 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-e9b2ccc1-a013-4e18-8359-d9dc3297c735 tempest-GroupSnapshotsTest-1779717395 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 25 15:54:02 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.quobyte [None req-e9b2ccc1-a013-4e18-8359-d9dc3297c735 tempest-GroupSnapshotsTest-1779717395 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23e9d725-3e04-4cd9-bfe0-c8ef43305589': None} {{(pid=83528) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 25 15:54:02 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.quobyte [None req-e9b2ccc1-a013-4e18-8359-d9dc3297c735 tempest-GroupSnapshotsTest-1779717395 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23e9d725-3e04-4cd9-bfe0-c8ef43305589'] {{(pid=83528) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 25 15:54:02 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-e9b2ccc1-a013-4e18-8359-d9dc3297c735 tempest-GroupSnapshotsTest-1779717395 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 25 15:54:02 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.quobyte [None req-e9b2ccc1-a013-4e18-8359-d9dc3297c735 tempest-GroupSnapshotsTest-1779717395 None] Selected osci02.corp.quobyte.com/cinder-vol-23e9d725-3e04-4cd9-bfe0-c8ef43305589 as target Quobyte volume. {{(pid=83528) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 25 15:54:02 devstack cinder-volume[83528]: INFO cinder.volume.drivers.remotefs [None req-e9b2ccc1-a013-4e18-8359-d9dc3297c735 tempest-GroupSnapshotsTest-1779717395 None] casted to osci02.corp.quobyte.com/cinder-vol-23e9d725-3e04-4cd9-bfe0-c8ef43305589 Feb 25 15:54:02 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-e9b2ccc1-a013-4e18-8359-d9dc3297c735 tempest-GroupSnapshotsTest-1779717395 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-c96adca3-9875-40e8-aa3e-3b7f6d371d46 1073741824 {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 25 15:54:02 devstack sudo[85959]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-c96adca3-9875-40e8-aa3e-3b7f6d371d46 1073741824 Feb 25 15:54:02 devstack sudo[85959]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 25 15:54:02 devstack sudo[85939]: pam_unix(sudo:session): session closed for user root Feb 25 15:54:02 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [req-7d534b89-3d4d-4917-b497-2ddd040b93e5 req-9aadbd4c-0dbf-437e-89e0-3c6670d207b1 tempest-ServerBootFromVolumeStableRescueTest-939682044 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c50f3ecd-5e88-4737-aa36-6e073ce70c60_tefo1gz7devstack@QuobyteHD" returned: 0 in 1.238s {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 25 15:54:02 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [req-7d534b89-3d4d-4917-b497-2ddd040b93e5 req-9aadbd4c-0dbf-437e-89e0-3c6670d207b1 tempest-ServerBootFromVolumeStableRescueTest-939682044 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 25 15:54:03 devstack cinder-volume[83528]: DEBUG cinder.volume.flows.manager.create_volume [None req-dacfdc93-c20a-4f72-b4b9-446c4f579a39 tempest-GroupSnapshotsV319Test-1296641229 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83528) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 25 15:54:03 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-dacfdc93-c20a-4f72-b4b9-446c4f579a39 tempest-GroupSnapshotsV319Test-1296641229 None] Flow 'volume_create_manager' (d0092524-f46f-4cf8-91b3-efb8659b3f08) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83528) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 25 15:54:03 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-dacfdc93-c20a-4f72-b4b9-446c4f579a39 tempest-GroupSnapshotsV319Test-1296641229 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (edff4ede-605d-44ff-a5b0-1c6e57ac985d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 25 15:54:03 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-dacfdc93-c20a-4f72-b4b9-446c4f579a39 tempest-GroupSnapshotsV319Test-1296641229 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (edff4ede-605d-44ff-a5b0-1c6e57ac985d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-25T14:54:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1836306181',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=0d759f5a-e677-40c0-a636-44a4ad7f1d44,host='devstack@QuobyteHD#QuobyteHD',id=c3ba235a-b0c8-43b4-89dc-5894944a7df1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b0e73719f0544d71bd703c53b81db847',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-25T14:54:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-25T14:54:03Z,use_quota=True,user_id='b9ad7585f0f049058a198e23f4d2d8fd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1c48e708-5f33-4780-90dd-a160f8e3f63d),volume_type_id=1c48e708-5f33-4780-90dd-a160f8e3f63d)' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 25 15:54:03 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-dacfdc93-c20a-4f72-b4b9-446c4f579a39 tempest-GroupSnapshotsV319Test-1296641229 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6e104e82-8f44-4b7d-aac7-8e38d47b71bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 25 15:54:03 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-dacfdc93-c20a-4f72-b4b9-446c4f579a39 tempest-GroupSnapshotsV319Test-1296641229 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6e104e82-8f44-4b7d-aac7-8e38d47b71bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 25 15:54:03 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-dacfdc93-c20a-4f72-b4b9-446c4f579a39 tempest-GroupSnapshotsV319Test-1296641229 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4ce0008b-7484-48b8-b1ed-3e47edc109ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 25 15:54:03 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-dacfdc93-c20a-4f72-b4b9-446c4f579a39 tempest-GroupSnapshotsV319Test-1296641229 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4ce0008b-7484-48b8-b1ed-3e47edc109ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c3ba235a-b0c8-43b4-89dc-5894944a7df1', 'volume_name': 'volume-c3ba235a-b0c8-43b4-89dc-5894944a7df1', 'volume_size': 1}' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 25 15:54:03 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-dacfdc93-c20a-4f72-b4b9-446c4f579a39 tempest-GroupSnapshotsV319Test-1296641229 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5aa3b696-608a-4a19-a2c3-23b3bd6f5ad6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 25 15:54:03 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-dacfdc93-c20a-4f72-b4b9-446c4f579a39 tempest-GroupSnapshotsV319Test-1296641229 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5aa3b696-608a-4a19-a2c3-23b3bd6f5ad6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 25 15:54:03 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-dacfdc93-c20a-4f72-b4b9-446c4f579a39 tempest-GroupSnapshotsV319Test-1296641229 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (005e08fa-adeb-43c7-a89c-3b6a35084659) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 25 15:54:03 devstack cinder-volume[83528]: INFO cinder.volume.flows.manager.create_volume [None req-dacfdc93-c20a-4f72-b4b9-446c4f579a39 tempest-GroupSnapshotsV319Test-1296641229 None] Volume c3ba235a-b0c8-43b4-89dc-5894944a7df1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c3ba235a-b0c8-43b4-89dc-5894944a7df1', 'volume_size': 1} Feb 25 15:54:03 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-dacfdc93-c20a-4f72-b4b9-446c4f579a39 tempest-GroupSnapshotsV319Test-1296641229 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 25 15:54:03 devstack sudo[85959]: pam_unix(sudo:session): session closed for user root Feb 25 15:54:03 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-e9b2ccc1-a013-4e18-8359-d9dc3297c735 tempest-GroupSnapshotsTest-1779717395 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-c96adca3-9875-40e8-aa3e-3b7f6d371d46 1073741824" returned: 0 in 1.254s {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 25 15:54:03 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-e9b2ccc1-a013-4e18-8359-d9dc3297c735 tempest-GroupSnapshotsTest-1779717395 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-c96adca3-9875-40e8-aa3e-3b7f6d371d46 {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 25 15:54:03 devstack sudo[85969]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-c96adca3-9875-40e8-aa3e-3b7f6d371d46 Feb 25 15:54:03 devstack sudo[85969]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 25 15:54:03 devstack sudo[85969]: pam_unix(sudo:session): session closed for user root Feb 25 15:54:03 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-e9b2ccc1-a013-4e18-8359-d9dc3297c735 tempest-GroupSnapshotsTest-1779717395 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-c96adca3-9875-40e8-aa3e-3b7f6d371d46" returned: 0 in 0.516s {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 25 15:54:03 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.quobyte [None req-e9b2ccc1-a013-4e18-8359-d9dc3297c735 tempest-GroupSnapshotsTest-1779717395 None] <== create_volume: return (1829ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-23e9d725-3e04-4cd9-bfe0-c8ef43305589'} {{(pid=83528) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 25 15:54:03 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-e9b2ccc1-a013-4e18-8359-d9dc3297c735 tempest-GroupSnapshotsTest-1779717395 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.832s {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 25 15:54:03 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [req-7d534b89-3d4d-4917-b497-2ddd040b93e5 req-9aadbd4c-0dbf-437e-89e0-3c6670d207b1 tempest-ServerBootFromVolumeStableRescueTest-939682044 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.020s {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 25 15:54:03 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.quobyte [req-7d534b89-3d4d-4917-b497-2ddd040b93e5 req-9aadbd4c-0dbf-437e-89e0-3c6670d207b1 tempest-ServerBootFromVolumeStableRescueTest-939682044 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-25T14:53:57Z,deleted=False,deleted_at=None,display_description='',display_name='',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bd62c213-e65c-4ced-a207-704de8f3bc88,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d8907daf560042a1a6765383470d101e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-25T14:53:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-25T14:53:58Z,use_quota=True,user_id='ccac5f6631a3427584db00fdc9fa82c4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ce71c2f9-6543-4165-9653-a1529b2ea243),volume_type_id=ce71c2f9-6543-4165-9653-a1529b2ea243)}" {{(pid=83528) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 25 15:54:03 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.remotefs [req-7d534b89-3d4d-4917-b497-2ddd040b93e5 req-9aadbd4c-0dbf-437e-89e0-3c6670d207b1 tempest-ServerBootFromVolumeStableRescueTest-939682044 None] Creating volume bd62c213-e65c-4ced-a207-704de8f3bc88 {{(pid=83528) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 25 15:54:03 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [req-7d534b89-3d4d-4917-b497-2ddd040b93e5 req-9aadbd4c-0dbf-437e-89e0-3c6670d207b1 tempest-ServerBootFromVolumeStableRescueTest-939682044 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 25 15:54:03 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [req-7d534b89-3d4d-4917-b497-2ddd040b93e5 req-9aadbd4c-0dbf-437e-89e0-3c6670d207b1 tempest-ServerBootFromVolumeStableRescueTest-939682044 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 25 15:54:03 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.quobyte [req-7d534b89-3d4d-4917-b497-2ddd040b93e5 req-9aadbd4c-0dbf-437e-89e0-3c6670d207b1 tempest-ServerBootFromVolumeStableRescueTest-939682044 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23e9d725-3e04-4cd9-bfe0-c8ef43305589': None} {{(pid=83528) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 25 15:54:03 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.quobyte [req-7d534b89-3d4d-4917-b497-2ddd040b93e5 req-9aadbd4c-0dbf-437e-89e0-3c6670d207b1 tempest-ServerBootFromVolumeStableRescueTest-939682044 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23e9d725-3e04-4cd9-bfe0-c8ef43305589'] {{(pid=83528) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 25 15:54:03 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [req-7d534b89-3d4d-4917-b497-2ddd040b93e5 req-9aadbd4c-0dbf-437e-89e0-3c6670d207b1 tempest-ServerBootFromVolumeStableRescueTest-939682044 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 25 15:54:03 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.quobyte [req-7d534b89-3d4d-4917-b497-2ddd040b93e5 req-9aadbd4c-0dbf-437e-89e0-3c6670d207b1 tempest-ServerBootFromVolumeStableRescueTest-939682044 None] Selected osci02.corp.quobyte.com/cinder-vol-23e9d725-3e04-4cd9-bfe0-c8ef43305589 as target Quobyte volume. {{(pid=83528) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 25 15:54:03 devstack cinder-volume[83528]: INFO cinder.volume.drivers.remotefs [req-7d534b89-3d4d-4917-b497-2ddd040b93e5 req-9aadbd4c-0dbf-437e-89e0-3c6670d207b1 tempest-ServerBootFromVolumeStableRescueTest-939682044 None] casted to osci02.corp.quobyte.com/cinder-vol-23e9d725-3e04-4cd9-bfe0-c8ef43305589 Feb 25 15:54:03 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [req-7d534b89-3d4d-4917-b497-2ddd040b93e5 req-9aadbd4c-0dbf-437e-89e0-3c6670d207b1 tempest-ServerBootFromVolumeStableRescueTest-939682044 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-bd62c213-e65c-4ced-a207-704de8f3bc88 1073741824 {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 25 15:54:03 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-e9b2ccc1-a013-4e18-8359-d9dc3297c735 tempest-GroupSnapshotsTest-1779717395 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dcfed570-a175-46f1-8aa3-49da24e7360a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c96adca3-9875-40e8-aa3e-3b7f6d371d46', 'volume_size': 1}' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 25 15:54:03 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-e9b2ccc1-a013-4e18-8359-d9dc3297c735 tempest-GroupSnapshotsTest-1779717395 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (47e3d2b7-f242-4d4e-9eb8-1773fbc8ba8f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 25 15:54:03 devstack sudo[85972]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-bd62c213-e65c-4ced-a207-704de8f3bc88 1073741824 Feb 25 15:54:03 devstack sudo[85972]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 25 15:54:03 devstack cinder-volume[83528]: INFO cinder.volume.flows.manager.create_volume [None req-e9b2ccc1-a013-4e18-8359-d9dc3297c735 tempest-GroupSnapshotsTest-1779717395 None] Volume volume-c96adca3-9875-40e8-aa3e-3b7f6d371d46 (c96adca3-9875-40e8-aa3e-3b7f6d371d46): created successfully Feb 25 15:54:03 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-e9b2ccc1-a013-4e18-8359-d9dc3297c735 tempest-GroupSnapshotsTest-1779717395 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (47e3d2b7-f242-4d4e-9eb8-1773fbc8ba8f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 25 15:54:03 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-e9b2ccc1-a013-4e18-8359-d9dc3297c735 tempest-GroupSnapshotsTest-1779717395 None] Flow 'volume_create_manager' (e91139bb-9df2-4263-9c1d-6e51e04ac1a8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83528) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 25 15:54:03 devstack cinder-volume[83528]: INFO cinder.volume.manager [None req-e9b2ccc1-a013-4e18-8359-d9dc3297c735 tempest-GroupSnapshotsTest-1779717395 None] Created volume successfully. Feb 25 15:54:04 devstack cinder-volume[83528]: INFO cinder.volume.manager [None req-dc83770d-dbb9-4418-8a72-4f4db861426a tempest-GroupSnapshotsTest-1779717395 None] Update group completed successfully. Feb 25 15:54:04 devstack sudo[85972]: pam_unix(sudo:session): session closed for user root Feb 25 15:54:04 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [req-7d534b89-3d4d-4917-b497-2ddd040b93e5 req-9aadbd4c-0dbf-437e-89e0-3c6670d207b1 tempest-ServerBootFromVolumeStableRescueTest-939682044 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-bd62c213-e65c-4ced-a207-704de8f3bc88 1073741824" returned: 0 in 0.926s {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 25 15:54:04 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [req-7d534b89-3d4d-4917-b497-2ddd040b93e5 req-9aadbd4c-0dbf-437e-89e0-3c6670d207b1 tempest-ServerBootFromVolumeStableRescueTest-939682044 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-bd62c213-e65c-4ced-a207-704de8f3bc88 {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 25 15:54:04 devstack sudo[85979]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-bd62c213-e65c-4ced-a207-704de8f3bc88 Feb 25 15:54:04 devstack sudo[85979]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 25 15:54:05 devstack sudo[85979]: pam_unix(sudo:session): session closed for user root Feb 25 15:54:05 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [req-7d534b89-3d4d-4917-b497-2ddd040b93e5 req-9aadbd4c-0dbf-437e-89e0-3c6670d207b1 tempest-ServerBootFromVolumeStableRescueTest-939682044 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-bd62c213-e65c-4ced-a207-704de8f3bc88" returned: 0 in 0.603s {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 25 15:54:05 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.quobyte [req-7d534b89-3d4d-4917-b497-2ddd040b93e5 req-9aadbd4c-0dbf-437e-89e0-3c6670d207b1 tempest-ServerBootFromVolumeStableRescueTest-939682044 None] <== create_volume: return (1560ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-23e9d725-3e04-4cd9-bfe0-c8ef43305589'} {{(pid=83528) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 25 15:54:05 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [req-7d534b89-3d4d-4917-b497-2ddd040b93e5 req-9aadbd4c-0dbf-437e-89e0-3c6670d207b1 tempest-ServerBootFromVolumeStableRescueTest-939682044 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.564s {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 25 15:54:05 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-dacfdc93-c20a-4f72-b4b9-446c4f579a39 tempest-GroupSnapshotsV319Test-1296641229 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.277s {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 25 15:54:05 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.quobyte [None req-dacfdc93-c20a-4f72-b4b9-446c4f579a39 tempest-GroupSnapshotsV319Test-1296641229 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=0d759f5a-e677-40c0-a636-44a4ad7f1d44,created_at=2026-02-25T14:54:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1836306181',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=0d759f5a-e677-40c0-a636-44a4ad7f1d44,host='devstack@QuobyteHD#QuobyteHD',id=c3ba235a-b0c8-43b4-89dc-5894944a7df1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b0e73719f0544d71bd703c53b81db847',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-25T14:54:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-25T14:54:03Z,use_quota=True,user_id='b9ad7585f0f049058a198e23f4d2d8fd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1c48e708-5f33-4780-90dd-a160f8e3f63d),volume_type_id=1c48e708-5f33-4780-90dd-a160f8e3f63d)}" {{(pid=83528) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 25 15:54:05 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.remotefs [None req-dacfdc93-c20a-4f72-b4b9-446c4f579a39 tempest-GroupSnapshotsV319Test-1296641229 None] Creating volume c3ba235a-b0c8-43b4-89dc-5894944a7df1 {{(pid=83528) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 25 15:54:05 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-dacfdc93-c20a-4f72-b4b9-446c4f579a39 tempest-GroupSnapshotsV319Test-1296641229 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 25 15:54:05 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-dacfdc93-c20a-4f72-b4b9-446c4f579a39 tempest-GroupSnapshotsV319Test-1296641229 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 25 15:54:05 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.quobyte [None req-dacfdc93-c20a-4f72-b4b9-446c4f579a39 tempest-GroupSnapshotsV319Test-1296641229 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23e9d725-3e04-4cd9-bfe0-c8ef43305589': None} {{(pid=83528) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 25 15:54:05 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.quobyte [None req-dacfdc93-c20a-4f72-b4b9-446c4f579a39 tempest-GroupSnapshotsV319Test-1296641229 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23e9d725-3e04-4cd9-bfe0-c8ef43305589'] {{(pid=83528) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 25 15:54:05 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-dacfdc93-c20a-4f72-b4b9-446c4f579a39 tempest-GroupSnapshotsV319Test-1296641229 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 25 15:54:05 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.quobyte [None req-dacfdc93-c20a-4f72-b4b9-446c4f579a39 tempest-GroupSnapshotsV319Test-1296641229 None] Selected osci02.corp.quobyte.com/cinder-vol-23e9d725-3e04-4cd9-bfe0-c8ef43305589 as target Quobyte volume. {{(pid=83528) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 25 15:54:05 devstack cinder-volume[83528]: INFO cinder.volume.drivers.remotefs [None req-dacfdc93-c20a-4f72-b4b9-446c4f579a39 tempest-GroupSnapshotsV319Test-1296641229 None] casted to osci02.corp.quobyte.com/cinder-vol-23e9d725-3e04-4cd9-bfe0-c8ef43305589 Feb 25 15:54:05 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-dacfdc93-c20a-4f72-b4b9-446c4f579a39 tempest-GroupSnapshotsV319Test-1296641229 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-c3ba235a-b0c8-43b4-89dc-5894944a7df1 1073741824 {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 25 15:54:05 devstack sudo[85982]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-c3ba235a-b0c8-43b4-89dc-5894944a7df1 1073741824 Feb 25 15:54:05 devstack sudo[85982]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 25 15:54:05 devstack cinder-volume[83528]: DEBUG cinder.volume.volume_utils [req-7d534b89-3d4d-4917-b497-2ddd040b93e5 req-9aadbd4c-0dbf-437e-89e0-3c6670d207b1 tempest-ServerBootFromVolumeStableRescueTest-939682044 None] Attempting download of c50f3ecd-5e88-4737-aa36-6e073ce70c60 ((None, [{'url': 'file:///opt/stack/data/glance/images/c50f3ecd-5e88-4737-aa36-6e073ce70c60', 'metadata': {}}])) to volume bd62c213-e65c-4ced-a207-704de8f3bc88. {{(pid=83528) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1189}} Feb 25 15:54:05 devstack cinder-volume[83528]: DEBUG oslo.privsep.daemon [-] privsep: reply[291562a2-d28a-4aec-ae91-eea4ef426e49]: (4, 'raw') {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 25 15:54:05 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [req-7d534b89-3d4d-4917-b497-2ddd040b93e5 req-9aadbd4c-0dbf-437e-89e0-3c6670d207b1 tempest-ServerBootFromVolumeStableRescueTest-939682044 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_c50f3ecd-5e88-4737-aa36-6e073ce70c60_reskgkf5 {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 25 15:54:05 devstack cinder-volume[83528]: INFO cinder.volume.manager [None req-d3b8b2e7-88a4-492b-8806-457be5e6046c tempest-GroupSnapshotsTest-1779717395 None] Update group completed successfully. Feb 25 15:54:05 devstack sudo[85984]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_c50f3ecd-5e88-4737-aa36-6e073ce70c60_reskgkf5 Feb 25 15:54:05 devstack sudo[85984]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 25 15:54:06 devstack sudo[85984]: pam_unix(sudo:session): session closed for user root Feb 25 15:54:06 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [req-7d534b89-3d4d-4917-b497-2ddd040b93e5 req-9aadbd4c-0dbf-437e-89e0-3c6670d207b1 tempest-ServerBootFromVolumeStableRescueTest-939682044 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_c50f3ecd-5e88-4737-aa36-6e073ce70c60_reskgkf5" returned: 0 in 0.985s {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 25 15:54:06 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [req-7d534b89-3d4d-4917-b497-2ddd040b93e5 req-9aadbd4c-0dbf-437e-89e0-3c6670d207b1 tempest-ServerBootFromVolumeStableRescueTest-939682044 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_c50f3ecd-5e88-4737-aa36-6e073ce70c60_reskgkf5 {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 25 15:54:06 devstack sudo[85982]: pam_unix(sudo:session): session closed for user root Feb 25 15:54:06 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-dacfdc93-c20a-4f72-b4b9-446c4f579a39 tempest-GroupSnapshotsV319Test-1296641229 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-c3ba235a-b0c8-43b4-89dc-5894944a7df1 1073741824" returned: 0 in 1.516s {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 25 15:54:06 devstack sudo[85994]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_c50f3ecd-5e88-4737-aa36-6e073ce70c60_reskgkf5 Feb 25 15:54:06 devstack sudo[85994]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 25 15:54:07 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-dacfdc93-c20a-4f72-b4b9-446c4f579a39 tempest-GroupSnapshotsV319Test-1296641229 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-c3ba235a-b0c8-43b4-89dc-5894944a7df1 {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 25 15:54:07 devstack sudo[86000]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-c3ba235a-b0c8-43b4-89dc-5894944a7df1 Feb 25 15:54:07 devstack sudo[86000]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 25 15:54:07 devstack cinder-volume[83528]: INFO cinder.volume.manager [None req-35b79adb-63ac-40e9-a076-7a8cc97626b1 tempest-GroupSnapshotsTest-1779717395 None] Update group completed successfully. Feb 25 15:54:07 devstack sudo[85994]: pam_unix(sudo:session): session closed for user root Feb 25 15:54:07 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [req-7d534b89-3d4d-4917-b497-2ddd040b93e5 req-9aadbd4c-0dbf-437e-89e0-3c6670d207b1 tempest-ServerBootFromVolumeStableRescueTest-939682044 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_c50f3ecd-5e88-4737-aa36-6e073ce70c60_reskgkf5" returned: 1 in 1.167s {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 25 15:54:07 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [req-7d534b89-3d4d-4917-b497-2ddd040b93e5 req-9aadbd4c-0dbf-437e-89e0-3c6670d207b1 tempest-ServerBootFromVolumeStableRescueTest-939682044 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_c50f3ecd-5e88-4737-aa36-6e073ce70c60_reskgkf5' failed. Not Retrying. {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Feb 25 15:54:07 devstack cinder-volume[83528]: DEBUG oslo.privsep.daemon [-] privsep: reply[979c6a52-4121-4ba6-8fbc-0f50c97c2479]: (4, 'qcow2') {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 25 15:54:07 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [req-7d534b89-3d4d-4917-b497-2ddd040b93e5 req-9aadbd4c-0dbf-437e-89e0-3c6670d207b1 tempest-ServerBootFromVolumeStableRescueTest-939682044 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c50f3ecd-5e88-4737-aa36-6e073ce70c60_tefo1gz7devstack@QuobyteHD {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 25 15:54:07 devstack sudo[86000]: pam_unix(sudo:session): session closed for user root Feb 25 15:54:07 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-dacfdc93-c20a-4f72-b4b9-446c4f579a39 tempest-GroupSnapshotsV319Test-1296641229 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-c3ba235a-b0c8-43b4-89dc-5894944a7df1" returned: 0 in 0.908s {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 25 15:54:07 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.quobyte [None req-dacfdc93-c20a-4f72-b4b9-446c4f579a39 tempest-GroupSnapshotsV319Test-1296641229 None] <== create_volume: return (2499ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-23e9d725-3e04-4cd9-bfe0-c8ef43305589'} {{(pid=83528) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 25 15:54:07 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-dacfdc93-c20a-4f72-b4b9-446c4f579a39 tempest-GroupSnapshotsV319Test-1296641229 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.503s {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 25 15:54:07 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-dacfdc93-c20a-4f72-b4b9-446c4f579a39 tempest-GroupSnapshotsV319Test-1296641229 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (005e08fa-adeb-43c7-a89c-3b6a35084659) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c3ba235a-b0c8-43b4-89dc-5894944a7df1', 'volume_size': 1}' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 25 15:54:07 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-dacfdc93-c20a-4f72-b4b9-446c4f579a39 tempest-GroupSnapshotsV319Test-1296641229 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2ea49597-cefa-4368-b5ee-2dbbe14b4d89) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 25 15:54:07 devstack sudo[86014]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c50f3ecd-5e88-4737-aa36-6e073ce70c60_tefo1gz7devstack@QuobyteHD Feb 25 15:54:07 devstack sudo[86014]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 25 15:54:07 devstack cinder-volume[83528]: INFO cinder.volume.flows.manager.create_volume [None req-dacfdc93-c20a-4f72-b4b9-446c4f579a39 tempest-GroupSnapshotsV319Test-1296641229 None] Volume volume-c3ba235a-b0c8-43b4-89dc-5894944a7df1 (c3ba235a-b0c8-43b4-89dc-5894944a7df1): created successfully Feb 25 15:54:07 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-dacfdc93-c20a-4f72-b4b9-446c4f579a39 tempest-GroupSnapshotsV319Test-1296641229 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2ea49597-cefa-4368-b5ee-2dbbe14b4d89) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 25 15:54:07 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-dacfdc93-c20a-4f72-b4b9-446c4f579a39 tempest-GroupSnapshotsV319Test-1296641229 None] Flow 'volume_create_manager' (d0092524-f46f-4cf8-91b3-efb8659b3f08) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83528) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 25 15:54:07 devstack cinder-volume[83528]: INFO cinder.volume.manager [None req-dacfdc93-c20a-4f72-b4b9-446c4f579a39 tempest-GroupSnapshotsV319Test-1296641229 None] Created volume successfully. Feb 25 15:54:08 devstack cinder-volume[83528]: INFO cinder.volume.manager [None req-a054230e-7981-4445-9d46-d5813bd6ee84 tempest-GroupSnapshotsTest-1779717395 None] Update group completed successfully. Feb 25 15:54:08 devstack sudo[86014]: pam_unix(sudo:session): session closed for user root Feb 25 15:54:08 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [req-7d534b89-3d4d-4917-b497-2ddd040b93e5 req-9aadbd4c-0dbf-437e-89e0-3c6670d207b1 tempest-ServerBootFromVolumeStableRescueTest-939682044 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c50f3ecd-5e88-4737-aa36-6e073ce70c60_tefo1gz7devstack@QuobyteHD" returned: 0 in 0.686s {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 25 15:54:08 devstack cinder-volume[83528]: DEBUG cinder.image.image_utils [req-7d534b89-3d4d-4917-b497-2ddd040b93e5 req-9aadbd4c-0dbf-437e-89e0-3c6670d207b1 tempest-ServerBootFromVolumeStableRescueTest-939682044 None] c50f3ecd-5e88-4737-aa36-6e073ce70c60 was qcow2, converting to raw {{(pid=83528) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1120}} Feb 25 15:54:08 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [req-7d534b89-3d4d-4917-b497-2ddd040b93e5 req-9aadbd4c-0dbf-437e-89e0-3c6670d207b1 tempest-ServerBootFromVolumeStableRescueTest-939682044 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_c50f3ecd-5e88-4737-aa36-6e073ce70c60_tefo1gz7devstack@QuobyteHD /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-bd62c213-e65c-4ced-a207-704de8f3bc88 {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 25 15:54:08 devstack sudo[86019]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_c50f3ecd-5e88-4737-aa36-6e073ce70c60_tefo1gz7devstack@QuobyteHD /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-bd62c213-e65c-4ced-a207-704de8f3bc88 Feb 25 15:54:08 devstack sudo[86019]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 25 15:54:09 devstack cinder-volume[83528]: INFO cinder.volume.manager [None req-1837fcd9-276f-449c-9b1e-1cf2302ae05e tempest-GroupSnapshotsV319Test-1296641229 None] GroupSnapshot d0e998b0-5635-4424-8698-38ae3c94e431: creating. Feb 25 15:54:09 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-1837fcd9-276f-449c-9b1e-1cf2302ae05e tempest-GroupSnapshotsV319Test-1296641229 None] Group snapshot d0e998b0-5635-4424-8698-38ae3c94e431: creating. {{(pid=83528) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Feb 25 15:54:09 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-1837fcd9-276f-449c-9b1e-1cf2302ae05e tempest-GroupSnapshotsV319Test-1296641229 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 25 15:54:09 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-1837fcd9-276f-449c-9b1e-1cf2302ae05e tempest-GroupSnapshotsV319Test-1296641229 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 25 15:54:09 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.remotefs [None req-1837fcd9-276f-449c-9b1e-1cf2302ae05e tempest-GroupSnapshotsV319Test-1296641229 None] Creating offline snapshot 0b077cdb-2837-4864-9227-31d42529b21b of volume c3ba235a-b0c8-43b4-89dc-5894944a7df1 {{(pid=83528) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Feb 25 15:54:09 devstack cinder-volume[83528]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb4bad2f-baf8-4171-9bf8-ea5f94ef8b3c]: (4, 'qcow2') {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 25 15:54:09 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-1837fcd9-276f-449c-9b1e-1cf2302ae05e tempest-GroupSnapshotsV319Test-1296641229 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-c3ba235a-b0c8-43b4-89dc-5894944a7df1 {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 25 15:54:09 devstack sudo[86026]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-c3ba235a-b0c8-43b4-89dc-5894944a7df1 Feb 25 15:54:09 devstack sudo[86026]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 25 15:54:09 devstack cinder-volume[83528]: INFO cinder.volume.manager [None req-67fb20cb-87ba-43e0-b951-c0864588dd7e tempest-GroupSnapshotsTest-1779717395 None] GroupSnapshot 20082c74-5e65-4baa-aee7-d494a054d6ff: creating. Feb 25 15:54:09 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-67fb20cb-87ba-43e0-b951-c0864588dd7e tempest-GroupSnapshotsTest-1779717395 None] Group snapshot 20082c74-5e65-4baa-aee7-d494a054d6ff: creating. {{(pid=83528) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Feb 25 15:54:09 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-67fb20cb-87ba-43e0-b951-c0864588dd7e tempest-GroupSnapshotsTest-1779717395 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 25 15:54:10 devstack sudo[86026]: pam_unix(sudo:session): session closed for user root Feb 25 15:54:10 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-1837fcd9-276f-449c-9b1e-1cf2302ae05e tempest-GroupSnapshotsV319Test-1296641229 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-c3ba235a-b0c8-43b4-89dc-5894944a7df1" returned: 0 in 1.005s {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 25 15:54:10 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-1837fcd9-276f-449c-9b1e-1cf2302ae05e tempest-GroupSnapshotsV319Test-1296641229 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-c3ba235a-b0c8-43b4-89dc-5894944a7df1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-c3ba235a-b0c8-43b4-89dc-5894944a7df1.0b077cdb-2837-4864-9227-31d42529b21b 1G {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 25 15:54:10 devstack sudo[86031]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-c3ba235a-b0c8-43b4-89dc-5894944a7df1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-c3ba235a-b0c8-43b4-89dc-5894944a7df1.0b077cdb-2837-4864-9227-31d42529b21b 1G Feb 25 15:54:10 devstack sudo[86031]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 25 15:54:10 devstack sudo[86019]: pam_unix(sudo:session): session closed for user root Feb 25 15:54:10 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [req-7d534b89-3d4d-4917-b497-2ddd040b93e5 req-9aadbd4c-0dbf-437e-89e0-3c6670d207b1 tempest-ServerBootFromVolumeStableRescueTest-939682044 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_c50f3ecd-5e88-4737-aa36-6e073ce70c60_tefo1gz7devstack@QuobyteHD /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-bd62c213-e65c-4ced-a207-704de8f3bc88" returned: 0 in 1.798s {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 25 15:54:10 devstack cinder-volume[83528]: DEBUG cinder.image.image_utils [req-7d534b89-3d4d-4917-b497-2ddd040b93e5 req-9aadbd4c-0dbf-437e-89e0-3c6670d207b1 tempest-ServerBootFromVolumeStableRescueTest-939682044 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_c50f3ecd-5e88-4737-aa36-6e073ce70c60_tefo1gz7devstack@QuobyteHD, size 112.00 MB, duration 1.80 sec, destination /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-bd62c213-e65c-4ced-a207-704de8f3bc88 {{(pid=83528) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Feb 25 15:54:10 devstack cinder-volume[83528]: INFO cinder.image.image_utils [req-7d534b89-3d4d-4917-b497-2ddd040b93e5 req-9aadbd4c-0dbf-437e-89e0-3c6670d207b1 tempest-ServerBootFromVolumeStableRescueTest-939682044 None] Converted 112.00 MB image at 62.23 MB/s Feb 25 15:54:10 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [req-7d534b89-3d4d-4917-b497-2ddd040b93e5 req-9aadbd4c-0dbf-437e-89e0-3c6670d207b1 tempest-ServerBootFromVolumeStableRescueTest-939682044 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-bd62c213-e65c-4ced-a207-704de8f3bc88 1G {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 25 15:54:10 devstack sudo[86045]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-bd62c213-e65c-4ced-a207-704de8f3bc88 1G Feb 25 15:54:10 devstack sudo[86045]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 25 15:54:11 devstack sudo[86045]: pam_unix(sudo:session): session closed for user root Feb 25 15:54:11 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [req-7d534b89-3d4d-4917-b497-2ddd040b93e5 req-9aadbd4c-0dbf-437e-89e0-3c6670d207b1 tempest-ServerBootFromVolumeStableRescueTest-939682044 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-bd62c213-e65c-4ced-a207-704de8f3bc88 1G" returned: 0 in 0.683s {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 25 15:54:11 devstack cinder-volume[83528]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b00736f-9e73-40c7-bd0c-32aaecb47a43]: (4, 'raw') {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 25 15:54:11 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [req-7d534b89-3d4d-4917-b497-2ddd040b93e5 req-9aadbd4c-0dbf-437e-89e0-3c6670d207b1 tempest-ServerBootFromVolumeStableRescueTest-939682044 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-bd62c213-e65c-4ced-a207-704de8f3bc88 {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 25 15:54:11 devstack sudo[86031]: pam_unix(sudo:session): session closed for user root Feb 25 15:54:11 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-1837fcd9-276f-449c-9b1e-1cf2302ae05e tempest-GroupSnapshotsV319Test-1296641229 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-c3ba235a-b0c8-43b4-89dc-5894944a7df1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-c3ba235a-b0c8-43b4-89dc-5894944a7df1.0b077cdb-2837-4864-9227-31d42529b21b 1G" returned: 0 in 0.884s {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 25 15:54:11 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-1837fcd9-276f-449c-9b1e-1cf2302ae05e tempest-GroupSnapshotsV319Test-1296641229 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c3ba235a-b0c8-43b4-89dc-5894944a7df1 -F qcow2 /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-c3ba235a-b0c8-43b4-89dc-5894944a7df1.0b077cdb-2837-4864-9227-31d42529b21b {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 25 15:54:11 devstack sudo[86076]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c3ba235a-b0c8-43b4-89dc-5894944a7df1 -F qcow2 /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-c3ba235a-b0c8-43b4-89dc-5894944a7df1.0b077cdb-2837-4864-9227-31d42529b21b Feb 25 15:54:11 devstack sudo[86076]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 25 15:54:11 devstack sudo[86075]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-bd62c213-e65c-4ced-a207-704de8f3bc88 Feb 25 15:54:11 devstack sudo[86075]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 25 15:54:11 devstack sudo[86075]: pam_unix(sudo:session): session closed for user root Feb 25 15:54:11 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [req-7d534b89-3d4d-4917-b497-2ddd040b93e5 req-9aadbd4c-0dbf-437e-89e0-3c6670d207b1 tempest-ServerBootFromVolumeStableRescueTest-939682044 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-bd62c213-e65c-4ced-a207-704de8f3bc88" returned: 0 in 0.702s {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 25 15:54:11 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [req-7d534b89-3d4d-4917-b497-2ddd040b93e5 req-9aadbd4c-0dbf-437e-89e0-3c6670d207b1 tempest-ServerBootFromVolumeStableRescueTest-939682044 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-bd62c213-e65c-4ced-a207-704de8f3bc88 {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 25 15:54:11 devstack sudo[86076]: pam_unix(sudo:session): session closed for user root Feb 25 15:54:11 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-1837fcd9-276f-449c-9b1e-1cf2302ae05e tempest-GroupSnapshotsV319Test-1296641229 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c3ba235a-b0c8-43b4-89dc-5894944a7df1 -F qcow2 /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-c3ba235a-b0c8-43b4-89dc-5894944a7df1.0b077cdb-2837-4864-9227-31d42529b21b" returned: 0 in 0.684s {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 25 15:54:11 devstack cinder-volume[83528]: WARNING cinder.volume.drivers.remotefs [None req-1837fcd9-276f-449c-9b1e-1cf2302ae05e tempest-GroupSnapshotsV319Test-1296641229 None] /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-c3ba235a-b0c8-43b4-89dc-5894944a7df1.0b077cdb-2837-4864-9227-31d42529b21b is being set with open permissions: ugo+rw: NotImplementedError Feb 25 15:54:11 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-1837fcd9-276f-449c-9b1e-1cf2302ae05e tempest-GroupSnapshotsV319Test-1296641229 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-c3ba235a-b0c8-43b4-89dc-5894944a7df1.0b077cdb-2837-4864-9227-31d42529b21b {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 25 15:54:11 devstack sudo[86088]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-c3ba235a-b0c8-43b4-89dc-5894944a7df1.0b077cdb-2837-4864-9227-31d42529b21b Feb 25 15:54:11 devstack sudo[86088]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 25 15:54:11 devstack sudo[86087]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-bd62c213-e65c-4ced-a207-704de8f3bc88 Feb 25 15:54:11 devstack sudo[86087]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 25 15:54:12 devstack sudo[86088]: pam_unix(sudo:session): session closed for user root Feb 25 15:54:12 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-1837fcd9-276f-449c-9b1e-1cf2302ae05e tempest-GroupSnapshotsV319Test-1296641229 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-c3ba235a-b0c8-43b4-89dc-5894944a7df1.0b077cdb-2837-4864-9227-31d42529b21b" returned: 0 in 0.524s {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 25 15:54:12 devstack cinder-volume[83528]: DEBUG dbcounter [-] [83528] Writing DB stats cinder:SELECT=112,cinder:UPDATE=125,cinder:INSERT=27,cinder:DELETE=5 {{(pid=83528) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Feb 25 15:54:12 devstack cinder-volume[83528]: DEBUG dbcounter [-] [83528] Writing DB stats cinder:SELECT=109,cinder:UPDATE=113,cinder:INSERT=27,cinder:DELETE=10 {{(pid=83528) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Feb 25 15:54:12 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-1837fcd9-276f-449c-9b1e-1cf2302ae05e tempest-GroupSnapshotsV319Test-1296641229 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-c3ba235a-b0c8-43b4-89dc-5894944a7df1.info {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 25 15:54:12 devstack sudo[86095]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-c3ba235a-b0c8-43b4-89dc-5894944a7df1.info Feb 25 15:54:12 devstack sudo[86095]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 25 15:54:12 devstack sudo[86087]: pam_unix(sudo:session): session closed for user root Feb 25 15:54:12 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [req-7d534b89-3d4d-4917-b497-2ddd040b93e5 req-9aadbd4c-0dbf-437e-89e0-3c6670d207b1 tempest-ServerBootFromVolumeStableRescueTest-939682044 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-bd62c213-e65c-4ced-a207-704de8f3bc88" returned: 1 in 0.711s {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 25 15:54:12 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [req-7d534b89-3d4d-4917-b497-2ddd040b93e5 req-9aadbd4c-0dbf-437e-89e0-3c6670d207b1 tempest-ServerBootFromVolumeStableRescueTest-939682044 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-bd62c213-e65c-4ced-a207-704de8f3bc88' failed. Not Retrying. {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Feb 25 15:54:12 devstack cinder-volume[83528]: DEBUG cinder.volume.volume_utils [req-7d534b89-3d4d-4917-b497-2ddd040b93e5 req-9aadbd4c-0dbf-437e-89e0-3c6670d207b1 tempest-ServerBootFromVolumeStableRescueTest-939682044 None] Downloaded image c50f3ecd-5e88-4737-aa36-6e073ce70c60 ((None, [{'url': 'file:///opt/stack/data/glance/images/c50f3ecd-5e88-4737-aa36-6e073ce70c60', 'metadata': {}}])) to volume bd62c213-e65c-4ced-a207-704de8f3bc88 successfully. {{(pid=83528) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1234}} Feb 25 15:54:12 devstack cinder-volume[83528]: DEBUG cinder.image.image_utils [req-7d534b89-3d4d-4917-b497-2ddd040b93e5 req-9aadbd4c-0dbf-437e-89e0-3c6670d207b1 tempest-ServerBootFromVolumeStableRescueTest-939682044 None] Temporary image c50f3ecd-5e88-4737-aa36-6e073ce70c60 for user ccac5f6631a3427584db00fdc9fa82c4 is deleted. {{(pid=83528) fetch /opt/stack/cinder/cinder/image/image_utils.py:1435}} Feb 25 15:54:12 devstack cinder-volume[83528]: DEBUG cinder.volume.volume_utils [req-7d534b89-3d4d-4917-b497-2ddd040b93e5 req-9aadbd4c-0dbf-437e-89e0-3c6670d207b1 tempest-ServerBootFromVolumeStableRescueTest-939682044 None] Marking volume bd62c213-e65c-4ced-a207-704de8f3bc88 as bootable. {{(pid=83528) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1138}} Feb 25 15:54:12 devstack cinder-volume[83528]: DEBUG cinder.volume.flows.manager.create_volume [req-7d534b89-3d4d-4917-b497-2ddd040b93e5 req-9aadbd4c-0dbf-437e-89e0-3c6670d207b1 tempest-ServerBootFromVolumeStableRescueTest-939682044 None] Copying metadata from image c50f3ecd-5e88-4737-aa36-6e073ce70c60 to bd62c213-e65c-4ced-a207-704de8f3bc88. {{(pid=83528) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Feb 25 15:54:12 devstack cinder-volume[83528]: DEBUG cinder.volume.flows.manager.create_volume [req-7d534b89-3d4d-4917-b497-2ddd040b93e5 req-9aadbd4c-0dbf-437e-89e0-3c6670d207b1 tempest-ServerBootFromVolumeStableRescueTest-939682044 None] Creating volume glance metadata for volume bd62c213-e65c-4ced-a207-704de8f3bc88 backed by image c50f3ecd-5e88-4737-aa36-6e073ce70c60 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': 'c50f3ecd-5e88-4737-aa36-6e073ce70c60', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=83528) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Feb 25 15:54:12 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [req-7d534b89-3d4d-4917-b497-2ddd040b93e5 req-9aadbd4c-0dbf-437e-89e0-3c6670d207b1 tempest-ServerBootFromVolumeStableRescueTest-939682044 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (649333aa-718c-4e6a-a894-7398349ef0e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bd62c213-e65c-4ced-a207-704de8f3bc88', 'volume_size': 1, 'image_id': 'c50f3ecd-5e88-4737-aa36-6e073ce70c60', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/c50f3ecd-5e88-4737-aa36-6e073ce70c60', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '75f8571da0ad46ec8e734ab2a4fa231d', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'c50f3ecd-5e88-4737-aa36-6e073ce70c60', 'created_at': datetime.datetime(2026, 2, 25, 14, 47, 16, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 2, 25, 14, 47, 18, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/c50f3ecd-5e88-4737-aa36-6e073ce70c60/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 25 15:54:12 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [req-7d534b89-3d4d-4917-b497-2ddd040b93e5 req-9aadbd4c-0dbf-437e-89e0-3c6670d207b1 tempest-ServerBootFromVolumeStableRescueTest-939682044 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e1f88084-f356-4608-8c56-5243ba26652c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 25 15:54:12 devstack cinder-volume[83528]: INFO cinder.volume.flows.manager.create_volume [req-7d534b89-3d4d-4917-b497-2ddd040b93e5 req-9aadbd4c-0dbf-437e-89e0-3c6670d207b1 tempest-ServerBootFromVolumeStableRescueTest-939682044 None] Volume volume-bd62c213-e65c-4ced-a207-704de8f3bc88 (bd62c213-e65c-4ced-a207-704de8f3bc88): created successfully Feb 25 15:54:12 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [req-7d534b89-3d4d-4917-b497-2ddd040b93e5 req-9aadbd4c-0dbf-437e-89e0-3c6670d207b1 tempest-ServerBootFromVolumeStableRescueTest-939682044 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e1f88084-f356-4608-8c56-5243ba26652c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 25 15:54:12 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [req-7d534b89-3d4d-4917-b497-2ddd040b93e5 req-9aadbd4c-0dbf-437e-89e0-3c6670d207b1 tempest-ServerBootFromVolumeStableRescueTest-939682044 None] Flow 'volume_create_manager' (665b9c88-dd2f-4488-80d6-bb3376a207eb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83528) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 25 15:54:12 devstack cinder-volume[83528]: INFO cinder.volume.manager [req-7d534b89-3d4d-4917-b497-2ddd040b93e5 req-9aadbd4c-0dbf-437e-89e0-3c6670d207b1 tempest-ServerBootFromVolumeStableRescueTest-939682044 None] Created volume successfully. Feb 25 15:54:13 devstack sudo[86095]: pam_unix(sudo:session): session closed for user root Feb 25 15:54:13 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-1837fcd9-276f-449c-9b1e-1cf2302ae05e tempest-GroupSnapshotsV319Test-1296641229 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-c3ba235a-b0c8-43b4-89dc-5894944a7df1.info" returned: 0 in 0.755s {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 25 15:54:13 devstack cinder-volume[83528]: WARNING cinder.volume.drivers.remotefs [None req-1837fcd9-276f-449c-9b1e-1cf2302ae05e tempest-GroupSnapshotsV319Test-1296641229 None] /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-c3ba235a-b0c8-43b4-89dc-5894944a7df1.info is being set with open permissions: ugo+rw: NotImplementedError Feb 25 15:54:13 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-1837fcd9-276f-449c-9b1e-1cf2302ae05e tempest-GroupSnapshotsV319Test-1296641229 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-c3ba235a-b0c8-43b4-89dc-5894944a7df1.info {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 25 15:54:13 devstack sudo[86129]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-c3ba235a-b0c8-43b4-89dc-5894944a7df1.info Feb 25 15:54:13 devstack sudo[86129]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 25 15:54:14 devstack sudo[86129]: pam_unix(sudo:session): session closed for user root Feb 25 15:54:14 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-1837fcd9-276f-449c-9b1e-1cf2302ae05e tempest-GroupSnapshotsV319Test-1296641229 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-c3ba235a-b0c8-43b4-89dc-5894944a7df1.info" returned: 0 in 1.076s {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 25 15:54:14 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-1837fcd9-276f-449c-9b1e-1cf2302ae05e tempest-GroupSnapshotsV319Test-1296641229 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.011s {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 25 15:54:14 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-67fb20cb-87ba-43e0-b951-c0864588dd7e tempest-GroupSnapshotsTest-1779717395 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 4.453s {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 25 15:54:14 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.remotefs [None req-67fb20cb-87ba-43e0-b951-c0864588dd7e tempest-GroupSnapshotsTest-1779717395 None] Creating offline snapshot 1e3cb04d-e1da-4b30-8e2d-57ad232dca5d of volume 5153a222-bd7e-4e1e-8ff9-1b0c4d8bcba9 {{(pid=83528) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Feb 25 15:54:14 devstack cinder-volume[83528]: DEBUG oslo.privsep.daemon [-] privsep: reply[6bfbebb3-ca25-47d9-a35e-7448e0d4cf30]: (4, 'qcow2') {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 25 15:54:14 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-67fb20cb-87ba-43e0-b951-c0864588dd7e tempest-GroupSnapshotsTest-1779717395 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-5153a222-bd7e-4e1e-8ff9-1b0c4d8bcba9 {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 25 15:54:14 devstack cinder-volume[83528]: INFO cinder.volume.manager [None req-1837fcd9-276f-449c-9b1e-1cf2302ae05e tempest-GroupSnapshotsV319Test-1296641229 None] group_snapshot d0e998b0-5635-4424-8698-38ae3c94e431: created successfully Feb 25 15:54:14 devstack sudo[86142]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-5153a222-bd7e-4e1e-8ff9-1b0c4d8bcba9 Feb 25 15:54:14 devstack sudo[86142]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 25 15:54:14 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [req-7d534b89-3d4d-4917-b497-2ddd040b93e5 req-7379346a-ac76-4e19-a08d-660da306ec30 tempest-ServerBootFromVolumeStableRescueTest-939682044 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 25 15:54:15 devstack cinder-volume[83528]: INFO cinder.volume.manager [None req-cc450369-16e7-44f8-b5c6-6caba086c2f9 tempest-GroupSnapshotsV319Test-1296641229 None] group_snapshot d0e998b0-5635-4424-8698-38ae3c94e431: deleting Feb 25 15:54:15 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-cc450369-16e7-44f8-b5c6-6caba086c2f9 tempest-GroupSnapshotsV319Test-1296641229 None] group_snapshot d0e998b0-5635-4424-8698-38ae3c94e431: deleting {{(pid=83528) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Feb 25 15:54:15 devstack cinder-volume[83528]: DEBUG cinder.coordination [None req-cc450369-16e7-44f8-b5c6-6caba086c2f9 tempest-GroupSnapshotsV319Test-1296641229 None] Acquiring lock "cinder-quobyte-c3ba235a-b0c8-43b4-89dc-5894944a7df1" by "delete_snapshot" {{(pid=83528) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 25 15:54:15 devstack cinder-volume[83528]: DEBUG cinder.coordination [None req-cc450369-16e7-44f8-b5c6-6caba086c2f9 tempest-GroupSnapshotsV319Test-1296641229 None] Lock "cinder-quobyte-c3ba235a-b0c8-43b4-89dc-5894944a7df1" acquired by "delete_snapshot" :: waited 0.022s {{(pid=83528) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 25 15:54:15 devstack cinder-volume[83528]: DEBUG cinder.coordination [None req-cc450369-16e7-44f8-b5c6-6caba086c2f9 tempest-GroupSnapshotsV319Test-1296641229 None] Acquiring lock "cinder-quobyte-0b077cdb-2837-4864-9227-31d42529b21b" by "_delete_snapshot" {{(pid=83528) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 25 15:54:15 devstack cinder-volume[83528]: DEBUG cinder.coordination [None req-cc450369-16e7-44f8-b5c6-6caba086c2f9 tempest-GroupSnapshotsV319Test-1296641229 None] Lock "cinder-quobyte-0b077cdb-2837-4864-9227-31d42529b21b" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=83528) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 25 15:54:15 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.remotefs [None req-cc450369-16e7-44f8-b5c6-6caba086c2f9 tempest-GroupSnapshotsV319Test-1296641229 None] Deleting offline snapshot 0b077cdb-2837-4864-9227-31d42529b21b of volume c3ba235a-b0c8-43b4-89dc-5894944a7df1 {{(pid=83528) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Feb 25 15:54:15 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.remotefs [None req-cc450369-16e7-44f8-b5c6-6caba086c2f9 tempest-GroupSnapshotsV319Test-1296641229 None] snapshot_file for this snap is: volume-c3ba235a-b0c8-43b4-89dc-5894944a7df1.0b077cdb-2837-4864-9227-31d42529b21b {{(pid=83528) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Feb 25 15:54:15 devstack cinder-volume[83528]: DEBUG oslo.privsep.daemon [-] privsep: reply[f04db196-d3c0-4d7f-a0e8-39e1558e9698]: (4, 'qcow2') {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 25 15:54:15 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-cc450369-16e7-44f8-b5c6-6caba086c2f9 tempest-GroupSnapshotsV319Test-1296641229 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-c3ba235a-b0c8-43b4-89dc-5894944a7df1.0b077cdb-2837-4864-9227-31d42529b21b {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 25 15:54:15 devstack sudo[86142]: pam_unix(sudo:session): session closed for user root Feb 25 15:54:15 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-67fb20cb-87ba-43e0-b951-c0864588dd7e tempest-GroupSnapshotsTest-1779717395 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-5153a222-bd7e-4e1e-8ff9-1b0c4d8bcba9" returned: 0 in 1.106s {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 25 15:54:15 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-67fb20cb-87ba-43e0-b951-c0864588dd7e tempest-GroupSnapshotsTest-1779717395 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-5153a222-bd7e-4e1e-8ff9-1b0c4d8bcba9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-5153a222-bd7e-4e1e-8ff9-1b0c4d8bcba9.1e3cb04d-e1da-4b30-8e2d-57ad232dca5d 1G {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 25 15:54:15 devstack sudo[86149]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-5153a222-bd7e-4e1e-8ff9-1b0c4d8bcba9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-5153a222-bd7e-4e1e-8ff9-1b0c4d8bcba9.1e3cb04d-e1da-4b30-8e2d-57ad232dca5d 1G Feb 25 15:54:15 devstack sudo[86149]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 25 15:54:15 devstack sudo[86148]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-c3ba235a-b0c8-43b4-89dc-5894944a7df1.0b077cdb-2837-4864-9227-31d42529b21b Feb 25 15:54:15 devstack sudo[86148]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 25 15:54:16 devstack sudo[86148]: pam_unix(sudo:session): session closed for user root Feb 25 15:54:16 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-cc450369-16e7-44f8-b5c6-6caba086c2f9 tempest-GroupSnapshotsV319Test-1296641229 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-c3ba235a-b0c8-43b4-89dc-5894944a7df1.0b077cdb-2837-4864-9227-31d42529b21b" returned: 0 in 1.043s {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 25 15:54:16 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.remotefs [None req-cc450369-16e7-44f8-b5c6-6caba086c2f9 tempest-GroupSnapshotsV319Test-1296641229 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c3ba235a-b0c8-43b4-89dc-5894944a7df1(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83528) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Feb 25 15:54:16 devstack cinder-volume[83528]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb0f4f3f-565b-4ad9-85f4-7d0d6f6f0596]: (4, 'qcow2') {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 25 15:54:16 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-cc450369-16e7-44f8-b5c6-6caba086c2f9 tempest-GroupSnapshotsV319Test-1296641229 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-c3ba235a-b0c8-43b4-89dc-5894944a7df1 {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 25 15:54:16 devstack sudo[86171]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-c3ba235a-b0c8-43b4-89dc-5894944a7df1 Feb 25 15:54:16 devstack sudo[86171]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 25 15:54:16 devstack sudo[86149]: pam_unix(sudo:session): session closed for user root Feb 25 15:54:16 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-67fb20cb-87ba-43e0-b951-c0864588dd7e tempest-GroupSnapshotsTest-1779717395 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-5153a222-bd7e-4e1e-8ff9-1b0c4d8bcba9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-5153a222-bd7e-4e1e-8ff9-1b0c4d8bcba9.1e3cb04d-e1da-4b30-8e2d-57ad232dca5d 1G" returned: 0 in 1.184s {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 25 15:54:16 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-67fb20cb-87ba-43e0-b951-c0864588dd7e tempest-GroupSnapshotsTest-1779717395 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5153a222-bd7e-4e1e-8ff9-1b0c4d8bcba9 -F qcow2 /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-5153a222-bd7e-4e1e-8ff9-1b0c4d8bcba9.1e3cb04d-e1da-4b30-8e2d-57ad232dca5d {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 25 15:54:16 devstack sudo[86178]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5153a222-bd7e-4e1e-8ff9-1b0c4d8bcba9 -F qcow2 /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-5153a222-bd7e-4e1e-8ff9-1b0c4d8bcba9.1e3cb04d-e1da-4b30-8e2d-57ad232dca5d Feb 25 15:54:16 devstack sudo[86178]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 25 15:54:17 devstack sudo[86171]: pam_unix(sudo:session): session closed for user root Feb 25 15:54:17 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-cc450369-16e7-44f8-b5c6-6caba086c2f9 tempest-GroupSnapshotsV319Test-1296641229 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-c3ba235a-b0c8-43b4-89dc-5894944a7df1" returned: 0 in 0.858s {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 25 15:54:17 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-cc450369-16e7-44f8-b5c6-6caba086c2f9 tempest-GroupSnapshotsV319Test-1296641229 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-c3ba235a-b0c8-43b4-89dc-5894944a7df1.0b077cdb-2837-4864-9227-31d42529b21b {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 25 15:54:17 devstack sudo[86211]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-c3ba235a-b0c8-43b4-89dc-5894944a7df1.0b077cdb-2837-4864-9227-31d42529b21b Feb 25 15:54:17 devstack sudo[86211]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 25 15:54:17 devstack sudo[86178]: pam_unix(sudo:session): session closed for user root Feb 25 15:54:17 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-67fb20cb-87ba-43e0-b951-c0864588dd7e tempest-GroupSnapshotsTest-1779717395 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5153a222-bd7e-4e1e-8ff9-1b0c4d8bcba9 -F qcow2 /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-5153a222-bd7e-4e1e-8ff9-1b0c4d8bcba9.1e3cb04d-e1da-4b30-8e2d-57ad232dca5d" returned: 0 in 0.977s {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 25 15:54:17 devstack cinder-volume[83528]: WARNING cinder.volume.drivers.remotefs [None req-67fb20cb-87ba-43e0-b951-c0864588dd7e tempest-GroupSnapshotsTest-1779717395 None] /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-5153a222-bd7e-4e1e-8ff9-1b0c4d8bcba9.1e3cb04d-e1da-4b30-8e2d-57ad232dca5d is being set with open permissions: ugo+rw: NotImplementedError Feb 25 15:54:17 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-67fb20cb-87ba-43e0-b951-c0864588dd7e tempest-GroupSnapshotsTest-1779717395 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-5153a222-bd7e-4e1e-8ff9-1b0c4d8bcba9.1e3cb04d-e1da-4b30-8e2d-57ad232dca5d {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 25 15:54:17 devstack sudo[86220]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-5153a222-bd7e-4e1e-8ff9-1b0c4d8bcba9.1e3cb04d-e1da-4b30-8e2d-57ad232dca5d Feb 25 15:54:17 devstack sudo[86220]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 25 15:54:18 devstack sudo[86220]: pam_unix(sudo:session): session closed for user root Feb 25 15:54:18 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-67fb20cb-87ba-43e0-b951-c0864588dd7e tempest-GroupSnapshotsTest-1779717395 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-5153a222-bd7e-4e1e-8ff9-1b0c4d8bcba9.1e3cb04d-e1da-4b30-8e2d-57ad232dca5d" returned: 0 in 0.469s {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 25 15:54:18 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-67fb20cb-87ba-43e0-b951-c0864588dd7e tempest-GroupSnapshotsTest-1779717395 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-5153a222-bd7e-4e1e-8ff9-1b0c4d8bcba9.info {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 25 15:54:18 devstack sudo[86211]: pam_unix(sudo:session): session closed for user root Feb 25 15:54:18 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-cc450369-16e7-44f8-b5c6-6caba086c2f9 tempest-GroupSnapshotsV319Test-1296641229 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-c3ba235a-b0c8-43b4-89dc-5894944a7df1.0b077cdb-2837-4864-9227-31d42529b21b" returned: 0 in 0.820s {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 25 15:54:18 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-cc450369-16e7-44f8-b5c6-6caba086c2f9 tempest-GroupSnapshotsV319Test-1296641229 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-c3ba235a-b0c8-43b4-89dc-5894944a7df1.0b077cdb-2837-4864-9227-31d42529b21b {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 25 15:54:18 devstack sudo[86227]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-c3ba235a-b0c8-43b4-89dc-5894944a7df1.0b077cdb-2837-4864-9227-31d42529b21b Feb 25 15:54:18 devstack sudo[86227]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 25 15:54:18 devstack sudo[86226]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-5153a222-bd7e-4e1e-8ff9-1b0c4d8bcba9.info Feb 25 15:54:18 devstack sudo[86226]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 25 15:54:18 devstack sudo[86226]: pam_unix(sudo:session): session closed for user root Feb 25 15:54:18 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-67fb20cb-87ba-43e0-b951-c0864588dd7e tempest-GroupSnapshotsTest-1779717395 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-5153a222-bd7e-4e1e-8ff9-1b0c4d8bcba9.info" returned: 0 in 0.589s {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 25 15:54:18 devstack cinder-volume[83528]: WARNING cinder.volume.drivers.remotefs [None req-67fb20cb-87ba-43e0-b951-c0864588dd7e tempest-GroupSnapshotsTest-1779717395 None] /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-5153a222-bd7e-4e1e-8ff9-1b0c4d8bcba9.info is being set with open permissions: ugo+rw: NotImplementedError Feb 25 15:54:18 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-67fb20cb-87ba-43e0-b951-c0864588dd7e tempest-GroupSnapshotsTest-1779717395 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-5153a222-bd7e-4e1e-8ff9-1b0c4d8bcba9.info {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 25 15:54:18 devstack sudo[86233]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-5153a222-bd7e-4e1e-8ff9-1b0c4d8bcba9.info Feb 25 15:54:18 devstack sudo[86233]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 25 15:54:18 devstack sudo[86227]: pam_unix(sudo:session): session closed for user root Feb 25 15:54:18 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-cc450369-16e7-44f8-b5c6-6caba086c2f9 tempest-GroupSnapshotsV319Test-1296641229 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-c3ba235a-b0c8-43b4-89dc-5894944a7df1.0b077cdb-2837-4864-9227-31d42529b21b" returned: 0 in 0.596s {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 25 15:54:18 devstack cinder-volume[83528]: DEBUG cinder.coordination [None req-cc450369-16e7-44f8-b5c6-6caba086c2f9 tempest-GroupSnapshotsV319Test-1296641229 None] Lock "cinder-quobyte-0b077cdb-2837-4864-9227-31d42529b21b" released by "_delete_snapshot" :: held 3.432s {{(pid=83528) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 25 15:54:18 devstack cinder-volume[83528]: DEBUG cinder.coordination [None req-cc450369-16e7-44f8-b5c6-6caba086c2f9 tempest-GroupSnapshotsV319Test-1296641229 None] Lock "cinder-quobyte-c3ba235a-b0c8-43b4-89dc-5894944a7df1" released by "delete_snapshot" :: held 3.456s {{(pid=83528) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 25 15:54:18 devstack cinder-volume[83528]: WARNING cinder.quota [None req-cc450369-16e7-44f8-b5c6-6caba086c2f9 tempest-GroupSnapshotsV319Test-1296641229 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsV319Test-volume-type-381007903 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsV319Test-volume-type-381007903, it is now deprecated. Please use the default quota class for default quota. Feb 25 15:54:18 devstack cinder-volume[83528]: WARNING cinder.quota [None req-cc450369-16e7-44f8-b5c6-6caba086c2f9 tempest-GroupSnapshotsV319Test-1296641229 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsV319Test-volume-type-381007903 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsV319Test-volume-type-381007903, it is now deprecated. Please use the default quota class for default quota. Feb 25 15:54:18 devstack cinder-volume[83528]: DEBUG cinder.quota [None req-cc450369-16e7-44f8-b5c6-6caba086c2f9 tempest-GroupSnapshotsV319Test-1296641229 None] Created reservations ['6e59977a-74b7-4070-b753-04512551b036', '11cb9e76-05ad-4dfc-95fb-82275b6d4b68', '5d1111e2-434d-41a6-af74-1f39a7410170', 'b37894e9-2596-4dd5-9aee-8418b49b9def'] {{(pid=83528) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 25 15:54:18 devstack cinder-volume[83528]: INFO cinder.volume.manager [None req-cc450369-16e7-44f8-b5c6-6caba086c2f9 tempest-GroupSnapshotsV319Test-1296641229 None] group_snapshot d0e998b0-5635-4424-8698-38ae3c94e431: deleted successfully Feb 25 15:54:19 devstack sudo[86233]: pam_unix(sudo:session): session closed for user root Feb 25 15:54:19 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-67fb20cb-87ba-43e0-b951-c0864588dd7e tempest-GroupSnapshotsTest-1779717395 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-5153a222-bd7e-4e1e-8ff9-1b0c4d8bcba9.info" returned: 0 in 0.563s {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 25 15:54:19 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-67fb20cb-87ba-43e0-b951-c0864588dd7e tempest-GroupSnapshotsTest-1779717395 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.099s {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 25 15:54:19 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-67fb20cb-87ba-43e0-b951-c0864588dd7e tempest-GroupSnapshotsTest-1779717395 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 25 15:54:19 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-67fb20cb-87ba-43e0-b951-c0864588dd7e tempest-GroupSnapshotsTest-1779717395 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.000s {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 25 15:54:19 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.remotefs [None req-67fb20cb-87ba-43e0-b951-c0864588dd7e tempest-GroupSnapshotsTest-1779717395 None] Creating offline snapshot 55e1602f-f353-439f-b32e-17efe498f5c5 of volume c96adca3-9875-40e8-aa3e-3b7f6d371d46 {{(pid=83528) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Feb 25 15:54:19 devstack cinder-volume[83528]: DEBUG oslo.privsep.daemon [-] privsep: reply[674a6c2c-1ca1-4e15-8f91-de4d8de091e4]: (4, 'qcow2') {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 25 15:54:19 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-67fb20cb-87ba-43e0-b951-c0864588dd7e tempest-GroupSnapshotsTest-1779717395 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-c96adca3-9875-40e8-aa3e-3b7f6d371d46 {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 25 15:54:19 devstack sudo[86236]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-c96adca3-9875-40e8-aa3e-3b7f6d371d46 Feb 25 15:54:19 devstack sudo[86236]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 25 15:54:19 devstack sudo[86236]: pam_unix(sudo:session): session closed for user root Feb 25 15:54:19 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-67fb20cb-87ba-43e0-b951-c0864588dd7e tempest-GroupSnapshotsTest-1779717395 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-c96adca3-9875-40e8-aa3e-3b7f6d371d46" returned: 0 in 0.621s {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 25 15:54:19 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-67fb20cb-87ba-43e0-b951-c0864588dd7e tempest-GroupSnapshotsTest-1779717395 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-c96adca3-9875-40e8-aa3e-3b7f6d371d46,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-c96adca3-9875-40e8-aa3e-3b7f6d371d46.55e1602f-f353-439f-b32e-17efe498f5c5 1G {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 25 15:54:19 devstack cinder-volume[83528]: DEBUG cinder.coordination [None req-b4c3a34d-d8fe-4c9b-9042-1fa5ec1cc6b6 tempest-GroupSnapshotsV319Test-1296641229 None] Acquiring lock "cinder-quobyte-c3ba235a-b0c8-43b4-89dc-5894944a7df1" by "delete_volume" {{(pid=83528) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 25 15:54:19 devstack cinder-volume[83528]: DEBUG cinder.coordination [None req-b4c3a34d-d8fe-4c9b-9042-1fa5ec1cc6b6 tempest-GroupSnapshotsV319Test-1296641229 None] Lock "cinder-quobyte-c3ba235a-b0c8-43b4-89dc-5894944a7df1" acquired by "delete_volume" :: waited 0.016s {{(pid=83528) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 25 15:54:19 devstack sudo[86241]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-c96adca3-9875-40e8-aa3e-3b7f6d371d46,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-c96adca3-9875-40e8-aa3e-3b7f6d371d46.55e1602f-f353-439f-b32e-17efe498f5c5 1G Feb 25 15:54:19 devstack sudo[86241]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 25 15:54:20 devstack cinder-volume[83528]: DEBUG oslo.privsep.daemon [-] privsep: reply[603a27fa-2e21-4458-9dcb-6ffef0b75cb7]: (4, 'qcow2') {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 25 15:54:20 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-b4c3a34d-d8fe-4c9b-9042-1fa5ec1cc6b6 tempest-GroupSnapshotsV319Test-1296641229 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-c3ba235a-b0c8-43b4-89dc-5894944a7df1 {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 25 15:54:20 devstack sudo[86243]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-c3ba235a-b0c8-43b4-89dc-5894944a7df1 Feb 25 15:54:20 devstack sudo[86243]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 25 15:54:20 devstack sudo[86241]: pam_unix(sudo:session): session closed for user root Feb 25 15:54:20 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-67fb20cb-87ba-43e0-b951-c0864588dd7e tempest-GroupSnapshotsTest-1779717395 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-c96adca3-9875-40e8-aa3e-3b7f6d371d46,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-c96adca3-9875-40e8-aa3e-3b7f6d371d46.55e1602f-f353-439f-b32e-17efe498f5c5 1G" returned: 0 in 0.707s {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 25 15:54:20 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-67fb20cb-87ba-43e0-b951-c0864588dd7e tempest-GroupSnapshotsTest-1779717395 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c96adca3-9875-40e8-aa3e-3b7f6d371d46 -F qcow2 /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-c96adca3-9875-40e8-aa3e-3b7f6d371d46.55e1602f-f353-439f-b32e-17efe498f5c5 {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 25 15:54:20 devstack sudo[86252]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c96adca3-9875-40e8-aa3e-3b7f6d371d46 -F qcow2 /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-c96adca3-9875-40e8-aa3e-3b7f6d371d46.55e1602f-f353-439f-b32e-17efe498f5c5 Feb 25 15:54:20 devstack sudo[86252]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 25 15:54:20 devstack sudo[86243]: pam_unix(sudo:session): session closed for user root Feb 25 15:54:20 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-b4c3a34d-d8fe-4c9b-9042-1fa5ec1cc6b6 tempest-GroupSnapshotsV319Test-1296641229 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-c3ba235a-b0c8-43b4-89dc-5894944a7df1" returned: 0 in 0.693s {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 25 15:54:20 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-b4c3a34d-d8fe-4c9b-9042-1fa5ec1cc6b6 tempest-GroupSnapshotsV319Test-1296641229 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-c3ba235a-b0c8-43b4-89dc-5894944a7df1 {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 25 15:54:20 devstack sudo[86254]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-c3ba235a-b0c8-43b4-89dc-5894944a7df1 Feb 25 15:54:20 devstack sudo[86254]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 25 15:54:21 devstack sudo[86254]: pam_unix(sudo:session): session closed for user root Feb 25 15:54:21 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-b4c3a34d-d8fe-4c9b-9042-1fa5ec1cc6b6 tempest-GroupSnapshotsV319Test-1296641229 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-c3ba235a-b0c8-43b4-89dc-5894944a7df1" returned: 0 in 0.533s {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 25 15:54:21 devstack cinder-volume[83528]: DEBUG cinder.coordination [None req-b4c3a34d-d8fe-4c9b-9042-1fa5ec1cc6b6 tempest-GroupSnapshotsV319Test-1296641229 None] Lock "cinder-quobyte-c3ba235a-b0c8-43b4-89dc-5894944a7df1" released by "delete_volume" :: held 1.264s {{(pid=83528) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 25 15:54:21 devstack sudo[86252]: pam_unix(sudo:session): session closed for user root Feb 25 15:54:21 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-67fb20cb-87ba-43e0-b951-c0864588dd7e tempest-GroupSnapshotsTest-1779717395 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c96adca3-9875-40e8-aa3e-3b7f6d371d46 -F qcow2 /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-c96adca3-9875-40e8-aa3e-3b7f6d371d46.55e1602f-f353-439f-b32e-17efe498f5c5" returned: 0 in 0.607s {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 25 15:54:21 devstack cinder-volume[83528]: WARNING cinder.volume.drivers.remotefs [None req-67fb20cb-87ba-43e0-b951-c0864588dd7e tempest-GroupSnapshotsTest-1779717395 None] /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-c96adca3-9875-40e8-aa3e-3b7f6d371d46.55e1602f-f353-439f-b32e-17efe498f5c5 is being set with open permissions: ugo+rw: NotImplementedError Feb 25 15:54:21 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-67fb20cb-87ba-43e0-b951-c0864588dd7e tempest-GroupSnapshotsTest-1779717395 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-c96adca3-9875-40e8-aa3e-3b7f6d371d46.55e1602f-f353-439f-b32e-17efe498f5c5 {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 25 15:54:21 devstack sudo[86260]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-c96adca3-9875-40e8-aa3e-3b7f6d371d46.55e1602f-f353-439f-b32e-17efe498f5c5 Feb 25 15:54:21 devstack sudo[86260]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 25 15:54:21 devstack cinder-volume[83528]: DEBUG cinder.quota [None req-b4c3a34d-d8fe-4c9b-9042-1fa5ec1cc6b6 tempest-GroupSnapshotsV319Test-1296641229 None] Created reservations ['79f656a8-4876-4bff-9117-60063fa3e897'] {{(pid=83528) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 25 15:54:21 devstack cinder-volume[83528]: WARNING cinder.quota [None req-b4c3a34d-d8fe-4c9b-9042-1fa5ec1cc6b6 tempest-GroupSnapshotsV319Test-1296641229 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsV319Test-volume-type-381007903 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsV319Test-volume-type-381007903, it is now deprecated. Please use the default quota class for default quota. Feb 25 15:54:21 devstack cinder-volume[83528]: DEBUG cinder.quota [None req-b4c3a34d-d8fe-4c9b-9042-1fa5ec1cc6b6 tempest-GroupSnapshotsV319Test-1296641229 None] Created reservations ['e0de7b3c-8f3d-41f4-953c-dc2d2aab1124', '7579533c-8202-44c5-b2c6-7c9e32423f86', '9bcbfa77-de24-4d56-9a09-fd772fda9d2d', '0973a716-f5e6-4af0-943c-f8e39cc11542'] {{(pid=83528) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 25 15:54:21 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-b4c3a34d-d8fe-4c9b-9042-1fa5ec1cc6b6 tempest-GroupSnapshotsV319Test-1296641229 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 25 15:54:21 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-b4c3a34d-d8fe-4c9b-9042-1fa5ec1cc6b6 tempest-GroupSnapshotsV319Test-1296641229 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 25 15:54:21 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.quobyte [None req-b4c3a34d-d8fe-4c9b-9042-1fa5ec1cc6b6 tempest-GroupSnapshotsV319Test-1296641229 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23e9d725-3e04-4cd9-bfe0-c8ef43305589': None} {{(pid=83528) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 25 15:54:21 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.quobyte [None req-b4c3a34d-d8fe-4c9b-9042-1fa5ec1cc6b6 tempest-GroupSnapshotsV319Test-1296641229 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23e9d725-3e04-4cd9-bfe0-c8ef43305589'] {{(pid=83528) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 25 15:54:21 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-b4c3a34d-d8fe-4c9b-9042-1fa5ec1cc6b6 tempest-GroupSnapshotsV319Test-1296641229 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 25 15:54:21 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-b4c3a34d-d8fe-4c9b-9042-1fa5ec1cc6b6 tempest-GroupSnapshotsV319Test-1296641229 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85 {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 25 15:54:21 devstack sudo[86262]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85 Feb 25 15:54:21 devstack sudo[86262]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 25 15:54:21 devstack sudo[86260]: pam_unix(sudo:session): session closed for user root Feb 25 15:54:21 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-67fb20cb-87ba-43e0-b951-c0864588dd7e tempest-GroupSnapshotsTest-1779717395 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-c96adca3-9875-40e8-aa3e-3b7f6d371d46.55e1602f-f353-439f-b32e-17efe498f5c5" returned: 0 in 0.548s {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 25 15:54:21 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-67fb20cb-87ba-43e0-b951-c0864588dd7e tempest-GroupSnapshotsTest-1779717395 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-c96adca3-9875-40e8-aa3e-3b7f6d371d46.info {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 25 15:54:21 devstack sudo[86266]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-c96adca3-9875-40e8-aa3e-3b7f6d371d46.info Feb 25 15:54:21 devstack sudo[86266]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 25 15:54:22 devstack sudo[86262]: pam_unix(sudo:session): session closed for user root Feb 25 15:54:22 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-b4c3a34d-d8fe-4c9b-9042-1fa5ec1cc6b6 tempest-GroupSnapshotsV319Test-1296641229 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85" returned: 0 in 0.629s {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 25 15:54:22 devstack cinder-volume[83528]: DEBUG cinder.manager [None req-b4c3a34d-d8fe-4c9b-9042-1fa5ec1cc6b6 tempest-GroupSnapshotsV319Test-1296641229 None] Notifying Schedulers of capabilities ... {{(pid=83528) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 25 15:54:22 devstack cinder-volume[83528]: INFO cinder.volume.manager [None req-b4c3a34d-d8fe-4c9b-9042-1fa5ec1cc6b6 tempest-GroupSnapshotsV319Test-1296641229 None] Delete group completed successfully. Feb 25 15:54:22 devstack sudo[86266]: pam_unix(sudo:session): session closed for user root Feb 25 15:54:22 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-67fb20cb-87ba-43e0-b951-c0864588dd7e tempest-GroupSnapshotsTest-1779717395 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-c96adca3-9875-40e8-aa3e-3b7f6d371d46.info" returned: 0 in 0.730s {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 25 15:54:22 devstack cinder-volume[83528]: WARNING cinder.volume.drivers.remotefs [None req-67fb20cb-87ba-43e0-b951-c0864588dd7e tempest-GroupSnapshotsTest-1779717395 None] /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-c96adca3-9875-40e8-aa3e-3b7f6d371d46.info is being set with open permissions: ugo+rw: NotImplementedError Feb 25 15:54:22 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-67fb20cb-87ba-43e0-b951-c0864588dd7e tempest-GroupSnapshotsTest-1779717395 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-c96adca3-9875-40e8-aa3e-3b7f6d371d46.info {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 25 15:54:22 devstack sudo[86293]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-c96adca3-9875-40e8-aa3e-3b7f6d371d46.info Feb 25 15:54:22 devstack sudo[86293]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 25 15:54:23 devstack cinder-volume[83528]: DEBUG cinder.volume.flows.manager.create_volume [None req-660c31d2-5544-458b-b879-7c9599dba64b tempest-ServersNegativeTestJSON-1114025437 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83528) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 25 15:54:23 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-660c31d2-5544-458b-b879-7c9599dba64b tempest-ServersNegativeTestJSON-1114025437 None] Flow 'volume_create_manager' (4ed2ea5f-cf50-46e0-80e1-3e7696c295c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83528) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 25 15:54:23 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-660c31d2-5544-458b-b879-7c9599dba64b tempest-ServersNegativeTestJSON-1114025437 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e8a81261-8d63-4cb0-adb3-21a8cb86cfd7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 25 15:54:23 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-660c31d2-5544-458b-b879-7c9599dba64b tempest-ServersNegativeTestJSON-1114025437 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e8a81261-8d63-4cb0-adb3-21a8cb86cfd7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-25T14:54:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-617343351',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=828c8642-08ac-4d4e-8853-8d306e0df82f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2c778231da724742bab91cc860306622',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-25T14:54:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-25T14:54:23Z,use_quota=True,user_id='2859977b9a1e49dfb28d4d17e8ea5513',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ce71c2f9-6543-4165-9653-a1529b2ea243),volume_type_id=ce71c2f9-6543-4165-9653-a1529b2ea243)' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 25 15:54:23 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-660c31d2-5544-458b-b879-7c9599dba64b tempest-ServersNegativeTestJSON-1114025437 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b7b539b1-4dae-462a-b55d-4b1b1020236c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 25 15:54:23 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-660c31d2-5544-458b-b879-7c9599dba64b tempest-ServersNegativeTestJSON-1114025437 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b7b539b1-4dae-462a-b55d-4b1b1020236c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 25 15:54:23 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-660c31d2-5544-458b-b879-7c9599dba64b tempest-ServersNegativeTestJSON-1114025437 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (156a16b4-cb01-4ea9-87a8-b68fe3be8d86) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 25 15:54:23 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-660c31d2-5544-458b-b879-7c9599dba64b tempest-ServersNegativeTestJSON-1114025437 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (156a16b4-cb01-4ea9-87a8-b68fe3be8d86) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '828c8642-08ac-4d4e-8853-8d306e0df82f', 'volume_name': 'volume-828c8642-08ac-4d4e-8853-8d306e0df82f', 'volume_size': 1}' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 25 15:54:23 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-660c31d2-5544-458b-b879-7c9599dba64b tempest-ServersNegativeTestJSON-1114025437 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b7a2529d-961e-41c0-a8a5-a76bfd13782c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 25 15:54:23 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-660c31d2-5544-458b-b879-7c9599dba64b tempest-ServersNegativeTestJSON-1114025437 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b7a2529d-961e-41c0-a8a5-a76bfd13782c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 25 15:54:23 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-660c31d2-5544-458b-b879-7c9599dba64b tempest-ServersNegativeTestJSON-1114025437 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8e01d9a9-811a-46d6-bf62-e590687bfbac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 25 15:54:23 devstack cinder-volume[83528]: INFO cinder.volume.flows.manager.create_volume [None req-660c31d2-5544-458b-b879-7c9599dba64b tempest-ServersNegativeTestJSON-1114025437 None] Volume 828c8642-08ac-4d4e-8853-8d306e0df82f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-828c8642-08ac-4d4e-8853-8d306e0df82f', 'volume_size': 1} Feb 25 15:54:23 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-660c31d2-5544-458b-b879-7c9599dba64b tempest-ServersNegativeTestJSON-1114025437 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 25 15:54:23 devstack sudo[86293]: pam_unix(sudo:session): session closed for user root Feb 25 15:54:23 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-67fb20cb-87ba-43e0-b951-c0864588dd7e tempest-GroupSnapshotsTest-1779717395 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-c96adca3-9875-40e8-aa3e-3b7f6d371d46.info" returned: 0 in 0.886s {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 25 15:54:23 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-67fb20cb-87ba-43e0-b951-c0864588dd7e tempest-GroupSnapshotsTest-1779717395 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.172s {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 25 15:54:23 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [req-7d534b89-3d4d-4917-b497-2ddd040b93e5 req-7379346a-ac76-4e19-a08d-660da306ec30 tempest-ServerBootFromVolumeStableRescueTest-939682044 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 8.882s {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 25 15:54:23 devstack cinder-volume[83528]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0ea6548-9bb2-498c-a5e2-341edfe132dd]: (4, 'raw') {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 25 15:54:23 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [req-7d534b89-3d4d-4917-b497-2ddd040b93e5 req-7379346a-ac76-4e19-a08d-660da306ec30 tempest-ServerBootFromVolumeStableRescueTest-939682044 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-bd62c213-e65c-4ced-a207-704de8f3bc88 {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 25 15:54:23 devstack sudo[86296]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-bd62c213-e65c-4ced-a207-704de8f3bc88 Feb 25 15:54:23 devstack sudo[86296]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 25 15:54:23 devstack cinder-volume[83528]: INFO cinder.volume.manager [None req-67fb20cb-87ba-43e0-b951-c0864588dd7e tempest-GroupSnapshotsTest-1779717395 None] group_snapshot 20082c74-5e65-4baa-aee7-d494a054d6ff: created successfully Feb 25 15:54:24 devstack sudo[86296]: pam_unix(sudo:session): session closed for user root Feb 25 15:54:24 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [req-7d534b89-3d4d-4917-b497-2ddd040b93e5 req-7379346a-ac76-4e19-a08d-660da306ec30 tempest-ServerBootFromVolumeStableRescueTest-939682044 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-bd62c213-e65c-4ced-a207-704de8f3bc88" returned: 0 in 0.552s {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 25 15:54:24 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [req-7d534b89-3d4d-4917-b497-2ddd040b93e5 req-7379346a-ac76-4e19-a08d-660da306ec30 tempest-ServerBootFromVolumeStableRescueTest-939682044 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-bd62c213-e65c-4ced-a207-704de8f3bc88 {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 25 15:54:24 devstack sudo[86313]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-bd62c213-e65c-4ced-a207-704de8f3bc88 Feb 25 15:54:24 devstack sudo[86313]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 25 15:54:24 devstack cinder-volume[83528]: INFO cinder.volume.manager [None req-eb11b03a-d9be-4c54-be27-42eccde1662b tempest-GroupSnapshotsTest-1779717395 None] group_snapshot 20082c74-5e65-4baa-aee7-d494a054d6ff: deleting Feb 25 15:54:24 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-eb11b03a-d9be-4c54-be27-42eccde1662b tempest-GroupSnapshotsTest-1779717395 None] group_snapshot 20082c74-5e65-4baa-aee7-d494a054d6ff: deleting {{(pid=83528) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Feb 25 15:54:24 devstack sudo[86313]: pam_unix(sudo:session): session closed for user root Feb 25 15:54:24 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [req-7d534b89-3d4d-4917-b497-2ddd040b93e5 req-7379346a-ac76-4e19-a08d-660da306ec30 tempest-ServerBootFromVolumeStableRescueTest-939682044 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-bd62c213-e65c-4ced-a207-704de8f3bc88" returned: 1 in 0.624s {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 25 15:54:24 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [req-7d534b89-3d4d-4917-b497-2ddd040b93e5 req-7379346a-ac76-4e19-a08d-660da306ec30 tempest-ServerBootFromVolumeStableRescueTest-939682044 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-bd62c213-e65c-4ced-a207-704de8f3bc88' failed. Not Retrying. {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Feb 25 15:54:24 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [req-7d534b89-3d4d-4917-b497-2ddd040b93e5 req-7379346a-ac76-4e19-a08d-660da306ec30 tempest-ServerBootFromVolumeStableRescueTest-939682044 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.221s {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 25 15:54:24 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-660c31d2-5544-458b-b879-7c9599dba64b tempest-ServersNegativeTestJSON-1114025437 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.291s {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 25 15:54:24 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.quobyte [None req-660c31d2-5544-458b-b879-7c9599dba64b tempest-ServersNegativeTestJSON-1114025437 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-25T14:54:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-617343351',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=828c8642-08ac-4d4e-8853-8d306e0df82f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2c778231da724742bab91cc860306622',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-25T14:54:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-25T14:54:23Z,use_quota=True,user_id='2859977b9a1e49dfb28d4d17e8ea5513',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ce71c2f9-6543-4165-9653-a1529b2ea243),volume_type_id=ce71c2f9-6543-4165-9653-a1529b2ea243)}" {{(pid=83528) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 25 15:54:24 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.remotefs [None req-660c31d2-5544-458b-b879-7c9599dba64b tempest-ServersNegativeTestJSON-1114025437 None] Creating volume 828c8642-08ac-4d4e-8853-8d306e0df82f {{(pid=83528) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 25 15:54:24 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-660c31d2-5544-458b-b879-7c9599dba64b tempest-ServersNegativeTestJSON-1114025437 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 25 15:54:24 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-660c31d2-5544-458b-b879-7c9599dba64b tempest-ServersNegativeTestJSON-1114025437 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 25 15:54:24 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.quobyte [None req-660c31d2-5544-458b-b879-7c9599dba64b tempest-ServersNegativeTestJSON-1114025437 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23e9d725-3e04-4cd9-bfe0-c8ef43305589': None} {{(pid=83528) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 25 15:54:24 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.quobyte [None req-660c31d2-5544-458b-b879-7c9599dba64b tempest-ServersNegativeTestJSON-1114025437 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23e9d725-3e04-4cd9-bfe0-c8ef43305589'] {{(pid=83528) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 25 15:54:24 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-660c31d2-5544-458b-b879-7c9599dba64b tempest-ServersNegativeTestJSON-1114025437 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 25 15:54:24 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.quobyte [None req-660c31d2-5544-458b-b879-7c9599dba64b tempest-ServersNegativeTestJSON-1114025437 None] Selected osci02.corp.quobyte.com/cinder-vol-23e9d725-3e04-4cd9-bfe0-c8ef43305589 as target Quobyte volume. {{(pid=83528) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 25 15:54:24 devstack cinder-volume[83528]: INFO cinder.volume.drivers.remotefs [None req-660c31d2-5544-458b-b879-7c9599dba64b tempest-ServersNegativeTestJSON-1114025437 None] casted to osci02.corp.quobyte.com/cinder-vol-23e9d725-3e04-4cd9-bfe0-c8ef43305589 Feb 25 15:54:24 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-660c31d2-5544-458b-b879-7c9599dba64b tempest-ServersNegativeTestJSON-1114025437 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-828c8642-08ac-4d4e-8853-8d306e0df82f 1073741824 {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 25 15:54:24 devstack cinder-volume[83528]: DEBUG cinder.coordination [None req-eb11b03a-d9be-4c54-be27-42eccde1662b tempest-GroupSnapshotsTest-1779717395 None] Acquiring lock "cinder-quobyte-5153a222-bd7e-4e1e-8ff9-1b0c4d8bcba9" by "delete_snapshot" {{(pid=83528) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 25 15:54:24 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [req-7d534b89-3d4d-4917-b497-2ddd040b93e5 req-7379346a-ac76-4e19-a08d-660da306ec30 tempest-ServerBootFromVolumeStableRescueTest-939682044 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-23e9d725-3e04-4cd9-bfe0-c8ef43305589', 'name': 'volume-bd62c213-e65c-4ced-a207-704de8f3bc88', 'options': None, 'format': 'raw', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '0148ab8e-7052-46da-961d-2f24789d9e97', 'enforce_multipath': True} {{(pid=83528) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Feb 25 15:54:24 devstack sudo[86319]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-828c8642-08ac-4d4e-8853-8d306e0df82f 1073741824 Feb 25 15:54:24 devstack sudo[86319]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 25 15:54:24 devstack cinder-volume[83528]: DEBUG cinder.coordination [None req-eb11b03a-d9be-4c54-be27-42eccde1662b tempest-GroupSnapshotsTest-1779717395 None] Lock "cinder-quobyte-5153a222-bd7e-4e1e-8ff9-1b0c4d8bcba9" acquired by "delete_snapshot" :: waited 0.027s {{(pid=83528) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 25 15:54:24 devstack cinder-volume[83528]: DEBUG cinder.coordination [None req-eb11b03a-d9be-4c54-be27-42eccde1662b tempest-GroupSnapshotsTest-1779717395 None] Acquiring lock "cinder-quobyte-1e3cb04d-e1da-4b30-8e2d-57ad232dca5d" by "_delete_snapshot" {{(pid=83528) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 25 15:54:24 devstack cinder-volume[83528]: DEBUG cinder.coordination [None req-eb11b03a-d9be-4c54-be27-42eccde1662b tempest-GroupSnapshotsTest-1779717395 None] Lock "cinder-quobyte-1e3cb04d-e1da-4b30-8e2d-57ad232dca5d" acquired by "_delete_snapshot" :: waited 0.024s {{(pid=83528) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 25 15:54:24 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.remotefs [None req-eb11b03a-d9be-4c54-be27-42eccde1662b tempest-GroupSnapshotsTest-1779717395 None] Deleting offline snapshot 1e3cb04d-e1da-4b30-8e2d-57ad232dca5d of volume 5153a222-bd7e-4e1e-8ff9-1b0c4d8bcba9 {{(pid=83528) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Feb 25 15:54:24 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.remotefs [None req-eb11b03a-d9be-4c54-be27-42eccde1662b tempest-GroupSnapshotsTest-1779717395 None] snapshot_file for this snap is: volume-5153a222-bd7e-4e1e-8ff9-1b0c4d8bcba9.1e3cb04d-e1da-4b30-8e2d-57ad232dca5d {{(pid=83528) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Feb 25 15:54:24 devstack cinder-volume[83528]: DEBUG oslo.privsep.daemon [-] privsep: reply[036eeab2-f788-4d9a-97fb-89d2dd2b28c8]: (4, 'qcow2') {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 25 15:54:24 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-eb11b03a-d9be-4c54-be27-42eccde1662b tempest-GroupSnapshotsTest-1779717395 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-5153a222-bd7e-4e1e-8ff9-1b0c4d8bcba9.1e3cb04d-e1da-4b30-8e2d-57ad232dca5d {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 25 15:54:24 devstack cinder-volume[83528]: INFO cinder.volume.manager [req-7d534b89-3d4d-4917-b497-2ddd040b93e5 req-7379346a-ac76-4e19-a08d-660da306ec30 tempest-ServerBootFromVolumeStableRescueTest-939682044 None] attachment_update completed successfully. Feb 25 15:54:24 devstack sudo[86321]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-5153a222-bd7e-4e1e-8ff9-1b0c4d8bcba9.1e3cb04d-e1da-4b30-8e2d-57ad232dca5d Feb 25 15:54:24 devstack sudo[86321]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 25 15:54:25 devstack sudo[86319]: pam_unix(sudo:session): session closed for user root Feb 25 15:54:25 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-660c31d2-5544-458b-b879-7c9599dba64b tempest-ServersNegativeTestJSON-1114025437 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-828c8642-08ac-4d4e-8853-8d306e0df82f 1073741824" returned: 0 in 0.618s {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 25 15:54:25 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-660c31d2-5544-458b-b879-7c9599dba64b tempest-ServersNegativeTestJSON-1114025437 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-828c8642-08ac-4d4e-8853-8d306e0df82f {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 25 15:54:25 devstack sudo[86326]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-828c8642-08ac-4d4e-8853-8d306e0df82f Feb 25 15:54:25 devstack sudo[86326]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 25 15:54:25 devstack sudo[86321]: pam_unix(sudo:session): session closed for user root Feb 25 15:54:25 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-eb11b03a-d9be-4c54-be27-42eccde1662b tempest-GroupSnapshotsTest-1779717395 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-5153a222-bd7e-4e1e-8ff9-1b0c4d8bcba9.1e3cb04d-e1da-4b30-8e2d-57ad232dca5d" returned: 0 in 0.778s {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 25 15:54:25 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.remotefs [None req-eb11b03a-d9be-4c54-be27-42eccde1662b tempest-GroupSnapshotsTest-1779717395 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5153a222-bd7e-4e1e-8ff9-1b0c4d8bcba9(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83528) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Feb 25 15:54:25 devstack cinder-volume[83528]: DEBUG oslo.privsep.daemon [-] privsep: reply[e92bddc2-14ab-4cbc-84e4-85bb2bd9e49f]: (4, 'qcow2') {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 25 15:54:25 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-eb11b03a-d9be-4c54-be27-42eccde1662b tempest-GroupSnapshotsTest-1779717395 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-5153a222-bd7e-4e1e-8ff9-1b0c4d8bcba9 {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 25 15:54:25 devstack sudo[86331]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-5153a222-bd7e-4e1e-8ff9-1b0c4d8bcba9 Feb 25 15:54:25 devstack sudo[86331]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 25 15:54:25 devstack sudo[86326]: pam_unix(sudo:session): session closed for user root Feb 25 15:54:25 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-660c31d2-5544-458b-b879-7c9599dba64b tempest-ServersNegativeTestJSON-1114025437 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-828c8642-08ac-4d4e-8853-8d306e0df82f" returned: 0 in 0.621s {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 25 15:54:25 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.quobyte [None req-660c31d2-5544-458b-b879-7c9599dba64b tempest-ServersNegativeTestJSON-1114025437 None] <== create_volume: return (1276ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-23e9d725-3e04-4cd9-bfe0-c8ef43305589'} {{(pid=83528) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 25 15:54:25 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-660c31d2-5544-458b-b879-7c9599dba64b tempest-ServersNegativeTestJSON-1114025437 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.280s {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 25 15:54:26 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-660c31d2-5544-458b-b879-7c9599dba64b tempest-ServersNegativeTestJSON-1114025437 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8e01d9a9-811a-46d6-bf62-e590687bfbac) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-828c8642-08ac-4d4e-8853-8d306e0df82f', 'volume_size': 1}' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 25 15:54:26 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-660c31d2-5544-458b-b879-7c9599dba64b tempest-ServersNegativeTestJSON-1114025437 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (333ea921-197b-424a-881b-c033a13ddbaf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 25 15:54:26 devstack cinder-volume[83528]: INFO cinder.volume.flows.manager.create_volume [None req-660c31d2-5544-458b-b879-7c9599dba64b tempest-ServersNegativeTestJSON-1114025437 None] Volume volume-828c8642-08ac-4d4e-8853-8d306e0df82f (828c8642-08ac-4d4e-8853-8d306e0df82f): created successfully Feb 25 15:54:26 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-660c31d2-5544-458b-b879-7c9599dba64b tempest-ServersNegativeTestJSON-1114025437 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (333ea921-197b-424a-881b-c033a13ddbaf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 25 15:54:26 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-660c31d2-5544-458b-b879-7c9599dba64b tempest-ServersNegativeTestJSON-1114025437 None] Flow 'volume_create_manager' (4ed2ea5f-cf50-46e0-80e1-3e7696c295c4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83528) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 25 15:54:26 devstack cinder-volume[83528]: INFO cinder.volume.manager [None req-660c31d2-5544-458b-b879-7c9599dba64b tempest-ServersNegativeTestJSON-1114025437 None] Created volume successfully. Feb 25 15:54:26 devstack sudo[86331]: pam_unix(sudo:session): session closed for user root Feb 25 15:54:26 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-eb11b03a-d9be-4c54-be27-42eccde1662b tempest-GroupSnapshotsTest-1779717395 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-5153a222-bd7e-4e1e-8ff9-1b0c4d8bcba9" returned: 0 in 0.636s {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 25 15:54:26 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-eb11b03a-d9be-4c54-be27-42eccde1662b tempest-GroupSnapshotsTest-1779717395 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-5153a222-bd7e-4e1e-8ff9-1b0c4d8bcba9.1e3cb04d-e1da-4b30-8e2d-57ad232dca5d {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 25 15:54:26 devstack sudo[86337]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-5153a222-bd7e-4e1e-8ff9-1b0c4d8bcba9.1e3cb04d-e1da-4b30-8e2d-57ad232dca5d Feb 25 15:54:26 devstack sudo[86337]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 25 15:54:27 devstack sudo[86337]: pam_unix(sudo:session): session closed for user root Feb 25 15:54:27 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-eb11b03a-d9be-4c54-be27-42eccde1662b tempest-GroupSnapshotsTest-1779717395 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-5153a222-bd7e-4e1e-8ff9-1b0c4d8bcba9.1e3cb04d-e1da-4b30-8e2d-57ad232dca5d" returned: 0 in 0.720s {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 25 15:54:27 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-eb11b03a-d9be-4c54-be27-42eccde1662b tempest-GroupSnapshotsTest-1779717395 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-5153a222-bd7e-4e1e-8ff9-1b0c4d8bcba9.1e3cb04d-e1da-4b30-8e2d-57ad232dca5d {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 25 15:54:27 devstack sudo[86342]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-5153a222-bd7e-4e1e-8ff9-1b0c4d8bcba9.1e3cb04d-e1da-4b30-8e2d-57ad232dca5d Feb 25 15:54:27 devstack sudo[86342]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 25 15:54:27 devstack cinder-volume[83528]: DEBUG cinder.volume.flows.manager.create_volume [None req-bfe2d3ca-0d43-4341-8196-8ea5021c98b0 tempest-ServersNegativeTestJSON-1114025437 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83528) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 25 15:54:27 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-bfe2d3ca-0d43-4341-8196-8ea5021c98b0 tempest-ServersNegativeTestJSON-1114025437 None] Flow 'volume_create_manager' (98e12fee-8e42-48ca-b581-98de9f94db2a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83528) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 25 15:54:27 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-bfe2d3ca-0d43-4341-8196-8ea5021c98b0 tempest-ServersNegativeTestJSON-1114025437 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e57fdcaf-6c32-4066-90d7-2efe4b5d22c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 25 15:54:27 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-bfe2d3ca-0d43-4341-8196-8ea5021c98b0 tempest-ServersNegativeTestJSON-1114025437 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e57fdcaf-6c32-4066-90d7-2efe4b5d22c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-25T14:54:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1708211882',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8b85fe25-933d-4943-9aef-a0a68801f761,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2c778231da724742bab91cc860306622',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-25T14:54:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-25T14:54:28Z,use_quota=True,user_id='2859977b9a1e49dfb28d4d17e8ea5513',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ce71c2f9-6543-4165-9653-a1529b2ea243),volume_type_id=ce71c2f9-6543-4165-9653-a1529b2ea243)' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 25 15:54:27 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-bfe2d3ca-0d43-4341-8196-8ea5021c98b0 tempest-ServersNegativeTestJSON-1114025437 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3fe1adb0-de23-4f7b-8f31-58263b8fdc7b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 25 15:54:27 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-bfe2d3ca-0d43-4341-8196-8ea5021c98b0 tempest-ServersNegativeTestJSON-1114025437 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3fe1adb0-de23-4f7b-8f31-58263b8fdc7b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 25 15:54:27 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-bfe2d3ca-0d43-4341-8196-8ea5021c98b0 tempest-ServersNegativeTestJSON-1114025437 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dc2118b4-3576-4c11-90cc-ad3779536d0f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 25 15:54:27 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-bfe2d3ca-0d43-4341-8196-8ea5021c98b0 tempest-ServersNegativeTestJSON-1114025437 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dc2118b4-3576-4c11-90cc-ad3779536d0f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8b85fe25-933d-4943-9aef-a0a68801f761', 'volume_name': 'volume-8b85fe25-933d-4943-9aef-a0a68801f761', 'volume_size': 1}' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 25 15:54:27 devstack sudo[86342]: pam_unix(sudo:session): session closed for user root Feb 25 15:54:27 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-bfe2d3ca-0d43-4341-8196-8ea5021c98b0 tempest-ServersNegativeTestJSON-1114025437 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7d523117-e18f-41dd-99a7-be54bf1c086f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 25 15:54:27 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-bfe2d3ca-0d43-4341-8196-8ea5021c98b0 tempest-ServersNegativeTestJSON-1114025437 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7d523117-e18f-41dd-99a7-be54bf1c086f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 25 15:54:27 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-bfe2d3ca-0d43-4341-8196-8ea5021c98b0 tempest-ServersNegativeTestJSON-1114025437 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (27b2aea2-f12f-4392-b068-a362112ccbf3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 25 15:54:27 devstack cinder-volume[83528]: INFO cinder.volume.flows.manager.create_volume [None req-bfe2d3ca-0d43-4341-8196-8ea5021c98b0 tempest-ServersNegativeTestJSON-1114025437 None] Volume 8b85fe25-933d-4943-9aef-a0a68801f761: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8b85fe25-933d-4943-9aef-a0a68801f761', 'volume_size': 1} Feb 25 15:54:27 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-bfe2d3ca-0d43-4341-8196-8ea5021c98b0 tempest-ServersNegativeTestJSON-1114025437 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 25 15:54:27 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-bfe2d3ca-0d43-4341-8196-8ea5021c98b0 tempest-ServersNegativeTestJSON-1114025437 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 25 15:54:27 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.quobyte [None req-bfe2d3ca-0d43-4341-8196-8ea5021c98b0 tempest-ServersNegativeTestJSON-1114025437 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-25T14:54:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1708211882',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8b85fe25-933d-4943-9aef-a0a68801f761,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2c778231da724742bab91cc860306622',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-25T14:54:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-25T14:54:28Z,use_quota=True,user_id='2859977b9a1e49dfb28d4d17e8ea5513',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ce71c2f9-6543-4165-9653-a1529b2ea243),volume_type_id=ce71c2f9-6543-4165-9653-a1529b2ea243)}" {{(pid=83528) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 25 15:54:27 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.remotefs [None req-bfe2d3ca-0d43-4341-8196-8ea5021c98b0 tempest-ServersNegativeTestJSON-1114025437 None] Creating volume 8b85fe25-933d-4943-9aef-a0a68801f761 {{(pid=83528) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 25 15:54:27 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-bfe2d3ca-0d43-4341-8196-8ea5021c98b0 tempest-ServersNegativeTestJSON-1114025437 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 25 15:54:27 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-bfe2d3ca-0d43-4341-8196-8ea5021c98b0 tempest-ServersNegativeTestJSON-1114025437 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 25 15:54:27 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.quobyte [None req-bfe2d3ca-0d43-4341-8196-8ea5021c98b0 tempest-ServersNegativeTestJSON-1114025437 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23e9d725-3e04-4cd9-bfe0-c8ef43305589': None} {{(pid=83528) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 25 15:54:27 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.quobyte [None req-bfe2d3ca-0d43-4341-8196-8ea5021c98b0 tempest-ServersNegativeTestJSON-1114025437 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23e9d725-3e04-4cd9-bfe0-c8ef43305589'] {{(pid=83528) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 25 15:54:27 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-bfe2d3ca-0d43-4341-8196-8ea5021c98b0 tempest-ServersNegativeTestJSON-1114025437 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 25 15:54:27 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.quobyte [None req-bfe2d3ca-0d43-4341-8196-8ea5021c98b0 tempest-ServersNegativeTestJSON-1114025437 None] Selected osci02.corp.quobyte.com/cinder-vol-23e9d725-3e04-4cd9-bfe0-c8ef43305589 as target Quobyte volume. {{(pid=83528) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 25 15:54:27 devstack cinder-volume[83528]: INFO cinder.volume.drivers.remotefs [None req-bfe2d3ca-0d43-4341-8196-8ea5021c98b0 tempest-ServersNegativeTestJSON-1114025437 None] casted to osci02.corp.quobyte.com/cinder-vol-23e9d725-3e04-4cd9-bfe0-c8ef43305589 Feb 25 15:54:27 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-bfe2d3ca-0d43-4341-8196-8ea5021c98b0 tempest-ServersNegativeTestJSON-1114025437 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-8b85fe25-933d-4943-9aef-a0a68801f761 1073741824 {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 25 15:54:27 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-eb11b03a-d9be-4c54-be27-42eccde1662b tempest-GroupSnapshotsTest-1779717395 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-5153a222-bd7e-4e1e-8ff9-1b0c4d8bcba9.1e3cb04d-e1da-4b30-8e2d-57ad232dca5d" returned: 0 in 0.704s {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 25 15:54:27 devstack sudo[86345]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-8b85fe25-933d-4943-9aef-a0a68801f761 1073741824 Feb 25 15:54:27 devstack sudo[86345]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 25 15:54:27 devstack cinder-volume[83528]: DEBUG cinder.coordination [None req-eb11b03a-d9be-4c54-be27-42eccde1662b tempest-GroupSnapshotsTest-1779717395 None] Lock "cinder-quobyte-1e3cb04d-e1da-4b30-8e2d-57ad232dca5d" released by "_delete_snapshot" :: held 2.928s {{(pid=83528) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 25 15:54:27 devstack cinder-volume[83528]: DEBUG cinder.coordination [None req-eb11b03a-d9be-4c54-be27-42eccde1662b tempest-GroupSnapshotsTest-1779717395 None] Lock "cinder-quobyte-5153a222-bd7e-4e1e-8ff9-1b0c4d8bcba9" released by "delete_snapshot" :: held 2.959s {{(pid=83528) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 25 15:54:27 devstack cinder-volume[83528]: DEBUG cinder.coordination [None req-eb11b03a-d9be-4c54-be27-42eccde1662b tempest-GroupSnapshotsTest-1779717395 None] Acquiring lock "cinder-quobyte-c96adca3-9875-40e8-aa3e-3b7f6d371d46" by "delete_snapshot" {{(pid=83528) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 25 15:54:27 devstack cinder-volume[83528]: DEBUG cinder.coordination [None req-eb11b03a-d9be-4c54-be27-42eccde1662b tempest-GroupSnapshotsTest-1779717395 None] Lock "cinder-quobyte-c96adca3-9875-40e8-aa3e-3b7f6d371d46" acquired by "delete_snapshot" :: waited 0.008s {{(pid=83528) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 25 15:54:27 devstack cinder-volume[83528]: DEBUG cinder.coordination [None req-eb11b03a-d9be-4c54-be27-42eccde1662b tempest-GroupSnapshotsTest-1779717395 None] Acquiring lock "cinder-quobyte-55e1602f-f353-439f-b32e-17efe498f5c5" by "_delete_snapshot" {{(pid=83528) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 25 15:54:27 devstack cinder-volume[83528]: DEBUG cinder.coordination [None req-eb11b03a-d9be-4c54-be27-42eccde1662b tempest-GroupSnapshotsTest-1779717395 None] Lock "cinder-quobyte-55e1602f-f353-439f-b32e-17efe498f5c5" acquired by "_delete_snapshot" :: waited 0.007s {{(pid=83528) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 25 15:54:27 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.remotefs [None req-eb11b03a-d9be-4c54-be27-42eccde1662b tempest-GroupSnapshotsTest-1779717395 None] Deleting offline snapshot 55e1602f-f353-439f-b32e-17efe498f5c5 of volume c96adca3-9875-40e8-aa3e-3b7f6d371d46 {{(pid=83528) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Feb 25 15:54:27 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.remotefs [None req-eb11b03a-d9be-4c54-be27-42eccde1662b tempest-GroupSnapshotsTest-1779717395 None] snapshot_file for this snap is: volume-c96adca3-9875-40e8-aa3e-3b7f6d371d46.55e1602f-f353-439f-b32e-17efe498f5c5 {{(pid=83528) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Feb 25 15:54:27 devstack cinder-volume[83528]: DEBUG oslo.privsep.daemon [-] privsep: reply[878cad92-92af-400d-974d-c45e8a676db4]: (4, 'qcow2') {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 25 15:54:27 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-eb11b03a-d9be-4c54-be27-42eccde1662b tempest-GroupSnapshotsTest-1779717395 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-c96adca3-9875-40e8-aa3e-3b7f6d371d46.55e1602f-f353-439f-b32e-17efe498f5c5 {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 25 15:54:27 devstack sudo[86347]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-c96adca3-9875-40e8-aa3e-3b7f6d371d46.55e1602f-f353-439f-b32e-17efe498f5c5 Feb 25 15:54:27 devstack sudo[86347]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 25 15:54:28 devstack sudo[86345]: pam_unix(sudo:session): session closed for user root Feb 25 15:54:28 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-bfe2d3ca-0d43-4341-8196-8ea5021c98b0 tempest-ServersNegativeTestJSON-1114025437 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-8b85fe25-933d-4943-9aef-a0a68801f761 1073741824" returned: 0 in 0.790s {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 25 15:54:28 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-bfe2d3ca-0d43-4341-8196-8ea5021c98b0 tempest-ServersNegativeTestJSON-1114025437 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-8b85fe25-933d-4943-9aef-a0a68801f761 {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 25 15:54:28 devstack sudo[86358]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-8b85fe25-933d-4943-9aef-a0a68801f761 Feb 25 15:54:28 devstack sudo[86358]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 25 15:54:28 devstack sudo[86347]: pam_unix(sudo:session): session closed for user root Feb 25 15:54:28 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-eb11b03a-d9be-4c54-be27-42eccde1662b tempest-GroupSnapshotsTest-1779717395 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-c96adca3-9875-40e8-aa3e-3b7f6d371d46.55e1602f-f353-439f-b32e-17efe498f5c5" returned: 0 in 0.866s {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 25 15:54:28 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.remotefs [None req-eb11b03a-d9be-4c54-be27-42eccde1662b tempest-GroupSnapshotsTest-1779717395 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c96adca3-9875-40e8-aa3e-3b7f6d371d46(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83528) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Feb 25 15:54:28 devstack cinder-volume[83528]: DEBUG oslo.privsep.daemon [-] privsep: reply[2809b929-4dea-47b5-bdb8-a21db45e71e3]: (4, 'qcow2') {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 25 15:54:28 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-eb11b03a-d9be-4c54-be27-42eccde1662b tempest-GroupSnapshotsTest-1779717395 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-c96adca3-9875-40e8-aa3e-3b7f6d371d46 {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 25 15:54:28 devstack sudo[86360]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-c96adca3-9875-40e8-aa3e-3b7f6d371d46 Feb 25 15:54:28 devstack sudo[86360]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 25 15:54:29 devstack sudo[86358]: pam_unix(sudo:session): session closed for user root Feb 25 15:54:29 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-bfe2d3ca-0d43-4341-8196-8ea5021c98b0 tempest-ServersNegativeTestJSON-1114025437 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-8b85fe25-933d-4943-9aef-a0a68801f761" returned: 0 in 0.623s {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 25 15:54:29 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.quobyte [None req-bfe2d3ca-0d43-4341-8196-8ea5021c98b0 tempest-ServersNegativeTestJSON-1114025437 None] <== create_volume: return (1456ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-23e9d725-3e04-4cd9-bfe0-c8ef43305589'} {{(pid=83528) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 25 15:54:29 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-bfe2d3ca-0d43-4341-8196-8ea5021c98b0 tempest-ServersNegativeTestJSON-1114025437 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.460s {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 25 15:54:29 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-bfe2d3ca-0d43-4341-8196-8ea5021c98b0 tempest-ServersNegativeTestJSON-1114025437 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (27b2aea2-f12f-4392-b068-a362112ccbf3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8b85fe25-933d-4943-9aef-a0a68801f761', 'volume_size': 1}' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 25 15:54:29 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-bfe2d3ca-0d43-4341-8196-8ea5021c98b0 tempest-ServersNegativeTestJSON-1114025437 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d649f48b-a7c7-4b3d-aa97-e9bc4513af08) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 25 15:54:29 devstack cinder-volume[83528]: INFO cinder.volume.flows.manager.create_volume [None req-bfe2d3ca-0d43-4341-8196-8ea5021c98b0 tempest-ServersNegativeTestJSON-1114025437 None] Volume volume-8b85fe25-933d-4943-9aef-a0a68801f761 (8b85fe25-933d-4943-9aef-a0a68801f761): created successfully Feb 25 15:54:29 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-bfe2d3ca-0d43-4341-8196-8ea5021c98b0 tempest-ServersNegativeTestJSON-1114025437 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d649f48b-a7c7-4b3d-aa97-e9bc4513af08) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 25 15:54:29 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-bfe2d3ca-0d43-4341-8196-8ea5021c98b0 tempest-ServersNegativeTestJSON-1114025437 None] Flow 'volume_create_manager' (98e12fee-8e42-48ca-b581-98de9f94db2a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83528) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 25 15:54:29 devstack cinder-volume[83528]: INFO cinder.volume.manager [None req-bfe2d3ca-0d43-4341-8196-8ea5021c98b0 tempest-ServersNegativeTestJSON-1114025437 None] Created volume successfully. Feb 25 15:54:29 devstack sudo[86360]: pam_unix(sudo:session): session closed for user root Feb 25 15:54:29 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-eb11b03a-d9be-4c54-be27-42eccde1662b tempest-GroupSnapshotsTest-1779717395 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-c96adca3-9875-40e8-aa3e-3b7f6d371d46" returned: 0 in 0.686s {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 25 15:54:29 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-eb11b03a-d9be-4c54-be27-42eccde1662b tempest-GroupSnapshotsTest-1779717395 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-c96adca3-9875-40e8-aa3e-3b7f6d371d46.55e1602f-f353-439f-b32e-17efe498f5c5 {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 25 15:54:29 devstack sudo[86366]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-c96adca3-9875-40e8-aa3e-3b7f6d371d46.55e1602f-f353-439f-b32e-17efe498f5c5 Feb 25 15:54:29 devstack sudo[86366]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 25 15:54:30 devstack sudo[86366]: pam_unix(sudo:session): session closed for user root Feb 25 15:54:30 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-eb11b03a-d9be-4c54-be27-42eccde1662b tempest-GroupSnapshotsTest-1779717395 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-c96adca3-9875-40e8-aa3e-3b7f6d371d46.55e1602f-f353-439f-b32e-17efe498f5c5" returned: 0 in 1.514s {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 25 15:54:30 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-eb11b03a-d9be-4c54-be27-42eccde1662b tempest-GroupSnapshotsTest-1779717395 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-c96adca3-9875-40e8-aa3e-3b7f6d371d46.55e1602f-f353-439f-b32e-17efe498f5c5 {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 25 15:54:30 devstack sudo[86396]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-c96adca3-9875-40e8-aa3e-3b7f6d371d46.55e1602f-f353-439f-b32e-17efe498f5c5 Feb 25 15:54:30 devstack sudo[86396]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 25 15:54:31 devstack cinder-volume[83528]: DEBUG cinder.coordination [None req-e6c51e0c-508e-4919-accf-bcd92b0c4d50 tempest-ServersNegativeTestJSON-1114025437 None] Acquiring lock "cinder-8b85fe25-933d-4943-9aef-a0a68801f761-delete_volume" by "delete_volume" {{(pid=83528) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 25 15:54:31 devstack cinder-volume[83528]: DEBUG cinder.coordination [None req-e6c51e0c-508e-4919-accf-bcd92b0c4d50 tempest-ServersNegativeTestJSON-1114025437 None] Lock "cinder-8b85fe25-933d-4943-9aef-a0a68801f761-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=83528) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 25 15:54:31 devstack cinder-volume[83528]: DEBUG cinder.coordination [None req-e6c51e0c-508e-4919-accf-bcd92b0c4d50 tempest-ServersNegativeTestJSON-1114025437 None] Acquiring lock "cinder-quobyte-8b85fe25-933d-4943-9aef-a0a68801f761" by "delete_volume" {{(pid=83528) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 25 15:54:31 devstack cinder-volume[83528]: DEBUG cinder.coordination [None req-e6c51e0c-508e-4919-accf-bcd92b0c4d50 tempest-ServersNegativeTestJSON-1114025437 None] Lock "cinder-quobyte-8b85fe25-933d-4943-9aef-a0a68801f761" acquired by "delete_volume" :: waited 0.027s {{(pid=83528) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 25 15:54:31 devstack cinder-volume[83528]: DEBUG oslo.privsep.daemon [-] privsep: reply[00eccaf8-b1a8-4177-bfd0-d1fe21bf0cfd]: (4, 'qcow2') {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 25 15:54:31 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-e6c51e0c-508e-4919-accf-bcd92b0c4d50 tempest-ServersNegativeTestJSON-1114025437 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-8b85fe25-933d-4943-9aef-a0a68801f761 {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 25 15:54:31 devstack sudo[86398]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-8b85fe25-933d-4943-9aef-a0a68801f761 Feb 25 15:54:31 devstack sudo[86398]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 25 15:54:31 devstack sudo[86396]: pam_unix(sudo:session): session closed for user root Feb 25 15:54:31 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-eb11b03a-d9be-4c54-be27-42eccde1662b tempest-GroupSnapshotsTest-1779717395 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-c96adca3-9875-40e8-aa3e-3b7f6d371d46.55e1602f-f353-439f-b32e-17efe498f5c5" returned: 0 in 1.082s {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 25 15:54:32 devstack cinder-volume[83528]: DEBUG cinder.coordination [None req-eb11b03a-d9be-4c54-be27-42eccde1662b tempest-GroupSnapshotsTest-1779717395 None] Lock "cinder-quobyte-55e1602f-f353-439f-b32e-17efe498f5c5" released by "_delete_snapshot" :: held 4.244s {{(pid=83528) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 25 15:54:32 devstack cinder-volume[83528]: DEBUG cinder.coordination [None req-eb11b03a-d9be-4c54-be27-42eccde1662b tempest-GroupSnapshotsTest-1779717395 None] Lock "cinder-quobyte-c96adca3-9875-40e8-aa3e-3b7f6d371d46" released by "delete_snapshot" :: held 4.268s {{(pid=83528) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 25 15:54:32 devstack cinder-volume[83528]: WARNING cinder.quota [None req-eb11b03a-d9be-4c54-be27-42eccde1662b tempest-GroupSnapshotsTest-1779717395 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-522481855 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-522481855, it is now deprecated. Please use the default quota class for default quota. Feb 25 15:54:32 devstack cinder-volume[83528]: WARNING cinder.quota [None req-eb11b03a-d9be-4c54-be27-42eccde1662b tempest-GroupSnapshotsTest-1779717395 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-522481855 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-522481855, it is now deprecated. Please use the default quota class for default quota. Feb 25 15:54:32 devstack cinder-volume[83528]: DEBUG cinder.quota [None req-eb11b03a-d9be-4c54-be27-42eccde1662b tempest-GroupSnapshotsTest-1779717395 None] Created reservations ['f5bc1f94-33f9-455b-9426-dee1efe6c110', '04854d9c-430c-419c-aef6-fafd20a56a31', '92c3dc84-c65d-4a9b-bc6d-8132312b144a', '9f83e229-d6c4-4b25-9f80-1307454b214a'] {{(pid=83528) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 25 15:54:32 devstack cinder-volume[83528]: DEBUG cinder.quota [None req-eb11b03a-d9be-4c54-be27-42eccde1662b tempest-GroupSnapshotsTest-1779717395 None] Created reservations ['00476739-a6a4-47c7-b4e8-7f5e9adb03de', '96ff2c98-2a3a-4536-95a6-b953b7199efa', '38762f67-f370-40e7-a561-68de6c27d2aa', '75fbabd8-ea09-4426-a004-ab5e95939b99'] {{(pid=83528) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 25 15:54:32 devstack cinder-volume[83528]: INFO cinder.volume.manager [None req-eb11b03a-d9be-4c54-be27-42eccde1662b tempest-GroupSnapshotsTest-1779717395 None] group_snapshot 20082c74-5e65-4baa-aee7-d494a054d6ff: deleted successfully Feb 25 15:54:32 devstack sudo[86398]: pam_unix(sudo:session): session closed for user root Feb 25 15:54:32 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-e6c51e0c-508e-4919-accf-bcd92b0c4d50 tempest-ServersNegativeTestJSON-1114025437 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-8b85fe25-933d-4943-9aef-a0a68801f761" returned: 0 in 1.151s {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 25 15:54:32 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-e6c51e0c-508e-4919-accf-bcd92b0c4d50 tempest-ServersNegativeTestJSON-1114025437 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-8b85fe25-933d-4943-9aef-a0a68801f761 {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 25 15:54:32 devstack sudo[86404]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-8b85fe25-933d-4943-9aef-a0a68801f761 Feb 25 15:54:32 devstack sudo[86404]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 25 15:54:32 devstack sudo[86404]: pam_unix(sudo:session): session closed for user root Feb 25 15:54:32 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-e6c51e0c-508e-4919-accf-bcd92b0c4d50 tempest-ServersNegativeTestJSON-1114025437 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-8b85fe25-933d-4943-9aef-a0a68801f761" returned: 0 in 0.581s {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 25 15:54:33 devstack cinder-volume[83528]: DEBUG cinder.coordination [None req-e6c51e0c-508e-4919-accf-bcd92b0c4d50 tempest-ServersNegativeTestJSON-1114025437 None] Lock "cinder-quobyte-8b85fe25-933d-4943-9aef-a0a68801f761" released by "delete_volume" :: held 1.819s {{(pid=83528) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 25 15:54:33 devstack cinder-volume[83528]: DEBUG cinder.quota [None req-e6c51e0c-508e-4919-accf-bcd92b0c4d50 tempest-ServersNegativeTestJSON-1114025437 None] Created reservations ['4177e929-c250-4273-a61d-43ac256bbc3c', 'd0b00e57-a9a5-4b8a-8935-c69d6aa637f9', '50607985-20f8-4643-b370-818cc5c9ef50', 'd65107d8-217b-40c6-a536-a35e8f9b8661'] {{(pid=83528) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 25 15:54:33 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-e6c51e0c-508e-4919-accf-bcd92b0c4d50 tempest-ServersNegativeTestJSON-1114025437 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 25 15:54:33 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-e6c51e0c-508e-4919-accf-bcd92b0c4d50 tempest-ServersNegativeTestJSON-1114025437 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 25 15:54:33 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.quobyte [None req-e6c51e0c-508e-4919-accf-bcd92b0c4d50 tempest-ServersNegativeTestJSON-1114025437 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23e9d725-3e04-4cd9-bfe0-c8ef43305589': None} {{(pid=83528) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 25 15:54:33 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.quobyte [None req-e6c51e0c-508e-4919-accf-bcd92b0c4d50 tempest-ServersNegativeTestJSON-1114025437 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23e9d725-3e04-4cd9-bfe0-c8ef43305589'] {{(pid=83528) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 25 15:54:33 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-e6c51e0c-508e-4919-accf-bcd92b0c4d50 tempest-ServersNegativeTestJSON-1114025437 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 25 15:54:33 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-e6c51e0c-508e-4919-accf-bcd92b0c4d50 tempest-ServersNegativeTestJSON-1114025437 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85 {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 25 15:54:33 devstack sudo[86409]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85 Feb 25 15:54:33 devstack sudo[86409]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 25 15:54:33 devstack cinder-volume[83528]: DEBUG cinder.coordination [None req-45dd0e33-4877-4aac-bd57-871e0d7d3e44 tempest-ServersNegativeTestJSON-1114025437 None] Acquiring lock "cinder-828c8642-08ac-4d4e-8853-8d306e0df82f-delete_volume" by "delete_volume" {{(pid=83528) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 25 15:54:33 devstack cinder-volume[83528]: DEBUG cinder.coordination [None req-45dd0e33-4877-4aac-bd57-871e0d7d3e44 tempest-ServersNegativeTestJSON-1114025437 None] Lock "cinder-828c8642-08ac-4d4e-8853-8d306e0df82f-delete_volume" acquired by "delete_volume" :: waited 0.014s {{(pid=83528) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 25 15:54:33 devstack cinder-volume[83528]: DEBUG cinder.coordination [None req-45dd0e33-4877-4aac-bd57-871e0d7d3e44 tempest-ServersNegativeTestJSON-1114025437 None] Acquiring lock "cinder-quobyte-828c8642-08ac-4d4e-8853-8d306e0df82f" by "delete_volume" {{(pid=83528) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 25 15:54:33 devstack cinder-volume[83528]: DEBUG cinder.coordination [None req-45dd0e33-4877-4aac-bd57-871e0d7d3e44 tempest-ServersNegativeTestJSON-1114025437 None] Lock "cinder-quobyte-828c8642-08ac-4d4e-8853-8d306e0df82f" acquired by "delete_volume" :: waited 0.025s {{(pid=83528) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 25 15:54:33 devstack cinder-volume[83528]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e098656-9785-42a9-8457-38823b1f5db3]: (4, 'qcow2') {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 25 15:54:33 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-45dd0e33-4877-4aac-bd57-871e0d7d3e44 tempest-ServersNegativeTestJSON-1114025437 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-828c8642-08ac-4d4e-8853-8d306e0df82f {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 25 15:54:33 devstack sudo[86411]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-828c8642-08ac-4d4e-8853-8d306e0df82f Feb 25 15:54:33 devstack sudo[86411]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 25 15:54:34 devstack cinder-volume[83528]: DEBUG cinder.coordination [None req-79385fe7-e1c8-4cdc-80a6-1892802a796b tempest-GroupSnapshotsTest-1779717395 None] Acquiring lock "cinder-quobyte-5153a222-bd7e-4e1e-8ff9-1b0c4d8bcba9" by "delete_volume" {{(pid=83528) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 25 15:54:34 devstack cinder-volume[83528]: DEBUG cinder.coordination [None req-79385fe7-e1c8-4cdc-80a6-1892802a796b tempest-GroupSnapshotsTest-1779717395 None] Lock "cinder-quobyte-5153a222-bd7e-4e1e-8ff9-1b0c4d8bcba9" acquired by "delete_volume" :: waited 0.052s {{(pid=83528) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 25 15:54:34 devstack cinder-volume[83528]: DEBUG oslo.privsep.daemon [-] privsep: reply[5616a0a6-d196-476c-a28a-71443c10b3bd]: (4, 'qcow2') {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 25 15:54:34 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-79385fe7-e1c8-4cdc-80a6-1892802a796b tempest-GroupSnapshotsTest-1779717395 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-5153a222-bd7e-4e1e-8ff9-1b0c4d8bcba9 {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 25 15:54:34 devstack sudo[86409]: pam_unix(sudo:session): session closed for user root Feb 25 15:54:34 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-e6c51e0c-508e-4919-accf-bcd92b0c4d50 tempest-ServersNegativeTestJSON-1114025437 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85" returned: 0 in 1.358s {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 25 15:54:34 devstack cinder-volume[83528]: DEBUG cinder.manager [None req-e6c51e0c-508e-4919-accf-bcd92b0c4d50 tempest-ServersNegativeTestJSON-1114025437 None] Notifying Schedulers of capabilities ... {{(pid=83528) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 25 15:54:34 devstack cinder-volume[83528]: INFO cinder.volume.manager [None req-e6c51e0c-508e-4919-accf-bcd92b0c4d50 tempest-ServersNegativeTestJSON-1114025437 None] Deleted volume successfully. Feb 25 15:54:34 devstack cinder-volume[83528]: DEBUG cinder.coordination [None req-e6c51e0c-508e-4919-accf-bcd92b0c4d50 tempest-ServersNegativeTestJSON-1114025437 None] Lock "cinder-8b85fe25-933d-4943-9aef-a0a68801f761-delete_volume" released by "delete_volume" :: held 3.522s {{(pid=83528) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 25 15:54:34 devstack sudo[86414]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-5153a222-bd7e-4e1e-8ff9-1b0c4d8bcba9 Feb 25 15:54:34 devstack sudo[86414]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 25 15:54:34 devstack sudo[86411]: pam_unix(sudo:session): session closed for user root Feb 25 15:54:34 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-45dd0e33-4877-4aac-bd57-871e0d7d3e44 tempest-ServersNegativeTestJSON-1114025437 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-828c8642-08ac-4d4e-8853-8d306e0df82f" returned: 0 in 1.190s {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 25 15:54:34 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-45dd0e33-4877-4aac-bd57-871e0d7d3e44 tempest-ServersNegativeTestJSON-1114025437 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-828c8642-08ac-4d4e-8853-8d306e0df82f {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 25 15:54:34 devstack sudo[86420]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-828c8642-08ac-4d4e-8853-8d306e0df82f Feb 25 15:54:34 devstack sudo[86420]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 25 15:54:35 devstack sudo[86414]: pam_unix(sudo:session): session closed for user root Feb 25 15:54:35 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-79385fe7-e1c8-4cdc-80a6-1892802a796b tempest-GroupSnapshotsTest-1779717395 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-5153a222-bd7e-4e1e-8ff9-1b0c4d8bcba9" returned: 0 in 0.963s {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 25 15:54:35 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-79385fe7-e1c8-4cdc-80a6-1892802a796b tempest-GroupSnapshotsTest-1779717395 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-5153a222-bd7e-4e1e-8ff9-1b0c4d8bcba9 {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 25 15:54:35 devstack sudo[86425]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-5153a222-bd7e-4e1e-8ff9-1b0c4d8bcba9 Feb 25 15:54:35 devstack sudo[86425]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 25 15:54:35 devstack sudo[86420]: pam_unix(sudo:session): session closed for user root Feb 25 15:54:35 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-45dd0e33-4877-4aac-bd57-871e0d7d3e44 tempest-ServersNegativeTestJSON-1114025437 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-828c8642-08ac-4d4e-8853-8d306e0df82f" returned: 0 in 0.719s {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 25 15:54:35 devstack cinder-volume[83528]: DEBUG cinder.coordination [None req-45dd0e33-4877-4aac-bd57-871e0d7d3e44 tempest-ServersNegativeTestJSON-1114025437 None] Lock "cinder-quobyte-828c8642-08ac-4d4e-8853-8d306e0df82f" released by "delete_volume" :: held 1.965s {{(pid=83528) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 25 15:54:35 devstack cinder-volume[83528]: DEBUG cinder.volume.flows.manager.create_volume [None req-97d98038-ba82-4fac-aaf4-b526d9eaacdb tempest-VolumeSnapshotQuotasNegativeTestJSON-234004389 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83528) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 25 15:54:35 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-97d98038-ba82-4fac-aaf4-b526d9eaacdb tempest-VolumeSnapshotQuotasNegativeTestJSON-234004389 None] Flow 'volume_create_manager' (0ff1b200-a9aa-4c9e-80a5-b70a3105ee68) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83528) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 25 15:54:35 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-97d98038-ba82-4fac-aaf4-b526d9eaacdb tempest-VolumeSnapshotQuotasNegativeTestJSON-234004389 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (49d14f92-b672-4c39-8d1b-51efefff10c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 25 15:54:35 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-97d98038-ba82-4fac-aaf4-b526d9eaacdb tempest-VolumeSnapshotQuotasNegativeTestJSON-234004389 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (49d14f92-b672-4c39-8d1b-51efefff10c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-25T14:54:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-1861573280',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d622f4d8-1c77-4128-b969-950e8eb8636d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4eaa0ddf36c74fa3a0859a81edaeadeb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-25T14:54:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-25T14:54:36Z,use_quota=True,user_id='4b5c5a372fc74d34b479315ce3871ee0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ce71c2f9-6543-4165-9653-a1529b2ea243),volume_type_id=ce71c2f9-6543-4165-9653-a1529b2ea243)' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 25 15:54:35 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-97d98038-ba82-4fac-aaf4-b526d9eaacdb tempest-VolumeSnapshotQuotasNegativeTestJSON-234004389 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (72a144c9-50a5-4d15-bc25-f022b90734ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 25 15:54:35 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-97d98038-ba82-4fac-aaf4-b526d9eaacdb tempest-VolumeSnapshotQuotasNegativeTestJSON-234004389 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (72a144c9-50a5-4d15-bc25-f022b90734ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 25 15:54:35 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-97d98038-ba82-4fac-aaf4-b526d9eaacdb tempest-VolumeSnapshotQuotasNegativeTestJSON-234004389 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0312d476-f0cd-42c8-9eb3-0f11804d810a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 25 15:54:35 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-97d98038-ba82-4fac-aaf4-b526d9eaacdb tempest-VolumeSnapshotQuotasNegativeTestJSON-234004389 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0312d476-f0cd-42c8-9eb3-0f11804d810a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd622f4d8-1c77-4128-b969-950e8eb8636d', 'volume_name': 'volume-d622f4d8-1c77-4128-b969-950e8eb8636d', 'volume_size': 1}' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 25 15:54:35 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-97d98038-ba82-4fac-aaf4-b526d9eaacdb tempest-VolumeSnapshotQuotasNegativeTestJSON-234004389 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3bc6d558-e76a-4303-94b6-c11db364e3f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 25 15:54:35 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-97d98038-ba82-4fac-aaf4-b526d9eaacdb tempest-VolumeSnapshotQuotasNegativeTestJSON-234004389 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3bc6d558-e76a-4303-94b6-c11db364e3f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 25 15:54:35 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-97d98038-ba82-4fac-aaf4-b526d9eaacdb tempest-VolumeSnapshotQuotasNegativeTestJSON-234004389 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (167dae1d-cf30-42ba-ba4c-e38188d42446) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 25 15:54:35 devstack cinder-volume[83528]: INFO cinder.volume.flows.manager.create_volume [None req-97d98038-ba82-4fac-aaf4-b526d9eaacdb tempest-VolumeSnapshotQuotasNegativeTestJSON-234004389 None] Volume d622f4d8-1c77-4128-b969-950e8eb8636d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d622f4d8-1c77-4128-b969-950e8eb8636d', 'volume_size': 1} Feb 25 15:54:35 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-97d98038-ba82-4fac-aaf4-b526d9eaacdb tempest-VolumeSnapshotQuotasNegativeTestJSON-234004389 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 25 15:54:35 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-97d98038-ba82-4fac-aaf4-b526d9eaacdb tempest-VolumeSnapshotQuotasNegativeTestJSON-234004389 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 25 15:54:35 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.quobyte [None req-97d98038-ba82-4fac-aaf4-b526d9eaacdb tempest-VolumeSnapshotQuotasNegativeTestJSON-234004389 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-25T14:54:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-1861573280',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d622f4d8-1c77-4128-b969-950e8eb8636d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4eaa0ddf36c74fa3a0859a81edaeadeb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-25T14:54:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-25T14:54:36Z,use_quota=True,user_id='4b5c5a372fc74d34b479315ce3871ee0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ce71c2f9-6543-4165-9653-a1529b2ea243),volume_type_id=ce71c2f9-6543-4165-9653-a1529b2ea243)}" {{(pid=83528) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 25 15:54:35 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.remotefs [None req-97d98038-ba82-4fac-aaf4-b526d9eaacdb tempest-VolumeSnapshotQuotasNegativeTestJSON-234004389 None] Creating volume d622f4d8-1c77-4128-b969-950e8eb8636d {{(pid=83528) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 25 15:54:35 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-97d98038-ba82-4fac-aaf4-b526d9eaacdb tempest-VolumeSnapshotQuotasNegativeTestJSON-234004389 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 25 15:54:35 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-97d98038-ba82-4fac-aaf4-b526d9eaacdb tempest-VolumeSnapshotQuotasNegativeTestJSON-234004389 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 25 15:54:35 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.quobyte [None req-97d98038-ba82-4fac-aaf4-b526d9eaacdb tempest-VolumeSnapshotQuotasNegativeTestJSON-234004389 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23e9d725-3e04-4cd9-bfe0-c8ef43305589': None} {{(pid=83528) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 25 15:54:35 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.quobyte [None req-97d98038-ba82-4fac-aaf4-b526d9eaacdb tempest-VolumeSnapshotQuotasNegativeTestJSON-234004389 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23e9d725-3e04-4cd9-bfe0-c8ef43305589'] {{(pid=83528) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 25 15:54:35 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-97d98038-ba82-4fac-aaf4-b526d9eaacdb tempest-VolumeSnapshotQuotasNegativeTestJSON-234004389 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 25 15:54:35 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.quobyte [None req-97d98038-ba82-4fac-aaf4-b526d9eaacdb tempest-VolumeSnapshotQuotasNegativeTestJSON-234004389 None] Selected osci02.corp.quobyte.com/cinder-vol-23e9d725-3e04-4cd9-bfe0-c8ef43305589 as target Quobyte volume. {{(pid=83528) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 25 15:54:35 devstack cinder-volume[83528]: INFO cinder.volume.drivers.remotefs [None req-97d98038-ba82-4fac-aaf4-b526d9eaacdb tempest-VolumeSnapshotQuotasNegativeTestJSON-234004389 None] casted to osci02.corp.quobyte.com/cinder-vol-23e9d725-3e04-4cd9-bfe0-c8ef43305589 Feb 25 15:54:35 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-97d98038-ba82-4fac-aaf4-b526d9eaacdb tempest-VolumeSnapshotQuotasNegativeTestJSON-234004389 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-d622f4d8-1c77-4128-b969-950e8eb8636d 1073741824 {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 25 15:54:35 devstack sudo[86429]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-d622f4d8-1c77-4128-b969-950e8eb8636d 1073741824 Feb 25 15:54:35 devstack sudo[86429]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 25 15:54:35 devstack cinder-volume[83528]: DEBUG cinder.quota [None req-45dd0e33-4877-4aac-bd57-871e0d7d3e44 tempest-ServersNegativeTestJSON-1114025437 None] Created reservations ['f6080c4b-000b-419a-8091-1efa222e1e5d', '56185853-3290-4a74-a298-31f35f635276', '47b1f99c-d21b-47a2-8e32-29f63e651350', 'bbe69321-c852-483e-a91c-6016451fc9f2'] {{(pid=83528) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 25 15:54:35 devstack sudo[86425]: pam_unix(sudo:session): session closed for user root Feb 25 15:54:35 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-79385fe7-e1c8-4cdc-80a6-1892802a796b tempest-GroupSnapshotsTest-1779717395 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-5153a222-bd7e-4e1e-8ff9-1b0c4d8bcba9" returned: 0 in 0.596s {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 25 15:54:35 devstack cinder-volume[83528]: DEBUG cinder.coordination [None req-79385fe7-e1c8-4cdc-80a6-1892802a796b tempest-GroupSnapshotsTest-1779717395 None] Lock "cinder-quobyte-5153a222-bd7e-4e1e-8ff9-1b0c4d8bcba9" released by "delete_volume" :: held 1.736s {{(pid=83528) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 25 15:54:35 devstack cinder-volume[83528]: DEBUG cinder.coordination [None req-79385fe7-e1c8-4cdc-80a6-1892802a796b tempest-GroupSnapshotsTest-1779717395 None] Acquiring lock "cinder-quobyte-c96adca3-9875-40e8-aa3e-3b7f6d371d46" by "delete_volume" {{(pid=83528) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 25 15:54:35 devstack cinder-volume[83528]: DEBUG cinder.coordination [None req-79385fe7-e1c8-4cdc-80a6-1892802a796b tempest-GroupSnapshotsTest-1779717395 None] Lock "cinder-quobyte-c96adca3-9875-40e8-aa3e-3b7f6d371d46" acquired by "delete_volume" :: waited 0.021s {{(pid=83528) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 25 15:54:35 devstack cinder-volume[83528]: DEBUG oslo.privsep.daemon [-] privsep: reply[cceb2ba5-0177-4d62-ba3c-7c0170de631e]: (4, 'qcow2') {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 25 15:54:35 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-79385fe7-e1c8-4cdc-80a6-1892802a796b tempest-GroupSnapshotsTest-1779717395 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-c96adca3-9875-40e8-aa3e-3b7f6d371d46 {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 25 15:54:36 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-45dd0e33-4877-4aac-bd57-871e0d7d3e44 tempest-ServersNegativeTestJSON-1114025437 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 25 15:54:36 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-45dd0e33-4877-4aac-bd57-871e0d7d3e44 tempest-ServersNegativeTestJSON-1114025437 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 25 15:54:36 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.quobyte [None req-45dd0e33-4877-4aac-bd57-871e0d7d3e44 tempest-ServersNegativeTestJSON-1114025437 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23e9d725-3e04-4cd9-bfe0-c8ef43305589': None} {{(pid=83528) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 25 15:54:36 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.quobyte [None req-45dd0e33-4877-4aac-bd57-871e0d7d3e44 tempest-ServersNegativeTestJSON-1114025437 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23e9d725-3e04-4cd9-bfe0-c8ef43305589'] {{(pid=83528) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 25 15:54:36 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-45dd0e33-4877-4aac-bd57-871e0d7d3e44 tempest-ServersNegativeTestJSON-1114025437 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 25 15:54:36 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-45dd0e33-4877-4aac-bd57-871e0d7d3e44 tempest-ServersNegativeTestJSON-1114025437 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85 {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 25 15:54:36 devstack sudo[86432]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85 Feb 25 15:54:36 devstack sudo[86432]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 25 15:54:36 devstack sudo[86431]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-c96adca3-9875-40e8-aa3e-3b7f6d371d46 Feb 25 15:54:36 devstack sudo[86431]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 25 15:54:36 devstack sudo[86432]: pam_unix(sudo:session): session closed for user root Feb 25 15:54:36 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-45dd0e33-4877-4aac-bd57-871e0d7d3e44 tempest-ServersNegativeTestJSON-1114025437 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85" returned: 0 in 0.610s {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 25 15:54:36 devstack cinder-volume[83528]: DEBUG cinder.manager [None req-45dd0e33-4877-4aac-bd57-871e0d7d3e44 tempest-ServersNegativeTestJSON-1114025437 None] Notifying Schedulers of capabilities ... {{(pid=83528) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 25 15:54:36 devstack cinder-volume[83528]: INFO cinder.volume.manager [None req-45dd0e33-4877-4aac-bd57-871e0d7d3e44 tempest-ServersNegativeTestJSON-1114025437 None] Deleted volume successfully. Feb 25 15:54:36 devstack cinder-volume[83528]: DEBUG cinder.coordination [None req-45dd0e33-4877-4aac-bd57-871e0d7d3e44 tempest-ServersNegativeTestJSON-1114025437 None] Lock "cinder-828c8642-08ac-4d4e-8853-8d306e0df82f-delete_volume" released by "delete_volume" :: held 3.158s {{(pid=83528) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 25 15:54:36 devstack sudo[86429]: pam_unix(sudo:session): session closed for user root Feb 25 15:54:36 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-97d98038-ba82-4fac-aaf4-b526d9eaacdb tempest-VolumeSnapshotQuotasNegativeTestJSON-234004389 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-d622f4d8-1c77-4128-b969-950e8eb8636d 1073741824" returned: 0 in 0.905s {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 25 15:54:36 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-97d98038-ba82-4fac-aaf4-b526d9eaacdb tempest-VolumeSnapshotQuotasNegativeTestJSON-234004389 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-d622f4d8-1c77-4128-b969-950e8eb8636d {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 25 15:54:36 devstack sudo[86442]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-d622f4d8-1c77-4128-b969-950e8eb8636d Feb 25 15:54:36 devstack sudo[86442]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 25 15:54:36 devstack sudo[86431]: pam_unix(sudo:session): session closed for user root Feb 25 15:54:36 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-79385fe7-e1c8-4cdc-80a6-1892802a796b tempest-GroupSnapshotsTest-1779717395 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-c96adca3-9875-40e8-aa3e-3b7f6d371d46" returned: 0 in 0.854s {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 25 15:54:36 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-79385fe7-e1c8-4cdc-80a6-1892802a796b tempest-GroupSnapshotsTest-1779717395 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-c96adca3-9875-40e8-aa3e-3b7f6d371d46 {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 25 15:54:36 devstack sudo[86444]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-c96adca3-9875-40e8-aa3e-3b7f6d371d46 Feb 25 15:54:36 devstack sudo[86444]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 25 15:54:37 devstack sudo[86442]: pam_unix(sudo:session): session closed for user root Feb 25 15:54:37 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-97d98038-ba82-4fac-aaf4-b526d9eaacdb tempest-VolumeSnapshotQuotasNegativeTestJSON-234004389 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-d622f4d8-1c77-4128-b969-950e8eb8636d" returned: 0 in 0.482s {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 25 15:54:37 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.quobyte [None req-97d98038-ba82-4fac-aaf4-b526d9eaacdb tempest-VolumeSnapshotQuotasNegativeTestJSON-234004389 None] <== create_volume: return (1420ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-23e9d725-3e04-4cd9-bfe0-c8ef43305589'} {{(pid=83528) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 25 15:54:37 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-97d98038-ba82-4fac-aaf4-b526d9eaacdb tempest-VolumeSnapshotQuotasNegativeTestJSON-234004389 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.423s {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 25 15:54:37 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-97d98038-ba82-4fac-aaf4-b526d9eaacdb tempest-VolumeSnapshotQuotasNegativeTestJSON-234004389 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (167dae1d-cf30-42ba-ba4c-e38188d42446) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d622f4d8-1c77-4128-b969-950e8eb8636d', 'volume_size': 1}' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 25 15:54:37 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-97d98038-ba82-4fac-aaf4-b526d9eaacdb tempest-VolumeSnapshotQuotasNegativeTestJSON-234004389 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (83d1c28a-f7ca-4a23-9e14-10d0c7d0c1bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 25 15:54:37 devstack cinder-volume[83528]: INFO cinder.volume.flows.manager.create_volume [None req-97d98038-ba82-4fac-aaf4-b526d9eaacdb tempest-VolumeSnapshotQuotasNegativeTestJSON-234004389 None] Volume volume-d622f4d8-1c77-4128-b969-950e8eb8636d (d622f4d8-1c77-4128-b969-950e8eb8636d): created successfully Feb 25 15:54:37 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-97d98038-ba82-4fac-aaf4-b526d9eaacdb tempest-VolumeSnapshotQuotasNegativeTestJSON-234004389 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (83d1c28a-f7ca-4a23-9e14-10d0c7d0c1bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 25 15:54:37 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-97d98038-ba82-4fac-aaf4-b526d9eaacdb tempest-VolumeSnapshotQuotasNegativeTestJSON-234004389 None] Flow 'volume_create_manager' (0ff1b200-a9aa-4c9e-80a5-b70a3105ee68) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83528) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 25 15:54:37 devstack cinder-volume[83528]: INFO cinder.volume.manager [None req-97d98038-ba82-4fac-aaf4-b526d9eaacdb tempest-VolumeSnapshotQuotasNegativeTestJSON-234004389 None] Created volume successfully. Feb 25 15:54:37 devstack sudo[86444]: pam_unix(sudo:session): session closed for user root Feb 25 15:54:37 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-79385fe7-e1c8-4cdc-80a6-1892802a796b tempest-GroupSnapshotsTest-1779717395 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-c96adca3-9875-40e8-aa3e-3b7f6d371d46" returned: 0 in 0.522s {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 25 15:54:37 devstack cinder-volume[83528]: DEBUG cinder.coordination [None req-79385fe7-e1c8-4cdc-80a6-1892802a796b tempest-GroupSnapshotsTest-1779717395 None] Lock "cinder-quobyte-c96adca3-9875-40e8-aa3e-3b7f6d371d46" released by "delete_volume" :: held 1.429s {{(pid=83528) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 25 15:54:37 devstack cinder-volume[83528]: DEBUG cinder.quota [None req-79385fe7-e1c8-4cdc-80a6-1892802a796b tempest-GroupSnapshotsTest-1779717395 None] Created reservations ['a13148ba-1b1d-415b-b856-a8e1fd4af486'] {{(pid=83528) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 25 15:54:37 devstack cinder-volume[83528]: WARNING cinder.quota [None req-79385fe7-e1c8-4cdc-80a6-1892802a796b tempest-GroupSnapshotsTest-1779717395 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-522481855 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-522481855, it is now deprecated. Please use the default quota class for default quota. Feb 25 15:54:37 devstack cinder-volume[83528]: DEBUG cinder.quota [None req-79385fe7-e1c8-4cdc-80a6-1892802a796b tempest-GroupSnapshotsTest-1779717395 None] Created reservations ['1cfe4e78-33a6-40e3-9108-a033cb53cc7b', 'f6df3cb1-0d4e-4682-9055-70725ad79f65', 'cb274315-e4e0-4b01-9436-afc180f5b2dd', 'adc8cf3e-5009-4475-93e0-e89d550514c2'] {{(pid=83528) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 25 15:54:37 devstack cinder-volume[83528]: DEBUG cinder.quota [None req-79385fe7-e1c8-4cdc-80a6-1892802a796b tempest-GroupSnapshotsTest-1779717395 None] Created reservations ['cc86cccb-970c-433a-9fb9-190ec2cf2686', '6306b679-947a-4a34-924d-c94851a67318', 'fc5194c6-5a35-4d97-86c7-916f3df74dac', '7fcb5b9b-ecfc-4fe2-ae72-0a103e413567'] {{(pid=83528) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 25 15:54:37 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-79385fe7-e1c8-4cdc-80a6-1892802a796b tempest-GroupSnapshotsTest-1779717395 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 25 15:54:37 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-79385fe7-e1c8-4cdc-80a6-1892802a796b tempest-GroupSnapshotsTest-1779717395 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 25 15:54:37 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.quobyte [None req-79385fe7-e1c8-4cdc-80a6-1892802a796b tempest-GroupSnapshotsTest-1779717395 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23e9d725-3e04-4cd9-bfe0-c8ef43305589': None} {{(pid=83528) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 25 15:54:37 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.quobyte [None req-79385fe7-e1c8-4cdc-80a6-1892802a796b tempest-GroupSnapshotsTest-1779717395 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23e9d725-3e04-4cd9-bfe0-c8ef43305589'] {{(pid=83528) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 25 15:54:37 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-79385fe7-e1c8-4cdc-80a6-1892802a796b tempest-GroupSnapshotsTest-1779717395 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 25 15:54:37 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-79385fe7-e1c8-4cdc-80a6-1892802a796b tempest-GroupSnapshotsTest-1779717395 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85 {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 25 15:54:37 devstack sudo[86448]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85 Feb 25 15:54:37 devstack sudo[86448]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 25 15:54:37 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-426e889d-2313-4ed1-821d-a9e612f32def tempest-VolumeSnapshotQuotasNegativeTestJSON-234004389 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 25 15:54:37 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-426e889d-2313-4ed1-821d-a9e612f32def tempest-VolumeSnapshotQuotasNegativeTestJSON-234004389 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 25 15:54:37 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.remotefs [None req-426e889d-2313-4ed1-821d-a9e612f32def tempest-VolumeSnapshotQuotasNegativeTestJSON-234004389 None] Creating offline snapshot 711d1dd8-a2c3-4c8a-922f-4573afbfe763 of volume d622f4d8-1c77-4128-b969-950e8eb8636d {{(pid=83528) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Feb 25 15:54:37 devstack cinder-volume[83528]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9b486e5-0586-4a51-a9a4-189a515308b8]: (4, 'qcow2') {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 25 15:54:37 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-426e889d-2313-4ed1-821d-a9e612f32def tempest-VolumeSnapshotQuotasNegativeTestJSON-234004389 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-d622f4d8-1c77-4128-b969-950e8eb8636d {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 25 15:54:38 devstack sudo[86450]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-d622f4d8-1c77-4128-b969-950e8eb8636d Feb 25 15:54:38 devstack sudo[86450]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 25 15:54:38 devstack sudo[86448]: pam_unix(sudo:session): session closed for user root Feb 25 15:54:38 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-79385fe7-e1c8-4cdc-80a6-1892802a796b tempest-GroupSnapshotsTest-1779717395 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85" returned: 0 in 0.712s {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 25 15:54:38 devstack cinder-volume[83528]: DEBUG cinder.manager [None req-79385fe7-e1c8-4cdc-80a6-1892802a796b tempest-GroupSnapshotsTest-1779717395 None] Notifying Schedulers of capabilities ... {{(pid=83528) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 25 15:54:38 devstack cinder-volume[83528]: INFO cinder.volume.manager [None req-79385fe7-e1c8-4cdc-80a6-1892802a796b tempest-GroupSnapshotsTest-1779717395 None] Delete group completed successfully. Feb 25 15:54:38 devstack cinder-volume[83528]: DEBUG oslo_service.periodic_task [None req-d4c764ec-0ebb-4b31-b534-c9a53c1ab0dd None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=83528) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Feb 25 15:54:38 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-d4c764ec-0ebb-4b31-b534-c9a53c1ab0dd None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 25 15:54:38 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-d4c764ec-0ebb-4b31-b534-c9a53c1ab0dd None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 25 15:54:38 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.quobyte [None req-d4c764ec-0ebb-4b31-b534-c9a53c1ab0dd None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23e9d725-3e04-4cd9-bfe0-c8ef43305589': None} {{(pid=83528) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 25 15:54:38 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.quobyte [None req-d4c764ec-0ebb-4b31-b534-c9a53c1ab0dd None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23e9d725-3e04-4cd9-bfe0-c8ef43305589'] {{(pid=83528) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 25 15:54:38 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-d4c764ec-0ebb-4b31-b534-c9a53c1ab0dd None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 25 15:54:38 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-d4c764ec-0ebb-4b31-b534-c9a53c1ab0dd None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85 {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 25 15:54:38 devstack sudo[86450]: pam_unix(sudo:session): session closed for user root Feb 25 15:54:38 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-426e889d-2313-4ed1-821d-a9e612f32def tempest-VolumeSnapshotQuotasNegativeTestJSON-234004389 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-d622f4d8-1c77-4128-b969-950e8eb8636d" returned: 0 in 0.752s {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 25 15:54:38 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-426e889d-2313-4ed1-821d-a9e612f32def tempest-VolumeSnapshotQuotasNegativeTestJSON-234004389 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-d622f4d8-1c77-4128-b969-950e8eb8636d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-d622f4d8-1c77-4128-b969-950e8eb8636d.711d1dd8-a2c3-4c8a-922f-4573afbfe763 1G {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 25 15:54:38 devstack sudo[86505]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85 Feb 25 15:54:38 devstack sudo[86505]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 25 15:54:38 devstack sudo[86506]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-d622f4d8-1c77-4128-b969-950e8eb8636d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-d622f4d8-1c77-4128-b969-950e8eb8636d.711d1dd8-a2c3-4c8a-922f-4573afbfe763 1G Feb 25 15:54:38 devstack sudo[86506]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 25 15:54:39 devstack cinder-volume[83528]: INFO cinder.volume.manager [None req-4162c8fe-2576-4bee-89d1-e171410d29f8 tempest-GroupSnapshotsTest-1779717395 None] Group tempest-GroupSnapshotsTest-Group-721595218: creating Feb 25 15:54:39 devstack cinder-volume[83528]: INFO cinder.volume.manager [None req-4162c8fe-2576-4bee-89d1-e171410d29f8 tempest-GroupSnapshotsTest-1779717395 None] Group tempest-GroupSnapshotsTest-Group-721595218: created successfully Feb 25 15:54:39 devstack cinder-volume[83528]: INFO cinder.volume.manager [None req-4162c8fe-2576-4bee-89d1-e171410d29f8 tempest-GroupSnapshotsTest-1779717395 None] Create group completed successfully. Feb 25 15:54:39 devstack sudo[86505]: pam_unix(sudo:session): session closed for user root Feb 25 15:54:39 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-d4c764ec-0ebb-4b31-b534-c9a53c1ab0dd None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85" returned: 0 in 0.666s {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 25 15:54:39 devstack cinder-volume[83528]: DEBUG cinder.manager [None req-d4c764ec-0ebb-4b31-b534-c9a53c1ab0dd None None] Notifying Schedulers of capabilities ... {{(pid=83528) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 25 15:54:39 devstack sudo[86506]: pam_unix(sudo:session): session closed for user root Feb 25 15:54:39 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-426e889d-2313-4ed1-821d-a9e612f32def tempest-VolumeSnapshotQuotasNegativeTestJSON-234004389 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-d622f4d8-1c77-4128-b969-950e8eb8636d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-d622f4d8-1c77-4128-b969-950e8eb8636d.711d1dd8-a2c3-4c8a-922f-4573afbfe763 1G" returned: 0 in 0.742s {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 25 15:54:39 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-426e889d-2313-4ed1-821d-a9e612f32def tempest-VolumeSnapshotQuotasNegativeTestJSON-234004389 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d622f4d8-1c77-4128-b969-950e8eb8636d -F qcow2 /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-d622f4d8-1c77-4128-b969-950e8eb8636d.711d1dd8-a2c3-4c8a-922f-4573afbfe763 {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 25 15:54:39 devstack sudo[86521]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d622f4d8-1c77-4128-b969-950e8eb8636d -F qcow2 /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-d622f4d8-1c77-4128-b969-950e8eb8636d.711d1dd8-a2c3-4c8a-922f-4573afbfe763 Feb 25 15:54:39 devstack sudo[86521]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 25 15:54:40 devstack sudo[86521]: pam_unix(sudo:session): session closed for user root Feb 25 15:54:40 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-426e889d-2313-4ed1-821d-a9e612f32def tempest-VolumeSnapshotQuotasNegativeTestJSON-234004389 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d622f4d8-1c77-4128-b969-950e8eb8636d -F qcow2 /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-d622f4d8-1c77-4128-b969-950e8eb8636d.711d1dd8-a2c3-4c8a-922f-4573afbfe763" returned: 0 in 0.593s {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 25 15:54:40 devstack cinder-volume[83528]: WARNING cinder.volume.drivers.remotefs [None req-426e889d-2313-4ed1-821d-a9e612f32def tempest-VolumeSnapshotQuotasNegativeTestJSON-234004389 None] /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-d622f4d8-1c77-4128-b969-950e8eb8636d.711d1dd8-a2c3-4c8a-922f-4573afbfe763 is being set with open permissions: ugo+rw Feb 25 15:54:40 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-426e889d-2313-4ed1-821d-a9e612f32def tempest-VolumeSnapshotQuotasNegativeTestJSON-234004389 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-d622f4d8-1c77-4128-b969-950e8eb8636d.711d1dd8-a2c3-4c8a-922f-4573afbfe763 {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 25 15:54:40 devstack sudo[86530]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-d622f4d8-1c77-4128-b969-950e8eb8636d.711d1dd8-a2c3-4c8a-922f-4573afbfe763 Feb 25 15:54:40 devstack sudo[86530]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 25 15:54:40 devstack cinder-volume[83528]: DEBUG cinder.volume.flows.manager.create_volume [None req-4670de3b-dd2d-41f6-9ecf-fdd77fa76403 tempest-GroupSnapshotsTest-1779717395 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83528) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 25 15:54:40 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-4670de3b-dd2d-41f6-9ecf-fdd77fa76403 tempest-GroupSnapshotsTest-1779717395 None] Flow 'volume_create_manager' (39c2ffc9-10fe-462c-944e-1b7a2439c549) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83528) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 25 15:54:40 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-4670de3b-dd2d-41f6-9ecf-fdd77fa76403 tempest-GroupSnapshotsTest-1779717395 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cca5c29e-8b91-43f8-b20e-41f19f2caa5c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 25 15:54:40 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-4670de3b-dd2d-41f6-9ecf-fdd77fa76403 tempest-GroupSnapshotsTest-1779717395 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cca5c29e-8b91-43f8-b20e-41f19f2caa5c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-25T14:54:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1708313735',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=d4b0e0a1-435b-4f91-8437-bb79789a3359,host='devstack@QuobyteHD#QuobyteHD',id=6ce1a7f0-81df-4e65-80ef-dad229989302,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3827b9375d3e4b44a95020c555372a80',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-25T14:54:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-25T14:54:40Z,use_quota=True,user_id='99d268450fcd419cab908aed8018b7e2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ffc1e732-16ed-48a7-8db5-cbbceb084e2e),volume_type_id=ffc1e732-16ed-48a7-8db5-cbbceb084e2e)' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 25 15:54:40 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-4670de3b-dd2d-41f6-9ecf-fdd77fa76403 tempest-GroupSnapshotsTest-1779717395 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9e46a3c6-0030-4a9d-b1df-a7ba96da1840) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 25 15:54:40 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-4670de3b-dd2d-41f6-9ecf-fdd77fa76403 tempest-GroupSnapshotsTest-1779717395 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9e46a3c6-0030-4a9d-b1df-a7ba96da1840) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 25 15:54:40 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-4670de3b-dd2d-41f6-9ecf-fdd77fa76403 tempest-GroupSnapshotsTest-1779717395 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5e4d28a7-0951-4817-9c64-39ef71fea1c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 25 15:54:40 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-4670de3b-dd2d-41f6-9ecf-fdd77fa76403 tempest-GroupSnapshotsTest-1779717395 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5e4d28a7-0951-4817-9c64-39ef71fea1c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6ce1a7f0-81df-4e65-80ef-dad229989302', 'volume_name': 'volume-6ce1a7f0-81df-4e65-80ef-dad229989302', 'volume_size': 1}' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 25 15:54:40 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-4670de3b-dd2d-41f6-9ecf-fdd77fa76403 tempest-GroupSnapshotsTest-1779717395 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a30a7c11-561e-4f04-9acc-97d50ba81b12) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 25 15:54:40 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-4670de3b-dd2d-41f6-9ecf-fdd77fa76403 tempest-GroupSnapshotsTest-1779717395 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a30a7c11-561e-4f04-9acc-97d50ba81b12) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 25 15:54:40 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-4670de3b-dd2d-41f6-9ecf-fdd77fa76403 tempest-GroupSnapshotsTest-1779717395 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (13b209bf-cfa3-4234-a8c2-4b3055f3c802) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 25 15:54:40 devstack cinder-volume[83528]: INFO cinder.volume.flows.manager.create_volume [None req-4670de3b-dd2d-41f6-9ecf-fdd77fa76403 tempest-GroupSnapshotsTest-1779717395 None] Volume 6ce1a7f0-81df-4e65-80ef-dad229989302: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6ce1a7f0-81df-4e65-80ef-dad229989302', 'volume_size': 1} Feb 25 15:54:40 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-4670de3b-dd2d-41f6-9ecf-fdd77fa76403 tempest-GroupSnapshotsTest-1779717395 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 25 15:54:40 devstack sudo[86530]: pam_unix(sudo:session): session closed for user root Feb 25 15:54:40 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-426e889d-2313-4ed1-821d-a9e612f32def tempest-VolumeSnapshotQuotasNegativeTestJSON-234004389 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-d622f4d8-1c77-4128-b969-950e8eb8636d.711d1dd8-a2c3-4c8a-922f-4573afbfe763" returned: 0 in 0.588s {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 25 15:54:40 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-426e889d-2313-4ed1-821d-a9e612f32def tempest-VolumeSnapshotQuotasNegativeTestJSON-234004389 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-d622f4d8-1c77-4128-b969-950e8eb8636d.info {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 25 15:54:40 devstack sudo[86550]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-d622f4d8-1c77-4128-b969-950e8eb8636d.info Feb 25 15:54:40 devstack sudo[86550]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 25 15:54:41 devstack sudo[86550]: pam_unix(sudo:session): session closed for user root Feb 25 15:54:41 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-426e889d-2313-4ed1-821d-a9e612f32def tempest-VolumeSnapshotQuotasNegativeTestJSON-234004389 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-d622f4d8-1c77-4128-b969-950e8eb8636d.info" returned: 0 in 0.461s {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 25 15:54:41 devstack cinder-volume[83528]: WARNING cinder.volume.drivers.remotefs [None req-426e889d-2313-4ed1-821d-a9e612f32def tempest-VolumeSnapshotQuotasNegativeTestJSON-234004389 None] /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-d622f4d8-1c77-4128-b969-950e8eb8636d.info is being set with open permissions: ugo+rw Feb 25 15:54:41 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-426e889d-2313-4ed1-821d-a9e612f32def tempest-VolumeSnapshotQuotasNegativeTestJSON-234004389 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-d622f4d8-1c77-4128-b969-950e8eb8636d.info {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 25 15:54:41 devstack sudo[86553]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-d622f4d8-1c77-4128-b969-950e8eb8636d.info Feb 25 15:54:41 devstack sudo[86553]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 25 15:54:41 devstack sudo[86553]: pam_unix(sudo:session): session closed for user root Feb 25 15:54:41 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-426e889d-2313-4ed1-821d-a9e612f32def tempest-VolumeSnapshotQuotasNegativeTestJSON-234004389 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-d622f4d8-1c77-4128-b969-950e8eb8636d.info" returned: 0 in 0.533s {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 25 15:54:41 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-426e889d-2313-4ed1-821d-a9e612f32def tempest-VolumeSnapshotQuotasNegativeTestJSON-234004389 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.729s {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 25 15:54:41 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-4670de3b-dd2d-41f6-9ecf-fdd77fa76403 tempest-GroupSnapshotsTest-1779717395 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.088s {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 25 15:54:41 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.quobyte [None req-4670de3b-dd2d-41f6-9ecf-fdd77fa76403 tempest-GroupSnapshotsTest-1779717395 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=d4b0e0a1-435b-4f91-8437-bb79789a3359,created_at=2026-02-25T14:54:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1708313735',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=d4b0e0a1-435b-4f91-8437-bb79789a3359,host='devstack@QuobyteHD#QuobyteHD',id=6ce1a7f0-81df-4e65-80ef-dad229989302,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3827b9375d3e4b44a95020c555372a80',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-25T14:54:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-25T14:54:40Z,use_quota=True,user_id='99d268450fcd419cab908aed8018b7e2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ffc1e732-16ed-48a7-8db5-cbbceb084e2e),volume_type_id=ffc1e732-16ed-48a7-8db5-cbbceb084e2e)}" {{(pid=83528) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 25 15:54:41 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.remotefs [None req-4670de3b-dd2d-41f6-9ecf-fdd77fa76403 tempest-GroupSnapshotsTest-1779717395 None] Creating volume 6ce1a7f0-81df-4e65-80ef-dad229989302 {{(pid=83528) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 25 15:54:41 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-4670de3b-dd2d-41f6-9ecf-fdd77fa76403 tempest-GroupSnapshotsTest-1779717395 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 25 15:54:41 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-4670de3b-dd2d-41f6-9ecf-fdd77fa76403 tempest-GroupSnapshotsTest-1779717395 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 25 15:54:41 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.quobyte [None req-4670de3b-dd2d-41f6-9ecf-fdd77fa76403 tempest-GroupSnapshotsTest-1779717395 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23e9d725-3e04-4cd9-bfe0-c8ef43305589': None} {{(pid=83528) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 25 15:54:41 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.quobyte [None req-4670de3b-dd2d-41f6-9ecf-fdd77fa76403 tempest-GroupSnapshotsTest-1779717395 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23e9d725-3e04-4cd9-bfe0-c8ef43305589'] {{(pid=83528) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 25 15:54:41 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-4670de3b-dd2d-41f6-9ecf-fdd77fa76403 tempest-GroupSnapshotsTest-1779717395 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 25 15:54:41 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.quobyte [None req-4670de3b-dd2d-41f6-9ecf-fdd77fa76403 tempest-GroupSnapshotsTest-1779717395 None] Selected osci02.corp.quobyte.com/cinder-vol-23e9d725-3e04-4cd9-bfe0-c8ef43305589 as target Quobyte volume. {{(pid=83528) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 25 15:54:41 devstack cinder-volume[83528]: INFO cinder.volume.drivers.remotefs [None req-4670de3b-dd2d-41f6-9ecf-fdd77fa76403 tempest-GroupSnapshotsTest-1779717395 None] casted to osci02.corp.quobyte.com/cinder-vol-23e9d725-3e04-4cd9-bfe0-c8ef43305589 Feb 25 15:54:41 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-4670de3b-dd2d-41f6-9ecf-fdd77fa76403 tempest-GroupSnapshotsTest-1779717395 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-6ce1a7f0-81df-4e65-80ef-dad229989302 1073741824 {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 25 15:54:41 devstack sudo[86556]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-6ce1a7f0-81df-4e65-80ef-dad229989302 1073741824 Feb 25 15:54:41 devstack sudo[86556]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 25 15:54:41 devstack cinder-volume[83528]: INFO cinder.volume.manager [None req-426e889d-2313-4ed1-821d-a9e612f32def tempest-VolumeSnapshotQuotasNegativeTestJSON-234004389 None] Create snapshot completed successfully Feb 25 15:54:42 devstack sudo[86556]: pam_unix(sudo:session): session closed for user root Feb 25 15:54:42 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-4670de3b-dd2d-41f6-9ecf-fdd77fa76403 tempest-GroupSnapshotsTest-1779717395 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-6ce1a7f0-81df-4e65-80ef-dad229989302 1073741824" returned: 0 in 0.572s {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 25 15:54:42 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-4670de3b-dd2d-41f6-9ecf-fdd77fa76403 tempest-GroupSnapshotsTest-1779717395 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-6ce1a7f0-81df-4e65-80ef-dad229989302 {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 25 15:54:42 devstack sudo[86561]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-6ce1a7f0-81df-4e65-80ef-dad229989302 Feb 25 15:54:42 devstack sudo[86561]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 25 15:54:42 devstack cinder-volume[83528]: DEBUG cinder.coordination [None req-073d62b9-a3eb-43bd-a08b-22943c2ae7b7 tempest-VolumeSnapshotQuotasNegativeTestJSON-234004389 None] Acquiring lock "cinder-711d1dd8-a2c3-4c8a-922f-4573afbfe763-delete_snapshot" by "delete_snapshot" {{(pid=83528) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 25 15:54:42 devstack cinder-volume[83528]: DEBUG cinder.coordination [None req-073d62b9-a3eb-43bd-a08b-22943c2ae7b7 tempest-VolumeSnapshotQuotasNegativeTestJSON-234004389 None] Lock "cinder-711d1dd8-a2c3-4c8a-922f-4573afbfe763-delete_snapshot" acquired by "delete_snapshot" :: waited 0.012s {{(pid=83528) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 25 15:54:42 devstack cinder-volume[83528]: DEBUG cinder.coordination [None req-073d62b9-a3eb-43bd-a08b-22943c2ae7b7 tempest-VolumeSnapshotQuotasNegativeTestJSON-234004389 None] Acquiring lock "cinder-quobyte-d622f4d8-1c77-4128-b969-950e8eb8636d" by "delete_snapshot" {{(pid=83528) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 25 15:54:42 devstack cinder-volume[83528]: DEBUG cinder.coordination [None req-073d62b9-a3eb-43bd-a08b-22943c2ae7b7 tempest-VolumeSnapshotQuotasNegativeTestJSON-234004389 None] Lock "cinder-quobyte-d622f4d8-1c77-4128-b969-950e8eb8636d" acquired by "delete_snapshot" :: waited 0.013s {{(pid=83528) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 25 15:54:42 devstack cinder-volume[83528]: DEBUG cinder.coordination [None req-073d62b9-a3eb-43bd-a08b-22943c2ae7b7 tempest-VolumeSnapshotQuotasNegativeTestJSON-234004389 None] Acquiring lock "cinder-quobyte-711d1dd8-a2c3-4c8a-922f-4573afbfe763" by "_delete_snapshot" {{(pid=83528) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 25 15:54:42 devstack cinder-volume[83528]: DEBUG cinder.coordination [None req-073d62b9-a3eb-43bd-a08b-22943c2ae7b7 tempest-VolumeSnapshotQuotasNegativeTestJSON-234004389 None] Lock "cinder-quobyte-711d1dd8-a2c3-4c8a-922f-4573afbfe763" acquired by "_delete_snapshot" :: waited 0.009s {{(pid=83528) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 25 15:54:42 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.remotefs [None req-073d62b9-a3eb-43bd-a08b-22943c2ae7b7 tempest-VolumeSnapshotQuotasNegativeTestJSON-234004389 None] Deleting offline snapshot 711d1dd8-a2c3-4c8a-922f-4573afbfe763 of volume d622f4d8-1c77-4128-b969-950e8eb8636d {{(pid=83528) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Feb 25 15:54:42 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.remotefs [None req-073d62b9-a3eb-43bd-a08b-22943c2ae7b7 tempest-VolumeSnapshotQuotasNegativeTestJSON-234004389 None] snapshot_file for this snap is: volume-d622f4d8-1c77-4128-b969-950e8eb8636d.711d1dd8-a2c3-4c8a-922f-4573afbfe763 {{(pid=83528) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Feb 25 15:54:42 devstack cinder-volume[83528]: DEBUG oslo.privsep.daemon [-] privsep: reply[7837ddfe-8d7b-44c4-b5ad-0ebdf1260cff]: (4, 'qcow2') {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 25 15:54:42 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-073d62b9-a3eb-43bd-a08b-22943c2ae7b7 tempest-VolumeSnapshotQuotasNegativeTestJSON-234004389 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-d622f4d8-1c77-4128-b969-950e8eb8636d.711d1dd8-a2c3-4c8a-922f-4573afbfe763 {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 25 15:54:42 devstack sudo[86563]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-d622f4d8-1c77-4128-b969-950e8eb8636d.711d1dd8-a2c3-4c8a-922f-4573afbfe763 Feb 25 15:54:42 devstack sudo[86563]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 25 15:54:42 devstack sudo[86561]: pam_unix(sudo:session): session closed for user root Feb 25 15:54:42 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-4670de3b-dd2d-41f6-9ecf-fdd77fa76403 tempest-GroupSnapshotsTest-1779717395 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-6ce1a7f0-81df-4e65-80ef-dad229989302" returned: 0 in 0.489s {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 25 15:54:42 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.quobyte [None req-4670de3b-dd2d-41f6-9ecf-fdd77fa76403 tempest-GroupSnapshotsTest-1779717395 None] <== create_volume: return (1091ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-23e9d725-3e04-4cd9-bfe0-c8ef43305589'} {{(pid=83528) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 25 15:54:42 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-4670de3b-dd2d-41f6-9ecf-fdd77fa76403 tempest-GroupSnapshotsTest-1779717395 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.095s {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 25 15:54:42 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-4670de3b-dd2d-41f6-9ecf-fdd77fa76403 tempest-GroupSnapshotsTest-1779717395 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (13b209bf-cfa3-4234-a8c2-4b3055f3c802) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6ce1a7f0-81df-4e65-80ef-dad229989302', 'volume_size': 1}' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 25 15:54:42 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-4670de3b-dd2d-41f6-9ecf-fdd77fa76403 tempest-GroupSnapshotsTest-1779717395 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9aede2c6-f3a2-4624-989b-da015d477d76) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 25 15:54:42 devstack cinder-volume[83528]: INFO cinder.volume.flows.manager.create_volume [None req-4670de3b-dd2d-41f6-9ecf-fdd77fa76403 tempest-GroupSnapshotsTest-1779717395 None] Volume volume-6ce1a7f0-81df-4e65-80ef-dad229989302 (6ce1a7f0-81df-4e65-80ef-dad229989302): created successfully Feb 25 15:54:42 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-4670de3b-dd2d-41f6-9ecf-fdd77fa76403 tempest-GroupSnapshotsTest-1779717395 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9aede2c6-f3a2-4624-989b-da015d477d76) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 25 15:54:42 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-4670de3b-dd2d-41f6-9ecf-fdd77fa76403 tempest-GroupSnapshotsTest-1779717395 None] Flow 'volume_create_manager' (39c2ffc9-10fe-462c-944e-1b7a2439c549) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83528) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 25 15:54:42 devstack cinder-volume[83528]: INFO cinder.volume.manager [None req-4670de3b-dd2d-41f6-9ecf-fdd77fa76403 tempest-GroupSnapshotsTest-1779717395 None] Created volume successfully. Feb 25 15:54:43 devstack sudo[86563]: pam_unix(sudo:session): session closed for user root Feb 25 15:54:43 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-073d62b9-a3eb-43bd-a08b-22943c2ae7b7 tempest-VolumeSnapshotQuotasNegativeTestJSON-234004389 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-d622f4d8-1c77-4128-b969-950e8eb8636d.711d1dd8-a2c3-4c8a-922f-4573afbfe763" returned: 0 in 0.596s {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 25 15:54:43 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.remotefs [None req-073d62b9-a3eb-43bd-a08b-22943c2ae7b7 tempest-VolumeSnapshotQuotasNegativeTestJSON-234004389 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d622f4d8-1c77-4128-b969-950e8eb8636d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83528) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Feb 25 15:54:43 devstack cinder-volume[83528]: DEBUG oslo.privsep.daemon [-] privsep: reply[13ee0d88-7d7c-4005-85db-e9e7547719ac]: (4, 'qcow2') {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 25 15:54:43 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-073d62b9-a3eb-43bd-a08b-22943c2ae7b7 tempest-VolumeSnapshotQuotasNegativeTestJSON-234004389 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-d622f4d8-1c77-4128-b969-950e8eb8636d {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 25 15:54:43 devstack sudo[86569]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-d622f4d8-1c77-4128-b969-950e8eb8636d Feb 25 15:54:43 devstack sudo[86569]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 25 15:54:43 devstack sudo[86569]: pam_unix(sudo:session): session closed for user root Feb 25 15:54:43 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-073d62b9-a3eb-43bd-a08b-22943c2ae7b7 tempest-VolumeSnapshotQuotasNegativeTestJSON-234004389 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-d622f4d8-1c77-4128-b969-950e8eb8636d" returned: 0 in 0.538s {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 25 15:54:43 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-073d62b9-a3eb-43bd-a08b-22943c2ae7b7 tempest-VolumeSnapshotQuotasNegativeTestJSON-234004389 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-d622f4d8-1c77-4128-b969-950e8eb8636d.711d1dd8-a2c3-4c8a-922f-4573afbfe763 {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 25 15:54:43 devstack sudo[86574]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-d622f4d8-1c77-4128-b969-950e8eb8636d.711d1dd8-a2c3-4c8a-922f-4573afbfe763 Feb 25 15:54:43 devstack sudo[86574]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 25 15:54:44 devstack cinder-volume[83528]: INFO cinder.volume.manager [None req-524599cd-79a7-4849-9f63-6437f38e8716 tempest-GroupSnapshotsTest-1779717395 None] GroupSnapshot 9d5a0ae5-bbe9-4b90-a912-f632805465b4: creating. Feb 25 15:54:44 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-524599cd-79a7-4849-9f63-6437f38e8716 tempest-GroupSnapshotsTest-1779717395 None] Group snapshot 9d5a0ae5-bbe9-4b90-a912-f632805465b4: creating. {{(pid=83528) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Feb 25 15:54:44 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-524599cd-79a7-4849-9f63-6437f38e8716 tempest-GroupSnapshotsTest-1779717395 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 25 15:54:44 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-524599cd-79a7-4849-9f63-6437f38e8716 tempest-GroupSnapshotsTest-1779717395 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 25 15:54:44 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.remotefs [None req-524599cd-79a7-4849-9f63-6437f38e8716 tempest-GroupSnapshotsTest-1779717395 None] Creating offline snapshot a4fc1acd-95e1-4904-9597-9e8fb94a215f of volume 6ce1a7f0-81df-4e65-80ef-dad229989302 {{(pid=83528) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Feb 25 15:54:44 devstack cinder-volume[83528]: DEBUG oslo.privsep.daemon [-] privsep: reply[cdd48aef-b494-4558-aa81-418f682ee954]: (4, 'qcow2') {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 25 15:54:44 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-524599cd-79a7-4849-9f63-6437f38e8716 tempest-GroupSnapshotsTest-1779717395 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-6ce1a7f0-81df-4e65-80ef-dad229989302 {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 25 15:54:44 devstack sudo[86576]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-6ce1a7f0-81df-4e65-80ef-dad229989302 Feb 25 15:54:44 devstack sudo[86576]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 25 15:54:44 devstack sudo[86574]: pam_unix(sudo:session): session closed for user root Feb 25 15:54:44 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-073d62b9-a3eb-43bd-a08b-22943c2ae7b7 tempest-VolumeSnapshotQuotasNegativeTestJSON-234004389 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-d622f4d8-1c77-4128-b969-950e8eb8636d.711d1dd8-a2c3-4c8a-922f-4573afbfe763" returned: 0 in 0.705s {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 25 15:54:44 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-073d62b9-a3eb-43bd-a08b-22943c2ae7b7 tempest-VolumeSnapshotQuotasNegativeTestJSON-234004389 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-d622f4d8-1c77-4128-b969-950e8eb8636d.711d1dd8-a2c3-4c8a-922f-4573afbfe763 {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 25 15:54:44 devstack sudo[86581]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-d622f4d8-1c77-4128-b969-950e8eb8636d.711d1dd8-a2c3-4c8a-922f-4573afbfe763 Feb 25 15:54:44 devstack sudo[86581]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 25 15:54:44 devstack sudo[86576]: pam_unix(sudo:session): session closed for user root Feb 25 15:54:44 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-524599cd-79a7-4849-9f63-6437f38e8716 tempest-GroupSnapshotsTest-1779717395 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-6ce1a7f0-81df-4e65-80ef-dad229989302" returned: 0 in 0.797s {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 25 15:54:44 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-524599cd-79a7-4849-9f63-6437f38e8716 tempest-GroupSnapshotsTest-1779717395 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-6ce1a7f0-81df-4e65-80ef-dad229989302,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-6ce1a7f0-81df-4e65-80ef-dad229989302.a4fc1acd-95e1-4904-9597-9e8fb94a215f 1G {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 25 15:54:44 devstack sudo[86614]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-6ce1a7f0-81df-4e65-80ef-dad229989302,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-6ce1a7f0-81df-4e65-80ef-dad229989302.a4fc1acd-95e1-4904-9597-9e8fb94a215f 1G Feb 25 15:54:44 devstack sudo[86614]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 25 15:54:45 devstack sudo[86581]: pam_unix(sudo:session): session closed for user root Feb 25 15:54:45 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-073d62b9-a3eb-43bd-a08b-22943c2ae7b7 tempest-VolumeSnapshotQuotasNegativeTestJSON-234004389 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-d622f4d8-1c77-4128-b969-950e8eb8636d.711d1dd8-a2c3-4c8a-922f-4573afbfe763" returned: 0 in 0.692s {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 25 15:54:45 devstack cinder-volume[83528]: DEBUG cinder.coordination [None req-073d62b9-a3eb-43bd-a08b-22943c2ae7b7 tempest-VolumeSnapshotQuotasNegativeTestJSON-234004389 None] Lock "cinder-quobyte-711d1dd8-a2c3-4c8a-922f-4573afbfe763" released by "_delete_snapshot" :: held 2.613s {{(pid=83528) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 25 15:54:45 devstack cinder-volume[83528]: DEBUG cinder.coordination [None req-073d62b9-a3eb-43bd-a08b-22943c2ae7b7 tempest-VolumeSnapshotQuotasNegativeTestJSON-234004389 None] Lock "cinder-quobyte-d622f4d8-1c77-4128-b969-950e8eb8636d" released by "delete_snapshot" :: held 2.628s {{(pid=83528) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 25 15:54:45 devstack cinder-volume[83528]: DEBUG cinder.quota [None req-073d62b9-a3eb-43bd-a08b-22943c2ae7b7 tempest-VolumeSnapshotQuotasNegativeTestJSON-234004389 None] Created reservations ['b49b6e4b-4ff9-4b03-9e1b-75fad6f85d81', '33cc9e18-1c2b-4b5d-8c50-6a192470a7a4', '90b24775-2a7b-4e7e-b42d-f0497a7b7def', '17d7049a-96d8-4c6c-b7a0-3517566aac52'] {{(pid=83528) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 25 15:54:45 devstack cinder-volume[83528]: INFO cinder.volume.manager [None req-073d62b9-a3eb-43bd-a08b-22943c2ae7b7 tempest-VolumeSnapshotQuotasNegativeTestJSON-234004389 None] Delete snapshot completed successfully. Feb 25 15:54:45 devstack cinder-volume[83528]: DEBUG cinder.coordination [None req-073d62b9-a3eb-43bd-a08b-22943c2ae7b7 tempest-VolumeSnapshotQuotasNegativeTestJSON-234004389 None] Lock "cinder-711d1dd8-a2c3-4c8a-922f-4573afbfe763-delete_snapshot" released by "delete_snapshot" :: held 2.883s {{(pid=83528) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 25 15:54:45 devstack cinder-volume[83528]: DEBUG cinder.coordination [None req-d97146d4-261f-4f1a-9807-14a1730e8d52 tempest-VolumeSnapshotQuotasNegativeTestJSON-234004389 None] Acquiring lock "cinder-d622f4d8-1c77-4128-b969-950e8eb8636d-delete_volume" by "delete_volume" {{(pid=83528) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 25 15:54:45 devstack cinder-volume[83528]: DEBUG cinder.coordination [None req-d97146d4-261f-4f1a-9807-14a1730e8d52 tempest-VolumeSnapshotQuotasNegativeTestJSON-234004389 None] Lock "cinder-d622f4d8-1c77-4128-b969-950e8eb8636d-delete_volume" acquired by "delete_volume" :: waited 0.014s {{(pid=83528) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 25 15:54:45 devstack cinder-volume[83528]: DEBUG cinder.coordination [None req-d97146d4-261f-4f1a-9807-14a1730e8d52 tempest-VolumeSnapshotQuotasNegativeTestJSON-234004389 None] Acquiring lock "cinder-quobyte-d622f4d8-1c77-4128-b969-950e8eb8636d" by "delete_volume" {{(pid=83528) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 25 15:54:45 devstack cinder-volume[83528]: DEBUG cinder.coordination [None req-d97146d4-261f-4f1a-9807-14a1730e8d52 tempest-VolumeSnapshotQuotasNegativeTestJSON-234004389 None] Lock "cinder-quobyte-d622f4d8-1c77-4128-b969-950e8eb8636d" acquired by "delete_volume" :: waited 0.015s {{(pid=83528) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 25 15:54:45 devstack cinder-volume[83528]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a442d5c-7507-4f55-914e-fa5a62d51f83]: (4, 'qcow2') {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 25 15:54:45 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-d97146d4-261f-4f1a-9807-14a1730e8d52 tempest-VolumeSnapshotQuotasNegativeTestJSON-234004389 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-d622f4d8-1c77-4128-b969-950e8eb8636d {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 25 15:54:45 devstack sudo[86614]: pam_unix(sudo:session): session closed for user root Feb 25 15:54:45 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-524599cd-79a7-4849-9f63-6437f38e8716 tempest-GroupSnapshotsTest-1779717395 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-6ce1a7f0-81df-4e65-80ef-dad229989302,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-6ce1a7f0-81df-4e65-80ef-dad229989302.a4fc1acd-95e1-4904-9597-9e8fb94a215f 1G" returned: 0 in 0.999s {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 25 15:54:45 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-524599cd-79a7-4849-9f63-6437f38e8716 tempest-GroupSnapshotsTest-1779717395 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6ce1a7f0-81df-4e65-80ef-dad229989302 -F qcow2 /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-6ce1a7f0-81df-4e65-80ef-dad229989302.a4fc1acd-95e1-4904-9597-9e8fb94a215f {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 25 15:54:45 devstack sudo[86622]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6ce1a7f0-81df-4e65-80ef-dad229989302 -F qcow2 /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-6ce1a7f0-81df-4e65-80ef-dad229989302.a4fc1acd-95e1-4904-9597-9e8fb94a215f Feb 25 15:54:45 devstack sudo[86622]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 25 15:54:46 devstack sudo[86621]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-d622f4d8-1c77-4128-b969-950e8eb8636d Feb 25 15:54:46 devstack sudo[86621]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 25 15:54:46 devstack sudo[86622]: pam_unix(sudo:session): session closed for user root Feb 25 15:54:46 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-524599cd-79a7-4849-9f63-6437f38e8716 tempest-GroupSnapshotsTest-1779717395 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6ce1a7f0-81df-4e65-80ef-dad229989302 -F qcow2 /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-6ce1a7f0-81df-4e65-80ef-dad229989302.a4fc1acd-95e1-4904-9597-9e8fb94a215f" returned: 0 in 0.547s {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 25 15:54:46 devstack cinder-volume[83528]: WARNING cinder.volume.drivers.remotefs [None req-524599cd-79a7-4849-9f63-6437f38e8716 tempest-GroupSnapshotsTest-1779717395 None] /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-6ce1a7f0-81df-4e65-80ef-dad229989302.a4fc1acd-95e1-4904-9597-9e8fb94a215f is being set with open permissions: ugo+rw: NotImplementedError Feb 25 15:54:46 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-524599cd-79a7-4849-9f63-6437f38e8716 tempest-GroupSnapshotsTest-1779717395 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-6ce1a7f0-81df-4e65-80ef-dad229989302.a4fc1acd-95e1-4904-9597-9e8fb94a215f {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 25 15:54:46 devstack sudo[86630]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-6ce1a7f0-81df-4e65-80ef-dad229989302.a4fc1acd-95e1-4904-9597-9e8fb94a215f Feb 25 15:54:46 devstack sudo[86630]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 25 15:54:46 devstack sudo[86621]: pam_unix(sudo:session): session closed for user root Feb 25 15:54:46 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-d97146d4-261f-4f1a-9807-14a1730e8d52 tempest-VolumeSnapshotQuotasNegativeTestJSON-234004389 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-d622f4d8-1c77-4128-b969-950e8eb8636d" returned: 0 in 0.677s {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 25 15:54:46 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-d97146d4-261f-4f1a-9807-14a1730e8d52 tempest-VolumeSnapshotQuotasNegativeTestJSON-234004389 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-d622f4d8-1c77-4128-b969-950e8eb8636d {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 25 15:54:46 devstack sudo[86633]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-d622f4d8-1c77-4128-b969-950e8eb8636d Feb 25 15:54:46 devstack sudo[86633]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 25 15:54:47 devstack sudo[86630]: pam_unix(sudo:session): session closed for user root Feb 25 15:54:47 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-524599cd-79a7-4849-9f63-6437f38e8716 tempest-GroupSnapshotsTest-1779717395 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-6ce1a7f0-81df-4e65-80ef-dad229989302.a4fc1acd-95e1-4904-9597-9e8fb94a215f" returned: 0 in 0.619s {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 25 15:54:47 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-524599cd-79a7-4849-9f63-6437f38e8716 tempest-GroupSnapshotsTest-1779717395 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-6ce1a7f0-81df-4e65-80ef-dad229989302.info {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 25 15:54:47 devstack sudo[86637]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-6ce1a7f0-81df-4e65-80ef-dad229989302.info Feb 25 15:54:47 devstack sudo[86637]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 25 15:54:47 devstack sudo[86633]: pam_unix(sudo:session): session closed for user root Feb 25 15:54:47 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-d97146d4-261f-4f1a-9807-14a1730e8d52 tempest-VolumeSnapshotQuotasNegativeTestJSON-234004389 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-d622f4d8-1c77-4128-b969-950e8eb8636d" returned: 0 in 0.734s {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 25 15:54:47 devstack cinder-volume[83528]: DEBUG cinder.coordination [None req-d97146d4-261f-4f1a-9807-14a1730e8d52 tempest-VolumeSnapshotQuotasNegativeTestJSON-234004389 None] Lock "cinder-quobyte-d622f4d8-1c77-4128-b969-950e8eb8636d" released by "delete_volume" :: held 1.481s {{(pid=83528) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 25 15:54:47 devstack cinder-volume[83528]: DEBUG cinder.quota [None req-d97146d4-261f-4f1a-9807-14a1730e8d52 tempest-VolumeSnapshotQuotasNegativeTestJSON-234004389 None] Created reservations ['e6645568-82e3-4369-b585-0545d4a229e2', '38538b4b-0d63-4c9c-b269-651acced781b', '4a0f5a3f-49b7-441b-bdd4-18f8912f5aaa', '2be71446-f169-4af4-9277-275256a6f878'] {{(pid=83528) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 25 15:54:47 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-d97146d4-261f-4f1a-9807-14a1730e8d52 tempest-VolumeSnapshotQuotasNegativeTestJSON-234004389 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 25 15:54:47 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-d97146d4-261f-4f1a-9807-14a1730e8d52 tempest-VolumeSnapshotQuotasNegativeTestJSON-234004389 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 25 15:54:47 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.quobyte [None req-d97146d4-261f-4f1a-9807-14a1730e8d52 tempest-VolumeSnapshotQuotasNegativeTestJSON-234004389 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23e9d725-3e04-4cd9-bfe0-c8ef43305589': None} {{(pid=83528) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 25 15:54:47 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.quobyte [None req-d97146d4-261f-4f1a-9807-14a1730e8d52 tempest-VolumeSnapshotQuotasNegativeTestJSON-234004389 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23e9d725-3e04-4cd9-bfe0-c8ef43305589'] {{(pid=83528) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 25 15:54:47 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-d97146d4-261f-4f1a-9807-14a1730e8d52 tempest-VolumeSnapshotQuotasNegativeTestJSON-234004389 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 25 15:54:47 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-d97146d4-261f-4f1a-9807-14a1730e8d52 tempest-VolumeSnapshotQuotasNegativeTestJSON-234004389 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85 {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 25 15:54:47 devstack sudo[86640]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85 Feb 25 15:54:47 devstack sudo[86640]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 25 15:54:47 devstack sudo[86637]: pam_unix(sudo:session): session closed for user root Feb 25 15:54:47 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-524599cd-79a7-4849-9f63-6437f38e8716 tempest-GroupSnapshotsTest-1779717395 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-6ce1a7f0-81df-4e65-80ef-dad229989302.info" returned: 0 in 0.707s {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 25 15:54:47 devstack cinder-volume[83528]: WARNING cinder.volume.drivers.remotefs [None req-524599cd-79a7-4849-9f63-6437f38e8716 tempest-GroupSnapshotsTest-1779717395 None] /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-6ce1a7f0-81df-4e65-80ef-dad229989302.info is being set with open permissions: ugo+rw: NotImplementedError Feb 25 15:54:47 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-524599cd-79a7-4849-9f63-6437f38e8716 tempest-GroupSnapshotsTest-1779717395 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-6ce1a7f0-81df-4e65-80ef-dad229989302.info {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 25 15:54:47 devstack sudo[86643]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-6ce1a7f0-81df-4e65-80ef-dad229989302.info Feb 25 15:54:47 devstack sudo[86643]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 25 15:54:48 devstack sudo[86640]: pam_unix(sudo:session): session closed for user root Feb 25 15:54:48 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-d97146d4-261f-4f1a-9807-14a1730e8d52 tempest-VolumeSnapshotQuotasNegativeTestJSON-234004389 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85" returned: 0 in 0.661s {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 25 15:54:48 devstack cinder-volume[83528]: DEBUG cinder.manager [None req-d97146d4-261f-4f1a-9807-14a1730e8d52 tempest-VolumeSnapshotQuotasNegativeTestJSON-234004389 None] Notifying Schedulers of capabilities ... {{(pid=83528) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 25 15:54:48 devstack cinder-volume[83528]: INFO cinder.volume.manager [None req-d97146d4-261f-4f1a-9807-14a1730e8d52 tempest-VolumeSnapshotQuotasNegativeTestJSON-234004389 None] Deleted volume successfully. Feb 25 15:54:48 devstack cinder-volume[83528]: DEBUG cinder.coordination [None req-d97146d4-261f-4f1a-9807-14a1730e8d52 tempest-VolumeSnapshotQuotasNegativeTestJSON-234004389 None] Lock "cinder-d622f4d8-1c77-4128-b969-950e8eb8636d-delete_volume" released by "delete_volume" :: held 2.479s {{(pid=83528) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 25 15:54:48 devstack sudo[86643]: pam_unix(sudo:session): session closed for user root Feb 25 15:54:48 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-524599cd-79a7-4849-9f63-6437f38e8716 tempest-GroupSnapshotsTest-1779717395 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-6ce1a7f0-81df-4e65-80ef-dad229989302.info" returned: 0 in 0.657s {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 25 15:54:48 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-524599cd-79a7-4849-9f63-6437f38e8716 tempest-GroupSnapshotsTest-1779717395 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.460s {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 25 15:54:48 devstack cinder-volume[83528]: INFO cinder.volume.manager [None req-524599cd-79a7-4849-9f63-6437f38e8716 tempest-GroupSnapshotsTest-1779717395 None] group_snapshot 9d5a0ae5-bbe9-4b90-a912-f632805465b4: created successfully Feb 25 15:54:49 devstack cinder-volume[83528]: INFO cinder.volume.manager [None req-30ee93e3-0eb9-49ec-8b08-31deb721c1c2 tempest-GroupSnapshotsTest-1779717395 None] group_snapshot 9d5a0ae5-bbe9-4b90-a912-f632805465b4: deleting Feb 25 15:54:49 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-30ee93e3-0eb9-49ec-8b08-31deb721c1c2 tempest-GroupSnapshotsTest-1779717395 None] group_snapshot 9d5a0ae5-bbe9-4b90-a912-f632805465b4: deleting {{(pid=83528) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Feb 25 15:54:49 devstack cinder-volume[83528]: DEBUG cinder.coordination [None req-30ee93e3-0eb9-49ec-8b08-31deb721c1c2 tempest-GroupSnapshotsTest-1779717395 None] Acquiring lock "cinder-quobyte-6ce1a7f0-81df-4e65-80ef-dad229989302" by "delete_snapshot" {{(pid=83528) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 25 15:54:49 devstack cinder-volume[83528]: DEBUG cinder.coordination [None req-30ee93e3-0eb9-49ec-8b08-31deb721c1c2 tempest-GroupSnapshotsTest-1779717395 None] Lock "cinder-quobyte-6ce1a7f0-81df-4e65-80ef-dad229989302" acquired by "delete_snapshot" :: waited 0.013s {{(pid=83528) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 25 15:54:49 devstack cinder-volume[83528]: DEBUG cinder.coordination [None req-30ee93e3-0eb9-49ec-8b08-31deb721c1c2 tempest-GroupSnapshotsTest-1779717395 None] Acquiring lock "cinder-quobyte-a4fc1acd-95e1-4904-9597-9e8fb94a215f" by "_delete_snapshot" {{(pid=83528) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 25 15:54:49 devstack cinder-volume[83528]: DEBUG cinder.coordination [None req-30ee93e3-0eb9-49ec-8b08-31deb721c1c2 tempest-GroupSnapshotsTest-1779717395 None] Lock "cinder-quobyte-a4fc1acd-95e1-4904-9597-9e8fb94a215f" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=83528) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 25 15:54:49 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.remotefs [None req-30ee93e3-0eb9-49ec-8b08-31deb721c1c2 tempest-GroupSnapshotsTest-1779717395 None] Deleting offline snapshot a4fc1acd-95e1-4904-9597-9e8fb94a215f of volume 6ce1a7f0-81df-4e65-80ef-dad229989302 {{(pid=83528) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Feb 25 15:54:49 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.remotefs [None req-30ee93e3-0eb9-49ec-8b08-31deb721c1c2 tempest-GroupSnapshotsTest-1779717395 None] snapshot_file for this snap is: volume-6ce1a7f0-81df-4e65-80ef-dad229989302.a4fc1acd-95e1-4904-9597-9e8fb94a215f {{(pid=83528) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Feb 25 15:54:49 devstack cinder-volume[83528]: DEBUG oslo.privsep.daemon [-] privsep: reply[0362b2b9-fda3-483f-868a-70ed96ddfc57]: (4, 'qcow2') {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 25 15:54:49 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-30ee93e3-0eb9-49ec-8b08-31deb721c1c2 tempest-GroupSnapshotsTest-1779717395 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-6ce1a7f0-81df-4e65-80ef-dad229989302.a4fc1acd-95e1-4904-9597-9e8fb94a215f {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 25 15:54:49 devstack sudo[86647]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-6ce1a7f0-81df-4e65-80ef-dad229989302.a4fc1acd-95e1-4904-9597-9e8fb94a215f Feb 25 15:54:49 devstack sudo[86647]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 25 15:54:50 devstack sudo[86647]: pam_unix(sudo:session): session closed for user root Feb 25 15:54:50 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-30ee93e3-0eb9-49ec-8b08-31deb721c1c2 tempest-GroupSnapshotsTest-1779717395 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-6ce1a7f0-81df-4e65-80ef-dad229989302.a4fc1acd-95e1-4904-9597-9e8fb94a215f" returned: 0 in 0.751s {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 25 15:54:50 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.remotefs [None req-30ee93e3-0eb9-49ec-8b08-31deb721c1c2 tempest-GroupSnapshotsTest-1779717395 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6ce1a7f0-81df-4e65-80ef-dad229989302(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83528) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Feb 25 15:54:50 devstack cinder-volume[83528]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b3394dc-4311-42c8-af31-4cbaecfb6cdf]: (4, 'qcow2') {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 25 15:54:50 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-30ee93e3-0eb9-49ec-8b08-31deb721c1c2 tempest-GroupSnapshotsTest-1779717395 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-6ce1a7f0-81df-4e65-80ef-dad229989302 {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 25 15:54:50 devstack sudo[86678]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-6ce1a7f0-81df-4e65-80ef-dad229989302 Feb 25 15:54:50 devstack sudo[86678]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 25 15:54:51 devstack sudo[86678]: pam_unix(sudo:session): session closed for user root Feb 25 15:54:51 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-30ee93e3-0eb9-49ec-8b08-31deb721c1c2 tempest-GroupSnapshotsTest-1779717395 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-6ce1a7f0-81df-4e65-80ef-dad229989302" returned: 0 in 0.900s {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 25 15:54:51 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-30ee93e3-0eb9-49ec-8b08-31deb721c1c2 tempest-GroupSnapshotsTest-1779717395 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-6ce1a7f0-81df-4e65-80ef-dad229989302.a4fc1acd-95e1-4904-9597-9e8fb94a215f {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 25 15:54:51 devstack sudo[86706]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-6ce1a7f0-81df-4e65-80ef-dad229989302.a4fc1acd-95e1-4904-9597-9e8fb94a215f Feb 25 15:54:51 devstack sudo[86706]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 25 15:54:52 devstack sudo[86706]: pam_unix(sudo:session): session closed for user root Feb 25 15:54:52 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-30ee93e3-0eb9-49ec-8b08-31deb721c1c2 tempest-GroupSnapshotsTest-1779717395 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-6ce1a7f0-81df-4e65-80ef-dad229989302.a4fc1acd-95e1-4904-9597-9e8fb94a215f" returned: 0 in 1.008s {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 25 15:54:52 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-30ee93e3-0eb9-49ec-8b08-31deb721c1c2 tempest-GroupSnapshotsTest-1779717395 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-6ce1a7f0-81df-4e65-80ef-dad229989302.a4fc1acd-95e1-4904-9597-9e8fb94a215f {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 25 15:54:52 devstack sudo[86712]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-6ce1a7f0-81df-4e65-80ef-dad229989302.a4fc1acd-95e1-4904-9597-9e8fb94a215f Feb 25 15:54:52 devstack sudo[86712]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 25 15:54:53 devstack sudo[86712]: pam_unix(sudo:session): session closed for user root Feb 25 15:54:53 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-30ee93e3-0eb9-49ec-8b08-31deb721c1c2 tempest-GroupSnapshotsTest-1779717395 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-6ce1a7f0-81df-4e65-80ef-dad229989302.a4fc1acd-95e1-4904-9597-9e8fb94a215f" returned: 0 in 0.700s {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 25 15:54:53 devstack cinder-volume[83528]: DEBUG cinder.coordination [None req-30ee93e3-0eb9-49ec-8b08-31deb721c1c2 tempest-GroupSnapshotsTest-1779717395 None] Lock "cinder-quobyte-a4fc1acd-95e1-4904-9597-9e8fb94a215f" released by "_delete_snapshot" :: held 3.558s {{(pid=83528) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 25 15:54:53 devstack cinder-volume[83528]: DEBUG cinder.coordination [None req-30ee93e3-0eb9-49ec-8b08-31deb721c1c2 tempest-GroupSnapshotsTest-1779717395 None] Lock "cinder-quobyte-6ce1a7f0-81df-4e65-80ef-dad229989302" released by "delete_snapshot" :: held 3.586s {{(pid=83528) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 25 15:54:53 devstack cinder-volume[83528]: WARNING cinder.quota [None req-30ee93e3-0eb9-49ec-8b08-31deb721c1c2 tempest-GroupSnapshotsTest-1779717395 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-163114378 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-163114378, it is now deprecated. Please use the default quota class for default quota. Feb 25 15:54:53 devstack cinder-volume[83528]: WARNING cinder.quota [None req-30ee93e3-0eb9-49ec-8b08-31deb721c1c2 tempest-GroupSnapshotsTest-1779717395 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-163114378 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-163114378, it is now deprecated. Please use the default quota class for default quota. Feb 25 15:54:53 devstack cinder-volume[83528]: DEBUG cinder.quota [None req-30ee93e3-0eb9-49ec-8b08-31deb721c1c2 tempest-GroupSnapshotsTest-1779717395 None] Created reservations ['1e9193de-e6d2-4395-ad23-6e31a74c5e75', '2c14813f-768f-49a6-9886-7b138a05dea5', 'ad97f80d-f979-4390-b04b-e0ebf7fc1e39', 'd49ef082-a792-44ea-894b-5ad2a3c61151'] {{(pid=83528) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 25 15:54:53 devstack cinder-volume[83528]: INFO cinder.volume.manager [None req-30ee93e3-0eb9-49ec-8b08-31deb721c1c2 tempest-GroupSnapshotsTest-1779717395 None] group_snapshot 9d5a0ae5-bbe9-4b90-a912-f632805465b4: deleted successfully Feb 25 15:54:54 devstack cinder-volume[83528]: DEBUG cinder.coordination [None req-752424b3-9df4-4779-9477-613d4f958457 tempest-GroupSnapshotsTest-1779717395 None] Acquiring lock "cinder-quobyte-6ce1a7f0-81df-4e65-80ef-dad229989302" by "delete_volume" {{(pid=83528) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 25 15:54:54 devstack cinder-volume[83528]: DEBUG cinder.coordination [None req-752424b3-9df4-4779-9477-613d4f958457 tempest-GroupSnapshotsTest-1779717395 None] Lock "cinder-quobyte-6ce1a7f0-81df-4e65-80ef-dad229989302" acquired by "delete_volume" :: waited 0.008s {{(pid=83528) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 25 15:54:54 devstack cinder-volume[83528]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6a006fa-c499-464b-8d49-ac309e05fe8a]: (4, 'qcow2') {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 25 15:54:54 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-752424b3-9df4-4779-9477-613d4f958457 tempest-GroupSnapshotsTest-1779717395 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-6ce1a7f0-81df-4e65-80ef-dad229989302 {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 25 15:54:54 devstack sudo[86738]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-6ce1a7f0-81df-4e65-80ef-dad229989302 Feb 25 15:54:54 devstack sudo[86738]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 25 15:54:54 devstack sudo[86738]: pam_unix(sudo:session): session closed for user root Feb 25 15:54:54 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-752424b3-9df4-4779-9477-613d4f958457 tempest-GroupSnapshotsTest-1779717395 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-6ce1a7f0-81df-4e65-80ef-dad229989302" returned: 0 in 0.646s {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 25 15:54:54 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-752424b3-9df4-4779-9477-613d4f958457 tempest-GroupSnapshotsTest-1779717395 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-6ce1a7f0-81df-4e65-80ef-dad229989302 {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 25 15:54:54 devstack sudo[86745]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-6ce1a7f0-81df-4e65-80ef-dad229989302 Feb 25 15:54:54 devstack sudo[86745]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 25 15:54:55 devstack sudo[86745]: pam_unix(sudo:session): session closed for user root Feb 25 15:54:55 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-752424b3-9df4-4779-9477-613d4f958457 tempest-GroupSnapshotsTest-1779717395 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-6ce1a7f0-81df-4e65-80ef-dad229989302" returned: 0 in 0.532s {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 25 15:54:55 devstack cinder-volume[83528]: DEBUG cinder.coordination [None req-752424b3-9df4-4779-9477-613d4f958457 tempest-GroupSnapshotsTest-1779717395 None] Lock "cinder-quobyte-6ce1a7f0-81df-4e65-80ef-dad229989302" released by "delete_volume" :: held 1.247s {{(pid=83528) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 25 15:54:55 devstack cinder-volume[83528]: DEBUG cinder.quota [None req-752424b3-9df4-4779-9477-613d4f958457 tempest-GroupSnapshotsTest-1779717395 None] Created reservations ['1dccd6d7-f942-412e-88c0-6743a6efee41'] {{(pid=83528) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 25 15:54:55 devstack cinder-volume[83528]: WARNING cinder.quota [None req-752424b3-9df4-4779-9477-613d4f958457 tempest-GroupSnapshotsTest-1779717395 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-163114378 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-163114378, it is now deprecated. Please use the default quota class for default quota. Feb 25 15:54:55 devstack cinder-volume[83528]: DEBUG cinder.quota [None req-752424b3-9df4-4779-9477-613d4f958457 tempest-GroupSnapshotsTest-1779717395 None] Created reservations ['d52ef8cd-cb77-4625-ba76-b07d22b2e1b7', '33381622-9794-4cd6-a3cb-5014b76fd478', 'cea09509-a1c4-433c-a0dd-e8719e2b24a3', '0a9278f0-43ea-48bb-914a-bfb0bbbec901'] {{(pid=83528) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 25 15:54:55 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-752424b3-9df4-4779-9477-613d4f958457 tempest-GroupSnapshotsTest-1779717395 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 25 15:54:55 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-752424b3-9df4-4779-9477-613d4f958457 tempest-GroupSnapshotsTest-1779717395 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 25 15:54:55 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.quobyte [None req-752424b3-9df4-4779-9477-613d4f958457 tempest-GroupSnapshotsTest-1779717395 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23e9d725-3e04-4cd9-bfe0-c8ef43305589': None} {{(pid=83528) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 25 15:54:55 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.quobyte [None req-752424b3-9df4-4779-9477-613d4f958457 tempest-GroupSnapshotsTest-1779717395 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23e9d725-3e04-4cd9-bfe0-c8ef43305589'] {{(pid=83528) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 25 15:54:55 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-752424b3-9df4-4779-9477-613d4f958457 tempest-GroupSnapshotsTest-1779717395 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 25 15:54:55 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-752424b3-9df4-4779-9477-613d4f958457 tempest-GroupSnapshotsTest-1779717395 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85 {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 25 15:54:55 devstack sudo[86749]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85 Feb 25 15:54:55 devstack sudo[86749]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 25 15:54:56 devstack sudo[86749]: pam_unix(sudo:session): session closed for user root Feb 25 15:54:56 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-752424b3-9df4-4779-9477-613d4f958457 tempest-GroupSnapshotsTest-1779717395 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85" returned: 0 in 0.516s {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 25 15:54:56 devstack cinder-volume[83528]: DEBUG cinder.manager [None req-752424b3-9df4-4779-9477-613d4f958457 tempest-GroupSnapshotsTest-1779717395 None] Notifying Schedulers of capabilities ... {{(pid=83528) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 25 15:54:56 devstack cinder-volume[83528]: INFO cinder.volume.manager [None req-752424b3-9df4-4779-9477-613d4f958457 tempest-GroupSnapshotsTest-1779717395 None] Delete group completed successfully. Feb 25 15:54:56 devstack cinder-volume[83528]: INFO cinder.volume.manager [req-86597060-e3b2-4aa0-b515-ae1b5647444e req-b1d021e6-1ea4-4d60-bea9-f5bb3b8ef6d1 tempest-ServerBootFromVolumeStableRescueTest-939682044 None] Terminate volume connection completed successfully. Feb 25 15:54:56 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [req-86597060-e3b2-4aa0-b515-ae1b5647444e req-b1d021e6-1ea4-4d60-bea9-f5bb3b8ef6d1 tempest-ServerBootFromVolumeStableRescueTest-939682044 None] Deleting attachment 0148ab8e-7052-46da-961d-2f24789d9e97. {{(pid=83528) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Feb 25 15:54:57 devstack cinder-volume[83528]: DEBUG cinder.coordination [req-86597060-e3b2-4aa0-b515-ae1b5647444e req-20cb6686-317b-4431-938e-37742c73e98d tempest-ServerBootFromVolumeStableRescueTest-939682044 None] Acquiring lock "cinder-bd62c213-e65c-4ced-a207-704de8f3bc88-delete_volume" by "delete_volume" {{(pid=83528) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 25 15:54:57 devstack cinder-volume[83528]: DEBUG cinder.coordination [req-86597060-e3b2-4aa0-b515-ae1b5647444e req-20cb6686-317b-4431-938e-37742c73e98d tempest-ServerBootFromVolumeStableRescueTest-939682044 None] Lock "cinder-bd62c213-e65c-4ced-a207-704de8f3bc88-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=83528) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 25 15:54:57 devstack cinder-volume[83528]: DEBUG cinder.coordination [req-86597060-e3b2-4aa0-b515-ae1b5647444e req-20cb6686-317b-4431-938e-37742c73e98d tempest-ServerBootFromVolumeStableRescueTest-939682044 None] Acquiring lock "cinder-quobyte-bd62c213-e65c-4ced-a207-704de8f3bc88" by "delete_volume" {{(pid=83528) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 25 15:54:57 devstack cinder-volume[83528]: DEBUG cinder.coordination [req-86597060-e3b2-4aa0-b515-ae1b5647444e req-20cb6686-317b-4431-938e-37742c73e98d tempest-ServerBootFromVolumeStableRescueTest-939682044 None] Lock "cinder-quobyte-bd62c213-e65c-4ced-a207-704de8f3bc88" acquired by "delete_volume" :: waited 0.010s {{(pid=83528) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 25 15:54:57 devstack cinder-volume[83528]: DEBUG oslo.privsep.daemon [-] privsep: reply[bedc9a23-cf69-4da3-9c82-88100c83c4d8]: (4, 'raw') {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 25 15:54:57 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [req-86597060-e3b2-4aa0-b515-ae1b5647444e req-20cb6686-317b-4431-938e-37742c73e98d tempest-ServerBootFromVolumeStableRescueTest-939682044 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-bd62c213-e65c-4ced-a207-704de8f3bc88 {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 25 15:54:57 devstack sudo[86753]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-bd62c213-e65c-4ced-a207-704de8f3bc88 Feb 25 15:54:57 devstack sudo[86753]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 25 15:54:58 devstack sudo[86753]: pam_unix(sudo:session): session closed for user root Feb 25 15:54:58 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [req-86597060-e3b2-4aa0-b515-ae1b5647444e req-20cb6686-317b-4431-938e-37742c73e98d tempest-ServerBootFromVolumeStableRescueTest-939682044 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-bd62c213-e65c-4ced-a207-704de8f3bc88" returned: 0 in 0.760s {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 25 15:54:58 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [req-86597060-e3b2-4aa0-b515-ae1b5647444e req-20cb6686-317b-4431-938e-37742c73e98d tempest-ServerBootFromVolumeStableRescueTest-939682044 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-bd62c213-e65c-4ced-a207-704de8f3bc88 {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 25 15:54:58 devstack sudo[86757]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-bd62c213-e65c-4ced-a207-704de8f3bc88 Feb 25 15:54:58 devstack sudo[86757]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 25 15:54:58 devstack sudo[86757]: pam_unix(sudo:session): session closed for user root Feb 25 15:54:58 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [req-86597060-e3b2-4aa0-b515-ae1b5647444e req-20cb6686-317b-4431-938e-37742c73e98d tempest-ServerBootFromVolumeStableRescueTest-939682044 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-bd62c213-e65c-4ced-a207-704de8f3bc88" returned: 1 in 0.692s {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 25 15:54:58 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [req-86597060-e3b2-4aa0-b515-ae1b5647444e req-20cb6686-317b-4431-938e-37742c73e98d tempest-ServerBootFromVolumeStableRescueTest-939682044 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-bd62c213-e65c-4ced-a207-704de8f3bc88' failed. Not Retrying. {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Feb 25 15:54:58 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [req-86597060-e3b2-4aa0-b515-ae1b5647444e req-20cb6686-317b-4431-938e-37742c73e98d tempest-ServerBootFromVolumeStableRescueTest-939682044 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-bd62c213-e65c-4ced-a207-704de8f3bc88 {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 25 15:54:58 devstack sudo[86762]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-bd62c213-e65c-4ced-a207-704de8f3bc88 Feb 25 15:54:58 devstack sudo[86762]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 25 15:54:59 devstack sudo[86762]: pam_unix(sudo:session): session closed for user root Feb 25 15:54:59 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [req-86597060-e3b2-4aa0-b515-ae1b5647444e req-20cb6686-317b-4431-938e-37742c73e98d tempest-ServerBootFromVolumeStableRescueTest-939682044 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-bd62c213-e65c-4ced-a207-704de8f3bc88" returned: 0 in 0.636s {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 25 15:54:59 devstack cinder-volume[83528]: DEBUG cinder.coordination [req-86597060-e3b2-4aa0-b515-ae1b5647444e req-20cb6686-317b-4431-938e-37742c73e98d tempest-ServerBootFromVolumeStableRescueTest-939682044 None] Lock "cinder-quobyte-bd62c213-e65c-4ced-a207-704de8f3bc88" released by "delete_volume" :: held 2.140s {{(pid=83528) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 25 15:54:59 devstack cinder-volume[83528]: DEBUG cinder.quota [req-86597060-e3b2-4aa0-b515-ae1b5647444e req-20cb6686-317b-4431-938e-37742c73e98d tempest-ServerBootFromVolumeStableRescueTest-939682044 None] Created reservations ['611484df-0e49-424f-9ee0-c665c4c48a03', 'c82505fc-d3d5-47fc-885f-4f189f69873f', '2355215b-31af-4bc0-8438-469c158e8b52', '6774af1c-b7e9-490b-8aa7-7eee20a23d14'] {{(pid=83528) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 25 15:54:59 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [req-86597060-e3b2-4aa0-b515-ae1b5647444e req-20cb6686-317b-4431-938e-37742c73e98d tempest-ServerBootFromVolumeStableRescueTest-939682044 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 25 15:54:59 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [req-86597060-e3b2-4aa0-b515-ae1b5647444e req-20cb6686-317b-4431-938e-37742c73e98d tempest-ServerBootFromVolumeStableRescueTest-939682044 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 25 15:54:59 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.quobyte [req-86597060-e3b2-4aa0-b515-ae1b5647444e req-20cb6686-317b-4431-938e-37742c73e98d tempest-ServerBootFromVolumeStableRescueTest-939682044 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23e9d725-3e04-4cd9-bfe0-c8ef43305589': None} {{(pid=83528) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 25 15:54:59 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.quobyte [req-86597060-e3b2-4aa0-b515-ae1b5647444e req-20cb6686-317b-4431-938e-37742c73e98d tempest-ServerBootFromVolumeStableRescueTest-939682044 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23e9d725-3e04-4cd9-bfe0-c8ef43305589'] {{(pid=83528) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 25 15:54:59 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [req-86597060-e3b2-4aa0-b515-ae1b5647444e req-20cb6686-317b-4431-938e-37742c73e98d tempest-ServerBootFromVolumeStableRescueTest-939682044 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 25 15:54:59 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [req-86597060-e3b2-4aa0-b515-ae1b5647444e req-20cb6686-317b-4431-938e-37742c73e98d tempest-ServerBootFromVolumeStableRescueTest-939682044 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85 {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 25 15:54:59 devstack sudo[86765]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85 Feb 25 15:54:59 devstack sudo[86765]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 25 15:55:00 devstack sudo[86765]: pam_unix(sudo:session): session closed for user root Feb 25 15:55:00 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [req-86597060-e3b2-4aa0-b515-ae1b5647444e req-20cb6686-317b-4431-938e-37742c73e98d tempest-ServerBootFromVolumeStableRescueTest-939682044 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85" returned: 0 in 0.616s {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 25 15:55:00 devstack cinder-volume[83528]: DEBUG cinder.manager [req-86597060-e3b2-4aa0-b515-ae1b5647444e req-20cb6686-317b-4431-938e-37742c73e98d tempest-ServerBootFromVolumeStableRescueTest-939682044 None] Notifying Schedulers of capabilities ... {{(pid=83528) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 25 15:55:00 devstack cinder-volume[83528]: INFO cinder.volume.manager [req-86597060-e3b2-4aa0-b515-ae1b5647444e req-20cb6686-317b-4431-938e-37742c73e98d tempest-ServerBootFromVolumeStableRescueTest-939682044 None] Deleted volume successfully. Feb 25 15:55:00 devstack cinder-volume[83528]: DEBUG cinder.coordination [req-86597060-e3b2-4aa0-b515-ae1b5647444e req-20cb6686-317b-4431-938e-37742c73e98d tempest-ServerBootFromVolumeStableRescueTest-939682044 None] Lock "cinder-bd62c213-e65c-4ced-a207-704de8f3bc88-delete_volume" released by "delete_volume" :: held 2.953s {{(pid=83528) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 25 15:55:03 devstack cinder-volume[83528]: DEBUG cinder.volume.flows.manager.create_volume [None req-633a94ca-4239-4ef7-a141-a340fae0c5bd tempest-VolumeQuotasNegativeTestJSON-1783137641 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83528) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 25 15:55:03 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-633a94ca-4239-4ef7-a141-a340fae0c5bd tempest-VolumeQuotasNegativeTestJSON-1783137641 None] Flow 'volume_create_manager' (008efeac-b0ad-4def-b8f3-8bcddc3fbc34) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83528) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 25 15:55:03 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-633a94ca-4239-4ef7-a141-a340fae0c5bd tempest-VolumeQuotasNegativeTestJSON-1783137641 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (72e1a553-b3ba-4f2e-a4e4-46c3d1ce336c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 25 15:55:03 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-633a94ca-4239-4ef7-a141-a340fae0c5bd tempest-VolumeQuotasNegativeTestJSON-1783137641 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (72e1a553-b3ba-4f2e-a4e4-46c3d1ce336c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-25T14:55:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-1267946809',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=149ac5d6-c715-4d6e-a5ab-1d20131066cd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='674dcf5d7ee7476b97037ea75200672d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-25T14:55:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-25T14:55:03Z,use_quota=True,user_id='b67f6e116cb946269da67c1777384000',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ce71c2f9-6543-4165-9653-a1529b2ea243),volume_type_id=ce71c2f9-6543-4165-9653-a1529b2ea243)' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 25 15:55:03 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-633a94ca-4239-4ef7-a141-a340fae0c5bd tempest-VolumeQuotasNegativeTestJSON-1783137641 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (544fe577-9eea-41dd-8cb0-30e3eea0858e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 25 15:55:03 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-633a94ca-4239-4ef7-a141-a340fae0c5bd tempest-VolumeQuotasNegativeTestJSON-1783137641 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (544fe577-9eea-41dd-8cb0-30e3eea0858e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 25 15:55:03 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-633a94ca-4239-4ef7-a141-a340fae0c5bd tempest-VolumeQuotasNegativeTestJSON-1783137641 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e412b4d9-53f2-4680-8a4f-ea11d842f5e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 25 15:55:03 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-633a94ca-4239-4ef7-a141-a340fae0c5bd tempest-VolumeQuotasNegativeTestJSON-1783137641 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e412b4d9-53f2-4680-8a4f-ea11d842f5e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '149ac5d6-c715-4d6e-a5ab-1d20131066cd', 'volume_name': 'volume-149ac5d6-c715-4d6e-a5ab-1d20131066cd', 'volume_size': 1}' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 25 15:55:03 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-633a94ca-4239-4ef7-a141-a340fae0c5bd tempest-VolumeQuotasNegativeTestJSON-1783137641 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (476c2177-54d0-491b-b867-0d995b6c4522) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 25 15:55:03 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-633a94ca-4239-4ef7-a141-a340fae0c5bd tempest-VolumeQuotasNegativeTestJSON-1783137641 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (476c2177-54d0-491b-b867-0d995b6c4522) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 25 15:55:03 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-633a94ca-4239-4ef7-a141-a340fae0c5bd tempest-VolumeQuotasNegativeTestJSON-1783137641 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cf53c7b0-94ca-43f0-aa5e-02765c981b79) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 25 15:55:03 devstack cinder-volume[83528]: INFO cinder.volume.flows.manager.create_volume [None req-633a94ca-4239-4ef7-a141-a340fae0c5bd tempest-VolumeQuotasNegativeTestJSON-1783137641 None] Volume 149ac5d6-c715-4d6e-a5ab-1d20131066cd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-149ac5d6-c715-4d6e-a5ab-1d20131066cd', 'volume_size': 1} Feb 25 15:55:03 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-633a94ca-4239-4ef7-a141-a340fae0c5bd tempest-VolumeQuotasNegativeTestJSON-1783137641 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 25 15:55:03 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-633a94ca-4239-4ef7-a141-a340fae0c5bd tempest-VolumeQuotasNegativeTestJSON-1783137641 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 25 15:55:03 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.quobyte [None req-633a94ca-4239-4ef7-a141-a340fae0c5bd tempest-VolumeQuotasNegativeTestJSON-1783137641 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-25T14:55:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-1267946809',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=149ac5d6-c715-4d6e-a5ab-1d20131066cd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='674dcf5d7ee7476b97037ea75200672d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-25T14:55:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-25T14:55:03Z,use_quota=True,user_id='b67f6e116cb946269da67c1777384000',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ce71c2f9-6543-4165-9653-a1529b2ea243),volume_type_id=ce71c2f9-6543-4165-9653-a1529b2ea243)}" {{(pid=83528) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 25 15:55:03 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.remotefs [None req-633a94ca-4239-4ef7-a141-a340fae0c5bd tempest-VolumeQuotasNegativeTestJSON-1783137641 None] Creating volume 149ac5d6-c715-4d6e-a5ab-1d20131066cd {{(pid=83528) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 25 15:55:03 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-633a94ca-4239-4ef7-a141-a340fae0c5bd tempest-VolumeQuotasNegativeTestJSON-1783137641 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 25 15:55:03 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-633a94ca-4239-4ef7-a141-a340fae0c5bd tempest-VolumeQuotasNegativeTestJSON-1783137641 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 25 15:55:03 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.quobyte [None req-633a94ca-4239-4ef7-a141-a340fae0c5bd tempest-VolumeQuotasNegativeTestJSON-1783137641 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23e9d725-3e04-4cd9-bfe0-c8ef43305589': None} {{(pid=83528) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 25 15:55:03 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.quobyte [None req-633a94ca-4239-4ef7-a141-a340fae0c5bd tempest-VolumeQuotasNegativeTestJSON-1783137641 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23e9d725-3e04-4cd9-bfe0-c8ef43305589'] {{(pid=83528) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 25 15:55:03 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-633a94ca-4239-4ef7-a141-a340fae0c5bd tempest-VolumeQuotasNegativeTestJSON-1783137641 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 25 15:55:03 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.quobyte [None req-633a94ca-4239-4ef7-a141-a340fae0c5bd tempest-VolumeQuotasNegativeTestJSON-1783137641 None] Selected osci02.corp.quobyte.com/cinder-vol-23e9d725-3e04-4cd9-bfe0-c8ef43305589 as target Quobyte volume. {{(pid=83528) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 25 15:55:03 devstack cinder-volume[83528]: INFO cinder.volume.drivers.remotefs [None req-633a94ca-4239-4ef7-a141-a340fae0c5bd tempest-VolumeQuotasNegativeTestJSON-1783137641 None] casted to osci02.corp.quobyte.com/cinder-vol-23e9d725-3e04-4cd9-bfe0-c8ef43305589 Feb 25 15:55:03 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-633a94ca-4239-4ef7-a141-a340fae0c5bd tempest-VolumeQuotasNegativeTestJSON-1783137641 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-149ac5d6-c715-4d6e-a5ab-1d20131066cd 1073741824 {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 25 15:55:03 devstack sudo[86938]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-149ac5d6-c715-4d6e-a5ab-1d20131066cd 1073741824 Feb 25 15:55:03 devstack sudo[86938]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 25 15:55:04 devstack sudo[86938]: pam_unix(sudo:session): session closed for user root Feb 25 15:55:04 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-633a94ca-4239-4ef7-a141-a340fae0c5bd tempest-VolumeQuotasNegativeTestJSON-1783137641 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-149ac5d6-c715-4d6e-a5ab-1d20131066cd 1073741824" returned: 0 in 0.776s {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 25 15:55:04 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-633a94ca-4239-4ef7-a141-a340fae0c5bd tempest-VolumeQuotasNegativeTestJSON-1783137641 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-149ac5d6-c715-4d6e-a5ab-1d20131066cd {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 25 15:55:04 devstack sudo[86944]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-149ac5d6-c715-4d6e-a5ab-1d20131066cd Feb 25 15:55:04 devstack sudo[86944]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 25 15:55:04 devstack sudo[86944]: pam_unix(sudo:session): session closed for user root Feb 25 15:55:04 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-633a94ca-4239-4ef7-a141-a340fae0c5bd tempest-VolumeQuotasNegativeTestJSON-1783137641 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-149ac5d6-c715-4d6e-a5ab-1d20131066cd" returned: 0 in 0.491s {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 25 15:55:04 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.quobyte [None req-633a94ca-4239-4ef7-a141-a340fae0c5bd tempest-VolumeQuotasNegativeTestJSON-1783137641 None] <== create_volume: return (1314ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-23e9d725-3e04-4cd9-bfe0-c8ef43305589'} {{(pid=83528) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 25 15:55:04 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-633a94ca-4239-4ef7-a141-a340fae0c5bd tempest-VolumeQuotasNegativeTestJSON-1783137641 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.316s {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 25 15:55:04 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-633a94ca-4239-4ef7-a141-a340fae0c5bd tempest-VolumeQuotasNegativeTestJSON-1783137641 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cf53c7b0-94ca-43f0-aa5e-02765c981b79) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-149ac5d6-c715-4d6e-a5ab-1d20131066cd', 'volume_size': 1}' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 25 15:55:04 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-633a94ca-4239-4ef7-a141-a340fae0c5bd tempest-VolumeQuotasNegativeTestJSON-1783137641 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (80c9caa4-3a80-4a88-a50c-eb0cff041c9e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 25 15:55:04 devstack cinder-volume[83528]: INFO cinder.volume.flows.manager.create_volume [None req-633a94ca-4239-4ef7-a141-a340fae0c5bd tempest-VolumeQuotasNegativeTestJSON-1783137641 None] Volume volume-149ac5d6-c715-4d6e-a5ab-1d20131066cd (149ac5d6-c715-4d6e-a5ab-1d20131066cd): created successfully Feb 25 15:55:04 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-633a94ca-4239-4ef7-a141-a340fae0c5bd tempest-VolumeQuotasNegativeTestJSON-1783137641 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (80c9caa4-3a80-4a88-a50c-eb0cff041c9e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 25 15:55:04 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-633a94ca-4239-4ef7-a141-a340fae0c5bd tempest-VolumeQuotasNegativeTestJSON-1783137641 None] Flow 'volume_create_manager' (008efeac-b0ad-4def-b8f3-8bcddc3fbc34) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83528) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 25 15:55:04 devstack cinder-volume[83528]: INFO cinder.volume.manager [None req-633a94ca-4239-4ef7-a141-a340fae0c5bd tempest-VolumeQuotasNegativeTestJSON-1783137641 None] Created volume successfully. Feb 25 15:55:06 devstack cinder-volume[83528]: DEBUG cinder.coordination [None req-6ae4a9af-44bf-45d7-978f-7fd01dfde020 tempest-VolumeQuotasNegativeTestJSON-1783137641 None] Acquiring lock "cinder-149ac5d6-c715-4d6e-a5ab-1d20131066cd-delete_volume" by "delete_volume" {{(pid=83528) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 25 15:55:06 devstack cinder-volume[83528]: DEBUG cinder.coordination [None req-6ae4a9af-44bf-45d7-978f-7fd01dfde020 tempest-VolumeQuotasNegativeTestJSON-1783137641 None] Lock "cinder-149ac5d6-c715-4d6e-a5ab-1d20131066cd-delete_volume" acquired by "delete_volume" :: waited 0.012s {{(pid=83528) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 25 15:55:06 devstack cinder-volume[83528]: DEBUG cinder.coordination [None req-6ae4a9af-44bf-45d7-978f-7fd01dfde020 tempest-VolumeQuotasNegativeTestJSON-1783137641 None] Acquiring lock "cinder-quobyte-149ac5d6-c715-4d6e-a5ab-1d20131066cd" by "delete_volume" {{(pid=83528) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 25 15:55:06 devstack cinder-volume[83528]: DEBUG cinder.coordination [None req-6ae4a9af-44bf-45d7-978f-7fd01dfde020 tempest-VolumeQuotasNegativeTestJSON-1783137641 None] Lock "cinder-quobyte-149ac5d6-c715-4d6e-a5ab-1d20131066cd" acquired by "delete_volume" :: waited 0.013s {{(pid=83528) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 25 15:55:06 devstack cinder-volume[83528]: DEBUG oslo.privsep.daemon [-] privsep: reply[6abf89d1-787d-4d90-82ae-bdac8c721dd0]: (4, 'qcow2') {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 25 15:55:06 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-6ae4a9af-44bf-45d7-978f-7fd01dfde020 tempest-VolumeQuotasNegativeTestJSON-1783137641 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-149ac5d6-c715-4d6e-a5ab-1d20131066cd {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 25 15:55:06 devstack sudo[86948]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-149ac5d6-c715-4d6e-a5ab-1d20131066cd Feb 25 15:55:06 devstack sudo[86948]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 25 15:55:06 devstack cinder-volume[83528]: DEBUG cinder.volume.flows.manager.create_volume [None req-14b45ef0-e53a-4efc-b68a-3d300458d524 tempest-SnapshotsActionsTest-738507698 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83528) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 25 15:55:06 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-14b45ef0-e53a-4efc-b68a-3d300458d524 tempest-SnapshotsActionsTest-738507698 None] Flow 'volume_create_manager' (7e156fe3-db6d-4172-80aa-f1eca373ab1f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83528) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 25 15:55:06 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-14b45ef0-e53a-4efc-b68a-3d300458d524 tempest-SnapshotsActionsTest-738507698 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (01ffde4c-58bc-4b25-9a28-6ddf19923adb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 25 15:55:06 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-14b45ef0-e53a-4efc-b68a-3d300458d524 tempest-SnapshotsActionsTest-738507698 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (01ffde4c-58bc-4b25-9a28-6ddf19923adb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-25T14:55:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-118506650',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fa2da276-994a-452f-950a-05721f695adb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='262c44f9f3ae49b790d0736800e8c417',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-25T14:55:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-25T14:55:07Z,use_quota=True,user_id='81b519b9b385415ea646bdd9b4204c19',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ce71c2f9-6543-4165-9653-a1529b2ea243),volume_type_id=ce71c2f9-6543-4165-9653-a1529b2ea243)' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 25 15:55:06 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-14b45ef0-e53a-4efc-b68a-3d300458d524 tempest-SnapshotsActionsTest-738507698 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a90ca682-e123-4d24-8c68-d67679d60c37) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 25 15:55:06 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-14b45ef0-e53a-4efc-b68a-3d300458d524 tempest-SnapshotsActionsTest-738507698 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a90ca682-e123-4d24-8c68-d67679d60c37) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 25 15:55:06 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-14b45ef0-e53a-4efc-b68a-3d300458d524 tempest-SnapshotsActionsTest-738507698 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6b260182-f330-4609-b21d-dd3e0e46a579) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 25 15:55:06 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-14b45ef0-e53a-4efc-b68a-3d300458d524 tempest-SnapshotsActionsTest-738507698 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6b260182-f330-4609-b21d-dd3e0e46a579) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fa2da276-994a-452f-950a-05721f695adb', 'volume_name': 'volume-fa2da276-994a-452f-950a-05721f695adb', 'volume_size': 1}' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 25 15:55:06 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-14b45ef0-e53a-4efc-b68a-3d300458d524 tempest-SnapshotsActionsTest-738507698 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e0e841cb-725d-44db-b538-32ccc9434a1f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 25 15:55:06 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-14b45ef0-e53a-4efc-b68a-3d300458d524 tempest-SnapshotsActionsTest-738507698 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e0e841cb-725d-44db-b538-32ccc9434a1f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 25 15:55:06 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-14b45ef0-e53a-4efc-b68a-3d300458d524 tempest-SnapshotsActionsTest-738507698 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e4fd3beb-42d3-42e2-81ec-1a2a49314ba0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 25 15:55:06 devstack cinder-volume[83528]: INFO cinder.volume.flows.manager.create_volume [None req-14b45ef0-e53a-4efc-b68a-3d300458d524 tempest-SnapshotsActionsTest-738507698 None] Volume fa2da276-994a-452f-950a-05721f695adb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fa2da276-994a-452f-950a-05721f695adb', 'volume_size': 1} Feb 25 15:55:06 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-14b45ef0-e53a-4efc-b68a-3d300458d524 tempest-SnapshotsActionsTest-738507698 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 25 15:55:06 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-14b45ef0-e53a-4efc-b68a-3d300458d524 tempest-SnapshotsActionsTest-738507698 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 25 15:55:06 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.quobyte [None req-14b45ef0-e53a-4efc-b68a-3d300458d524 tempest-SnapshotsActionsTest-738507698 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-25T14:55:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-118506650',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fa2da276-994a-452f-950a-05721f695adb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='262c44f9f3ae49b790d0736800e8c417',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-25T14:55:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-25T14:55:07Z,use_quota=True,user_id='81b519b9b385415ea646bdd9b4204c19',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ce71c2f9-6543-4165-9653-a1529b2ea243),volume_type_id=ce71c2f9-6543-4165-9653-a1529b2ea243)}" {{(pid=83528) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 25 15:55:06 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.remotefs [None req-14b45ef0-e53a-4efc-b68a-3d300458d524 tempest-SnapshotsActionsTest-738507698 None] Creating volume fa2da276-994a-452f-950a-05721f695adb {{(pid=83528) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 25 15:55:06 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-14b45ef0-e53a-4efc-b68a-3d300458d524 tempest-SnapshotsActionsTest-738507698 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 25 15:55:06 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-14b45ef0-e53a-4efc-b68a-3d300458d524 tempest-SnapshotsActionsTest-738507698 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 25 15:55:06 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.quobyte [None req-14b45ef0-e53a-4efc-b68a-3d300458d524 tempest-SnapshotsActionsTest-738507698 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23e9d725-3e04-4cd9-bfe0-c8ef43305589': None} {{(pid=83528) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 25 15:55:06 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.quobyte [None req-14b45ef0-e53a-4efc-b68a-3d300458d524 tempest-SnapshotsActionsTest-738507698 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23e9d725-3e04-4cd9-bfe0-c8ef43305589'] {{(pid=83528) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 25 15:55:06 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-14b45ef0-e53a-4efc-b68a-3d300458d524 tempest-SnapshotsActionsTest-738507698 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 25 15:55:06 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.quobyte [None req-14b45ef0-e53a-4efc-b68a-3d300458d524 tempest-SnapshotsActionsTest-738507698 None] Selected osci02.corp.quobyte.com/cinder-vol-23e9d725-3e04-4cd9-bfe0-c8ef43305589 as target Quobyte volume. {{(pid=83528) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 25 15:55:06 devstack cinder-volume[83528]: INFO cinder.volume.drivers.remotefs [None req-14b45ef0-e53a-4efc-b68a-3d300458d524 tempest-SnapshotsActionsTest-738507698 None] casted to osci02.corp.quobyte.com/cinder-vol-23e9d725-3e04-4cd9-bfe0-c8ef43305589 Feb 25 15:55:06 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-14b45ef0-e53a-4efc-b68a-3d300458d524 tempest-SnapshotsActionsTest-738507698 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-fa2da276-994a-452f-950a-05721f695adb 1073741824 {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 25 15:55:06 devstack sudo[86950]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-fa2da276-994a-452f-950a-05721f695adb 1073741824 Feb 25 15:55:06 devstack sudo[86950]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 25 15:55:07 devstack sudo[86948]: pam_unix(sudo:session): session closed for user root Feb 25 15:55:07 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-6ae4a9af-44bf-45d7-978f-7fd01dfde020 tempest-VolumeQuotasNegativeTestJSON-1783137641 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-149ac5d6-c715-4d6e-a5ab-1d20131066cd" returned: 0 in 0.693s {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 25 15:55:07 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-6ae4a9af-44bf-45d7-978f-7fd01dfde020 tempest-VolumeQuotasNegativeTestJSON-1783137641 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-149ac5d6-c715-4d6e-a5ab-1d20131066cd {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 25 15:55:07 devstack sudo[86955]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-149ac5d6-c715-4d6e-a5ab-1d20131066cd Feb 25 15:55:07 devstack sudo[86955]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 25 15:55:07 devstack sudo[86950]: pam_unix(sudo:session): session closed for user root Feb 25 15:55:07 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-14b45ef0-e53a-4efc-b68a-3d300458d524 tempest-SnapshotsActionsTest-738507698 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-fa2da276-994a-452f-950a-05721f695adb 1073741824" returned: 0 in 0.708s {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 25 15:55:07 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-14b45ef0-e53a-4efc-b68a-3d300458d524 tempest-SnapshotsActionsTest-738507698 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-fa2da276-994a-452f-950a-05721f695adb {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 25 15:55:07 devstack sudo[86960]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-fa2da276-994a-452f-950a-05721f695adb Feb 25 15:55:07 devstack sudo[86960]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 25 15:55:07 devstack sudo[86955]: pam_unix(sudo:session): session closed for user root Feb 25 15:55:07 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-6ae4a9af-44bf-45d7-978f-7fd01dfde020 tempest-VolumeQuotasNegativeTestJSON-1783137641 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-149ac5d6-c715-4d6e-a5ab-1d20131066cd" returned: 0 in 0.592s {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 25 15:55:07 devstack cinder-volume[83528]: DEBUG cinder.coordination [None req-6ae4a9af-44bf-45d7-978f-7fd01dfde020 tempest-VolumeQuotasNegativeTestJSON-1783137641 None] Lock "cinder-quobyte-149ac5d6-c715-4d6e-a5ab-1d20131066cd" released by "delete_volume" :: held 1.319s {{(pid=83528) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 25 15:55:07 devstack cinder-volume[83528]: DEBUG cinder.quota [None req-6ae4a9af-44bf-45d7-978f-7fd01dfde020 tempest-VolumeQuotasNegativeTestJSON-1783137641 None] Created reservations ['e6070299-129c-4e3d-93b5-d94a68f4c345', '5b1a8753-c720-4a25-89f3-b8e1caaf04aa', '4a422ce7-4615-4988-a5b7-ef6208e24742', 'f94dbad4-933a-4167-abe9-23488457a0b2'] {{(pid=83528) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 25 15:55:07 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-6ae4a9af-44bf-45d7-978f-7fd01dfde020 tempest-VolumeQuotasNegativeTestJSON-1783137641 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 25 15:55:07 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-6ae4a9af-44bf-45d7-978f-7fd01dfde020 tempest-VolumeQuotasNegativeTestJSON-1783137641 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 25 15:55:07 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.quobyte [None req-6ae4a9af-44bf-45d7-978f-7fd01dfde020 tempest-VolumeQuotasNegativeTestJSON-1783137641 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23e9d725-3e04-4cd9-bfe0-c8ef43305589': None} {{(pid=83528) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 25 15:55:07 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.quobyte [None req-6ae4a9af-44bf-45d7-978f-7fd01dfde020 tempest-VolumeQuotasNegativeTestJSON-1783137641 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23e9d725-3e04-4cd9-bfe0-c8ef43305589'] {{(pid=83528) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 25 15:55:07 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-6ae4a9af-44bf-45d7-978f-7fd01dfde020 tempest-VolumeQuotasNegativeTestJSON-1783137641 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 25 15:55:07 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-6ae4a9af-44bf-45d7-978f-7fd01dfde020 tempest-VolumeQuotasNegativeTestJSON-1783137641 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85 {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 25 15:55:07 devstack sudo[86963]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85 Feb 25 15:55:07 devstack sudo[86963]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 25 15:55:07 devstack sudo[86960]: pam_unix(sudo:session): session closed for user root Feb 25 15:55:07 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-14b45ef0-e53a-4efc-b68a-3d300458d524 tempest-SnapshotsActionsTest-738507698 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-fa2da276-994a-452f-950a-05721f695adb" returned: 0 in 0.595s {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 25 15:55:07 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.quobyte [None req-14b45ef0-e53a-4efc-b68a-3d300458d524 tempest-SnapshotsActionsTest-738507698 None] <== create_volume: return (1342ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-23e9d725-3e04-4cd9-bfe0-c8ef43305589'} {{(pid=83528) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 25 15:55:07 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-14b45ef0-e53a-4efc-b68a-3d300458d524 tempest-SnapshotsActionsTest-738507698 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.346s {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 25 15:55:08 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-14b45ef0-e53a-4efc-b68a-3d300458d524 tempest-SnapshotsActionsTest-738507698 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e4fd3beb-42d3-42e2-81ec-1a2a49314ba0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fa2da276-994a-452f-950a-05721f695adb', 'volume_size': 1}' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 25 15:55:08 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-14b45ef0-e53a-4efc-b68a-3d300458d524 tempest-SnapshotsActionsTest-738507698 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (779ced37-e668-4d49-9940-354d0e950b1b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 25 15:55:08 devstack cinder-volume[83528]: INFO cinder.volume.flows.manager.create_volume [None req-14b45ef0-e53a-4efc-b68a-3d300458d524 tempest-SnapshotsActionsTest-738507698 None] Volume volume-fa2da276-994a-452f-950a-05721f695adb (fa2da276-994a-452f-950a-05721f695adb): created successfully Feb 25 15:55:08 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-14b45ef0-e53a-4efc-b68a-3d300458d524 tempest-SnapshotsActionsTest-738507698 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (779ced37-e668-4d49-9940-354d0e950b1b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 25 15:55:08 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-14b45ef0-e53a-4efc-b68a-3d300458d524 tempest-SnapshotsActionsTest-738507698 None] Flow 'volume_create_manager' (7e156fe3-db6d-4172-80aa-f1eca373ab1f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83528) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 25 15:55:08 devstack cinder-volume[83528]: INFO cinder.volume.manager [None req-14b45ef0-e53a-4efc-b68a-3d300458d524 tempest-SnapshotsActionsTest-738507698 None] Created volume successfully. Feb 25 15:55:08 devstack sudo[86963]: pam_unix(sudo:session): session closed for user root Feb 25 15:55:08 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-6ae4a9af-44bf-45d7-978f-7fd01dfde020 tempest-VolumeQuotasNegativeTestJSON-1783137641 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85" returned: 0 in 0.588s {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 25 15:55:08 devstack cinder-volume[83528]: DEBUG cinder.manager [None req-6ae4a9af-44bf-45d7-978f-7fd01dfde020 tempest-VolumeQuotasNegativeTestJSON-1783137641 None] Notifying Schedulers of capabilities ... {{(pid=83528) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 25 15:55:08 devstack cinder-volume[83528]: INFO cinder.volume.manager [None req-6ae4a9af-44bf-45d7-978f-7fd01dfde020 tempest-VolumeQuotasNegativeTestJSON-1783137641 None] Deleted volume successfully. Feb 25 15:55:08 devstack cinder-volume[83528]: DEBUG cinder.coordination [None req-6ae4a9af-44bf-45d7-978f-7fd01dfde020 tempest-VolumeQuotasNegativeTestJSON-1783137641 None] Lock "cinder-149ac5d6-c715-4d6e-a5ab-1d20131066cd-delete_volume" released by "delete_volume" :: held 2.115s {{(pid=83528) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 25 15:55:08 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-0daeb9c5-045c-4ad7-9d6a-6a89a3da54dd tempest-SnapshotsActionsTest-738507698 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 25 15:55:08 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-0daeb9c5-045c-4ad7-9d6a-6a89a3da54dd tempest-SnapshotsActionsTest-738507698 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 25 15:55:08 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.remotefs [None req-0daeb9c5-045c-4ad7-9d6a-6a89a3da54dd tempest-SnapshotsActionsTest-738507698 None] Creating offline snapshot cf48a71a-46a9-4cb3-9a49-261772e1aa50 of volume fa2da276-994a-452f-950a-05721f695adb {{(pid=83528) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Feb 25 15:55:08 devstack cinder-volume[83528]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b84b971-d0cb-438e-a9d0-eb24cf476e61]: (4, 'qcow2') {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 25 15:55:08 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-0daeb9c5-045c-4ad7-9d6a-6a89a3da54dd tempest-SnapshotsActionsTest-738507698 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-fa2da276-994a-452f-950a-05721f695adb {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 25 15:55:09 devstack sudo[86973]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-fa2da276-994a-452f-950a-05721f695adb Feb 25 15:55:09 devstack sudo[86973]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 25 15:55:09 devstack sudo[86973]: pam_unix(sudo:session): session closed for user root Feb 25 15:55:09 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-0daeb9c5-045c-4ad7-9d6a-6a89a3da54dd tempest-SnapshotsActionsTest-738507698 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-fa2da276-994a-452f-950a-05721f695adb" returned: 0 in 0.742s {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 25 15:55:09 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-0daeb9c5-045c-4ad7-9d6a-6a89a3da54dd tempest-SnapshotsActionsTest-738507698 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-fa2da276-994a-452f-950a-05721f695adb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-fa2da276-994a-452f-950a-05721f695adb.cf48a71a-46a9-4cb3-9a49-261772e1aa50 1G {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 25 15:55:09 devstack sudo[86993]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-fa2da276-994a-452f-950a-05721f695adb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-fa2da276-994a-452f-950a-05721f695adb.cf48a71a-46a9-4cb3-9a49-261772e1aa50 1G Feb 25 15:55:09 devstack sudo[86993]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 25 15:55:10 devstack sudo[86993]: pam_unix(sudo:session): session closed for user root Feb 25 15:55:10 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-0daeb9c5-045c-4ad7-9d6a-6a89a3da54dd tempest-SnapshotsActionsTest-738507698 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-fa2da276-994a-452f-950a-05721f695adb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-fa2da276-994a-452f-950a-05721f695adb.cf48a71a-46a9-4cb3-9a49-261772e1aa50 1G" returned: 0 in 0.665s {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 25 15:55:10 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-0daeb9c5-045c-4ad7-9d6a-6a89a3da54dd tempest-SnapshotsActionsTest-738507698 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fa2da276-994a-452f-950a-05721f695adb -F qcow2 /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-fa2da276-994a-452f-950a-05721f695adb.cf48a71a-46a9-4cb3-9a49-261772e1aa50 {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 25 15:55:10 devstack sudo[87000]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fa2da276-994a-452f-950a-05721f695adb -F qcow2 /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-fa2da276-994a-452f-950a-05721f695adb.cf48a71a-46a9-4cb3-9a49-261772e1aa50 Feb 25 15:55:10 devstack sudo[87000]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 25 15:55:11 devstack sudo[87000]: pam_unix(sudo:session): session closed for user root Feb 25 15:55:11 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-0daeb9c5-045c-4ad7-9d6a-6a89a3da54dd tempest-SnapshotsActionsTest-738507698 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fa2da276-994a-452f-950a-05721f695adb -F qcow2 /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-fa2da276-994a-452f-950a-05721f695adb.cf48a71a-46a9-4cb3-9a49-261772e1aa50" returned: 0 in 0.637s {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 25 15:55:11 devstack cinder-volume[83528]: WARNING cinder.volume.drivers.remotefs [None req-0daeb9c5-045c-4ad7-9d6a-6a89a3da54dd tempest-SnapshotsActionsTest-738507698 None] /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-fa2da276-994a-452f-950a-05721f695adb.cf48a71a-46a9-4cb3-9a49-261772e1aa50 is being set with open permissions: ugo+rw Feb 25 15:55:11 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-0daeb9c5-045c-4ad7-9d6a-6a89a3da54dd tempest-SnapshotsActionsTest-738507698 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-fa2da276-994a-452f-950a-05721f695adb.cf48a71a-46a9-4cb3-9a49-261772e1aa50 {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 25 15:55:11 devstack sudo[87122]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-fa2da276-994a-452f-950a-05721f695adb.cf48a71a-46a9-4cb3-9a49-261772e1aa50 Feb 25 15:55:11 devstack sudo[87122]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 25 15:55:11 devstack sudo[87122]: pam_unix(sudo:session): session closed for user root Feb 25 15:55:11 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-0daeb9c5-045c-4ad7-9d6a-6a89a3da54dd tempest-SnapshotsActionsTest-738507698 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-fa2da276-994a-452f-950a-05721f695adb.cf48a71a-46a9-4cb3-9a49-261772e1aa50" returned: 0 in 0.632s {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 25 15:55:11 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-0daeb9c5-045c-4ad7-9d6a-6a89a3da54dd tempest-SnapshotsActionsTest-738507698 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-fa2da276-994a-452f-950a-05721f695adb.info {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 25 15:55:11 devstack sudo[87128]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-fa2da276-994a-452f-950a-05721f695adb.info Feb 25 15:55:11 devstack sudo[87128]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 25 15:55:12 devstack sudo[87128]: pam_unix(sudo:session): session closed for user root Feb 25 15:55:12 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-0daeb9c5-045c-4ad7-9d6a-6a89a3da54dd tempest-SnapshotsActionsTest-738507698 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-fa2da276-994a-452f-950a-05721f695adb.info" returned: 0 in 0.585s {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 25 15:55:12 devstack cinder-volume[83528]: WARNING cinder.volume.drivers.remotefs [None req-0daeb9c5-045c-4ad7-9d6a-6a89a3da54dd tempest-SnapshotsActionsTest-738507698 None] /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-fa2da276-994a-452f-950a-05721f695adb.info is being set with open permissions: ugo+rw Feb 25 15:55:12 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-0daeb9c5-045c-4ad7-9d6a-6a89a3da54dd tempest-SnapshotsActionsTest-738507698 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-fa2da276-994a-452f-950a-05721f695adb.info {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 25 15:55:12 devstack sudo[87131]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-fa2da276-994a-452f-950a-05721f695adb.info Feb 25 15:55:12 devstack sudo[87131]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 25 15:55:12 devstack cinder-volume[83528]: DEBUG dbcounter [-] [83528] Writing DB stats cinder:SELECT=143,cinder:INSERT=48,cinder:UPDATE=142,cinder:DELETE=7 {{(pid=83528) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Feb 25 15:55:12 devstack cinder-volume[83528]: DEBUG dbcounter [-] [83528] Writing DB stats cinder:UPDATE=144,cinder:SELECT=135,cinder:INSERT=35,cinder:DELETE=6 {{(pid=83528) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Feb 25 15:55:12 devstack cinder-volume[83528]: INFO cinder.volume.manager [req-7420e2e9-8d09-4851-ab7e-e93ba6361bc3 req-9bab31cd-c27b-487b-8aa7-c8ccd094ad27 tempest-ServerBootFromVolumeStableRescueTest-939682044 None] Terminate volume connection completed successfully. Feb 25 15:55:12 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [req-7420e2e9-8d09-4851-ab7e-e93ba6361bc3 req-9bab31cd-c27b-487b-8aa7-c8ccd094ad27 tempest-ServerBootFromVolumeStableRescueTest-939682044 None] Deleting attachment a2e68d77-2090-454c-ba0d-46b183ac17f2. {{(pid=83528) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Feb 25 15:55:12 devstack sudo[87131]: pam_unix(sudo:session): session closed for user root Feb 25 15:55:12 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-0daeb9c5-045c-4ad7-9d6a-6a89a3da54dd tempest-SnapshotsActionsTest-738507698 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-fa2da276-994a-452f-950a-05721f695adb.info" returned: 0 in 0.536s {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 25 15:55:12 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-0daeb9c5-045c-4ad7-9d6a-6a89a3da54dd tempest-SnapshotsActionsTest-738507698 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.912s {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 25 15:55:12 devstack cinder-volume[83528]: INFO cinder.volume.manager [None req-0daeb9c5-045c-4ad7-9d6a-6a89a3da54dd tempest-SnapshotsActionsTest-738507698 None] Create snapshot completed successfully Feb 25 15:55:13 devstack cinder-volume[83528]: DEBUG cinder.coordination [req-7420e2e9-8d09-4851-ab7e-e93ba6361bc3 req-74a64e2b-5c48-48e0-86ba-fd504f0a6782 tempest-ServerBootFromVolumeStableRescueTest-939682044 None] Acquiring lock "cinder-8846575b-0b7c-4fe1-a314-bb6ceaabd0a8-delete_volume" by "delete_volume" {{(pid=83528) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 25 15:55:13 devstack cinder-volume[83528]: DEBUG cinder.coordination [req-7420e2e9-8d09-4851-ab7e-e93ba6361bc3 req-74a64e2b-5c48-48e0-86ba-fd504f0a6782 tempest-ServerBootFromVolumeStableRescueTest-939682044 None] Lock "cinder-8846575b-0b7c-4fe1-a314-bb6ceaabd0a8-delete_volume" acquired by "delete_volume" :: waited 0.014s {{(pid=83528) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 25 15:55:13 devstack cinder-volume[83528]: DEBUG cinder.coordination [req-7420e2e9-8d09-4851-ab7e-e93ba6361bc3 req-74a64e2b-5c48-48e0-86ba-fd504f0a6782 tempest-ServerBootFromVolumeStableRescueTest-939682044 None] Acquiring lock "cinder-quobyte-8846575b-0b7c-4fe1-a314-bb6ceaabd0a8" by "delete_volume" {{(pid=83528) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 25 15:55:13 devstack cinder-volume[83528]: DEBUG cinder.coordination [req-7420e2e9-8d09-4851-ab7e-e93ba6361bc3 req-74a64e2b-5c48-48e0-86ba-fd504f0a6782 tempest-ServerBootFromVolumeStableRescueTest-939682044 None] Lock "cinder-quobyte-8846575b-0b7c-4fe1-a314-bb6ceaabd0a8" acquired by "delete_volume" :: waited 0.010s {{(pid=83528) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 25 15:55:13 devstack cinder-volume[83528]: DEBUG oslo.privsep.daemon [-] privsep: reply[c478bb1a-7fe2-4c98-ad8c-2b4b21913261]: (4, 'qcow2') {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 25 15:55:13 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [req-7420e2e9-8d09-4851-ab7e-e93ba6361bc3 req-74a64e2b-5c48-48e0-86ba-fd504f0a6782 tempest-ServerBootFromVolumeStableRescueTest-939682044 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-8846575b-0b7c-4fe1-a314-bb6ceaabd0a8 {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 25 15:55:13 devstack sudo[87140]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-8846575b-0b7c-4fe1-a314-bb6ceaabd0a8 Feb 25 15:55:13 devstack sudo[87140]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 25 15:55:13 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-8c824b06-4537-469e-992f-4005dc107082 tempest-SnapshotsActionsTest-738507698 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 25 15:55:13 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-8c824b06-4537-469e-992f-4005dc107082 tempest-SnapshotsActionsTest-738507698 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 25 15:55:13 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.remotefs [None req-8c824b06-4537-469e-992f-4005dc107082 tempest-SnapshotsActionsTest-738507698 None] Creating offline snapshot b8c27d68-ccca-4f87-95b9-17ef0d3362ad of volume fa2da276-994a-452f-950a-05721f695adb {{(pid=83528) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Feb 25 15:55:13 devstack cinder-volume[83528]: DEBUG oslo.privsep.daemon [-] privsep: reply[14d7dea2-8e86-4ddb-8533-87b9d7f33b97]: (4, 'qcow2') {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 25 15:55:13 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-8c824b06-4537-469e-992f-4005dc107082 tempest-SnapshotsActionsTest-738507698 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-fa2da276-994a-452f-950a-05721f695adb.cf48a71a-46a9-4cb3-9a49-261772e1aa50 {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 25 15:55:13 devstack sudo[87140]: pam_unix(sudo:session): session closed for user root Feb 25 15:55:13 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [req-7420e2e9-8d09-4851-ab7e-e93ba6361bc3 req-74a64e2b-5c48-48e0-86ba-fd504f0a6782 tempest-ServerBootFromVolumeStableRescueTest-939682044 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-8846575b-0b7c-4fe1-a314-bb6ceaabd0a8" returned: 0 in 0.730s {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 25 15:55:13 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [req-7420e2e9-8d09-4851-ab7e-e93ba6361bc3 req-74a64e2b-5c48-48e0-86ba-fd504f0a6782 tempest-ServerBootFromVolumeStableRescueTest-939682044 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-8846575b-0b7c-4fe1-a314-bb6ceaabd0a8 {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 25 15:55:13 devstack sudo[87145]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-fa2da276-994a-452f-950a-05721f695adb.cf48a71a-46a9-4cb3-9a49-261772e1aa50 Feb 25 15:55:13 devstack sudo[87145]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 25 15:55:13 devstack sudo[87146]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-8846575b-0b7c-4fe1-a314-bb6ceaabd0a8 Feb 25 15:55:13 devstack sudo[87146]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 25 15:55:14 devstack sudo[87145]: pam_unix(sudo:session): session closed for user root Feb 25 15:55:14 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-8c824b06-4537-469e-992f-4005dc107082 tempest-SnapshotsActionsTest-738507698 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-fa2da276-994a-452f-950a-05721f695adb.cf48a71a-46a9-4cb3-9a49-261772e1aa50" returned: 0 in 0.546s {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 25 15:55:14 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.remotefs [None req-8c824b06-4537-469e-992f-4005dc107082 tempest-SnapshotsActionsTest-738507698 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-fa2da276-994a-452f-950a-05721f695adb(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83528) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Feb 25 15:55:14 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-8c824b06-4537-469e-992f-4005dc107082 tempest-SnapshotsActionsTest-738507698 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-fa2da276-994a-452f-950a-05721f695adb.cf48a71a-46a9-4cb3-9a49-261772e1aa50,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-fa2da276-994a-452f-950a-05721f695adb.b8c27d68-ccca-4f87-95b9-17ef0d3362ad 1G {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 25 15:55:14 devstack sudo[87153]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-fa2da276-994a-452f-950a-05721f695adb.cf48a71a-46a9-4cb3-9a49-261772e1aa50,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-fa2da276-994a-452f-950a-05721f695adb.b8c27d68-ccca-4f87-95b9-17ef0d3362ad 1G Feb 25 15:55:14 devstack sudo[87153]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 25 15:55:14 devstack sudo[87146]: pam_unix(sudo:session): session closed for user root Feb 25 15:55:14 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [req-7420e2e9-8d09-4851-ab7e-e93ba6361bc3 req-74a64e2b-5c48-48e0-86ba-fd504f0a6782 tempest-ServerBootFromVolumeStableRescueTest-939682044 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-8846575b-0b7c-4fe1-a314-bb6ceaabd0a8" returned: 0 in 0.594s {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 25 15:55:14 devstack cinder-volume[83528]: DEBUG cinder.coordination [req-7420e2e9-8d09-4851-ab7e-e93ba6361bc3 req-74a64e2b-5c48-48e0-86ba-fd504f0a6782 tempest-ServerBootFromVolumeStableRescueTest-939682044 None] Lock "cinder-quobyte-8846575b-0b7c-4fe1-a314-bb6ceaabd0a8" released by "delete_volume" :: held 1.348s {{(pid=83528) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 25 15:55:14 devstack cinder-volume[83528]: DEBUG cinder.volume.flows.manager.create_volume [None req-f7b5f941-c631-4bed-a206-c50eb10b50f9 tempest-VolumeRetypeWithoutMigrationTest-1169426313 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83528) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 25 15:55:14 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-f7b5f941-c631-4bed-a206-c50eb10b50f9 tempest-VolumeRetypeWithoutMigrationTest-1169426313 None] Flow 'volume_create_manager' (e9128be5-ca66-4435-87a3-8ebba8c0b6bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83528) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 25 15:55:14 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-f7b5f941-c631-4bed-a206-c50eb10b50f9 tempest-VolumeRetypeWithoutMigrationTest-1169426313 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b826aaf8-50fa-452b-9a62-0cf7a2a28c9f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 25 15:55:14 devstack cinder-volume[83528]: DEBUG cinder.quota [req-7420e2e9-8d09-4851-ab7e-e93ba6361bc3 req-74a64e2b-5c48-48e0-86ba-fd504f0a6782 tempest-ServerBootFromVolumeStableRescueTest-939682044 None] Created reservations ['804407d8-a336-4400-a447-fe069a26abca', 'dfbc021f-6286-4fa5-9351-dfada4827535', 'debbcf33-0000-4032-8319-d53fbc9a6a2b', 'ec3f41ba-7d56-403d-a613-6164ee954dfc'] {{(pid=83528) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 25 15:55:14 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-f7b5f941-c631-4bed-a206-c50eb10b50f9 tempest-VolumeRetypeWithoutMigrationTest-1169426313 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b826aaf8-50fa-452b-9a62-0cf7a2a28c9f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-25T14:55:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-370005024',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0e884cc0-e150-4579-a4d8-1a51c1a89f3f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='902199f90d164bdda284310322d0ed35',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-25T14:55:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-25T14:55:15Z,use_quota=True,user_id='c4af1f95e9334e99a29141f2610f2f34',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0533e2b2-3178-478b-9218-780292c8e425),volume_type_id=0533e2b2-3178-478b-9218-780292c8e425)' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 25 15:55:14 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-f7b5f941-c631-4bed-a206-c50eb10b50f9 tempest-VolumeRetypeWithoutMigrationTest-1169426313 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5318613e-70fe-4ec1-b571-36a941bbf895) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 25 15:55:14 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-f7b5f941-c631-4bed-a206-c50eb10b50f9 tempest-VolumeRetypeWithoutMigrationTest-1169426313 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5318613e-70fe-4ec1-b571-36a941bbf895) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 25 15:55:14 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-f7b5f941-c631-4bed-a206-c50eb10b50f9 tempest-VolumeRetypeWithoutMigrationTest-1169426313 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6078ba7e-af4b-4cb2-b3ba-c2bc20a27e79) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 25 15:55:14 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-f7b5f941-c631-4bed-a206-c50eb10b50f9 tempest-VolumeRetypeWithoutMigrationTest-1169426313 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6078ba7e-af4b-4cb2-b3ba-c2bc20a27e79) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0e884cc0-e150-4579-a4d8-1a51c1a89f3f', 'volume_name': 'volume-0e884cc0-e150-4579-a4d8-1a51c1a89f3f', 'volume_size': 1}' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 25 15:55:14 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-f7b5f941-c631-4bed-a206-c50eb10b50f9 tempest-VolumeRetypeWithoutMigrationTest-1169426313 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0a8461d9-4a4c-4e54-a328-0541eac41f8b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 25 15:55:14 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-f7b5f941-c631-4bed-a206-c50eb10b50f9 tempest-VolumeRetypeWithoutMigrationTest-1169426313 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0a8461d9-4a4c-4e54-a328-0541eac41f8b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 25 15:55:14 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-f7b5f941-c631-4bed-a206-c50eb10b50f9 tempest-VolumeRetypeWithoutMigrationTest-1169426313 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a29bb0f8-4747-4fa2-a449-6f1aaf6430e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 25 15:55:14 devstack cinder-volume[83528]: INFO cinder.volume.flows.manager.create_volume [None req-f7b5f941-c631-4bed-a206-c50eb10b50f9 tempest-VolumeRetypeWithoutMigrationTest-1169426313 None] Volume 0e884cc0-e150-4579-a4d8-1a51c1a89f3f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0e884cc0-e150-4579-a4d8-1a51c1a89f3f', 'volume_size': 1} Feb 25 15:55:14 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-f7b5f941-c631-4bed-a206-c50eb10b50f9 tempest-VolumeRetypeWithoutMigrationTest-1169426313 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 25 15:55:14 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [req-7420e2e9-8d09-4851-ab7e-e93ba6361bc3 req-74a64e2b-5c48-48e0-86ba-fd504f0a6782 tempest-ServerBootFromVolumeStableRescueTest-939682044 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 25 15:55:14 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [req-7420e2e9-8d09-4851-ab7e-e93ba6361bc3 req-74a64e2b-5c48-48e0-86ba-fd504f0a6782 tempest-ServerBootFromVolumeStableRescueTest-939682044 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 25 15:55:14 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.quobyte [req-7420e2e9-8d09-4851-ab7e-e93ba6361bc3 req-74a64e2b-5c48-48e0-86ba-fd504f0a6782 tempest-ServerBootFromVolumeStableRescueTest-939682044 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23e9d725-3e04-4cd9-bfe0-c8ef43305589': None} {{(pid=83528) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 25 15:55:14 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.quobyte [req-7420e2e9-8d09-4851-ab7e-e93ba6361bc3 req-74a64e2b-5c48-48e0-86ba-fd504f0a6782 tempest-ServerBootFromVolumeStableRescueTest-939682044 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23e9d725-3e04-4cd9-bfe0-c8ef43305589'] {{(pid=83528) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 25 15:55:14 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [req-7420e2e9-8d09-4851-ab7e-e93ba6361bc3 req-74a64e2b-5c48-48e0-86ba-fd504f0a6782 tempest-ServerBootFromVolumeStableRescueTest-939682044 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 25 15:55:14 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [req-7420e2e9-8d09-4851-ab7e-e93ba6361bc3 req-74a64e2b-5c48-48e0-86ba-fd504f0a6782 tempest-ServerBootFromVolumeStableRescueTest-939682044 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85 {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 25 15:55:14 devstack sudo[87156]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85 Feb 25 15:55:14 devstack sudo[87156]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 25 15:55:15 devstack sudo[87153]: pam_unix(sudo:session): session closed for user root Feb 25 15:55:15 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-8c824b06-4537-469e-992f-4005dc107082 tempest-SnapshotsActionsTest-738507698 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-fa2da276-994a-452f-950a-05721f695adb.cf48a71a-46a9-4cb3-9a49-261772e1aa50,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-fa2da276-994a-452f-950a-05721f695adb.b8c27d68-ccca-4f87-95b9-17ef0d3362ad 1G" returned: 0 in 0.655s {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 25 15:55:15 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-8c824b06-4537-469e-992f-4005dc107082 tempest-SnapshotsActionsTest-738507698 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fa2da276-994a-452f-950a-05721f695adb.cf48a71a-46a9-4cb3-9a49-261772e1aa50 -F qcow2 /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-fa2da276-994a-452f-950a-05721f695adb.b8c27d68-ccca-4f87-95b9-17ef0d3362ad {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 25 15:55:15 devstack sudo[87161]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fa2da276-994a-452f-950a-05721f695adb.cf48a71a-46a9-4cb3-9a49-261772e1aa50 -F qcow2 /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-fa2da276-994a-452f-950a-05721f695adb.b8c27d68-ccca-4f87-95b9-17ef0d3362ad Feb 25 15:55:15 devstack sudo[87161]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 25 15:55:15 devstack sudo[87156]: pam_unix(sudo:session): session closed for user root Feb 25 15:55:15 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [req-7420e2e9-8d09-4851-ab7e-e93ba6361bc3 req-74a64e2b-5c48-48e0-86ba-fd504f0a6782 tempest-ServerBootFromVolumeStableRescueTest-939682044 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85" returned: 0 in 0.467s {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 25 15:55:15 devstack cinder-volume[83528]: DEBUG cinder.manager [req-7420e2e9-8d09-4851-ab7e-e93ba6361bc3 req-74a64e2b-5c48-48e0-86ba-fd504f0a6782 tempest-ServerBootFromVolumeStableRescueTest-939682044 None] Notifying Schedulers of capabilities ... {{(pid=83528) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 25 15:55:15 devstack cinder-volume[83528]: INFO cinder.volume.manager [req-7420e2e9-8d09-4851-ab7e-e93ba6361bc3 req-74a64e2b-5c48-48e0-86ba-fd504f0a6782 tempest-ServerBootFromVolumeStableRescueTest-939682044 None] Deleted volume successfully. Feb 25 15:55:15 devstack cinder-volume[83528]: DEBUG cinder.coordination [req-7420e2e9-8d09-4851-ab7e-e93ba6361bc3 req-74a64e2b-5c48-48e0-86ba-fd504f0a6782 tempest-ServerBootFromVolumeStableRescueTest-939682044 None] Lock "cinder-8846575b-0b7c-4fe1-a314-bb6ceaabd0a8-delete_volume" released by "delete_volume" :: held 2.096s {{(pid=83528) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 25 15:55:15 devstack sudo[87161]: pam_unix(sudo:session): session closed for user root Feb 25 15:55:15 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-8c824b06-4537-469e-992f-4005dc107082 tempest-SnapshotsActionsTest-738507698 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fa2da276-994a-452f-950a-05721f695adb.cf48a71a-46a9-4cb3-9a49-261772e1aa50 -F qcow2 /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-fa2da276-994a-452f-950a-05721f695adb.b8c27d68-ccca-4f87-95b9-17ef0d3362ad" returned: 0 in 0.455s {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 25 15:55:15 devstack cinder-volume[83528]: WARNING cinder.volume.drivers.remotefs [None req-8c824b06-4537-469e-992f-4005dc107082 tempest-SnapshotsActionsTest-738507698 None] /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-fa2da276-994a-452f-950a-05721f695adb.b8c27d68-ccca-4f87-95b9-17ef0d3362ad is being set with open permissions: ugo+rw Feb 25 15:55:15 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-8c824b06-4537-469e-992f-4005dc107082 tempest-SnapshotsActionsTest-738507698 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-fa2da276-994a-452f-950a-05721f695adb.b8c27d68-ccca-4f87-95b9-17ef0d3362ad {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 25 15:55:15 devstack sudo[87167]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-fa2da276-994a-452f-950a-05721f695adb.b8c27d68-ccca-4f87-95b9-17ef0d3362ad Feb 25 15:55:15 devstack sudo[87167]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 25 15:55:16 devstack sudo[87167]: pam_unix(sudo:session): session closed for user root Feb 25 15:55:16 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-8c824b06-4537-469e-992f-4005dc107082 tempest-SnapshotsActionsTest-738507698 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-fa2da276-994a-452f-950a-05721f695adb.b8c27d68-ccca-4f87-95b9-17ef0d3362ad" returned: 0 in 0.610s {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 25 15:55:16 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-8c824b06-4537-469e-992f-4005dc107082 tempest-SnapshotsActionsTest-738507698 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.336s {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 25 15:55:16 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-f7b5f941-c631-4bed-a206-c50eb10b50f9 tempest-VolumeRetypeWithoutMigrationTest-1169426313 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.456s {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 25 15:55:16 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.quobyte [None req-f7b5f941-c631-4bed-a206-c50eb10b50f9 tempest-VolumeRetypeWithoutMigrationTest-1169426313 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-25T14:55:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-370005024',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0e884cc0-e150-4579-a4d8-1a51c1a89f3f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='902199f90d164bdda284310322d0ed35',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-25T14:55:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-25T14:55:15Z,use_quota=True,user_id='c4af1f95e9334e99a29141f2610f2f34',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0533e2b2-3178-478b-9218-780292c8e425),volume_type_id=0533e2b2-3178-478b-9218-780292c8e425)}" {{(pid=83528) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 25 15:55:16 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.remotefs [None req-f7b5f941-c631-4bed-a206-c50eb10b50f9 tempest-VolumeRetypeWithoutMigrationTest-1169426313 None] Creating volume 0e884cc0-e150-4579-a4d8-1a51c1a89f3f {{(pid=83528) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 25 15:55:16 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-f7b5f941-c631-4bed-a206-c50eb10b50f9 tempest-VolumeRetypeWithoutMigrationTest-1169426313 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 25 15:55:16 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-f7b5f941-c631-4bed-a206-c50eb10b50f9 tempest-VolumeRetypeWithoutMigrationTest-1169426313 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 25 15:55:16 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.quobyte [None req-f7b5f941-c631-4bed-a206-c50eb10b50f9 tempest-VolumeRetypeWithoutMigrationTest-1169426313 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23e9d725-3e04-4cd9-bfe0-c8ef43305589': None} {{(pid=83528) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 25 15:55:16 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.quobyte [None req-f7b5f941-c631-4bed-a206-c50eb10b50f9 tempest-VolumeRetypeWithoutMigrationTest-1169426313 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23e9d725-3e04-4cd9-bfe0-c8ef43305589'] {{(pid=83528) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 25 15:55:16 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-f7b5f941-c631-4bed-a206-c50eb10b50f9 tempest-VolumeRetypeWithoutMigrationTest-1169426313 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 25 15:55:16 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.quobyte [None req-f7b5f941-c631-4bed-a206-c50eb10b50f9 tempest-VolumeRetypeWithoutMigrationTest-1169426313 None] Selected osci02.corp.quobyte.com/cinder-vol-23e9d725-3e04-4cd9-bfe0-c8ef43305589 as target Quobyte volume. {{(pid=83528) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 25 15:55:16 devstack cinder-volume[83528]: INFO cinder.volume.drivers.remotefs [None req-f7b5f941-c631-4bed-a206-c50eb10b50f9 tempest-VolumeRetypeWithoutMigrationTest-1169426313 None] casted to osci02.corp.quobyte.com/cinder-vol-23e9d725-3e04-4cd9-bfe0-c8ef43305589 Feb 25 15:55:16 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-f7b5f941-c631-4bed-a206-c50eb10b50f9 tempest-VolumeRetypeWithoutMigrationTest-1169426313 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-0e884cc0-e150-4579-a4d8-1a51c1a89f3f 1073741824 {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 25 15:55:16 devstack sudo[87170]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-0e884cc0-e150-4579-a4d8-1a51c1a89f3f 1073741824 Feb 25 15:55:16 devstack sudo[87170]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 25 15:55:16 devstack cinder-volume[83528]: INFO cinder.volume.manager [None req-8c824b06-4537-469e-992f-4005dc107082 tempest-SnapshotsActionsTest-738507698 None] Create snapshot completed successfully Feb 25 15:55:16 devstack sudo[87170]: pam_unix(sudo:session): session closed for user root Feb 25 15:55:16 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-f7b5f941-c631-4bed-a206-c50eb10b50f9 tempest-VolumeRetypeWithoutMigrationTest-1169426313 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-0e884cc0-e150-4579-a4d8-1a51c1a89f3f 1073741824" returned: 0 in 0.720s {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 25 15:55:16 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-f7b5f941-c631-4bed-a206-c50eb10b50f9 tempest-VolumeRetypeWithoutMigrationTest-1169426313 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-0e884cc0-e150-4579-a4d8-1a51c1a89f3f {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 25 15:55:16 devstack sudo[87182]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-0e884cc0-e150-4579-a4d8-1a51c1a89f3f Feb 25 15:55:16 devstack sudo[87182]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 25 15:55:17 devstack cinder-volume[83528]: DEBUG cinder.coordination [None req-42843643-0cf1-4bb1-9bda-802c2228cc0d tempest-SnapshotsActionsTest-65651383 None] Acquiring lock "cinder-b8c27d68-ccca-4f87-95b9-17ef0d3362ad-delete_snapshot" by "delete_snapshot" {{(pid=83528) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 25 15:55:17 devstack cinder-volume[83528]: DEBUG cinder.coordination [None req-42843643-0cf1-4bb1-9bda-802c2228cc0d tempest-SnapshotsActionsTest-65651383 None] Lock "cinder-b8c27d68-ccca-4f87-95b9-17ef0d3362ad-delete_snapshot" acquired by "delete_snapshot" :: waited 0.011s {{(pid=83528) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 25 15:55:17 devstack cinder-volume[83528]: DEBUG cinder.coordination [None req-42843643-0cf1-4bb1-9bda-802c2228cc0d tempest-SnapshotsActionsTest-65651383 None] Acquiring lock "cinder-quobyte-fa2da276-994a-452f-950a-05721f695adb" by "delete_snapshot" {{(pid=83528) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 25 15:55:17 devstack cinder-volume[83528]: DEBUG cinder.coordination [None req-42843643-0cf1-4bb1-9bda-802c2228cc0d tempest-SnapshotsActionsTest-65651383 None] Lock "cinder-quobyte-fa2da276-994a-452f-950a-05721f695adb" acquired by "delete_snapshot" :: waited 0.008s {{(pid=83528) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 25 15:55:17 devstack cinder-volume[83528]: DEBUG cinder.coordination [None req-42843643-0cf1-4bb1-9bda-802c2228cc0d tempest-SnapshotsActionsTest-65651383 None] Acquiring lock "cinder-quobyte-b8c27d68-ccca-4f87-95b9-17ef0d3362ad" by "_delete_snapshot" {{(pid=83528) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 25 15:55:17 devstack cinder-volume[83528]: DEBUG cinder.coordination [None req-42843643-0cf1-4bb1-9bda-802c2228cc0d tempest-SnapshotsActionsTest-65651383 None] Lock "cinder-quobyte-b8c27d68-ccca-4f87-95b9-17ef0d3362ad" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=83528) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 25 15:55:17 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.remotefs [None req-42843643-0cf1-4bb1-9bda-802c2228cc0d tempest-SnapshotsActionsTest-65651383 None] Deleting offline snapshot b8c27d68-ccca-4f87-95b9-17ef0d3362ad of volume fa2da276-994a-452f-950a-05721f695adb {{(pid=83528) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Feb 25 15:55:17 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.remotefs [None req-42843643-0cf1-4bb1-9bda-802c2228cc0d tempest-SnapshotsActionsTest-65651383 None] snapshot_file for this snap is: volume-fa2da276-994a-452f-950a-05721f695adb.b8c27d68-ccca-4f87-95b9-17ef0d3362ad {{(pid=83528) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Feb 25 15:55:17 devstack cinder-volume[83528]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b24ce88-2c59-431d-bd2c-35d8b0d4ed87]: (4, 'qcow2') {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 25 15:55:17 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-42843643-0cf1-4bb1-9bda-802c2228cc0d tempest-SnapshotsActionsTest-65651383 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-fa2da276-994a-452f-950a-05721f695adb.b8c27d68-ccca-4f87-95b9-17ef0d3362ad {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 25 15:55:17 devstack sudo[87193]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-fa2da276-994a-452f-950a-05721f695adb.b8c27d68-ccca-4f87-95b9-17ef0d3362ad Feb 25 15:55:17 devstack sudo[87193]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 25 15:55:17 devstack sudo[87182]: pam_unix(sudo:session): session closed for user root Feb 25 15:55:17 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-f7b5f941-c631-4bed-a206-c50eb10b50f9 tempest-VolumeRetypeWithoutMigrationTest-1169426313 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-0e884cc0-e150-4579-a4d8-1a51c1a89f3f" returned: 0 in 0.585s {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 25 15:55:17 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.quobyte [None req-f7b5f941-c631-4bed-a206-c50eb10b50f9 tempest-VolumeRetypeWithoutMigrationTest-1169426313 None] <== create_volume: return (1337ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-23e9d725-3e04-4cd9-bfe0-c8ef43305589'} {{(pid=83528) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 25 15:55:17 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-f7b5f941-c631-4bed-a206-c50eb10b50f9 tempest-VolumeRetypeWithoutMigrationTest-1169426313 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.344s {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 25 15:55:17 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-f7b5f941-c631-4bed-a206-c50eb10b50f9 tempest-VolumeRetypeWithoutMigrationTest-1169426313 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a29bb0f8-4747-4fa2-a449-6f1aaf6430e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0e884cc0-e150-4579-a4d8-1a51c1a89f3f', 'volume_size': 1}' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 25 15:55:17 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-f7b5f941-c631-4bed-a206-c50eb10b50f9 tempest-VolumeRetypeWithoutMigrationTest-1169426313 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ecf4d9a5-eb5c-44db-b38f-534e3eed78ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 25 15:55:17 devstack cinder-volume[83528]: INFO cinder.volume.flows.manager.create_volume [None req-f7b5f941-c631-4bed-a206-c50eb10b50f9 tempest-VolumeRetypeWithoutMigrationTest-1169426313 None] Volume volume-0e884cc0-e150-4579-a4d8-1a51c1a89f3f (0e884cc0-e150-4579-a4d8-1a51c1a89f3f): created successfully Feb 25 15:55:17 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-f7b5f941-c631-4bed-a206-c50eb10b50f9 tempest-VolumeRetypeWithoutMigrationTest-1169426313 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ecf4d9a5-eb5c-44db-b38f-534e3eed78ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 25 15:55:17 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-f7b5f941-c631-4bed-a206-c50eb10b50f9 tempest-VolumeRetypeWithoutMigrationTest-1169426313 None] Flow 'volume_create_manager' (e9128be5-ca66-4435-87a3-8ebba8c0b6bd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83528) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 25 15:55:17 devstack cinder-volume[83528]: INFO cinder.volume.manager [None req-f7b5f941-c631-4bed-a206-c50eb10b50f9 tempest-VolumeRetypeWithoutMigrationTest-1169426313 None] Created volume successfully. Feb 25 15:55:17 devstack sudo[87193]: pam_unix(sudo:session): session closed for user root Feb 25 15:55:17 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-42843643-0cf1-4bb1-9bda-802c2228cc0d tempest-SnapshotsActionsTest-65651383 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-fa2da276-994a-452f-950a-05721f695adb.b8c27d68-ccca-4f87-95b9-17ef0d3362ad" returned: 0 in 0.727s {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 25 15:55:17 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.remotefs [None req-42843643-0cf1-4bb1-9bda-802c2228cc0d tempest-SnapshotsActionsTest-65651383 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-fa2da276-994a-452f-950a-05721f695adb(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83528) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Feb 25 15:55:17 devstack cinder-volume[83528]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7d480be-ef0c-4ed4-aa8f-541f0e556082]: (4, 'qcow2') {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 25 15:55:17 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-42843643-0cf1-4bb1-9bda-802c2228cc0d tempest-SnapshotsActionsTest-65651383 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-fa2da276-994a-452f-950a-05721f695adb.cf48a71a-46a9-4cb3-9a49-261772e1aa50 {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 25 15:55:18 devstack sudo[87213]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-fa2da276-994a-452f-950a-05721f695adb.cf48a71a-46a9-4cb3-9a49-261772e1aa50 Feb 25 15:55:18 devstack sudo[87213]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 25 15:55:18 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-43c5c69b-befb-4315-8779-45f65845f7f8 tempest-VolumeRetypeWithoutMigrationTest-1169426313 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 25 15:55:18 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-43c5c69b-befb-4315-8779-45f65845f7f8 tempest-VolumeRetypeWithoutMigrationTest-1169426313 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 25 15:55:18 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.quobyte [None req-43c5c69b-befb-4315-8779-45f65845f7f8 tempest-VolumeRetypeWithoutMigrationTest-1169426313 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23e9d725-3e04-4cd9-bfe0-c8ef43305589': None} {{(pid=83528) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 25 15:55:18 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.quobyte [None req-43c5c69b-befb-4315-8779-45f65845f7f8 tempest-VolumeRetypeWithoutMigrationTest-1169426313 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23e9d725-3e04-4cd9-bfe0-c8ef43305589'] {{(pid=83528) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 25 15:55:18 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-43c5c69b-befb-4315-8779-45f65845f7f8 tempest-VolumeRetypeWithoutMigrationTest-1169426313 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 25 15:55:18 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-43c5c69b-befb-4315-8779-45f65845f7f8 tempest-VolumeRetypeWithoutMigrationTest-1169426313 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85 {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 25 15:55:18 devstack sudo[87215]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85 Feb 25 15:55:18 devstack sudo[87215]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 25 15:55:18 devstack sudo[87213]: pam_unix(sudo:session): session closed for user root Feb 25 15:55:18 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-42843643-0cf1-4bb1-9bda-802c2228cc0d tempest-SnapshotsActionsTest-65651383 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-fa2da276-994a-452f-950a-05721f695adb.cf48a71a-46a9-4cb3-9a49-261772e1aa50" returned: 0 in 0.587s {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 25 15:55:18 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.remotefs [None req-42843643-0cf1-4bb1-9bda-802c2228cc0d tempest-SnapshotsActionsTest-65651383 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-fa2da276-994a-452f-950a-05721f695adb(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83528) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Feb 25 15:55:18 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-42843643-0cf1-4bb1-9bda-802c2228cc0d tempest-SnapshotsActionsTest-65651383 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-fa2da276-994a-452f-950a-05721f695adb.b8c27d68-ccca-4f87-95b9-17ef0d3362ad {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 25 15:55:18 devstack sudo[87220]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-fa2da276-994a-452f-950a-05721f695adb.b8c27d68-ccca-4f87-95b9-17ef0d3362ad Feb 25 15:55:18 devstack sudo[87220]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 25 15:55:18 devstack sudo[87215]: pam_unix(sudo:session): session closed for user root Feb 25 15:55:18 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-43c5c69b-befb-4315-8779-45f65845f7f8 tempest-VolumeRetypeWithoutMigrationTest-1169426313 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85" returned: 0 in 0.538s {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 25 15:55:18 devstack cinder-volume[83528]: DEBUG cinder.manager [None req-43c5c69b-befb-4315-8779-45f65845f7f8 tempest-VolumeRetypeWithoutMigrationTest-1169426313 None] Notifying Schedulers of capabilities ... {{(pid=83528) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 25 15:55:18 devstack cinder-volume[83528]: INFO cinder.volume.manager [None req-43c5c69b-befb-4315-8779-45f65845f7f8 tempest-VolumeRetypeWithoutMigrationTest-1169426313 None] Retype volume completed successfully. Feb 25 15:55:19 devstack sudo[87220]: pam_unix(sudo:session): session closed for user root Feb 25 15:55:19 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-42843643-0cf1-4bb1-9bda-802c2228cc0d tempest-SnapshotsActionsTest-65651383 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-fa2da276-994a-452f-950a-05721f695adb.b8c27d68-ccca-4f87-95b9-17ef0d3362ad" returned: 0 in 0.692s {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 25 15:55:19 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-42843643-0cf1-4bb1-9bda-802c2228cc0d tempest-SnapshotsActionsTest-65651383 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-fa2da276-994a-452f-950a-05721f695adb.b8c27d68-ccca-4f87-95b9-17ef0d3362ad {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 25 15:55:19 devstack sudo[87228]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-fa2da276-994a-452f-950a-05721f695adb.b8c27d68-ccca-4f87-95b9-17ef0d3362ad Feb 25 15:55:19 devstack sudo[87228]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 25 15:55:19 devstack cinder-volume[83528]: DEBUG cinder.coordination [None req-ee4c4744-0975-4fcc-b82b-1efbf4963918 tempest-VolumeRetypeWithoutMigrationTest-1169426313 None] Acquiring lock "cinder-0e884cc0-e150-4579-a4d8-1a51c1a89f3f-delete_volume" by "delete_volume" {{(pid=83528) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 25 15:55:19 devstack cinder-volume[83528]: DEBUG cinder.coordination [None req-ee4c4744-0975-4fcc-b82b-1efbf4963918 tempest-VolumeRetypeWithoutMigrationTest-1169426313 None] Lock "cinder-0e884cc0-e150-4579-a4d8-1a51c1a89f3f-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=83528) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 25 15:55:19 devstack cinder-volume[83528]: DEBUG cinder.coordination [None req-ee4c4744-0975-4fcc-b82b-1efbf4963918 tempest-VolumeRetypeWithoutMigrationTest-1169426313 None] Acquiring lock "cinder-quobyte-0e884cc0-e150-4579-a4d8-1a51c1a89f3f" by "delete_volume" {{(pid=83528) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 25 15:55:19 devstack cinder-volume[83528]: DEBUG cinder.coordination [None req-ee4c4744-0975-4fcc-b82b-1efbf4963918 tempest-VolumeRetypeWithoutMigrationTest-1169426313 None] Lock "cinder-quobyte-0e884cc0-e150-4579-a4d8-1a51c1a89f3f" acquired by "delete_volume" :: waited 0.008s {{(pid=83528) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 25 15:55:19 devstack cinder-volume[83528]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6927862-5ae9-4bf9-ae19-3945ba580934]: (4, 'qcow2') {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 25 15:55:19 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-ee4c4744-0975-4fcc-b82b-1efbf4963918 tempest-VolumeRetypeWithoutMigrationTest-1169426313 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-0e884cc0-e150-4579-a4d8-1a51c1a89f3f {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 25 15:55:19 devstack sudo[87230]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-0e884cc0-e150-4579-a4d8-1a51c1a89f3f Feb 25 15:55:19 devstack sudo[87230]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 25 15:55:19 devstack sudo[87228]: pam_unix(sudo:session): session closed for user root Feb 25 15:55:19 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-42843643-0cf1-4bb1-9bda-802c2228cc0d tempest-SnapshotsActionsTest-65651383 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-fa2da276-994a-452f-950a-05721f695adb.b8c27d68-ccca-4f87-95b9-17ef0d3362ad" returned: 0 in 0.547s {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 25 15:55:19 devstack cinder-volume[83528]: DEBUG cinder.coordination [None req-42843643-0cf1-4bb1-9bda-802c2228cc0d tempest-SnapshotsActionsTest-65651383 None] Lock "cinder-quobyte-b8c27d68-ccca-4f87-95b9-17ef0d3362ad" released by "_delete_snapshot" :: held 2.628s {{(pid=83528) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 25 15:55:19 devstack cinder-volume[83528]: DEBUG cinder.coordination [None req-42843643-0cf1-4bb1-9bda-802c2228cc0d tempest-SnapshotsActionsTest-65651383 None] Lock "cinder-quobyte-fa2da276-994a-452f-950a-05721f695adb" released by "delete_snapshot" :: held 2.655s {{(pid=83528) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 25 15:55:19 devstack cinder-volume[83528]: DEBUG cinder.quota [None req-42843643-0cf1-4bb1-9bda-802c2228cc0d tempest-SnapshotsActionsTest-65651383 None] Created reservations ['0de0b65a-a535-42da-990d-0876e8a6709a', '77eff73e-492d-437c-9bbf-8d182e376d86', 'c653caa1-7a31-44a5-8395-8a11657ddd78', '1558dd18-c232-4c2e-9c10-dfa255faf6f2'] {{(pid=83528) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 25 15:55:19 devstack cinder-volume[83528]: INFO cinder.volume.manager [None req-42843643-0cf1-4bb1-9bda-802c2228cc0d tempest-SnapshotsActionsTest-65651383 None] Delete snapshot completed successfully. Feb 25 15:55:19 devstack cinder-volume[83528]: DEBUG cinder.coordination [None req-42843643-0cf1-4bb1-9bda-802c2228cc0d tempest-SnapshotsActionsTest-65651383 None] Lock "cinder-b8c27d68-ccca-4f87-95b9-17ef0d3362ad-delete_snapshot" released by "delete_snapshot" :: held 2.753s {{(pid=83528) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 25 15:55:20 devstack sudo[87230]: pam_unix(sudo:session): session closed for user root Feb 25 15:55:20 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-ee4c4744-0975-4fcc-b82b-1efbf4963918 tempest-VolumeRetypeWithoutMigrationTest-1169426313 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-0e884cc0-e150-4579-a4d8-1a51c1a89f3f" returned: 0 in 0.555s {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 25 15:55:20 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-ee4c4744-0975-4fcc-b82b-1efbf4963918 tempest-VolumeRetypeWithoutMigrationTest-1169426313 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-0e884cc0-e150-4579-a4d8-1a51c1a89f3f {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 25 15:55:20 devstack sudo[87236]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-0e884cc0-e150-4579-a4d8-1a51c1a89f3f Feb 25 15:55:20 devstack sudo[87236]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 25 15:55:20 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-a2489a12-4140-442a-927d-cf36c6877f71 tempest-SnapshotsActionsTest-738507698 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 25 15:55:20 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-a2489a12-4140-442a-927d-cf36c6877f71 tempest-SnapshotsActionsTest-738507698 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 25 15:55:20 devstack sudo[87236]: pam_unix(sudo:session): session closed for user root Feb 25 15:55:20 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-ee4c4744-0975-4fcc-b82b-1efbf4963918 tempest-VolumeRetypeWithoutMigrationTest-1169426313 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-0e884cc0-e150-4579-a4d8-1a51c1a89f3f" returned: 0 in 0.575s {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 25 15:55:20 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.remotefs [None req-a2489a12-4140-442a-927d-cf36c6877f71 tempest-SnapshotsActionsTest-738507698 None] Creating offline snapshot f3db4c18-2fa6-46be-8e83-366bd9ffa5c3 of volume fa2da276-994a-452f-950a-05721f695adb {{(pid=83528) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Feb 25 15:55:20 devstack cinder-volume[83528]: DEBUG cinder.coordination [None req-ee4c4744-0975-4fcc-b82b-1efbf4963918 tempest-VolumeRetypeWithoutMigrationTest-1169426313 None] Lock "cinder-quobyte-0e884cc0-e150-4579-a4d8-1a51c1a89f3f" released by "delete_volume" :: held 1.202s {{(pid=83528) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 25 15:55:20 devstack cinder-volume[83528]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0c347be-f231-466b-a5d9-c3c394c3297b]: (4, 'qcow2') {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 25 15:55:20 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-a2489a12-4140-442a-927d-cf36c6877f71 tempest-SnapshotsActionsTest-738507698 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-fa2da276-994a-452f-950a-05721f695adb.cf48a71a-46a9-4cb3-9a49-261772e1aa50 {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 25 15:55:20 devstack cinder-volume[83528]: WARNING cinder.quota [None req-ee4c4744-0975-4fcc-b82b-1efbf4963918 tempest-VolumeRetypeWithoutMigrationTest-1169426313 None] Deprecated: Default quota for resource: volumes_volume-type-2 is set by the default quota flag: quota_volumes_volume-type-2, it is now deprecated. Please use the default quota class for default quota. Feb 25 15:55:20 devstack cinder-volume[83528]: WARNING cinder.quota [None req-ee4c4744-0975-4fcc-b82b-1efbf4963918 tempest-VolumeRetypeWithoutMigrationTest-1169426313 None] Deprecated: Default quota for resource: gigabytes_volume-type-2 is set by the default quota flag: quota_gigabytes_volume-type-2, it is now deprecated. Please use the default quota class for default quota. Feb 25 15:55:20 devstack cinder-volume[83528]: DEBUG cinder.quota [None req-ee4c4744-0975-4fcc-b82b-1efbf4963918 tempest-VolumeRetypeWithoutMigrationTest-1169426313 None] Created reservations ['d3dae06f-ab28-468b-a937-63952282d50c', '3e2cf19a-8db8-4301-8183-89c54eb3cf10', 'aafa722a-9cdb-44c7-a430-2332cdd01902', '9bd1e9fe-7a8e-46c9-9c55-08b3804a98f0'] {{(pid=83528) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 25 15:55:20 devstack sudo[87239]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-fa2da276-994a-452f-950a-05721f695adb.cf48a71a-46a9-4cb3-9a49-261772e1aa50 Feb 25 15:55:20 devstack sudo[87239]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 25 15:55:20 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-ee4c4744-0975-4fcc-b82b-1efbf4963918 tempest-VolumeRetypeWithoutMigrationTest-1169426313 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 25 15:55:20 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-ee4c4744-0975-4fcc-b82b-1efbf4963918 tempest-VolumeRetypeWithoutMigrationTest-1169426313 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 25 15:55:20 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.quobyte [None req-ee4c4744-0975-4fcc-b82b-1efbf4963918 tempest-VolumeRetypeWithoutMigrationTest-1169426313 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23e9d725-3e04-4cd9-bfe0-c8ef43305589': None} {{(pid=83528) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 25 15:55:20 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.quobyte [None req-ee4c4744-0975-4fcc-b82b-1efbf4963918 tempest-VolumeRetypeWithoutMigrationTest-1169426313 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23e9d725-3e04-4cd9-bfe0-c8ef43305589'] {{(pid=83528) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 25 15:55:20 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-ee4c4744-0975-4fcc-b82b-1efbf4963918 tempest-VolumeRetypeWithoutMigrationTest-1169426313 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 25 15:55:20 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-ee4c4744-0975-4fcc-b82b-1efbf4963918 tempest-VolumeRetypeWithoutMigrationTest-1169426313 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85 {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 25 15:55:20 devstack sudo[87241]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85 Feb 25 15:55:20 devstack sudo[87241]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 25 15:55:21 devstack sudo[87241]: pam_unix(sudo:session): session closed for user root Feb 25 15:55:21 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-ee4c4744-0975-4fcc-b82b-1efbf4963918 tempest-VolumeRetypeWithoutMigrationTest-1169426313 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85" returned: 0 in 0.451s {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 25 15:55:21 devstack cinder-volume[83528]: DEBUG cinder.manager [None req-ee4c4744-0975-4fcc-b82b-1efbf4963918 tempest-VolumeRetypeWithoutMigrationTest-1169426313 None] Notifying Schedulers of capabilities ... {{(pid=83528) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 25 15:55:21 devstack cinder-volume[83528]: INFO cinder.volume.manager [None req-ee4c4744-0975-4fcc-b82b-1efbf4963918 tempest-VolumeRetypeWithoutMigrationTest-1169426313 None] Deleted volume successfully. Feb 25 15:55:21 devstack cinder-volume[83528]: DEBUG cinder.coordination [None req-ee4c4744-0975-4fcc-b82b-1efbf4963918 tempest-VolumeRetypeWithoutMigrationTest-1169426313 None] Lock "cinder-0e884cc0-e150-4579-a4d8-1a51c1a89f3f-delete_volume" released by "delete_volume" :: held 1.820s {{(pid=83528) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 25 15:55:21 devstack sudo[87239]: pam_unix(sudo:session): session closed for user root Feb 25 15:55:21 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-a2489a12-4140-442a-927d-cf36c6877f71 tempest-SnapshotsActionsTest-738507698 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-fa2da276-994a-452f-950a-05721f695adb.cf48a71a-46a9-4cb3-9a49-261772e1aa50" returned: 0 in 0.600s {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 25 15:55:21 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.remotefs [None req-a2489a12-4140-442a-927d-cf36c6877f71 tempest-SnapshotsActionsTest-738507698 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-fa2da276-994a-452f-950a-05721f695adb(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83528) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Feb 25 15:55:21 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-a2489a12-4140-442a-927d-cf36c6877f71 tempest-SnapshotsActionsTest-738507698 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-fa2da276-994a-452f-950a-05721f695adb.cf48a71a-46a9-4cb3-9a49-261772e1aa50,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-fa2da276-994a-452f-950a-05721f695adb.f3db4c18-2fa6-46be-8e83-366bd9ffa5c3 1G {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 25 15:55:21 devstack sudo[87247]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-fa2da276-994a-452f-950a-05721f695adb.cf48a71a-46a9-4cb3-9a49-261772e1aa50,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-fa2da276-994a-452f-950a-05721f695adb.f3db4c18-2fa6-46be-8e83-366bd9ffa5c3 1G Feb 25 15:55:21 devstack sudo[87247]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 25 15:55:22 devstack sudo[87247]: pam_unix(sudo:session): session closed for user root Feb 25 15:55:22 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-a2489a12-4140-442a-927d-cf36c6877f71 tempest-SnapshotsActionsTest-738507698 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-fa2da276-994a-452f-950a-05721f695adb.cf48a71a-46a9-4cb3-9a49-261772e1aa50,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-fa2da276-994a-452f-950a-05721f695adb.f3db4c18-2fa6-46be-8e83-366bd9ffa5c3 1G" returned: 0 in 0.866s {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 25 15:55:22 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-a2489a12-4140-442a-927d-cf36c6877f71 tempest-SnapshotsActionsTest-738507698 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fa2da276-994a-452f-950a-05721f695adb.cf48a71a-46a9-4cb3-9a49-261772e1aa50 -F qcow2 /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-fa2da276-994a-452f-950a-05721f695adb.f3db4c18-2fa6-46be-8e83-366bd9ffa5c3 {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 25 15:55:22 devstack sudo[87252]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fa2da276-994a-452f-950a-05721f695adb.cf48a71a-46a9-4cb3-9a49-261772e1aa50 -F qcow2 /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-fa2da276-994a-452f-950a-05721f695adb.f3db4c18-2fa6-46be-8e83-366bd9ffa5c3 Feb 25 15:55:22 devstack sudo[87252]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 25 15:55:22 devstack sudo[87252]: pam_unix(sudo:session): session closed for user root Feb 25 15:55:22 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-a2489a12-4140-442a-927d-cf36c6877f71 tempest-SnapshotsActionsTest-738507698 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fa2da276-994a-452f-950a-05721f695adb.cf48a71a-46a9-4cb3-9a49-261772e1aa50 -F qcow2 /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-fa2da276-994a-452f-950a-05721f695adb.f3db4c18-2fa6-46be-8e83-366bd9ffa5c3" returned: 0 in 0.637s {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 25 15:55:22 devstack cinder-volume[83528]: WARNING cinder.volume.drivers.remotefs [None req-a2489a12-4140-442a-927d-cf36c6877f71 tempest-SnapshotsActionsTest-738507698 None] /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-fa2da276-994a-452f-950a-05721f695adb.f3db4c18-2fa6-46be-8e83-366bd9ffa5c3 is being set with open permissions: ugo+rw Feb 25 15:55:22 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-a2489a12-4140-442a-927d-cf36c6877f71 tempest-SnapshotsActionsTest-738507698 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-fa2da276-994a-452f-950a-05721f695adb.f3db4c18-2fa6-46be-8e83-366bd9ffa5c3 {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 25 15:55:22 devstack sudo[87257]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-fa2da276-994a-452f-950a-05721f695adb.f3db4c18-2fa6-46be-8e83-366bd9ffa5c3 Feb 25 15:55:22 devstack sudo[87257]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 25 15:55:23 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-a2489a12-4140-442a-927d-cf36c6877f71 tempest-SnapshotsActionsTest-738507698 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-fa2da276-994a-452f-950a-05721f695adb.f3db4c18-2fa6-46be-8e83-366bd9ffa5c3" returned: 0 in 0.613s {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 25 15:55:23 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-a2489a12-4140-442a-927d-cf36c6877f71 tempest-SnapshotsActionsTest-738507698 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.805s {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 25 15:55:23 devstack sudo[87257]: pam_unix(sudo:session): session closed for user root Feb 25 15:55:23 devstack cinder-volume[83528]: INFO cinder.volume.manager [None req-a2489a12-4140-442a-927d-cf36c6877f71 tempest-SnapshotsActionsTest-738507698 None] Create snapshot completed successfully Feb 25 15:55:23 devstack cinder-volume[83528]: DEBUG cinder.coordination [None req-761ee5e5-768d-465e-a298-167ffd450cc4 tempest-SnapshotsActionsTest-65651383 None] Acquiring lock "cinder-f3db4c18-2fa6-46be-8e83-366bd9ffa5c3-delete_snapshot" by "delete_snapshot" {{(pid=83528) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 25 15:55:23 devstack cinder-volume[83528]: DEBUG cinder.coordination [None req-761ee5e5-768d-465e-a298-167ffd450cc4 tempest-SnapshotsActionsTest-65651383 None] Lock "cinder-f3db4c18-2fa6-46be-8e83-366bd9ffa5c3-delete_snapshot" acquired by "delete_snapshot" :: waited 0.020s {{(pid=83528) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 25 15:55:23 devstack cinder-volume[83528]: DEBUG cinder.coordination [None req-761ee5e5-768d-465e-a298-167ffd450cc4 tempest-SnapshotsActionsTest-65651383 None] Acquiring lock "cinder-quobyte-fa2da276-994a-452f-950a-05721f695adb" by "delete_snapshot" {{(pid=83528) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 25 15:55:23 devstack cinder-volume[83528]: DEBUG cinder.coordination [None req-761ee5e5-768d-465e-a298-167ffd450cc4 tempest-SnapshotsActionsTest-65651383 None] Lock "cinder-quobyte-fa2da276-994a-452f-950a-05721f695adb" acquired by "delete_snapshot" :: waited 0.017s {{(pid=83528) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 25 15:55:23 devstack cinder-volume[83528]: DEBUG cinder.coordination [None req-761ee5e5-768d-465e-a298-167ffd450cc4 tempest-SnapshotsActionsTest-65651383 None] Acquiring lock "cinder-quobyte-f3db4c18-2fa6-46be-8e83-366bd9ffa5c3" by "_delete_snapshot" {{(pid=83528) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 25 15:55:23 devstack cinder-volume[83528]: DEBUG cinder.coordination [None req-761ee5e5-768d-465e-a298-167ffd450cc4 tempest-SnapshotsActionsTest-65651383 None] Lock "cinder-quobyte-f3db4c18-2fa6-46be-8e83-366bd9ffa5c3" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=83528) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 25 15:55:23 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.remotefs [None req-761ee5e5-768d-465e-a298-167ffd450cc4 tempest-SnapshotsActionsTest-65651383 None] Deleting offline snapshot f3db4c18-2fa6-46be-8e83-366bd9ffa5c3 of volume fa2da276-994a-452f-950a-05721f695adb {{(pid=83528) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Feb 25 15:55:23 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.remotefs [None req-761ee5e5-768d-465e-a298-167ffd450cc4 tempest-SnapshotsActionsTest-65651383 None] snapshot_file for this snap is: volume-fa2da276-994a-452f-950a-05721f695adb.f3db4c18-2fa6-46be-8e83-366bd9ffa5c3 {{(pid=83528) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Feb 25 15:55:23 devstack cinder-volume[83528]: DEBUG oslo.privsep.daemon [-] privsep: reply[501df6de-5c10-4c93-ae2a-78f31770cb42]: (4, 'qcow2') {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 25 15:55:23 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-761ee5e5-768d-465e-a298-167ffd450cc4 tempest-SnapshotsActionsTest-65651383 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-fa2da276-994a-452f-950a-05721f695adb.f3db4c18-2fa6-46be-8e83-366bd9ffa5c3 {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 25 15:55:24 devstack sudo[87262]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-fa2da276-994a-452f-950a-05721f695adb.f3db4c18-2fa6-46be-8e83-366bd9ffa5c3 Feb 25 15:55:24 devstack sudo[87262]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 25 15:55:24 devstack sudo[87262]: pam_unix(sudo:session): session closed for user root Feb 25 15:55:24 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-761ee5e5-768d-465e-a298-167ffd450cc4 tempest-SnapshotsActionsTest-65651383 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-fa2da276-994a-452f-950a-05721f695adb.f3db4c18-2fa6-46be-8e83-366bd9ffa5c3" returned: 0 in 0.769s {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 25 15:55:24 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.remotefs [None req-761ee5e5-768d-465e-a298-167ffd450cc4 tempest-SnapshotsActionsTest-65651383 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-fa2da276-994a-452f-950a-05721f695adb(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83528) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Feb 25 15:55:24 devstack cinder-volume[83528]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3d2bb9f-ad76-4dc3-8fbe-e7f85fb4c72b]: (4, 'qcow2') {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 25 15:55:24 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-761ee5e5-768d-465e-a298-167ffd450cc4 tempest-SnapshotsActionsTest-65651383 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-fa2da276-994a-452f-950a-05721f695adb.cf48a71a-46a9-4cb3-9a49-261772e1aa50 {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 25 15:55:24 devstack sudo[87271]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-fa2da276-994a-452f-950a-05721f695adb.cf48a71a-46a9-4cb3-9a49-261772e1aa50 Feb 25 15:55:24 devstack sudo[87271]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 25 15:55:25 devstack sudo[87271]: pam_unix(sudo:session): session closed for user root Feb 25 15:55:25 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-761ee5e5-768d-465e-a298-167ffd450cc4 tempest-SnapshotsActionsTest-65651383 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-fa2da276-994a-452f-950a-05721f695adb.cf48a71a-46a9-4cb3-9a49-261772e1aa50" returned: 0 in 0.617s {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 25 15:55:25 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.remotefs [None req-761ee5e5-768d-465e-a298-167ffd450cc4 tempest-SnapshotsActionsTest-65651383 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-fa2da276-994a-452f-950a-05721f695adb(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83528) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Feb 25 15:55:25 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-761ee5e5-768d-465e-a298-167ffd450cc4 tempest-SnapshotsActionsTest-65651383 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-fa2da276-994a-452f-950a-05721f695adb.f3db4c18-2fa6-46be-8e83-366bd9ffa5c3 {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 25 15:55:25 devstack sudo[87276]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-fa2da276-994a-452f-950a-05721f695adb.f3db4c18-2fa6-46be-8e83-366bd9ffa5c3 Feb 25 15:55:25 devstack sudo[87276]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 25 15:55:26 devstack sudo[87276]: pam_unix(sudo:session): session closed for user root Feb 25 15:55:26 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-761ee5e5-768d-465e-a298-167ffd450cc4 tempest-SnapshotsActionsTest-65651383 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-fa2da276-994a-452f-950a-05721f695adb.f3db4c18-2fa6-46be-8e83-366bd9ffa5c3" returned: 0 in 0.669s {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 25 15:55:26 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-761ee5e5-768d-465e-a298-167ffd450cc4 tempest-SnapshotsActionsTest-65651383 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-fa2da276-994a-452f-950a-05721f695adb.f3db4c18-2fa6-46be-8e83-366bd9ffa5c3 {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 25 15:55:26 devstack sudo[87281]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-fa2da276-994a-452f-950a-05721f695adb.f3db4c18-2fa6-46be-8e83-366bd9ffa5c3 Feb 25 15:55:26 devstack sudo[87281]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 25 15:55:26 devstack sudo[87281]: pam_unix(sudo:session): session closed for user root Feb 25 15:55:26 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-761ee5e5-768d-465e-a298-167ffd450cc4 tempest-SnapshotsActionsTest-65651383 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-fa2da276-994a-452f-950a-05721f695adb.f3db4c18-2fa6-46be-8e83-366bd9ffa5c3" returned: 0 in 0.594s {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 25 15:55:26 devstack cinder-volume[83528]: DEBUG cinder.coordination [None req-761ee5e5-768d-465e-a298-167ffd450cc4 tempest-SnapshotsActionsTest-65651383 None] Lock "cinder-quobyte-f3db4c18-2fa6-46be-8e83-366bd9ffa5c3" released by "_delete_snapshot" :: held 2.722s {{(pid=83528) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 25 15:55:26 devstack cinder-volume[83528]: DEBUG cinder.coordination [None req-761ee5e5-768d-465e-a298-167ffd450cc4 tempest-SnapshotsActionsTest-65651383 None] Lock "cinder-quobyte-fa2da276-994a-452f-950a-05721f695adb" released by "delete_snapshot" :: held 2.745s {{(pid=83528) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 25 15:55:26 devstack cinder-volume[83528]: DEBUG cinder.quota [None req-761ee5e5-768d-465e-a298-167ffd450cc4 tempest-SnapshotsActionsTest-65651383 None] Created reservations ['a4600e1d-ef23-4309-84ff-0d8497f29c26', '69b4f01d-8caa-4304-bfdd-b8655eea6c2c', '389c18b7-aff1-4363-b1ee-9ed7ba4b6634', '5e6133c7-80fd-4bf3-9f51-83ded93e0b2c'] {{(pid=83528) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 25 15:55:26 devstack cinder-volume[83528]: INFO cinder.volume.manager [None req-761ee5e5-768d-465e-a298-167ffd450cc4 tempest-SnapshotsActionsTest-65651383 None] Delete snapshot completed successfully. Feb 25 15:55:26 devstack cinder-volume[83528]: DEBUG cinder.coordination [None req-761ee5e5-768d-465e-a298-167ffd450cc4 tempest-SnapshotsActionsTest-65651383 None] Lock "cinder-f3db4c18-2fa6-46be-8e83-366bd9ffa5c3-delete_snapshot" released by "delete_snapshot" :: held 2.863s {{(pid=83528) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 25 15:55:27 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-c2b1d2bb-6d2c-46d0-a86f-9e49cbdc043c tempest-SnapshotsActionsTest-738507698 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 25 15:55:27 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-c2b1d2bb-6d2c-46d0-a86f-9e49cbdc043c tempest-SnapshotsActionsTest-738507698 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 25 15:55:27 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.remotefs [None req-c2b1d2bb-6d2c-46d0-a86f-9e49cbdc043c tempest-SnapshotsActionsTest-738507698 None] Creating offline snapshot 95e85573-458e-434b-aa8d-c13eb7bea72b of volume fa2da276-994a-452f-950a-05721f695adb {{(pid=83528) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Feb 25 15:55:27 devstack cinder-volume[83528]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4e3b3cf-49a8-41b1-a375-b8785041baa5]: (4, 'qcow2') {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 25 15:55:27 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-c2b1d2bb-6d2c-46d0-a86f-9e49cbdc043c tempest-SnapshotsActionsTest-738507698 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-fa2da276-994a-452f-950a-05721f695adb.cf48a71a-46a9-4cb3-9a49-261772e1aa50 {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 25 15:55:27 devstack sudo[87285]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-fa2da276-994a-452f-950a-05721f695adb.cf48a71a-46a9-4cb3-9a49-261772e1aa50 Feb 25 15:55:27 devstack sudo[87285]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 25 15:55:27 devstack sudo[87285]: pam_unix(sudo:session): session closed for user root Feb 25 15:55:27 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-c2b1d2bb-6d2c-46d0-a86f-9e49cbdc043c tempest-SnapshotsActionsTest-738507698 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-fa2da276-994a-452f-950a-05721f695adb.cf48a71a-46a9-4cb3-9a49-261772e1aa50" returned: 0 in 0.585s {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 25 15:55:27 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.remotefs [None req-c2b1d2bb-6d2c-46d0-a86f-9e49cbdc043c tempest-SnapshotsActionsTest-738507698 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-fa2da276-994a-452f-950a-05721f695adb(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83528) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Feb 25 15:55:27 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-c2b1d2bb-6d2c-46d0-a86f-9e49cbdc043c tempest-SnapshotsActionsTest-738507698 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-fa2da276-994a-452f-950a-05721f695adb.cf48a71a-46a9-4cb3-9a49-261772e1aa50,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-fa2da276-994a-452f-950a-05721f695adb.95e85573-458e-434b-aa8d-c13eb7bea72b 1G {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 25 15:55:27 devstack sudo[87290]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-fa2da276-994a-452f-950a-05721f695adb.cf48a71a-46a9-4cb3-9a49-261772e1aa50,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-fa2da276-994a-452f-950a-05721f695adb.95e85573-458e-434b-aa8d-c13eb7bea72b 1G Feb 25 15:55:27 devstack sudo[87290]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 25 15:55:28 devstack sudo[87290]: pam_unix(sudo:session): session closed for user root Feb 25 15:55:28 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-c2b1d2bb-6d2c-46d0-a86f-9e49cbdc043c tempest-SnapshotsActionsTest-738507698 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-fa2da276-994a-452f-950a-05721f695adb.cf48a71a-46a9-4cb3-9a49-261772e1aa50,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-fa2da276-994a-452f-950a-05721f695adb.95e85573-458e-434b-aa8d-c13eb7bea72b 1G" returned: 0 in 0.647s {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 25 15:55:28 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-c2b1d2bb-6d2c-46d0-a86f-9e49cbdc043c tempest-SnapshotsActionsTest-738507698 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fa2da276-994a-452f-950a-05721f695adb.cf48a71a-46a9-4cb3-9a49-261772e1aa50 -F qcow2 /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-fa2da276-994a-452f-950a-05721f695adb.95e85573-458e-434b-aa8d-c13eb7bea72b {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 25 15:55:28 devstack sudo[87296]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fa2da276-994a-452f-950a-05721f695adb.cf48a71a-46a9-4cb3-9a49-261772e1aa50 -F qcow2 /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-fa2da276-994a-452f-950a-05721f695adb.95e85573-458e-434b-aa8d-c13eb7bea72b Feb 25 15:55:28 devstack sudo[87296]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 25 15:55:29 devstack sudo[87296]: pam_unix(sudo:session): session closed for user root Feb 25 15:55:29 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-c2b1d2bb-6d2c-46d0-a86f-9e49cbdc043c tempest-SnapshotsActionsTest-738507698 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fa2da276-994a-452f-950a-05721f695adb.cf48a71a-46a9-4cb3-9a49-261772e1aa50 -F qcow2 /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-fa2da276-994a-452f-950a-05721f695adb.95e85573-458e-434b-aa8d-c13eb7bea72b" returned: 0 in 0.506s {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 25 15:55:29 devstack cinder-volume[83528]: WARNING cinder.volume.drivers.remotefs [None req-c2b1d2bb-6d2c-46d0-a86f-9e49cbdc043c tempest-SnapshotsActionsTest-738507698 None] /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-fa2da276-994a-452f-950a-05721f695adb.95e85573-458e-434b-aa8d-c13eb7bea72b is being set with open permissions: ugo+rw Feb 25 15:55:29 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-c2b1d2bb-6d2c-46d0-a86f-9e49cbdc043c tempest-SnapshotsActionsTest-738507698 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-fa2da276-994a-452f-950a-05721f695adb.95e85573-458e-434b-aa8d-c13eb7bea72b {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 25 15:55:29 devstack sudo[87301]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-fa2da276-994a-452f-950a-05721f695adb.95e85573-458e-434b-aa8d-c13eb7bea72b Feb 25 15:55:29 devstack sudo[87301]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 25 15:55:29 devstack sudo[87301]: pam_unix(sudo:session): session closed for user root Feb 25 15:55:29 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-c2b1d2bb-6d2c-46d0-a86f-9e49cbdc043c tempest-SnapshotsActionsTest-738507698 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-fa2da276-994a-452f-950a-05721f695adb.95e85573-458e-434b-aa8d-c13eb7bea72b" returned: 0 in 0.432s {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 25 15:55:29 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-c2b1d2bb-6d2c-46d0-a86f-9e49cbdc043c tempest-SnapshotsActionsTest-738507698 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.270s {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 25 15:55:29 devstack cinder-volume[83528]: INFO cinder.volume.manager [None req-c2b1d2bb-6d2c-46d0-a86f-9e49cbdc043c tempest-SnapshotsActionsTest-738507698 None] Create snapshot completed successfully Feb 25 15:55:32 devstack cinder-volume[83528]: DEBUG cinder.coordination [None req-0f867ebc-cf30-409d-8958-108fb87a10bc tempest-SnapshotsActionsTest-65651383 None] Acquiring lock "cinder-95e85573-458e-434b-aa8d-c13eb7bea72b-delete_snapshot" by "delete_snapshot" {{(pid=83528) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 25 15:55:32 devstack cinder-volume[83528]: DEBUG cinder.coordination [None req-0f867ebc-cf30-409d-8958-108fb87a10bc tempest-SnapshotsActionsTest-65651383 None] Lock "cinder-95e85573-458e-434b-aa8d-c13eb7bea72b-delete_snapshot" acquired by "delete_snapshot" :: waited 0.010s {{(pid=83528) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 25 15:55:32 devstack cinder-volume[83528]: DEBUG cinder.coordination [None req-0f867ebc-cf30-409d-8958-108fb87a10bc tempest-SnapshotsActionsTest-65651383 None] Acquiring lock "cinder-quobyte-fa2da276-994a-452f-950a-05721f695adb" by "delete_snapshot" {{(pid=83528) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 25 15:55:32 devstack cinder-volume[83528]: DEBUG cinder.coordination [None req-0f867ebc-cf30-409d-8958-108fb87a10bc tempest-SnapshotsActionsTest-65651383 None] Lock "cinder-quobyte-fa2da276-994a-452f-950a-05721f695adb" acquired by "delete_snapshot" :: waited 0.012s {{(pid=83528) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 25 15:55:32 devstack cinder-volume[83528]: DEBUG cinder.coordination [None req-0f867ebc-cf30-409d-8958-108fb87a10bc tempest-SnapshotsActionsTest-65651383 None] Acquiring lock "cinder-quobyte-95e85573-458e-434b-aa8d-c13eb7bea72b" by "_delete_snapshot" {{(pid=83528) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 25 15:55:32 devstack cinder-volume[83528]: DEBUG cinder.coordination [None req-0f867ebc-cf30-409d-8958-108fb87a10bc tempest-SnapshotsActionsTest-65651383 None] Lock "cinder-quobyte-95e85573-458e-434b-aa8d-c13eb7bea72b" acquired by "_delete_snapshot" :: waited 0.012s {{(pid=83528) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 25 15:55:32 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.remotefs [None req-0f867ebc-cf30-409d-8958-108fb87a10bc tempest-SnapshotsActionsTest-65651383 None] Deleting offline snapshot 95e85573-458e-434b-aa8d-c13eb7bea72b of volume fa2da276-994a-452f-950a-05721f695adb {{(pid=83528) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Feb 25 15:55:32 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.remotefs [None req-0f867ebc-cf30-409d-8958-108fb87a10bc tempest-SnapshotsActionsTest-65651383 None] snapshot_file for this snap is: volume-fa2da276-994a-452f-950a-05721f695adb.95e85573-458e-434b-aa8d-c13eb7bea72b {{(pid=83528) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Feb 25 15:55:32 devstack cinder-volume[83528]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f415f35-ad73-486a-b559-67d99872d3d6]: (4, 'qcow2') {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 25 15:55:32 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-0f867ebc-cf30-409d-8958-108fb87a10bc tempest-SnapshotsActionsTest-65651383 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-fa2da276-994a-452f-950a-05721f695adb.95e85573-458e-434b-aa8d-c13eb7bea72b {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 25 15:55:32 devstack sudo[87321]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-fa2da276-994a-452f-950a-05721f695adb.95e85573-458e-434b-aa8d-c13eb7bea72b Feb 25 15:55:32 devstack sudo[87321]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 25 15:55:33 devstack sudo[87321]: pam_unix(sudo:session): session closed for user root Feb 25 15:55:33 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-0f867ebc-cf30-409d-8958-108fb87a10bc tempest-SnapshotsActionsTest-65651383 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-fa2da276-994a-452f-950a-05721f695adb.95e85573-458e-434b-aa8d-c13eb7bea72b" returned: 0 in 0.461s {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 25 15:55:33 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.remotefs [None req-0f867ebc-cf30-409d-8958-108fb87a10bc tempest-SnapshotsActionsTest-65651383 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-fa2da276-994a-452f-950a-05721f695adb(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83528) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Feb 25 15:55:33 devstack cinder-volume[83528]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2a0be7c-406e-4fd8-862f-663fdf85a0d0]: (4, 'qcow2') {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 25 15:55:33 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-0f867ebc-cf30-409d-8958-108fb87a10bc tempest-SnapshotsActionsTest-65651383 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-fa2da276-994a-452f-950a-05721f695adb.cf48a71a-46a9-4cb3-9a49-261772e1aa50 {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 25 15:55:33 devstack sudo[87326]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-fa2da276-994a-452f-950a-05721f695adb.cf48a71a-46a9-4cb3-9a49-261772e1aa50 Feb 25 15:55:33 devstack sudo[87326]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 25 15:55:33 devstack sudo[87326]: pam_unix(sudo:session): session closed for user root Feb 25 15:55:33 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-0f867ebc-cf30-409d-8958-108fb87a10bc tempest-SnapshotsActionsTest-65651383 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-fa2da276-994a-452f-950a-05721f695adb.cf48a71a-46a9-4cb3-9a49-261772e1aa50" returned: 0 in 0.468s {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 25 15:55:33 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.remotefs [None req-0f867ebc-cf30-409d-8958-108fb87a10bc tempest-SnapshotsActionsTest-65651383 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-fa2da276-994a-452f-950a-05721f695adb(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83528) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Feb 25 15:55:33 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-0f867ebc-cf30-409d-8958-108fb87a10bc tempest-SnapshotsActionsTest-65651383 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-fa2da276-994a-452f-950a-05721f695adb.95e85573-458e-434b-aa8d-c13eb7bea72b {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 25 15:55:33 devstack sudo[87331]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-fa2da276-994a-452f-950a-05721f695adb.95e85573-458e-434b-aa8d-c13eb7bea72b Feb 25 15:55:33 devstack sudo[87331]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 25 15:55:34 devstack sudo[87331]: pam_unix(sudo:session): session closed for user root Feb 25 15:55:34 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-0f867ebc-cf30-409d-8958-108fb87a10bc tempest-SnapshotsActionsTest-65651383 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-fa2da276-994a-452f-950a-05721f695adb.95e85573-458e-434b-aa8d-c13eb7bea72b" returned: 0 in 0.529s {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 25 15:55:34 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-0f867ebc-cf30-409d-8958-108fb87a10bc tempest-SnapshotsActionsTest-65651383 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-fa2da276-994a-452f-950a-05721f695adb.95e85573-458e-434b-aa8d-c13eb7bea72b {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 25 15:55:34 devstack sudo[87336]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-fa2da276-994a-452f-950a-05721f695adb.95e85573-458e-434b-aa8d-c13eb7bea72b Feb 25 15:55:34 devstack sudo[87336]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 25 15:55:34 devstack sudo[87336]: pam_unix(sudo:session): session closed for user root Feb 25 15:55:34 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-0f867ebc-cf30-409d-8958-108fb87a10bc tempest-SnapshotsActionsTest-65651383 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-fa2da276-994a-452f-950a-05721f695adb.95e85573-458e-434b-aa8d-c13eb7bea72b" returned: 0 in 0.433s {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 25 15:55:34 devstack cinder-volume[83528]: DEBUG cinder.coordination [None req-0f867ebc-cf30-409d-8958-108fb87a10bc tempest-SnapshotsActionsTest-65651383 None] Lock "cinder-quobyte-95e85573-458e-434b-aa8d-c13eb7bea72b" released by "_delete_snapshot" :: held 1.962s {{(pid=83528) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 25 15:55:34 devstack cinder-volume[83528]: DEBUG cinder.coordination [None req-0f867ebc-cf30-409d-8958-108fb87a10bc tempest-SnapshotsActionsTest-65651383 None] Lock "cinder-quobyte-fa2da276-994a-452f-950a-05721f695adb" released by "delete_snapshot" :: held 1.979s {{(pid=83528) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 25 15:55:34 devstack cinder-volume[83528]: DEBUG cinder.quota [None req-0f867ebc-cf30-409d-8958-108fb87a10bc tempest-SnapshotsActionsTest-65651383 None] Created reservations ['646a7454-a1a4-4694-a12e-b8b238df461d', '7c660884-e7b5-48ec-9b79-0af0f84fda29', 'c958b9d5-a472-4a2d-b276-4a146ddd1020', '7bead4fc-8418-4945-8d39-dce332cb9918'] {{(pid=83528) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 25 15:55:34 devstack cinder-volume[83528]: INFO cinder.volume.manager [None req-0f867ebc-cf30-409d-8958-108fb87a10bc tempest-SnapshotsActionsTest-65651383 None] Delete snapshot completed successfully. Feb 25 15:55:34 devstack cinder-volume[83528]: DEBUG cinder.coordination [None req-0f867ebc-cf30-409d-8958-108fb87a10bc tempest-SnapshotsActionsTest-65651383 None] Lock "cinder-95e85573-458e-434b-aa8d-c13eb7bea72b-delete_snapshot" released by "delete_snapshot" :: held 2.282s {{(pid=83528) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 25 15:55:36 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-810cec81-8893-48eb-8915-03c6caa8596c tempest-SnapshotsActionsTest-738507698 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 25 15:55:36 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-810cec81-8893-48eb-8915-03c6caa8596c tempest-SnapshotsActionsTest-738507698 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 25 15:55:36 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.remotefs [None req-810cec81-8893-48eb-8915-03c6caa8596c tempest-SnapshotsActionsTest-738507698 None] Creating offline snapshot c7a5289e-dcdb-46cf-80d3-6a4f17340499 of volume fa2da276-994a-452f-950a-05721f695adb {{(pid=83528) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Feb 25 15:55:36 devstack cinder-volume[83528]: DEBUG oslo.privsep.daemon [-] privsep: reply[abf9f193-098c-4ca6-8703-f1839e16c1b7]: (4, 'qcow2') {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 25 15:55:36 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-810cec81-8893-48eb-8915-03c6caa8596c tempest-SnapshotsActionsTest-738507698 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-fa2da276-994a-452f-950a-05721f695adb.cf48a71a-46a9-4cb3-9a49-261772e1aa50 {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 25 15:55:36 devstack sudo[87341]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-fa2da276-994a-452f-950a-05721f695adb.cf48a71a-46a9-4cb3-9a49-261772e1aa50 Feb 25 15:55:36 devstack sudo[87341]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 25 15:55:36 devstack sudo[87341]: pam_unix(sudo:session): session closed for user root Feb 25 15:55:36 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-810cec81-8893-48eb-8915-03c6caa8596c tempest-SnapshotsActionsTest-738507698 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-fa2da276-994a-452f-950a-05721f695adb.cf48a71a-46a9-4cb3-9a49-261772e1aa50" returned: 0 in 0.661s {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 25 15:55:36 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.remotefs [None req-810cec81-8893-48eb-8915-03c6caa8596c tempest-SnapshotsActionsTest-738507698 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-fa2da276-994a-452f-950a-05721f695adb(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83528) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Feb 25 15:55:36 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-810cec81-8893-48eb-8915-03c6caa8596c tempest-SnapshotsActionsTest-738507698 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-fa2da276-994a-452f-950a-05721f695adb.cf48a71a-46a9-4cb3-9a49-261772e1aa50,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-fa2da276-994a-452f-950a-05721f695adb.c7a5289e-dcdb-46cf-80d3-6a4f17340499 1G {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 25 15:55:36 devstack sudo[87346]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-fa2da276-994a-452f-950a-05721f695adb.cf48a71a-46a9-4cb3-9a49-261772e1aa50,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-fa2da276-994a-452f-950a-05721f695adb.c7a5289e-dcdb-46cf-80d3-6a4f17340499 1G Feb 25 15:55:36 devstack sudo[87346]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 25 15:55:37 devstack cinder-volume[83528]: DEBUG cinder.volume.flows.manager.create_volume [None req-ae6963c2-f43c-422f-b530-8ede85c40fb3 tempest-AbsoluteLimitsTests-1199316860 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83528) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 25 15:55:37 devstack sudo[87346]: pam_unix(sudo:session): session closed for user root Feb 25 15:55:37 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-ae6963c2-f43c-422f-b530-8ede85c40fb3 tempest-AbsoluteLimitsTests-1199316860 None] Flow 'volume_create_manager' (1bd8f04f-ff0e-45e5-a7b0-dc6dba69fba3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83528) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 25 15:55:37 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-ae6963c2-f43c-422f-b530-8ede85c40fb3 tempest-AbsoluteLimitsTests-1199316860 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (25508dae-37c5-4392-b68b-64d8d661d442) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 25 15:55:37 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-810cec81-8893-48eb-8915-03c6caa8596c tempest-SnapshotsActionsTest-738507698 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-fa2da276-994a-452f-950a-05721f695adb.cf48a71a-46a9-4cb3-9a49-261772e1aa50,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-fa2da276-994a-452f-950a-05721f695adb.c7a5289e-dcdb-46cf-80d3-6a4f17340499 1G" returned: 0 in 0.700s {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 25 15:55:37 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-810cec81-8893-48eb-8915-03c6caa8596c tempest-SnapshotsActionsTest-738507698 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fa2da276-994a-452f-950a-05721f695adb.cf48a71a-46a9-4cb3-9a49-261772e1aa50 -F qcow2 /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-fa2da276-994a-452f-950a-05721f695adb.c7a5289e-dcdb-46cf-80d3-6a4f17340499 {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 25 15:55:37 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-ae6963c2-f43c-422f-b530-8ede85c40fb3 tempest-AbsoluteLimitsTests-1199316860 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (25508dae-37c5-4392-b68b-64d8d661d442) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-25T14:55:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-800728031',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bb62b249-3c3c-4632-8e9f-050f7ee90cc2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b3b71025a3f94b19bb4af497e9d951a4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-25T14:55:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-25T14:55:37Z,use_quota=True,user_id='292d6959befe4b878b95c0969757bf0f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ce71c2f9-6543-4165-9653-a1529b2ea243),volume_type_id=ce71c2f9-6543-4165-9653-a1529b2ea243)' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 25 15:55:37 devstack sudo[87351]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fa2da276-994a-452f-950a-05721f695adb.cf48a71a-46a9-4cb3-9a49-261772e1aa50 -F qcow2 /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-fa2da276-994a-452f-950a-05721f695adb.c7a5289e-dcdb-46cf-80d3-6a4f17340499 Feb 25 15:55:37 devstack sudo[87351]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 25 15:55:37 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-ae6963c2-f43c-422f-b530-8ede85c40fb3 tempest-AbsoluteLimitsTests-1199316860 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8a5787a1-852f-4a3f-a8a9-370242f2fb51) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 25 15:55:37 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-ae6963c2-f43c-422f-b530-8ede85c40fb3 tempest-AbsoluteLimitsTests-1199316860 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8a5787a1-852f-4a3f-a8a9-370242f2fb51) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 25 15:55:37 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-ae6963c2-f43c-422f-b530-8ede85c40fb3 tempest-AbsoluteLimitsTests-1199316860 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6b5bb875-c3a0-4204-a530-5999d0b963c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 25 15:55:37 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-ae6963c2-f43c-422f-b530-8ede85c40fb3 tempest-AbsoluteLimitsTests-1199316860 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6b5bb875-c3a0-4204-a530-5999d0b963c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bb62b249-3c3c-4632-8e9f-050f7ee90cc2', 'volume_name': 'volume-bb62b249-3c3c-4632-8e9f-050f7ee90cc2', 'volume_size': 1}' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 25 15:55:37 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-ae6963c2-f43c-422f-b530-8ede85c40fb3 tempest-AbsoluteLimitsTests-1199316860 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9f76ea8c-3eaf-4141-9a73-7f4fc74c8ee6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 25 15:55:37 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-ae6963c2-f43c-422f-b530-8ede85c40fb3 tempest-AbsoluteLimitsTests-1199316860 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9f76ea8c-3eaf-4141-9a73-7f4fc74c8ee6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 25 15:55:37 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-ae6963c2-f43c-422f-b530-8ede85c40fb3 tempest-AbsoluteLimitsTests-1199316860 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (683d8d10-60c6-4bca-add2-362f9f2c8bb0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 25 15:55:37 devstack cinder-volume[83528]: INFO cinder.volume.flows.manager.create_volume [None req-ae6963c2-f43c-422f-b530-8ede85c40fb3 tempest-AbsoluteLimitsTests-1199316860 None] Volume bb62b249-3c3c-4632-8e9f-050f7ee90cc2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bb62b249-3c3c-4632-8e9f-050f7ee90cc2', 'volume_size': 1} Feb 25 15:55:37 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-ae6963c2-f43c-422f-b530-8ede85c40fb3 tempest-AbsoluteLimitsTests-1199316860 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 25 15:55:38 devstack sudo[87351]: pam_unix(sudo:session): session closed for user root Feb 25 15:55:38 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-810cec81-8893-48eb-8915-03c6caa8596c tempest-SnapshotsActionsTest-738507698 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fa2da276-994a-452f-950a-05721f695adb.cf48a71a-46a9-4cb3-9a49-261772e1aa50 -F qcow2 /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-fa2da276-994a-452f-950a-05721f695adb.c7a5289e-dcdb-46cf-80d3-6a4f17340499" returned: 0 in 0.524s {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 25 15:55:38 devstack cinder-volume[83528]: WARNING cinder.volume.drivers.remotefs [None req-810cec81-8893-48eb-8915-03c6caa8596c tempest-SnapshotsActionsTest-738507698 None] /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-fa2da276-994a-452f-950a-05721f695adb.c7a5289e-dcdb-46cf-80d3-6a4f17340499 is being set with open permissions: ugo+rw Feb 25 15:55:38 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-810cec81-8893-48eb-8915-03c6caa8596c tempest-SnapshotsActionsTest-738507698 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-fa2da276-994a-452f-950a-05721f695adb.c7a5289e-dcdb-46cf-80d3-6a4f17340499 {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 25 15:55:38 devstack sudo[87356]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-fa2da276-994a-452f-950a-05721f695adb.c7a5289e-dcdb-46cf-80d3-6a4f17340499 Feb 25 15:55:38 devstack sudo[87356]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 25 15:55:38 devstack sudo[87356]: pam_unix(sudo:session): session closed for user root Feb 25 15:55:38 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-810cec81-8893-48eb-8915-03c6caa8596c tempest-SnapshotsActionsTest-738507698 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-fa2da276-994a-452f-950a-05721f695adb.c7a5289e-dcdb-46cf-80d3-6a4f17340499" returned: 0 in 0.474s {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 25 15:55:38 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-810cec81-8893-48eb-8915-03c6caa8596c tempest-SnapshotsActionsTest-738507698 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.448s {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 25 15:55:38 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-ae6963c2-f43c-422f-b530-8ede85c40fb3 tempest-AbsoluteLimitsTests-1199316860 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.974s {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 25 15:55:38 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.quobyte [None req-ae6963c2-f43c-422f-b530-8ede85c40fb3 tempest-AbsoluteLimitsTests-1199316860 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-25T14:55:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-800728031',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bb62b249-3c3c-4632-8e9f-050f7ee90cc2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b3b71025a3f94b19bb4af497e9d951a4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-25T14:55:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-25T14:55:37Z,use_quota=True,user_id='292d6959befe4b878b95c0969757bf0f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ce71c2f9-6543-4165-9653-a1529b2ea243),volume_type_id=ce71c2f9-6543-4165-9653-a1529b2ea243)}" {{(pid=83528) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 25 15:55:38 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.remotefs [None req-ae6963c2-f43c-422f-b530-8ede85c40fb3 tempest-AbsoluteLimitsTests-1199316860 None] Creating volume bb62b249-3c3c-4632-8e9f-050f7ee90cc2 {{(pid=83528) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 25 15:55:38 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-ae6963c2-f43c-422f-b530-8ede85c40fb3 tempest-AbsoluteLimitsTests-1199316860 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 25 15:55:38 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-ae6963c2-f43c-422f-b530-8ede85c40fb3 tempest-AbsoluteLimitsTests-1199316860 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 25 15:55:38 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.quobyte [None req-ae6963c2-f43c-422f-b530-8ede85c40fb3 tempest-AbsoluteLimitsTests-1199316860 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23e9d725-3e04-4cd9-bfe0-c8ef43305589': None} {{(pid=83528) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 25 15:55:38 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.quobyte [None req-ae6963c2-f43c-422f-b530-8ede85c40fb3 tempest-AbsoluteLimitsTests-1199316860 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23e9d725-3e04-4cd9-bfe0-c8ef43305589'] {{(pid=83528) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 25 15:55:38 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-ae6963c2-f43c-422f-b530-8ede85c40fb3 tempest-AbsoluteLimitsTests-1199316860 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 25 15:55:38 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.quobyte [None req-ae6963c2-f43c-422f-b530-8ede85c40fb3 tempest-AbsoluteLimitsTests-1199316860 None] Selected osci02.corp.quobyte.com/cinder-vol-23e9d725-3e04-4cd9-bfe0-c8ef43305589 as target Quobyte volume. {{(pid=83528) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 25 15:55:38 devstack cinder-volume[83528]: INFO cinder.volume.drivers.remotefs [None req-ae6963c2-f43c-422f-b530-8ede85c40fb3 tempest-AbsoluteLimitsTests-1199316860 None] casted to osci02.corp.quobyte.com/cinder-vol-23e9d725-3e04-4cd9-bfe0-c8ef43305589 Feb 25 15:55:38 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-ae6963c2-f43c-422f-b530-8ede85c40fb3 tempest-AbsoluteLimitsTests-1199316860 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-bb62b249-3c3c-4632-8e9f-050f7ee90cc2 1073741824 {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 25 15:55:38 devstack sudo[87362]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-bb62b249-3c3c-4632-8e9f-050f7ee90cc2 1073741824 Feb 25 15:55:38 devstack sudo[87362]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 25 15:55:38 devstack cinder-volume[83528]: INFO cinder.volume.manager [None req-810cec81-8893-48eb-8915-03c6caa8596c tempest-SnapshotsActionsTest-738507698 None] Create snapshot completed successfully Feb 25 15:55:38 devstack cinder-volume[83528]: DEBUG oslo_service.periodic_task [None req-d4c764ec-0ebb-4b31-b534-c9a53c1ab0dd None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=83528) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Feb 25 15:55:38 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-d4c764ec-0ebb-4b31-b534-c9a53c1ab0dd None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 25 15:55:38 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-d4c764ec-0ebb-4b31-b534-c9a53c1ab0dd None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 25 15:55:38 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.quobyte [None req-d4c764ec-0ebb-4b31-b534-c9a53c1ab0dd None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23e9d725-3e04-4cd9-bfe0-c8ef43305589': None} {{(pid=83528) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 25 15:55:38 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.quobyte [None req-d4c764ec-0ebb-4b31-b534-c9a53c1ab0dd None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23e9d725-3e04-4cd9-bfe0-c8ef43305589'] {{(pid=83528) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 25 15:55:38 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-d4c764ec-0ebb-4b31-b534-c9a53c1ab0dd None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 25 15:55:38 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-d4c764ec-0ebb-4b31-b534-c9a53c1ab0dd None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85 {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 25 15:55:38 devstack sudo[87364]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85 Feb 25 15:55:38 devstack sudo[87364]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 25 15:55:38 devstack cinder-volume[83528]: INFO cinder.volume.manager [None req-0c6d209e-772c-438a-bd28-fc62abd5d8a8 tempest-GroupsTest-1552622998 None] Group tempest-Group1-628813978: creating Feb 25 15:55:38 devstack cinder-volume[83528]: INFO cinder.volume.manager [None req-0c6d209e-772c-438a-bd28-fc62abd5d8a8 tempest-GroupsTest-1552622998 None] Group tempest-Group1-628813978: created successfully Feb 25 15:55:38 devstack cinder-volume[83528]: INFO cinder.volume.manager [None req-0c6d209e-772c-438a-bd28-fc62abd5d8a8 tempest-GroupsTest-1552622998 None] Create group completed successfully. Feb 25 15:55:39 devstack sudo[87362]: pam_unix(sudo:session): session closed for user root Feb 25 15:55:39 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-ae6963c2-f43c-422f-b530-8ede85c40fb3 tempest-AbsoluteLimitsTests-1199316860 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-bb62b249-3c3c-4632-8e9f-050f7ee90cc2 1073741824" returned: 0 in 0.559s {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 25 15:55:39 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-ae6963c2-f43c-422f-b530-8ede85c40fb3 tempest-AbsoluteLimitsTests-1199316860 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-bb62b249-3c3c-4632-8e9f-050f7ee90cc2 {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 25 15:55:39 devstack sudo[87370]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-bb62b249-3c3c-4632-8e9f-050f7ee90cc2 Feb 25 15:55:39 devstack sudo[87370]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 25 15:55:39 devstack sudo[87364]: pam_unix(sudo:session): session closed for user root Feb 25 15:55:39 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-d4c764ec-0ebb-4b31-b534-c9a53c1ab0dd None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85" returned: 0 in 0.543s {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 25 15:55:39 devstack cinder-volume[83528]: DEBUG cinder.manager [None req-d4c764ec-0ebb-4b31-b534-c9a53c1ab0dd None None] Notifying Schedulers of capabilities ... {{(pid=83528) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 25 15:55:39 devstack cinder-volume[83528]: DEBUG cinder.coordination [None req-a28b2981-4010-41c2-aaf4-dc4121b510f9 tempest-SnapshotsActionsTest-65651383 None] Acquiring lock "cinder-c7a5289e-dcdb-46cf-80d3-6a4f17340499-delete_snapshot" by "delete_snapshot" {{(pid=83528) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 25 15:55:39 devstack cinder-volume[83528]: DEBUG cinder.coordination [None req-a28b2981-4010-41c2-aaf4-dc4121b510f9 tempest-SnapshotsActionsTest-65651383 None] Lock "cinder-c7a5289e-dcdb-46cf-80d3-6a4f17340499-delete_snapshot" acquired by "delete_snapshot" :: waited 0.015s {{(pid=83528) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 25 15:55:39 devstack cinder-volume[83528]: DEBUG cinder.coordination [None req-a28b2981-4010-41c2-aaf4-dc4121b510f9 tempest-SnapshotsActionsTest-65651383 None] Acquiring lock "cinder-quobyte-fa2da276-994a-452f-950a-05721f695adb" by "delete_snapshot" {{(pid=83528) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 25 15:55:39 devstack cinder-volume[83528]: DEBUG cinder.coordination [None req-a28b2981-4010-41c2-aaf4-dc4121b510f9 tempest-SnapshotsActionsTest-65651383 None] Lock "cinder-quobyte-fa2da276-994a-452f-950a-05721f695adb" acquired by "delete_snapshot" :: waited 0.008s {{(pid=83528) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 25 15:55:39 devstack cinder-volume[83528]: DEBUG cinder.coordination [None req-a28b2981-4010-41c2-aaf4-dc4121b510f9 tempest-SnapshotsActionsTest-65651383 None] Acquiring lock "cinder-quobyte-c7a5289e-dcdb-46cf-80d3-6a4f17340499" by "_delete_snapshot" {{(pid=83528) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 25 15:55:39 devstack cinder-volume[83528]: DEBUG cinder.coordination [None req-a28b2981-4010-41c2-aaf4-dc4121b510f9 tempest-SnapshotsActionsTest-65651383 None] Lock "cinder-quobyte-c7a5289e-dcdb-46cf-80d3-6a4f17340499" acquired by "_delete_snapshot" :: waited 0.008s {{(pid=83528) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 25 15:55:39 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.remotefs [None req-a28b2981-4010-41c2-aaf4-dc4121b510f9 tempest-SnapshotsActionsTest-65651383 None] Deleting offline snapshot c7a5289e-dcdb-46cf-80d3-6a4f17340499 of volume fa2da276-994a-452f-950a-05721f695adb {{(pid=83528) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Feb 25 15:55:39 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.remotefs [None req-a28b2981-4010-41c2-aaf4-dc4121b510f9 tempest-SnapshotsActionsTest-65651383 None] snapshot_file for this snap is: volume-fa2da276-994a-452f-950a-05721f695adb.c7a5289e-dcdb-46cf-80d3-6a4f17340499 {{(pid=83528) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Feb 25 15:55:39 devstack cinder-volume[83528]: DEBUG oslo.privsep.daemon [-] privsep: reply[45d197b6-7fb0-47dc-a133-3a331cb5a330]: (4, 'qcow2') {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 25 15:55:39 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-a28b2981-4010-41c2-aaf4-dc4121b510f9 tempest-SnapshotsActionsTest-65651383 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-fa2da276-994a-452f-950a-05721f695adb.c7a5289e-dcdb-46cf-80d3-6a4f17340499 {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 25 15:55:39 devstack sudo[87372]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-fa2da276-994a-452f-950a-05721f695adb.c7a5289e-dcdb-46cf-80d3-6a4f17340499 Feb 25 15:55:39 devstack sudo[87372]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 25 15:55:39 devstack sudo[87370]: pam_unix(sudo:session): session closed for user root Feb 25 15:55:39 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-ae6963c2-f43c-422f-b530-8ede85c40fb3 tempest-AbsoluteLimitsTests-1199316860 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-bb62b249-3c3c-4632-8e9f-050f7ee90cc2" returned: 0 in 0.590s {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 25 15:55:39 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.quobyte [None req-ae6963c2-f43c-422f-b530-8ede85c40fb3 tempest-AbsoluteLimitsTests-1199316860 None] <== create_volume: return (1203ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-23e9d725-3e04-4cd9-bfe0-c8ef43305589'} {{(pid=83528) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 25 15:55:39 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-ae6963c2-f43c-422f-b530-8ede85c40fb3 tempest-AbsoluteLimitsTests-1199316860 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.207s {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 25 15:55:39 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-ae6963c2-f43c-422f-b530-8ede85c40fb3 tempest-AbsoluteLimitsTests-1199316860 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (683d8d10-60c6-4bca-add2-362f9f2c8bb0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bb62b249-3c3c-4632-8e9f-050f7ee90cc2', 'volume_size': 1}' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 25 15:55:39 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-ae6963c2-f43c-422f-b530-8ede85c40fb3 tempest-AbsoluteLimitsTests-1199316860 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fa337908-305b-4a9b-ab4c-a614baf7e9bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 25 15:55:39 devstack cinder-volume[83528]: INFO cinder.volume.flows.manager.create_volume [None req-ae6963c2-f43c-422f-b530-8ede85c40fb3 tempest-AbsoluteLimitsTests-1199316860 None] Volume volume-bb62b249-3c3c-4632-8e9f-050f7ee90cc2 (bb62b249-3c3c-4632-8e9f-050f7ee90cc2): created successfully Feb 25 15:55:39 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-ae6963c2-f43c-422f-b530-8ede85c40fb3 tempest-AbsoluteLimitsTests-1199316860 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fa337908-305b-4a9b-ab4c-a614baf7e9bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 25 15:55:39 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-ae6963c2-f43c-422f-b530-8ede85c40fb3 tempest-AbsoluteLimitsTests-1199316860 None] Flow 'volume_create_manager' (1bd8f04f-ff0e-45e5-a7b0-dc6dba69fba3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83528) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 25 15:55:39 devstack cinder-volume[83528]: INFO cinder.volume.manager [None req-ae6963c2-f43c-422f-b530-8ede85c40fb3 tempest-AbsoluteLimitsTests-1199316860 None] Created volume successfully. Feb 25 15:55:40 devstack cinder-volume[83528]: INFO cinder.volume.manager [None req-415f4227-94e0-4254-af00-b0a01671d6e3 tempest-GroupsTest-1552622998 None] Group tempest-Group2-794706540: creating Feb 25 15:55:40 devstack cinder-volume[83528]: INFO cinder.volume.manager [None req-415f4227-94e0-4254-af00-b0a01671d6e3 tempest-GroupsTest-1552622998 None] Group tempest-Group2-794706540: created successfully Feb 25 15:55:40 devstack cinder-volume[83528]: INFO cinder.volume.manager [None req-415f4227-94e0-4254-af00-b0a01671d6e3 tempest-GroupsTest-1552622998 None] Create group completed successfully. Feb 25 15:55:40 devstack sudo[87372]: pam_unix(sudo:session): session closed for user root Feb 25 15:55:40 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-a28b2981-4010-41c2-aaf4-dc4121b510f9 tempest-SnapshotsActionsTest-65651383 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-fa2da276-994a-452f-950a-05721f695adb.c7a5289e-dcdb-46cf-80d3-6a4f17340499" returned: 0 in 0.846s {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 25 15:55:40 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.remotefs [None req-a28b2981-4010-41c2-aaf4-dc4121b510f9 tempest-SnapshotsActionsTest-65651383 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-fa2da276-994a-452f-950a-05721f695adb(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83528) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Feb 25 15:55:40 devstack cinder-volume[83528]: DEBUG oslo.privsep.daemon [-] privsep: reply[b128712f-9c6c-44e8-9d25-ad1e66f26f8b]: (4, 'qcow2') {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 25 15:55:40 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-a28b2981-4010-41c2-aaf4-dc4121b510f9 tempest-SnapshotsActionsTest-65651383 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-fa2da276-994a-452f-950a-05721f695adb.cf48a71a-46a9-4cb3-9a49-261772e1aa50 {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 25 15:55:40 devstack sudo[87404]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-fa2da276-994a-452f-950a-05721f695adb.cf48a71a-46a9-4cb3-9a49-261772e1aa50 Feb 25 15:55:40 devstack sudo[87404]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 25 15:55:40 devstack cinder-volume[83528]: DEBUG cinder.coordination [None req-4fd73eea-9e77-4993-bae9-df54a3c5d204 tempest-AbsoluteLimitsTests-1199316860 None] Acquiring lock "cinder-bb62b249-3c3c-4632-8e9f-050f7ee90cc2-delete_volume" by "delete_volume" {{(pid=83528) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 25 15:55:40 devstack cinder-volume[83528]: DEBUG cinder.coordination [None req-4fd73eea-9e77-4993-bae9-df54a3c5d204 tempest-AbsoluteLimitsTests-1199316860 None] Lock "cinder-bb62b249-3c3c-4632-8e9f-050f7ee90cc2-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=83528) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 25 15:55:40 devstack cinder-volume[83528]: DEBUG cinder.coordination [None req-4fd73eea-9e77-4993-bae9-df54a3c5d204 tempest-AbsoluteLimitsTests-1199316860 None] Acquiring lock "cinder-quobyte-bb62b249-3c3c-4632-8e9f-050f7ee90cc2" by "delete_volume" {{(pid=83528) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 25 15:55:40 devstack cinder-volume[83528]: DEBUG cinder.coordination [None req-4fd73eea-9e77-4993-bae9-df54a3c5d204 tempest-AbsoluteLimitsTests-1199316860 None] Lock "cinder-quobyte-bb62b249-3c3c-4632-8e9f-050f7ee90cc2" acquired by "delete_volume" :: waited 0.017s {{(pid=83528) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 25 15:55:41 devstack cinder-volume[83528]: DEBUG oslo.privsep.daemon [-] privsep: reply[15167792-e961-41ac-8884-8db6eef245ec]: (4, 'qcow2') {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 25 15:55:41 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-4fd73eea-9e77-4993-bae9-df54a3c5d204 tempest-AbsoluteLimitsTests-1199316860 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-bb62b249-3c3c-4632-8e9f-050f7ee90cc2 {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 25 15:55:41 devstack sudo[87410]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-bb62b249-3c3c-4632-8e9f-050f7ee90cc2 Feb 25 15:55:41 devstack sudo[87410]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 25 15:55:41 devstack sudo[87404]: pam_unix(sudo:session): session closed for user root Feb 25 15:55:41 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-a28b2981-4010-41c2-aaf4-dc4121b510f9 tempest-SnapshotsActionsTest-65651383 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-fa2da276-994a-452f-950a-05721f695adb.cf48a71a-46a9-4cb3-9a49-261772e1aa50" returned: 0 in 0.838s {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 25 15:55:41 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.remotefs [None req-a28b2981-4010-41c2-aaf4-dc4121b510f9 tempest-SnapshotsActionsTest-65651383 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-fa2da276-994a-452f-950a-05721f695adb(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83528) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Feb 25 15:55:41 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-a28b2981-4010-41c2-aaf4-dc4121b510f9 tempest-SnapshotsActionsTest-65651383 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-fa2da276-994a-452f-950a-05721f695adb.c7a5289e-dcdb-46cf-80d3-6a4f17340499 {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 25 15:55:41 devstack sudo[87412]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-fa2da276-994a-452f-950a-05721f695adb.c7a5289e-dcdb-46cf-80d3-6a4f17340499 Feb 25 15:55:41 devstack sudo[87412]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 25 15:55:41 devstack cinder-volume[83528]: DEBUG cinder.volume.flows.manager.create_volume [None req-2f45b2de-6209-4694-a75c-1e584f7e9388 tempest-GroupsTest-1552622998 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83528) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 25 15:55:41 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-2f45b2de-6209-4694-a75c-1e584f7e9388 tempest-GroupsTest-1552622998 None] Flow 'volume_create_manager' (f41d02eb-490b-45bb-9323-01105dae8bbe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83528) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 25 15:55:41 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-2f45b2de-6209-4694-a75c-1e584f7e9388 tempest-GroupsTest-1552622998 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (661953a4-2c2f-4e00-9e0e-adc7a6380abc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 25 15:55:41 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-2f45b2de-6209-4694-a75c-1e584f7e9388 tempest-GroupsTest-1552622998 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (661953a4-2c2f-4e00-9e0e-adc7a6380abc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-25T14:55:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1329775992',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=a55dbd11-fd56-4c35-b544-21c7e4a60d48,host='devstack@QuobyteHD#QuobyteHD',id=8e8f8f11-b6d6-4746-910e-7302effc8c4d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0785ca15590d4680ad9b8bad9784d5ca',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-25T14:55:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-25T14:55:42Z,use_quota=True,user_id='34b8223ed571400a993a078d1c0b741a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a85ae5d4-0b7f-4525-bbd7-6ce0467684f8),volume_type_id=a85ae5d4-0b7f-4525-bbd7-6ce0467684f8)' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 25 15:55:41 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-2f45b2de-6209-4694-a75c-1e584f7e9388 tempest-GroupsTest-1552622998 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7714b9e2-1b8a-4dda-834d-65311b8a46e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 25 15:55:41 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-2f45b2de-6209-4694-a75c-1e584f7e9388 tempest-GroupsTest-1552622998 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7714b9e2-1b8a-4dda-834d-65311b8a46e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 25 15:55:41 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-2f45b2de-6209-4694-a75c-1e584f7e9388 tempest-GroupsTest-1552622998 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1835e281-3e59-463f-8e81-d95838568408) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 25 15:55:41 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-2f45b2de-6209-4694-a75c-1e584f7e9388 tempest-GroupsTest-1552622998 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1835e281-3e59-463f-8e81-d95838568408) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8e8f8f11-b6d6-4746-910e-7302effc8c4d', 'volume_name': 'volume-8e8f8f11-b6d6-4746-910e-7302effc8c4d', 'volume_size': 1}' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 25 15:55:41 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-2f45b2de-6209-4694-a75c-1e584f7e9388 tempest-GroupsTest-1552622998 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6dc81f17-ecb8-40bf-8140-68e2daef0446) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 25 15:55:42 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-2f45b2de-6209-4694-a75c-1e584f7e9388 tempest-GroupsTest-1552622998 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6dc81f17-ecb8-40bf-8140-68e2daef0446) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 25 15:55:42 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-2f45b2de-6209-4694-a75c-1e584f7e9388 tempest-GroupsTest-1552622998 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (56ef267f-efe4-4514-9549-7656108e3f7e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 25 15:55:42 devstack cinder-volume[83528]: INFO cinder.volume.flows.manager.create_volume [None req-2f45b2de-6209-4694-a75c-1e584f7e9388 tempest-GroupsTest-1552622998 None] Volume 8e8f8f11-b6d6-4746-910e-7302effc8c4d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8e8f8f11-b6d6-4746-910e-7302effc8c4d', 'volume_size': 1} Feb 25 15:55:42 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-2f45b2de-6209-4694-a75c-1e584f7e9388 tempest-GroupsTest-1552622998 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 25 15:55:42 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-2f45b2de-6209-4694-a75c-1e584f7e9388 tempest-GroupsTest-1552622998 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.004s {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 25 15:55:42 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.quobyte [None req-2f45b2de-6209-4694-a75c-1e584f7e9388 tempest-GroupsTest-1552622998 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=a55dbd11-fd56-4c35-b544-21c7e4a60d48,created_at=2026-02-25T14:55:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1329775992',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=a55dbd11-fd56-4c35-b544-21c7e4a60d48,host='devstack@QuobyteHD#QuobyteHD',id=8e8f8f11-b6d6-4746-910e-7302effc8c4d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0785ca15590d4680ad9b8bad9784d5ca',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-25T14:55:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-25T14:55:42Z,use_quota=True,user_id='34b8223ed571400a993a078d1c0b741a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a85ae5d4-0b7f-4525-bbd7-6ce0467684f8),volume_type_id=a85ae5d4-0b7f-4525-bbd7-6ce0467684f8)}" {{(pid=83528) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 25 15:55:42 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.remotefs [None req-2f45b2de-6209-4694-a75c-1e584f7e9388 tempest-GroupsTest-1552622998 None] Creating volume 8e8f8f11-b6d6-4746-910e-7302effc8c4d {{(pid=83528) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 25 15:55:42 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-2f45b2de-6209-4694-a75c-1e584f7e9388 tempest-GroupsTest-1552622998 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 25 15:55:42 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-2f45b2de-6209-4694-a75c-1e584f7e9388 tempest-GroupsTest-1552622998 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.006s {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 25 15:55:42 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.quobyte [None req-2f45b2de-6209-4694-a75c-1e584f7e9388 tempest-GroupsTest-1552622998 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23e9d725-3e04-4cd9-bfe0-c8ef43305589': None} {{(pid=83528) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 25 15:55:42 devstack sudo[87410]: pam_unix(sudo:session): session closed for user root Feb 25 15:55:42 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.quobyte [None req-2f45b2de-6209-4694-a75c-1e584f7e9388 tempest-GroupsTest-1552622998 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23e9d725-3e04-4cd9-bfe0-c8ef43305589'] {{(pid=83528) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 25 15:55:42 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-2f45b2de-6209-4694-a75c-1e584f7e9388 tempest-GroupsTest-1552622998 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 25 15:55:42 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.quobyte [None req-2f45b2de-6209-4694-a75c-1e584f7e9388 tempest-GroupsTest-1552622998 None] Selected osci02.corp.quobyte.com/cinder-vol-23e9d725-3e04-4cd9-bfe0-c8ef43305589 as target Quobyte volume. {{(pid=83528) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 25 15:55:42 devstack cinder-volume[83528]: INFO cinder.volume.drivers.remotefs [None req-2f45b2de-6209-4694-a75c-1e584f7e9388 tempest-GroupsTest-1552622998 None] casted to osci02.corp.quobyte.com/cinder-vol-23e9d725-3e04-4cd9-bfe0-c8ef43305589 Feb 25 15:55:42 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-2f45b2de-6209-4694-a75c-1e584f7e9388 tempest-GroupsTest-1552622998 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-8e8f8f11-b6d6-4746-910e-7302effc8c4d 1073741824 {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 25 15:55:42 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-4fd73eea-9e77-4993-bae9-df54a3c5d204 tempest-AbsoluteLimitsTests-1199316860 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-bb62b249-3c3c-4632-8e9f-050f7ee90cc2" returned: 0 in 1.081s {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 25 15:55:42 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-4fd73eea-9e77-4993-bae9-df54a3c5d204 tempest-AbsoluteLimitsTests-1199316860 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-bb62b249-3c3c-4632-8e9f-050f7ee90cc2 {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 25 15:55:42 devstack sudo[87420]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-8e8f8f11-b6d6-4746-910e-7302effc8c4d 1073741824 Feb 25 15:55:42 devstack sudo[87421]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-bb62b249-3c3c-4632-8e9f-050f7ee90cc2 Feb 25 15:55:42 devstack sudo[87421]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 25 15:55:42 devstack sudo[87420]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 25 15:55:42 devstack sudo[87412]: pam_unix(sudo:session): session closed for user root Feb 25 15:55:42 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-a28b2981-4010-41c2-aaf4-dc4121b510f9 tempest-SnapshotsActionsTest-65651383 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-fa2da276-994a-452f-950a-05721f695adb.c7a5289e-dcdb-46cf-80d3-6a4f17340499" returned: 0 in 1.023s {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 25 15:55:42 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-a28b2981-4010-41c2-aaf4-dc4121b510f9 tempest-SnapshotsActionsTest-65651383 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-fa2da276-994a-452f-950a-05721f695adb.c7a5289e-dcdb-46cf-80d3-6a4f17340499 {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 25 15:55:42 devstack sudo[87424]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-fa2da276-994a-452f-950a-05721f695adb.c7a5289e-dcdb-46cf-80d3-6a4f17340499 Feb 25 15:55:42 devstack sudo[87424]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 25 15:55:42 devstack cinder-volume[83528]: DEBUG cinder.volume.flows.manager.create_volume [None req-efa656d6-4e07-49d6-972c-d9c95dc1aa33 tempest-VolumesActionsTest-872240335 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83528) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 25 15:55:42 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-efa656d6-4e07-49d6-972c-d9c95dc1aa33 tempest-VolumesActionsTest-872240335 None] Flow 'volume_create_manager' (4c8f2a59-9f04-41ea-9f7d-cbdbfaebfcc2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83528) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 25 15:55:42 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-efa656d6-4e07-49d6-972c-d9c95dc1aa33 tempest-VolumesActionsTest-872240335 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c23ef073-4d12-4144-b3e9-cd1086026fa5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 25 15:55:42 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-efa656d6-4e07-49d6-972c-d9c95dc1aa33 tempest-VolumesActionsTest-872240335 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c23ef073-4d12-4144-b3e9-cd1086026fa5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-25T14:55:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-2071597207',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9b63c7fd-433d-47df-874c-6aa6d075fd6a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='da136677879e424b82ce0c4ab6e11f76',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-25T14:55:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-25T14:55:43Z,use_quota=True,user_id='8b2df249d4dc442f91f55f39a5a775f4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ce71c2f9-6543-4165-9653-a1529b2ea243),volume_type_id=ce71c2f9-6543-4165-9653-a1529b2ea243)' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 25 15:55:42 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-efa656d6-4e07-49d6-972c-d9c95dc1aa33 tempest-VolumesActionsTest-872240335 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (68f5deb1-840b-45f7-a4f4-c2dc1a34f0c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 25 15:55:42 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-efa656d6-4e07-49d6-972c-d9c95dc1aa33 tempest-VolumesActionsTest-872240335 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (68f5deb1-840b-45f7-a4f4-c2dc1a34f0c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 25 15:55:42 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-efa656d6-4e07-49d6-972c-d9c95dc1aa33 tempest-VolumesActionsTest-872240335 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (34fe6352-7722-4b34-bf28-de0e1d5be1aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 25 15:55:42 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-efa656d6-4e07-49d6-972c-d9c95dc1aa33 tempest-VolumesActionsTest-872240335 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (34fe6352-7722-4b34-bf28-de0e1d5be1aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9b63c7fd-433d-47df-874c-6aa6d075fd6a', 'volume_name': 'volume-9b63c7fd-433d-47df-874c-6aa6d075fd6a', 'volume_size': 1}' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 25 15:55:42 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-efa656d6-4e07-49d6-972c-d9c95dc1aa33 tempest-VolumesActionsTest-872240335 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f9550ad4-8ea7-4920-bf1f-973cba45e24f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 25 15:55:42 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-efa656d6-4e07-49d6-972c-d9c95dc1aa33 tempest-VolumesActionsTest-872240335 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f9550ad4-8ea7-4920-bf1f-973cba45e24f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 25 15:55:42 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-efa656d6-4e07-49d6-972c-d9c95dc1aa33 tempest-VolumesActionsTest-872240335 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8ef5de6f-9ecd-4a17-9c35-46d775a3c25f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 25 15:55:42 devstack cinder-volume[83528]: INFO cinder.volume.flows.manager.create_volume [None req-efa656d6-4e07-49d6-972c-d9c95dc1aa33 tempest-VolumesActionsTest-872240335 None] Volume 9b63c7fd-433d-47df-874c-6aa6d075fd6a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9b63c7fd-433d-47df-874c-6aa6d075fd6a', 'volume_size': 1} Feb 25 15:55:42 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-efa656d6-4e07-49d6-972c-d9c95dc1aa33 tempest-VolumesActionsTest-872240335 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 25 15:55:42 devstack sudo[87421]: pam_unix(sudo:session): session closed for user root Feb 25 15:55:42 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-4fd73eea-9e77-4993-bae9-df54a3c5d204 tempest-AbsoluteLimitsTests-1199316860 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-bb62b249-3c3c-4632-8e9f-050f7ee90cc2" returned: 0 in 0.866s {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 25 15:55:43 devstack cinder-volume[83528]: DEBUG cinder.coordination [None req-4fd73eea-9e77-4993-bae9-df54a3c5d204 tempest-AbsoluteLimitsTests-1199316860 None] Lock "cinder-quobyte-bb62b249-3c3c-4632-8e9f-050f7ee90cc2" released by "delete_volume" :: held 2.010s {{(pid=83528) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 25 15:55:43 devstack sudo[87424]: pam_unix(sudo:session): session closed for user root Feb 25 15:55:43 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-a28b2981-4010-41c2-aaf4-dc4121b510f9 tempest-SnapshotsActionsTest-65651383 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-fa2da276-994a-452f-950a-05721f695adb.c7a5289e-dcdb-46cf-80d3-6a4f17340499" returned: 0 in 0.833s {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 25 15:55:43 devstack cinder-volume[83528]: DEBUG cinder.coordination [None req-a28b2981-4010-41c2-aaf4-dc4121b510f9 tempest-SnapshotsActionsTest-65651383 None] Lock "cinder-quobyte-c7a5289e-dcdb-46cf-80d3-6a4f17340499" released by "_delete_snapshot" :: held 3.624s {{(pid=83528) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 25 15:55:43 devstack cinder-volume[83528]: DEBUG cinder.coordination [None req-a28b2981-4010-41c2-aaf4-dc4121b510f9 tempest-SnapshotsActionsTest-65651383 None] Lock "cinder-quobyte-fa2da276-994a-452f-950a-05721f695adb" released by "delete_snapshot" :: held 3.642s {{(pid=83528) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 25 15:55:43 devstack cinder-volume[83528]: DEBUG cinder.quota [None req-4fd73eea-9e77-4993-bae9-df54a3c5d204 tempest-AbsoluteLimitsTests-1199316860 None] Created reservations ['498bb95a-797e-41b8-8add-ad4a0d1040cf', 'cd2d830c-f401-44de-b5e4-5bbeb8f20c39', 'c79f673a-3c1e-49be-968c-9efc8ab3d418', 'a5a2b3e6-aaf4-4add-99c1-e8dfc0b46216'] {{(pid=83528) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 25 15:55:43 devstack sudo[87420]: pam_unix(sudo:session): session closed for user root Feb 25 15:55:43 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-2f45b2de-6209-4694-a75c-1e584f7e9388 tempest-GroupsTest-1552622998 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-8e8f8f11-b6d6-4746-910e-7302effc8c4d 1073741824" returned: 0 in 1.056s {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 25 15:55:43 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-2f45b2de-6209-4694-a75c-1e584f7e9388 tempest-GroupsTest-1552622998 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-8e8f8f11-b6d6-4746-910e-7302effc8c4d {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 25 15:55:43 devstack cinder-volume[83528]: DEBUG cinder.quota [None req-a28b2981-4010-41c2-aaf4-dc4121b510f9 tempest-SnapshotsActionsTest-65651383 None] Created reservations ['b04d24d6-f2c2-495d-9510-9278ce1f11ea', 'd2175daf-7504-4087-a21b-88d90294b9d1', '60472f64-b6b9-44d8-96f9-fe6f9dcde85b', 'd1f40b00-f20a-4dec-9893-d7124cabe515'] {{(pid=83528) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 25 15:55:43 devstack sudo[87431]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-8e8f8f11-b6d6-4746-910e-7302effc8c4d Feb 25 15:55:43 devstack sudo[87431]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 25 15:55:43 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-4fd73eea-9e77-4993-bae9-df54a3c5d204 tempest-AbsoluteLimitsTests-1199316860 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 25 15:55:43 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-4fd73eea-9e77-4993-bae9-df54a3c5d204 tempest-AbsoluteLimitsTests-1199316860 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 25 15:55:43 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.quobyte [None req-4fd73eea-9e77-4993-bae9-df54a3c5d204 tempest-AbsoluteLimitsTests-1199316860 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23e9d725-3e04-4cd9-bfe0-c8ef43305589': None} {{(pid=83528) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 25 15:55:43 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.quobyte [None req-4fd73eea-9e77-4993-bae9-df54a3c5d204 tempest-AbsoluteLimitsTests-1199316860 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23e9d725-3e04-4cd9-bfe0-c8ef43305589'] {{(pid=83528) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 25 15:55:43 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-4fd73eea-9e77-4993-bae9-df54a3c5d204 tempest-AbsoluteLimitsTests-1199316860 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 25 15:55:43 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-4fd73eea-9e77-4993-bae9-df54a3c5d204 tempest-AbsoluteLimitsTests-1199316860 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85 {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 25 15:55:43 devstack cinder-volume[83528]: INFO cinder.volume.manager [None req-a28b2981-4010-41c2-aaf4-dc4121b510f9 tempest-SnapshotsActionsTest-65651383 None] Delete snapshot completed successfully. Feb 25 15:55:43 devstack cinder-volume[83528]: DEBUG cinder.coordination [None req-a28b2981-4010-41c2-aaf4-dc4121b510f9 tempest-SnapshotsActionsTest-65651383 None] Lock "cinder-c7a5289e-dcdb-46cf-80d3-6a4f17340499-delete_snapshot" released by "delete_snapshot" :: held 3.868s {{(pid=83528) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 25 15:55:43 devstack sudo[87433]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85 Feb 25 15:55:43 devstack sudo[87433]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 25 15:55:43 devstack sudo[87433]: pam_unix(sudo:session): session closed for user root Feb 25 15:55:43 devstack sudo[87431]: pam_unix(sudo:session): session closed for user root Feb 25 15:55:43 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-2f45b2de-6209-4694-a75c-1e584f7e9388 tempest-GroupsTest-1552622998 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-8e8f8f11-b6d6-4746-910e-7302effc8c4d" returned: 0 in 0.575s {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 25 15:55:43 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-4fd73eea-9e77-4993-bae9-df54a3c5d204 tempest-AbsoluteLimitsTests-1199316860 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85" returned: 0 in 0.497s {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 25 15:55:43 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.quobyte [None req-2f45b2de-6209-4694-a75c-1e584f7e9388 tempest-GroupsTest-1552622998 None] <== create_volume: return (1724ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-23e9d725-3e04-4cd9-bfe0-c8ef43305589'} {{(pid=83528) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 25 15:55:43 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-2f45b2de-6209-4694-a75c-1e584f7e9388 tempest-GroupsTest-1552622998 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.728s {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 25 15:55:43 devstack cinder-volume[83528]: DEBUG cinder.manager [None req-4fd73eea-9e77-4993-bae9-df54a3c5d204 tempest-AbsoluteLimitsTests-1199316860 None] Notifying Schedulers of capabilities ... {{(pid=83528) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 25 15:55:43 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-efa656d6-4e07-49d6-972c-d9c95dc1aa33 tempest-VolumesActionsTest-872240335 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.961s {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 25 15:55:43 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.quobyte [None req-efa656d6-4e07-49d6-972c-d9c95dc1aa33 tempest-VolumesActionsTest-872240335 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-25T14:55:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-2071597207',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9b63c7fd-433d-47df-874c-6aa6d075fd6a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='da136677879e424b82ce0c4ab6e11f76',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-25T14:55:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-25T14:55:43Z,use_quota=True,user_id='8b2df249d4dc442f91f55f39a5a775f4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ce71c2f9-6543-4165-9653-a1529b2ea243),volume_type_id=ce71c2f9-6543-4165-9653-a1529b2ea243)}" {{(pid=83528) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 25 15:55:43 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.remotefs [None req-efa656d6-4e07-49d6-972c-d9c95dc1aa33 tempest-VolumesActionsTest-872240335 None] Creating volume 9b63c7fd-433d-47df-874c-6aa6d075fd6a {{(pid=83528) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 25 15:55:43 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-efa656d6-4e07-49d6-972c-d9c95dc1aa33 tempest-VolumesActionsTest-872240335 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 25 15:55:43 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-efa656d6-4e07-49d6-972c-d9c95dc1aa33 tempest-VolumesActionsTest-872240335 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 25 15:55:43 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.quobyte [None req-efa656d6-4e07-49d6-972c-d9c95dc1aa33 tempest-VolumesActionsTest-872240335 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23e9d725-3e04-4cd9-bfe0-c8ef43305589': None} {{(pid=83528) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 25 15:55:43 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.quobyte [None req-efa656d6-4e07-49d6-972c-d9c95dc1aa33 tempest-VolumesActionsTest-872240335 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23e9d725-3e04-4cd9-bfe0-c8ef43305589'] {{(pid=83528) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 25 15:55:43 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-efa656d6-4e07-49d6-972c-d9c95dc1aa33 tempest-VolumesActionsTest-872240335 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 25 15:55:43 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.quobyte [None req-efa656d6-4e07-49d6-972c-d9c95dc1aa33 tempest-VolumesActionsTest-872240335 None] Selected osci02.corp.quobyte.com/cinder-vol-23e9d725-3e04-4cd9-bfe0-c8ef43305589 as target Quobyte volume. {{(pid=83528) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 25 15:55:43 devstack cinder-volume[83528]: INFO cinder.volume.drivers.remotefs [None req-efa656d6-4e07-49d6-972c-d9c95dc1aa33 tempest-VolumesActionsTest-872240335 None] casted to osci02.corp.quobyte.com/cinder-vol-23e9d725-3e04-4cd9-bfe0-c8ef43305589 Feb 25 15:55:43 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-efa656d6-4e07-49d6-972c-d9c95dc1aa33 tempest-VolumesActionsTest-872240335 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-9b63c7fd-433d-47df-874c-6aa6d075fd6a 1073741824 {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 25 15:55:43 devstack cinder-volume[83528]: INFO cinder.volume.manager [None req-4fd73eea-9e77-4993-bae9-df54a3c5d204 tempest-AbsoluteLimitsTests-1199316860 None] Deleted volume successfully. Feb 25 15:55:43 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-2f45b2de-6209-4694-a75c-1e584f7e9388 tempest-GroupsTest-1552622998 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (56ef267f-efe4-4514-9549-7656108e3f7e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8e8f8f11-b6d6-4746-910e-7302effc8c4d', 'volume_size': 1}' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 25 15:55:43 devstack sudo[87437]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-9b63c7fd-433d-47df-874c-6aa6d075fd6a 1073741824 Feb 25 15:55:43 devstack sudo[87437]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 25 15:55:43 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-2f45b2de-6209-4694-a75c-1e584f7e9388 tempest-GroupsTest-1552622998 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8b690054-4a9b-4cdc-a7ad-451ea0384eed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 25 15:55:43 devstack cinder-volume[83528]: INFO cinder.volume.flows.manager.create_volume [None req-2f45b2de-6209-4694-a75c-1e584f7e9388 tempest-GroupsTest-1552622998 None] Volume volume-8e8f8f11-b6d6-4746-910e-7302effc8c4d (8e8f8f11-b6d6-4746-910e-7302effc8c4d): created successfully Feb 25 15:55:43 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-2f45b2de-6209-4694-a75c-1e584f7e9388 tempest-GroupsTest-1552622998 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8b690054-4a9b-4cdc-a7ad-451ea0384eed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 25 15:55:43 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-2f45b2de-6209-4694-a75c-1e584f7e9388 tempest-GroupsTest-1552622998 None] Flow 'volume_create_manager' (f41d02eb-490b-45bb-9323-01105dae8bbe) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83528) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 25 15:55:43 devstack cinder-volume[83528]: DEBUG cinder.coordination [None req-4fd73eea-9e77-4993-bae9-df54a3c5d204 tempest-AbsoluteLimitsTests-1199316860 None] Lock "cinder-bb62b249-3c3c-4632-8e9f-050f7ee90cc2-delete_volume" released by "delete_volume" :: held 2.957s {{(pid=83528) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 25 15:55:43 devstack cinder-volume[83528]: INFO cinder.volume.manager [None req-2f45b2de-6209-4694-a75c-1e584f7e9388 tempest-GroupsTest-1552622998 None] Created volume successfully. Feb 25 15:55:44 devstack cinder-volume[83528]: DEBUG cinder.coordination [None req-e01f4d7e-2445-4346-b1f4-03d41e9f7530 tempest-SnapshotsActionsTest-738507698 None] Acquiring lock "cinder-cf48a71a-46a9-4cb3-9a49-261772e1aa50-delete_snapshot" by "delete_snapshot" {{(pid=83528) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 25 15:55:44 devstack cinder-volume[83528]: DEBUG cinder.coordination [None req-e01f4d7e-2445-4346-b1f4-03d41e9f7530 tempest-SnapshotsActionsTest-738507698 None] Lock "cinder-cf48a71a-46a9-4cb3-9a49-261772e1aa50-delete_snapshot" acquired by "delete_snapshot" :: waited 0.019s {{(pid=83528) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 25 15:55:44 devstack cinder-volume[83528]: DEBUG cinder.coordination [None req-e01f4d7e-2445-4346-b1f4-03d41e9f7530 tempest-SnapshotsActionsTest-738507698 None] Acquiring lock "cinder-quobyte-fa2da276-994a-452f-950a-05721f695adb" by "delete_snapshot" {{(pid=83528) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 25 15:55:44 devstack cinder-volume[83528]: DEBUG cinder.coordination [None req-e01f4d7e-2445-4346-b1f4-03d41e9f7530 tempest-SnapshotsActionsTest-738507698 None] Lock "cinder-quobyte-fa2da276-994a-452f-950a-05721f695adb" acquired by "delete_snapshot" :: waited 0.028s {{(pid=83528) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 25 15:55:44 devstack cinder-volume[83528]: DEBUG cinder.coordination [None req-e01f4d7e-2445-4346-b1f4-03d41e9f7530 tempest-SnapshotsActionsTest-738507698 None] Acquiring lock "cinder-quobyte-cf48a71a-46a9-4cb3-9a49-261772e1aa50" by "_delete_snapshot" {{(pid=83528) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 25 15:55:44 devstack cinder-volume[83528]: DEBUG cinder.coordination [None req-e01f4d7e-2445-4346-b1f4-03d41e9f7530 tempest-SnapshotsActionsTest-738507698 None] Lock "cinder-quobyte-cf48a71a-46a9-4cb3-9a49-261772e1aa50" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=83528) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 25 15:55:44 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.remotefs [None req-e01f4d7e-2445-4346-b1f4-03d41e9f7530 tempest-SnapshotsActionsTest-738507698 None] Deleting offline snapshot cf48a71a-46a9-4cb3-9a49-261772e1aa50 of volume fa2da276-994a-452f-950a-05721f695adb {{(pid=83528) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Feb 25 15:55:44 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.remotefs [None req-e01f4d7e-2445-4346-b1f4-03d41e9f7530 tempest-SnapshotsActionsTest-738507698 None] snapshot_file for this snap is: volume-fa2da276-994a-452f-950a-05721f695adb.cf48a71a-46a9-4cb3-9a49-261772e1aa50 {{(pid=83528) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Feb 25 15:55:44 devstack cinder-volume[83528]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1b4b3c4-0538-45bd-9044-e7e0f9560045]: (4, 'qcow2') {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 25 15:55:44 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-e01f4d7e-2445-4346-b1f4-03d41e9f7530 tempest-SnapshotsActionsTest-738507698 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-fa2da276-994a-452f-950a-05721f695adb.cf48a71a-46a9-4cb3-9a49-261772e1aa50 {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 25 15:55:44 devstack sudo[87439]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-fa2da276-994a-452f-950a-05721f695adb.cf48a71a-46a9-4cb3-9a49-261772e1aa50 Feb 25 15:55:44 devstack sudo[87439]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 25 15:55:44 devstack cinder-volume[83528]: DEBUG cinder.coordination [None req-dad71142-cb73-4bc5-b8d1-d59ade5be237 tempest-GroupsTest-1552622998 None] Acquiring lock "cinder-quobyte-8e8f8f11-b6d6-4746-910e-7302effc8c4d" by "delete_volume" {{(pid=83528) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 25 15:55:44 devstack sudo[87437]: pam_unix(sudo:session): session closed for user root Feb 25 15:55:44 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-efa656d6-4e07-49d6-972c-d9c95dc1aa33 tempest-VolumesActionsTest-872240335 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-9b63c7fd-433d-47df-874c-6aa6d075fd6a 1073741824" returned: 0 in 0.863s {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 25 15:55:44 devstack cinder-volume[83528]: DEBUG cinder.coordination [None req-dad71142-cb73-4bc5-b8d1-d59ade5be237 tempest-GroupsTest-1552622998 None] Lock "cinder-quobyte-8e8f8f11-b6d6-4746-910e-7302effc8c4d" acquired by "delete_volume" :: waited 0.023s {{(pid=83528) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 25 15:55:44 devstack cinder-volume[83528]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4596376-08b0-4c9d-9dd6-c1f7ca5a6149]: (4, 'qcow2') {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 25 15:55:44 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-dad71142-cb73-4bc5-b8d1-d59ade5be237 tempest-GroupsTest-1552622998 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-8e8f8f11-b6d6-4746-910e-7302effc8c4d {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 25 15:55:44 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-efa656d6-4e07-49d6-972c-d9c95dc1aa33 tempest-VolumesActionsTest-872240335 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-9b63c7fd-433d-47df-874c-6aa6d075fd6a {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 25 15:55:44 devstack sudo[87446]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-9b63c7fd-433d-47df-874c-6aa6d075fd6a Feb 25 15:55:44 devstack sudo[87446]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 25 15:55:44 devstack sudo[87445]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-8e8f8f11-b6d6-4746-910e-7302effc8c4d Feb 25 15:55:44 devstack sudo[87445]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 25 15:55:45 devstack sudo[87439]: pam_unix(sudo:session): session closed for user root Feb 25 15:55:45 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-e01f4d7e-2445-4346-b1f4-03d41e9f7530 tempest-SnapshotsActionsTest-738507698 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-fa2da276-994a-452f-950a-05721f695adb.cf48a71a-46a9-4cb3-9a49-261772e1aa50" returned: 0 in 0.894s {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 25 15:55:45 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.remotefs [None req-e01f4d7e-2445-4346-b1f4-03d41e9f7530 tempest-SnapshotsActionsTest-738507698 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-fa2da276-994a-452f-950a-05721f695adb(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83528) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Feb 25 15:55:45 devstack cinder-volume[83528]: DEBUG oslo.privsep.daemon [-] privsep: reply[64a19d3c-dc8c-43f1-989e-7df22abd43e1]: (4, 'qcow2') {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 25 15:55:45 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-e01f4d7e-2445-4346-b1f4-03d41e9f7530 tempest-SnapshotsActionsTest-738507698 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-fa2da276-994a-452f-950a-05721f695adb {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 25 15:55:45 devstack sudo[87452]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-fa2da276-994a-452f-950a-05721f695adb Feb 25 15:55:45 devstack sudo[87452]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 25 15:55:45 devstack sudo[87446]: pam_unix(sudo:session): session closed for user root Feb 25 15:55:45 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-efa656d6-4e07-49d6-972c-d9c95dc1aa33 tempest-VolumesActionsTest-872240335 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-9b63c7fd-433d-47df-874c-6aa6d075fd6a" returned: 0 in 0.767s {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 25 15:55:45 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.quobyte [None req-efa656d6-4e07-49d6-972c-d9c95dc1aa33 tempest-VolumesActionsTest-872240335 None] <== create_volume: return (1703ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-23e9d725-3e04-4cd9-bfe0-c8ef43305589'} {{(pid=83528) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 25 15:55:45 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-efa656d6-4e07-49d6-972c-d9c95dc1aa33 tempest-VolumesActionsTest-872240335 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.706s {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 25 15:55:45 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-efa656d6-4e07-49d6-972c-d9c95dc1aa33 tempest-VolumesActionsTest-872240335 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8ef5de6f-9ecd-4a17-9c35-46d775a3c25f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9b63c7fd-433d-47df-874c-6aa6d075fd6a', 'volume_size': 1}' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 25 15:55:45 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-efa656d6-4e07-49d6-972c-d9c95dc1aa33 tempest-VolumesActionsTest-872240335 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e08f76fd-65e1-4591-b27e-3d737283a6be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 25 15:55:45 devstack cinder-volume[83528]: INFO cinder.volume.flows.manager.create_volume [None req-efa656d6-4e07-49d6-972c-d9c95dc1aa33 tempest-VolumesActionsTest-872240335 None] Volume volume-9b63c7fd-433d-47df-874c-6aa6d075fd6a (9b63c7fd-433d-47df-874c-6aa6d075fd6a): created successfully Feb 25 15:55:45 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-efa656d6-4e07-49d6-972c-d9c95dc1aa33 tempest-VolumesActionsTest-872240335 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e08f76fd-65e1-4591-b27e-3d737283a6be) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 25 15:55:45 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-efa656d6-4e07-49d6-972c-d9c95dc1aa33 tempest-VolumesActionsTest-872240335 None] Flow 'volume_create_manager' (4c8f2a59-9f04-41ea-9f7d-cbdbfaebfcc2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83528) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 25 15:55:45 devstack cinder-volume[83528]: INFO cinder.volume.manager [None req-efa656d6-4e07-49d6-972c-d9c95dc1aa33 tempest-VolumesActionsTest-872240335 None] Created volume successfully. Feb 25 15:55:45 devstack sudo[87445]: pam_unix(sudo:session): session closed for user root Feb 25 15:55:45 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-dad71142-cb73-4bc5-b8d1-d59ade5be237 tempest-GroupsTest-1552622998 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-8e8f8f11-b6d6-4746-910e-7302effc8c4d" returned: 0 in 0.909s {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 25 15:55:45 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-dad71142-cb73-4bc5-b8d1-d59ade5be237 tempest-GroupsTest-1552622998 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-8e8f8f11-b6d6-4746-910e-7302effc8c4d {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 25 15:55:45 devstack sudo[87458]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-8e8f8f11-b6d6-4746-910e-7302effc8c4d Feb 25 15:55:45 devstack sudo[87458]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 25 15:55:45 devstack sudo[87452]: pam_unix(sudo:session): session closed for user root Feb 25 15:55:45 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-e01f4d7e-2445-4346-b1f4-03d41e9f7530 tempest-SnapshotsActionsTest-738507698 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-fa2da276-994a-452f-950a-05721f695adb" returned: 0 in 0.700s {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 25 15:55:45 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-e01f4d7e-2445-4346-b1f4-03d41e9f7530 tempest-SnapshotsActionsTest-738507698 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-fa2da276-994a-452f-950a-05721f695adb.cf48a71a-46a9-4cb3-9a49-261772e1aa50 {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 25 15:55:45 devstack sudo[87463]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-fa2da276-994a-452f-950a-05721f695adb.cf48a71a-46a9-4cb3-9a49-261772e1aa50 Feb 25 15:55:45 devstack sudo[87463]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 25 15:55:45 devstack cinder-volume[83528]: DEBUG cinder.coordination [None req-007fd7fd-d86f-4209-b816-b8ebdb49b57d tempest-VolumesActionsTest-872240335 None] Acquiring lock "cinder-9b63c7fd-433d-47df-874c-6aa6d075fd6a" by "attach_volume" {{(pid=83528) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 25 15:55:45 devstack cinder-volume[83528]: DEBUG cinder.coordination [None req-007fd7fd-d86f-4209-b816-b8ebdb49b57d tempest-VolumesActionsTest-872240335 None] Lock "cinder-9b63c7fd-433d-47df-874c-6aa6d075fd6a" acquired by "attach_volume" :: waited 0.018s {{(pid=83528) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 25 15:55:46 devstack cinder-volume[83528]: INFO cinder.volume.manager [None req-007fd7fd-d86f-4209-b816-b8ebdb49b57d tempest-VolumesActionsTest-872240335 None] Attaching volume 9b63c7fd-433d-47df-874c-6aa6d075fd6a to instance ea321937-022e-4521-9a02-51ae0845ac03 at mountpoint /dev/vdb on host None. Feb 25 15:55:46 devstack cinder-volume[83528]: INFO cinder.volume.manager [None req-007fd7fd-d86f-4209-b816-b8ebdb49b57d tempest-VolumesActionsTest-872240335 None] Attach volume completed successfully. Feb 25 15:55:46 devstack cinder-volume[83528]: DEBUG cinder.coordination [None req-007fd7fd-d86f-4209-b816-b8ebdb49b57d tempest-VolumesActionsTest-872240335 None] Lock "cinder-9b63c7fd-433d-47df-874c-6aa6d075fd6a" released by "attach_volume" :: held 0.148s {{(pid=83528) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 25 15:55:46 devstack sudo[87458]: pam_unix(sudo:session): session closed for user root Feb 25 15:55:46 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-dad71142-cb73-4bc5-b8d1-d59ade5be237 tempest-GroupsTest-1552622998 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-8e8f8f11-b6d6-4746-910e-7302effc8c4d" returned: 0 in 0.664s {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 25 15:55:46 devstack cinder-volume[83528]: DEBUG cinder.coordination [None req-dad71142-cb73-4bc5-b8d1-d59ade5be237 tempest-GroupsTest-1552622998 None] Lock "cinder-quobyte-8e8f8f11-b6d6-4746-910e-7302effc8c4d" released by "delete_volume" :: held 1.601s {{(pid=83528) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 25 15:55:46 devstack cinder-volume[83528]: DEBUG cinder.quota [None req-dad71142-cb73-4bc5-b8d1-d59ade5be237 tempest-GroupsTest-1552622998 None] Created reservations ['2772c6bf-561e-4888-aa67-2b714260327e'] {{(pid=83528) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 25 15:55:46 devstack cinder-volume[83528]: WARNING cinder.quota [None req-dad71142-cb73-4bc5-b8d1-d59ade5be237 tempest-GroupsTest-1552622998 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-179372518 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-179372518, it is now deprecated. Please use the default quota class for default quota. Feb 25 15:55:46 devstack cinder-volume[83528]: WARNING cinder.quota [None req-dad71142-cb73-4bc5-b8d1-d59ade5be237 tempest-GroupsTest-1552622998 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-179372518 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-179372518, it is now deprecated. Please use the default quota class for default quota. Feb 25 15:55:46 devstack cinder-volume[83528]: DEBUG cinder.quota [None req-dad71142-cb73-4bc5-b8d1-d59ade5be237 tempest-GroupsTest-1552622998 None] Created reservations ['915ed0d2-257a-4841-b7e8-f9f1ed1621ba', '55f207f1-4ebc-477e-a9ce-6b0622645ec3', 'eaa3f060-66f9-42af-91df-15a0cdbab361', 'f7a707c1-1849-40f2-950e-139073bf230d'] {{(pid=83528) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 25 15:55:46 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-dad71142-cb73-4bc5-b8d1-d59ade5be237 tempest-GroupsTest-1552622998 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 25 15:55:46 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-dad71142-cb73-4bc5-b8d1-d59ade5be237 tempest-GroupsTest-1552622998 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 25 15:55:46 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.quobyte [None req-dad71142-cb73-4bc5-b8d1-d59ade5be237 tempest-GroupsTest-1552622998 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23e9d725-3e04-4cd9-bfe0-c8ef43305589': None} {{(pid=83528) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 25 15:55:46 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.quobyte [None req-dad71142-cb73-4bc5-b8d1-d59ade5be237 tempest-GroupsTest-1552622998 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23e9d725-3e04-4cd9-bfe0-c8ef43305589'] {{(pid=83528) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 25 15:55:46 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-dad71142-cb73-4bc5-b8d1-d59ade5be237 tempest-GroupsTest-1552622998 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 25 15:55:46 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-dad71142-cb73-4bc5-b8d1-d59ade5be237 tempest-GroupsTest-1552622998 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85 {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 25 15:55:46 devstack sudo[87468]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85 Feb 25 15:55:46 devstack sudo[87468]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 25 15:55:46 devstack sudo[87463]: pam_unix(sudo:session): session closed for user root Feb 25 15:55:46 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-e01f4d7e-2445-4346-b1f4-03d41e9f7530 tempest-SnapshotsActionsTest-738507698 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-fa2da276-994a-452f-950a-05721f695adb.cf48a71a-46a9-4cb3-9a49-261772e1aa50" returned: 0 in 0.922s {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 25 15:55:46 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-e01f4d7e-2445-4346-b1f4-03d41e9f7530 tempest-SnapshotsActionsTest-738507698 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-fa2da276-994a-452f-950a-05721f695adb.cf48a71a-46a9-4cb3-9a49-261772e1aa50 {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 25 15:55:46 devstack sudo[87471]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-fa2da276-994a-452f-950a-05721f695adb.cf48a71a-46a9-4cb3-9a49-261772e1aa50 Feb 25 15:55:46 devstack sudo[87471]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 25 15:55:47 devstack cinder-volume[83528]: INFO cinder.volume.manager [None req-f739f5a9-f9b6-400e-889c-5e62cb5f06c7 tempest-VolumesActionsTest-1068253837 None] Terminate volume connection completed successfully. Feb 25 15:55:47 devstack cinder-volume[83528]: DEBUG cinder.quota [None req-81b04c84-129f-4ef6-b491-523ac965afe4 tempest-GroupsTest-1552622998 None] Created reservations ['e8119435-5abd-49f4-852b-9516d8f7e3f4'] {{(pid=83528) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 25 15:55:47 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-81b04c84-129f-4ef6-b491-523ac965afe4 tempest-GroupsTest-1552622998 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 25 15:55:47 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-81b04c84-129f-4ef6-b491-523ac965afe4 tempest-GroupsTest-1552622998 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 25 15:55:47 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.quobyte [None req-81b04c84-129f-4ef6-b491-523ac965afe4 tempest-GroupsTest-1552622998 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23e9d725-3e04-4cd9-bfe0-c8ef43305589': None} {{(pid=83528) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 25 15:55:47 devstack sudo[87468]: pam_unix(sudo:session): session closed for user root Feb 25 15:55:47 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.quobyte [None req-81b04c84-129f-4ef6-b491-523ac965afe4 tempest-GroupsTest-1552622998 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23e9d725-3e04-4cd9-bfe0-c8ef43305589'] {{(pid=83528) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 25 15:55:47 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-81b04c84-129f-4ef6-b491-523ac965afe4 tempest-GroupsTest-1552622998 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 25 15:55:47 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-81b04c84-129f-4ef6-b491-523ac965afe4 tempest-GroupsTest-1552622998 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85 {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 25 15:55:47 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-dad71142-cb73-4bc5-b8d1-d59ade5be237 tempest-GroupsTest-1552622998 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85" returned: 0 in 0.911s {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 25 15:55:47 devstack cinder-volume[83528]: DEBUG cinder.manager [None req-dad71142-cb73-4bc5-b8d1-d59ade5be237 tempest-GroupsTest-1552622998 None] Notifying Schedulers of capabilities ... {{(pid=83528) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 25 15:55:47 devstack cinder-volume[83528]: INFO cinder.volume.manager [None req-dad71142-cb73-4bc5-b8d1-d59ade5be237 tempest-GroupsTest-1552622998 None] Delete group completed successfully. Feb 25 15:55:47 devstack sudo[87474]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85 Feb 25 15:55:47 devstack sudo[87474]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 25 15:55:47 devstack sudo[87471]: pam_unix(sudo:session): session closed for user root Feb 25 15:55:47 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-e01f4d7e-2445-4346-b1f4-03d41e9f7530 tempest-SnapshotsActionsTest-738507698 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-fa2da276-994a-452f-950a-05721f695adb.cf48a71a-46a9-4cb3-9a49-261772e1aa50" returned: 0 in 0.884s {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 25 15:55:47 devstack cinder-volume[83528]: DEBUG cinder.coordination [None req-e01f4d7e-2445-4346-b1f4-03d41e9f7530 tempest-SnapshotsActionsTest-738507698 None] Lock "cinder-quobyte-cf48a71a-46a9-4cb3-9a49-261772e1aa50" released by "_delete_snapshot" :: held 3.538s {{(pid=83528) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 25 15:55:47 devstack cinder-volume[83528]: DEBUG cinder.coordination [None req-e01f4d7e-2445-4346-b1f4-03d41e9f7530 tempest-SnapshotsActionsTest-738507698 None] Lock "cinder-quobyte-fa2da276-994a-452f-950a-05721f695adb" released by "delete_snapshot" :: held 3.564s {{(pid=83528) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 25 15:55:47 devstack cinder-volume[83528]: DEBUG cinder.coordination [None req-f739f5a9-f9b6-400e-889c-5e62cb5f06c7 tempest-VolumesActionsTest-1068253837 None] Acquiring lock "cinder-9b63c7fd-433d-47df-874c-6aa6d075fd6a-detach_volume" by "detach_volume" {{(pid=83528) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 25 15:55:47 devstack cinder-volume[83528]: DEBUG cinder.coordination [None req-f739f5a9-f9b6-400e-889c-5e62cb5f06c7 tempest-VolumesActionsTest-1068253837 None] Lock "cinder-9b63c7fd-433d-47df-874c-6aa6d075fd6a-detach_volume" acquired by "detach_volume" :: waited 0.026s {{(pid=83528) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 25 15:55:47 devstack cinder-volume[83528]: INFO cinder.volume.manager [None req-f739f5a9-f9b6-400e-889c-5e62cb5f06c7 tempest-VolumesActionsTest-1068253837 None] Detaching volume 9b63c7fd-433d-47df-874c-6aa6d075fd6a from instance ea321937-022e-4521-9a02-51ae0845ac03. Feb 25 15:55:47 devstack cinder-volume[83528]: DEBUG cinder.quota [None req-e01f4d7e-2445-4346-b1f4-03d41e9f7530 tempest-SnapshotsActionsTest-738507698 None] Created reservations ['23acb4aa-9769-49d8-b07e-ebbfde2d932b', '7bdc4534-5f76-4cbb-8e39-7cbc99af1b1f', '3f9419a8-97a0-4a52-94f9-361c1f47550e', 'fbb7179b-8fee-4f54-aa7b-894ea0e47721'] {{(pid=83528) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 25 15:55:47 devstack sudo[87474]: pam_unix(sudo:session): session closed for user root Feb 25 15:55:47 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-81b04c84-129f-4ef6-b491-523ac965afe4 tempest-GroupsTest-1552622998 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85" returned: 0 in 0.539s {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 25 15:55:47 devstack cinder-volume[83528]: DEBUG cinder.manager [None req-81b04c84-129f-4ef6-b491-523ac965afe4 tempest-GroupsTest-1552622998 None] Notifying Schedulers of capabilities ... {{(pid=83528) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 25 15:55:47 devstack cinder-volume[83528]: INFO cinder.volume.manager [None req-f739f5a9-f9b6-400e-889c-5e62cb5f06c7 tempest-VolumesActionsTest-1068253837 None] Detach volume completed successfully. Feb 25 15:55:47 devstack cinder-volume[83528]: INFO cinder.volume.manager [None req-81b04c84-129f-4ef6-b491-523ac965afe4 tempest-GroupsTest-1552622998 None] Delete group completed successfully. Feb 25 15:55:47 devstack cinder-volume[83528]: DEBUG cinder.coordination [None req-f739f5a9-f9b6-400e-889c-5e62cb5f06c7 tempest-VolumesActionsTest-1068253837 None] Lock "cinder-9b63c7fd-433d-47df-874c-6aa6d075fd6a-detach_volume" released by "detach_volume" :: held 0.135s {{(pid=83528) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 25 15:55:47 devstack cinder-volume[83528]: INFO cinder.volume.manager [None req-e01f4d7e-2445-4346-b1f4-03d41e9f7530 tempest-SnapshotsActionsTest-738507698 None] Delete snapshot completed successfully. Feb 25 15:55:47 devstack cinder-volume[83528]: DEBUG cinder.coordination [None req-e01f4d7e-2445-4346-b1f4-03d41e9f7530 tempest-SnapshotsActionsTest-738507698 None] Lock "cinder-cf48a71a-46a9-4cb3-9a49-261772e1aa50-delete_snapshot" released by "delete_snapshot" :: held 3.851s {{(pid=83528) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 25 15:55:48 devstack cinder-volume[83528]: DEBUG cinder.coordination [None req-6294c1b7-a154-4340-a8f1-786ff5d42ea5 tempest-SnapshotsActionsTest-738507698 None] Acquiring lock "cinder-fa2da276-994a-452f-950a-05721f695adb-delete_volume" by "delete_volume" {{(pid=83528) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 25 15:55:48 devstack cinder-volume[83528]: DEBUG cinder.coordination [None req-6294c1b7-a154-4340-a8f1-786ff5d42ea5 tempest-SnapshotsActionsTest-738507698 None] Lock "cinder-fa2da276-994a-452f-950a-05721f695adb-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=83528) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 25 15:55:48 devstack cinder-volume[83528]: DEBUG cinder.coordination [None req-6294c1b7-a154-4340-a8f1-786ff5d42ea5 tempest-SnapshotsActionsTest-738507698 None] Acquiring lock "cinder-quobyte-fa2da276-994a-452f-950a-05721f695adb" by "delete_volume" {{(pid=83528) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 25 15:55:48 devstack cinder-volume[83528]: DEBUG cinder.coordination [None req-6294c1b7-a154-4340-a8f1-786ff5d42ea5 tempest-SnapshotsActionsTest-738507698 None] Lock "cinder-quobyte-fa2da276-994a-452f-950a-05721f695adb" acquired by "delete_volume" :: waited 0.016s {{(pid=83528) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 25 15:55:48 devstack cinder-volume[83528]: DEBUG cinder.coordination [None req-3db5d0bb-a046-42e0-bc74-d997d050d9b0 tempest-VolumesActionsTest-872240335 None] Acquiring lock "cinder-9b63c7fd-433d-47df-874c-6aa6d075fd6a-detach_volume" by "detach_volume" {{(pid=83528) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 25 15:55:48 devstack cinder-volume[83528]: DEBUG oslo.privsep.daemon [-] privsep: reply[04b2ad3b-8ccb-4970-ab37-4352f75a7d81]: (4, 'qcow2') {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 25 15:55:48 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-6294c1b7-a154-4340-a8f1-786ff5d42ea5 tempest-SnapshotsActionsTest-738507698 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-fa2da276-994a-452f-950a-05721f695adb {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 25 15:55:48 devstack cinder-volume[83528]: DEBUG cinder.coordination [None req-3db5d0bb-a046-42e0-bc74-d997d050d9b0 tempest-VolumesActionsTest-872240335 None] Lock "cinder-9b63c7fd-433d-47df-874c-6aa6d075fd6a-detach_volume" acquired by "detach_volume" :: waited 0.036s {{(pid=83528) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 25 15:55:48 devstack cinder-volume[83528]: INFO cinder.volume.manager [None req-3db5d0bb-a046-42e0-bc74-d997d050d9b0 tempest-VolumesActionsTest-872240335 None] Volume detach called, but volume not attached. Feb 25 15:55:48 devstack cinder-volume[83528]: DEBUG cinder.coordination [None req-3db5d0bb-a046-42e0-bc74-d997d050d9b0 tempest-VolumesActionsTest-872240335 None] Lock "cinder-9b63c7fd-433d-47df-874c-6aa6d075fd6a-detach_volume" released by "detach_volume" :: held 0.025s {{(pid=83528) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 25 15:55:48 devstack sudo[87478]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-fa2da276-994a-452f-950a-05721f695adb Feb 25 15:55:48 devstack sudo[87478]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 25 15:55:48 devstack cinder-volume[83528]: DEBUG cinder.volume.flows.manager.create_volume [None req-92e97647-4d06-4f08-9271-e8deab781fa2 tempest-VolumesMetadataTest-266040296 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83528) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 25 15:55:49 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-92e97647-4d06-4f08-9271-e8deab781fa2 tempest-VolumesMetadataTest-266040296 None] Flow 'volume_create_manager' (a2a9367a-fe17-4695-9118-a77bb8a81f0e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83528) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 25 15:55:49 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-92e97647-4d06-4f08-9271-e8deab781fa2 tempest-VolumesMetadataTest-266040296 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f4df642a-4bf7-47cd-9f84-33fc05d9977f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 25 15:55:49 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-92e97647-4d06-4f08-9271-e8deab781fa2 tempest-VolumesMetadataTest-266040296 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f4df642a-4bf7-47cd-9f84-33fc05d9977f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-25T14:55:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-115987276',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0bb037f1-cff3-486b-b1c1-0e13f13dab1f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0b75c9fb918441e992f4a485df5b4893',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-25T14:55:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-25T14:55:49Z,use_quota=True,user_id='82f1a438a1c549a8b1616a0b9e47a0d5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ce71c2f9-6543-4165-9653-a1529b2ea243),volume_type_id=ce71c2f9-6543-4165-9653-a1529b2ea243)' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 25 15:55:49 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-92e97647-4d06-4f08-9271-e8deab781fa2 tempest-VolumesMetadataTest-266040296 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a74c07e0-c5cb-4bd4-a815-a87a517f96b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 25 15:55:49 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-92e97647-4d06-4f08-9271-e8deab781fa2 tempest-VolumesMetadataTest-266040296 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a74c07e0-c5cb-4bd4-a815-a87a517f96b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 25 15:55:49 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-92e97647-4d06-4f08-9271-e8deab781fa2 tempest-VolumesMetadataTest-266040296 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (03d74d92-855d-4008-9bcb-0504a1f08633) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 25 15:55:49 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-92e97647-4d06-4f08-9271-e8deab781fa2 tempest-VolumesMetadataTest-266040296 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (03d74d92-855d-4008-9bcb-0504a1f08633) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0bb037f1-cff3-486b-b1c1-0e13f13dab1f', 'volume_name': 'volume-0bb037f1-cff3-486b-b1c1-0e13f13dab1f', 'volume_size': 1}' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 25 15:55:49 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-92e97647-4d06-4f08-9271-e8deab781fa2 tempest-VolumesMetadataTest-266040296 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5428e3b5-5c9a-484f-909f-34d64f0a8674) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 25 15:55:49 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-92e97647-4d06-4f08-9271-e8deab781fa2 tempest-VolumesMetadataTest-266040296 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5428e3b5-5c9a-484f-909f-34d64f0a8674) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 25 15:55:49 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-92e97647-4d06-4f08-9271-e8deab781fa2 tempest-VolumesMetadataTest-266040296 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b3b4f9b6-7bde-43ac-a574-21ce963998a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 25 15:55:49 devstack cinder-volume[83528]: INFO cinder.volume.flows.manager.create_volume [None req-92e97647-4d06-4f08-9271-e8deab781fa2 tempest-VolumesMetadataTest-266040296 None] Volume 0bb037f1-cff3-486b-b1c1-0e13f13dab1f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0bb037f1-cff3-486b-b1c1-0e13f13dab1f', 'volume_size': 1} Feb 25 15:55:49 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-92e97647-4d06-4f08-9271-e8deab781fa2 tempest-VolumesMetadataTest-266040296 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 25 15:55:49 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-92e97647-4d06-4f08-9271-e8deab781fa2 tempest-VolumesMetadataTest-266040296 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 25 15:55:49 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.quobyte [None req-92e97647-4d06-4f08-9271-e8deab781fa2 tempest-VolumesMetadataTest-266040296 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-25T14:55:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-115987276',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0bb037f1-cff3-486b-b1c1-0e13f13dab1f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0b75c9fb918441e992f4a485df5b4893',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-25T14:55:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-25T14:55:49Z,use_quota=True,user_id='82f1a438a1c549a8b1616a0b9e47a0d5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ce71c2f9-6543-4165-9653-a1529b2ea243),volume_type_id=ce71c2f9-6543-4165-9653-a1529b2ea243)}" {{(pid=83528) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 25 15:55:49 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.remotefs [None req-92e97647-4d06-4f08-9271-e8deab781fa2 tempest-VolumesMetadataTest-266040296 None] Creating volume 0bb037f1-cff3-486b-b1c1-0e13f13dab1f {{(pid=83528) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 25 15:55:49 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-92e97647-4d06-4f08-9271-e8deab781fa2 tempest-VolumesMetadataTest-266040296 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 25 15:55:49 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-92e97647-4d06-4f08-9271-e8deab781fa2 tempest-VolumesMetadataTest-266040296 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 25 15:55:49 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.quobyte [None req-92e97647-4d06-4f08-9271-e8deab781fa2 tempest-VolumesMetadataTest-266040296 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23e9d725-3e04-4cd9-bfe0-c8ef43305589': None} {{(pid=83528) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 25 15:55:49 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.quobyte [None req-92e97647-4d06-4f08-9271-e8deab781fa2 tempest-VolumesMetadataTest-266040296 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23e9d725-3e04-4cd9-bfe0-c8ef43305589'] {{(pid=83528) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 25 15:55:49 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-92e97647-4d06-4f08-9271-e8deab781fa2 tempest-VolumesMetadataTest-266040296 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 25 15:55:49 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.quobyte [None req-92e97647-4d06-4f08-9271-e8deab781fa2 tempest-VolumesMetadataTest-266040296 None] Selected osci02.corp.quobyte.com/cinder-vol-23e9d725-3e04-4cd9-bfe0-c8ef43305589 as target Quobyte volume. {{(pid=83528) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 25 15:55:49 devstack cinder-volume[83528]: INFO cinder.volume.drivers.remotefs [None req-92e97647-4d06-4f08-9271-e8deab781fa2 tempest-VolumesMetadataTest-266040296 None] casted to osci02.corp.quobyte.com/cinder-vol-23e9d725-3e04-4cd9-bfe0-c8ef43305589 Feb 25 15:55:49 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-92e97647-4d06-4f08-9271-e8deab781fa2 tempest-VolumesMetadataTest-266040296 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-0bb037f1-cff3-486b-b1c1-0e13f13dab1f 1073741824 {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 25 15:55:49 devstack sudo[87483]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-0bb037f1-cff3-486b-b1c1-0e13f13dab1f 1073741824 Feb 25 15:55:49 devstack sudo[87483]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 25 15:55:49 devstack cinder-volume[83528]: DEBUG cinder.coordination [None req-143cd82a-7991-4f33-8f64-f32ec4b1c535 tempest-VolumesActionsTest-872240335 None] Acquiring lock "cinder-9b63c7fd-433d-47df-874c-6aa6d075fd6a-delete_volume" by "delete_volume" {{(pid=83528) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 25 15:55:49 devstack cinder-volume[83528]: DEBUG cinder.coordination [None req-143cd82a-7991-4f33-8f64-f32ec4b1c535 tempest-VolumesActionsTest-872240335 None] Lock "cinder-9b63c7fd-433d-47df-874c-6aa6d075fd6a-delete_volume" acquired by "delete_volume" :: waited 0.014s {{(pid=83528) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 25 15:55:49 devstack cinder-volume[83528]: DEBUG cinder.coordination [None req-143cd82a-7991-4f33-8f64-f32ec4b1c535 tempest-VolumesActionsTest-872240335 None] Acquiring lock "cinder-quobyte-9b63c7fd-433d-47df-874c-6aa6d075fd6a" by "delete_volume" {{(pid=83528) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 25 15:55:49 devstack cinder-volume[83528]: DEBUG cinder.coordination [None req-143cd82a-7991-4f33-8f64-f32ec4b1c535 tempest-VolumesActionsTest-872240335 None] Lock "cinder-quobyte-9b63c7fd-433d-47df-874c-6aa6d075fd6a" acquired by "delete_volume" :: waited 0.032s {{(pid=83528) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 25 15:55:49 devstack sudo[87478]: pam_unix(sudo:session): session closed for user root Feb 25 15:55:49 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-6294c1b7-a154-4340-a8f1-786ff5d42ea5 tempest-SnapshotsActionsTest-738507698 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-fa2da276-994a-452f-950a-05721f695adb" returned: 0 in 0.865s {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 25 15:55:49 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-6294c1b7-a154-4340-a8f1-786ff5d42ea5 tempest-SnapshotsActionsTest-738507698 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-fa2da276-994a-452f-950a-05721f695adb {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 25 15:55:49 devstack cinder-volume[83528]: DEBUG oslo.privsep.daemon [-] privsep: reply[3be79670-eb59-4f23-b6ff-11eb17ac670f]: (4, 'qcow2') {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 25 15:55:49 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-143cd82a-7991-4f33-8f64-f32ec4b1c535 tempest-VolumesActionsTest-872240335 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-9b63c7fd-433d-47df-874c-6aa6d075fd6a {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 25 15:55:49 devstack sudo[87485]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-fa2da276-994a-452f-950a-05721f695adb Feb 25 15:55:49 devstack sudo[87485]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 25 15:55:49 devstack cinder-volume[83528]: INFO cinder.volume.manager [None req-b04cbff8-700e-4d60-9b10-016c8b8a1e04 tempest-GroupsTest-1552622998 None] Group tempest-GroupsTest-Group-949264483: creating Feb 25 15:55:49 devstack cinder-volume[83528]: INFO cinder.volume.manager [None req-b04cbff8-700e-4d60-9b10-016c8b8a1e04 tempest-GroupsTest-1552622998 None] Group tempest-GroupsTest-Group-949264483: created successfully Feb 25 15:55:49 devstack sudo[87486]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-9b63c7fd-433d-47df-874c-6aa6d075fd6a Feb 25 15:55:49 devstack sudo[87486]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 25 15:55:49 devstack cinder-volume[83528]: INFO cinder.volume.manager [None req-b04cbff8-700e-4d60-9b10-016c8b8a1e04 tempest-GroupsTest-1552622998 None] Create group completed successfully. Feb 25 15:55:49 devstack sudo[87485]: pam_unix(sudo:session): session closed for user root Feb 25 15:55:49 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-6294c1b7-a154-4340-a8f1-786ff5d42ea5 tempest-SnapshotsActionsTest-738507698 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-fa2da276-994a-452f-950a-05721f695adb" returned: 0 in 0.511s {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 25 15:55:49 devstack cinder-volume[83528]: DEBUG cinder.coordination [None req-6294c1b7-a154-4340-a8f1-786ff5d42ea5 tempest-SnapshotsActionsTest-738507698 None] Lock "cinder-quobyte-fa2da276-994a-452f-950a-05721f695adb" released by "delete_volume" :: held 1.424s {{(pid=83528) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 25 15:55:49 devstack sudo[87483]: pam_unix(sudo:session): session closed for user root Feb 25 15:55:49 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-92e97647-4d06-4f08-9271-e8deab781fa2 tempest-VolumesMetadataTest-266040296 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-0bb037f1-cff3-486b-b1c1-0e13f13dab1f 1073741824" returned: 0 in 0.795s {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 25 15:55:49 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-92e97647-4d06-4f08-9271-e8deab781fa2 tempest-VolumesMetadataTest-266040296 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-0bb037f1-cff3-486b-b1c1-0e13f13dab1f {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 25 15:55:50 devstack sudo[87496]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-0bb037f1-cff3-486b-b1c1-0e13f13dab1f Feb 25 15:55:50 devstack sudo[87496]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 25 15:55:50 devstack cinder-volume[83528]: DEBUG cinder.quota [None req-6294c1b7-a154-4340-a8f1-786ff5d42ea5 tempest-SnapshotsActionsTest-738507698 None] Created reservations ['fd5515d2-4c37-41ed-a88a-8b2e4158023d', 'c7dc91f1-949a-4857-84e5-5dea4b25a4b6', 'f4bcacd6-d81a-4b1b-9d55-4a887b6569c9', '95f35273-bb7a-4309-a537-89b0d145d07d'] {{(pid=83528) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 25 15:55:50 devstack sudo[87486]: pam_unix(sudo:session): session closed for user root Feb 25 15:55:50 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-143cd82a-7991-4f33-8f64-f32ec4b1c535 tempest-VolumesActionsTest-872240335 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-9b63c7fd-433d-47df-874c-6aa6d075fd6a" returned: 0 in 0.646s {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 25 15:55:50 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-143cd82a-7991-4f33-8f64-f32ec4b1c535 tempest-VolumesActionsTest-872240335 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-9b63c7fd-433d-47df-874c-6aa6d075fd6a {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 25 15:55:50 devstack sudo[87498]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-9b63c7fd-433d-47df-874c-6aa6d075fd6a Feb 25 15:55:50 devstack sudo[87498]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 25 15:55:50 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-6294c1b7-a154-4340-a8f1-786ff5d42ea5 tempest-SnapshotsActionsTest-738507698 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 25 15:55:50 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-6294c1b7-a154-4340-a8f1-786ff5d42ea5 tempest-SnapshotsActionsTest-738507698 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 25 15:55:50 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.quobyte [None req-6294c1b7-a154-4340-a8f1-786ff5d42ea5 tempest-SnapshotsActionsTest-738507698 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23e9d725-3e04-4cd9-bfe0-c8ef43305589': None} {{(pid=83528) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 25 15:55:50 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.quobyte [None req-6294c1b7-a154-4340-a8f1-786ff5d42ea5 tempest-SnapshotsActionsTest-738507698 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23e9d725-3e04-4cd9-bfe0-c8ef43305589'] {{(pid=83528) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 25 15:55:50 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-6294c1b7-a154-4340-a8f1-786ff5d42ea5 tempest-SnapshotsActionsTest-738507698 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 25 15:55:50 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-6294c1b7-a154-4340-a8f1-786ff5d42ea5 tempest-SnapshotsActionsTest-738507698 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85 {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 25 15:55:50 devstack sudo[87500]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85 Feb 25 15:55:50 devstack sudo[87500]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 25 15:55:50 devstack sudo[87496]: pam_unix(sudo:session): session closed for user root Feb 25 15:55:50 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-92e97647-4d06-4f08-9271-e8deab781fa2 tempest-VolumesMetadataTest-266040296 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-0bb037f1-cff3-486b-b1c1-0e13f13dab1f" returned: 0 in 0.576s {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 25 15:55:50 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.quobyte [None req-92e97647-4d06-4f08-9271-e8deab781fa2 tempest-VolumesMetadataTest-266040296 None] <== create_volume: return (1435ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-23e9d725-3e04-4cd9-bfe0-c8ef43305589'} {{(pid=83528) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 25 15:55:50 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-92e97647-4d06-4f08-9271-e8deab781fa2 tempest-VolumesMetadataTest-266040296 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.438s {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 25 15:55:50 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-92e97647-4d06-4f08-9271-e8deab781fa2 tempest-VolumesMetadataTest-266040296 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b3b4f9b6-7bde-43ac-a574-21ce963998a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0bb037f1-cff3-486b-b1c1-0e13f13dab1f', 'volume_size': 1}' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 25 15:55:50 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-92e97647-4d06-4f08-9271-e8deab781fa2 tempest-VolumesMetadataTest-266040296 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1b8d6294-1e2b-419f-b7bc-41115c392abe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 25 15:55:50 devstack cinder-volume[83528]: INFO cinder.volume.flows.manager.create_volume [None req-92e97647-4d06-4f08-9271-e8deab781fa2 tempest-VolumesMetadataTest-266040296 None] Volume volume-0bb037f1-cff3-486b-b1c1-0e13f13dab1f (0bb037f1-cff3-486b-b1c1-0e13f13dab1f): created successfully Feb 25 15:55:50 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-92e97647-4d06-4f08-9271-e8deab781fa2 tempest-VolumesMetadataTest-266040296 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1b8d6294-1e2b-419f-b7bc-41115c392abe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 25 15:55:50 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-92e97647-4d06-4f08-9271-e8deab781fa2 tempest-VolumesMetadataTest-266040296 None] Flow 'volume_create_manager' (a2a9367a-fe17-4695-9118-a77bb8a81f0e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83528) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 25 15:55:50 devstack cinder-volume[83528]: INFO cinder.volume.manager [None req-92e97647-4d06-4f08-9271-e8deab781fa2 tempest-VolumesMetadataTest-266040296 None] Created volume successfully. Feb 25 15:55:50 devstack sudo[87500]: pam_unix(sudo:session): session closed for user root Feb 25 15:55:50 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-6294c1b7-a154-4340-a8f1-786ff5d42ea5 tempest-SnapshotsActionsTest-738507698 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85" returned: 0 in 0.534s {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 25 15:55:50 devstack cinder-volume[83528]: DEBUG cinder.manager [None req-6294c1b7-a154-4340-a8f1-786ff5d42ea5 tempest-SnapshotsActionsTest-738507698 None] Notifying Schedulers of capabilities ... {{(pid=83528) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 25 15:55:50 devstack cinder-volume[83528]: INFO cinder.volume.manager [None req-6294c1b7-a154-4340-a8f1-786ff5d42ea5 tempest-SnapshotsActionsTest-738507698 None] Deleted volume successfully. Feb 25 15:55:50 devstack cinder-volume[83528]: DEBUG cinder.coordination [None req-6294c1b7-a154-4340-a8f1-786ff5d42ea5 tempest-SnapshotsActionsTest-738507698 None] Lock "cinder-fa2da276-994a-452f-950a-05721f695adb-delete_volume" released by "delete_volume" :: held 2.247s {{(pid=83528) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 25 15:55:50 devstack sudo[87498]: pam_unix(sudo:session): session closed for user root Feb 25 15:55:50 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-143cd82a-7991-4f33-8f64-f32ec4b1c535 tempest-VolumesActionsTest-872240335 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-9b63c7fd-433d-47df-874c-6aa6d075fd6a" returned: 0 in 0.696s {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 25 15:55:50 devstack cinder-volume[83528]: DEBUG cinder.coordination [None req-143cd82a-7991-4f33-8f64-f32ec4b1c535 tempest-VolumesActionsTest-872240335 None] Lock "cinder-quobyte-9b63c7fd-433d-47df-874c-6aa6d075fd6a" released by "delete_volume" :: held 1.412s {{(pid=83528) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 25 15:55:50 devstack cinder-volume[83528]: DEBUG cinder.quota [None req-143cd82a-7991-4f33-8f64-f32ec4b1c535 tempest-VolumesActionsTest-872240335 None] Created reservations ['60ef8c93-7d85-4947-bc10-5ad3f2a1325b', 'bc42a6d2-c939-4d2e-bdfd-b79298d8fc37', 'c7d2e3f3-7e31-4f44-b11f-d380b64cfb2f', '475f9679-daaf-4465-aa42-d32e0200b616'] {{(pid=83528) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 25 15:55:50 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-143cd82a-7991-4f33-8f64-f32ec4b1c535 tempest-VolumesActionsTest-872240335 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 25 15:55:50 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-143cd82a-7991-4f33-8f64-f32ec4b1c535 tempest-VolumesActionsTest-872240335 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 25 15:55:50 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.quobyte [None req-143cd82a-7991-4f33-8f64-f32ec4b1c535 tempest-VolumesActionsTest-872240335 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23e9d725-3e04-4cd9-bfe0-c8ef43305589': None} {{(pid=83528) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 25 15:55:50 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.quobyte [None req-143cd82a-7991-4f33-8f64-f32ec4b1c535 tempest-VolumesActionsTest-872240335 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23e9d725-3e04-4cd9-bfe0-c8ef43305589'] {{(pid=83528) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 25 15:55:50 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-143cd82a-7991-4f33-8f64-f32ec4b1c535 tempest-VolumesActionsTest-872240335 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 25 15:55:50 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-143cd82a-7991-4f33-8f64-f32ec4b1c535 tempest-VolumesActionsTest-872240335 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85 {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 25 15:55:50 devstack sudo[87505]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85 Feb 25 15:55:50 devstack sudo[87505]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 25 15:55:50 devstack cinder-volume[83528]: DEBUG cinder.volume.flows.manager.create_volume [None req-8a8d2f8d-6312-4f9f-aa59-2082563aee9d tempest-GroupsTest-1552622998 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83528) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 25 15:55:50 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-8a8d2f8d-6312-4f9f-aa59-2082563aee9d tempest-GroupsTest-1552622998 None] Flow 'volume_create_manager' (17a136c9-3dce-488c-94cd-0f82e0d7f23f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83528) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 25 15:55:50 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-8a8d2f8d-6312-4f9f-aa59-2082563aee9d tempest-GroupsTest-1552622998 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f2ad7995-104c-4da6-88b0-71696e402575) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 25 15:55:51 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-8a8d2f8d-6312-4f9f-aa59-2082563aee9d tempest-GroupsTest-1552622998 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f2ad7995-104c-4da6-88b0-71696e402575) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-25T14:55:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1172501964',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=b334470f-8e6d-44a9-9a4e-90075cfcfc25,host='devstack@QuobyteHD#QuobyteHD',id=d4ec39fb-2338-4fc5-b4b1-89d9a2faa108,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0785ca15590d4680ad9b8bad9784d5ca',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-25T14:55:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-25T14:55:51Z,use_quota=True,user_id='34b8223ed571400a993a078d1c0b741a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cf4db4ca-37ff-4554-9a37-aa447dbb8c7b),volume_type_id=cf4db4ca-37ff-4554-9a37-aa447dbb8c7b)' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 25 15:55:51 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-8a8d2f8d-6312-4f9f-aa59-2082563aee9d tempest-GroupsTest-1552622998 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e21a2a0b-3e08-49fa-b94b-45cc0aeb2e30) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 25 15:55:51 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-8a8d2f8d-6312-4f9f-aa59-2082563aee9d tempest-GroupsTest-1552622998 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e21a2a0b-3e08-49fa-b94b-45cc0aeb2e30) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 25 15:55:51 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-8a8d2f8d-6312-4f9f-aa59-2082563aee9d tempest-GroupsTest-1552622998 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (731b1515-7cee-4182-b9c2-42ff3e139401) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 25 15:55:51 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-8a8d2f8d-6312-4f9f-aa59-2082563aee9d tempest-GroupsTest-1552622998 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (731b1515-7cee-4182-b9c2-42ff3e139401) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd4ec39fb-2338-4fc5-b4b1-89d9a2faa108', 'volume_name': 'volume-d4ec39fb-2338-4fc5-b4b1-89d9a2faa108', 'volume_size': 1}' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 25 15:55:51 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-8a8d2f8d-6312-4f9f-aa59-2082563aee9d tempest-GroupsTest-1552622998 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (80cec00f-2304-4209-b103-61b2a1f2590f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 25 15:55:51 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-8a8d2f8d-6312-4f9f-aa59-2082563aee9d tempest-GroupsTest-1552622998 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (80cec00f-2304-4209-b103-61b2a1f2590f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 25 15:55:51 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-8a8d2f8d-6312-4f9f-aa59-2082563aee9d tempest-GroupsTest-1552622998 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e1a66903-7e0b-4582-8c95-6485d4918f31) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 25 15:55:51 devstack cinder-volume[83528]: INFO cinder.volume.flows.manager.create_volume [None req-8a8d2f8d-6312-4f9f-aa59-2082563aee9d tempest-GroupsTest-1552622998 None] Volume d4ec39fb-2338-4fc5-b4b1-89d9a2faa108: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d4ec39fb-2338-4fc5-b4b1-89d9a2faa108', 'volume_size': 1} Feb 25 15:55:51 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-8a8d2f8d-6312-4f9f-aa59-2082563aee9d tempest-GroupsTest-1552622998 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 25 15:55:51 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-8a8d2f8d-6312-4f9f-aa59-2082563aee9d tempest-GroupsTest-1552622998 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 25 15:55:51 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.quobyte [None req-8a8d2f8d-6312-4f9f-aa59-2082563aee9d tempest-GroupsTest-1552622998 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=b334470f-8e6d-44a9-9a4e-90075cfcfc25,created_at=2026-02-25T14:55:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1172501964',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=b334470f-8e6d-44a9-9a4e-90075cfcfc25,host='devstack@QuobyteHD#QuobyteHD',id=d4ec39fb-2338-4fc5-b4b1-89d9a2faa108,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0785ca15590d4680ad9b8bad9784d5ca',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-25T14:55:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-25T14:55:51Z,use_quota=True,user_id='34b8223ed571400a993a078d1c0b741a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cf4db4ca-37ff-4554-9a37-aa447dbb8c7b),volume_type_id=cf4db4ca-37ff-4554-9a37-aa447dbb8c7b)}" {{(pid=83528) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 25 15:55:51 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.remotefs [None req-8a8d2f8d-6312-4f9f-aa59-2082563aee9d tempest-GroupsTest-1552622998 None] Creating volume d4ec39fb-2338-4fc5-b4b1-89d9a2faa108 {{(pid=83528) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 25 15:55:51 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-8a8d2f8d-6312-4f9f-aa59-2082563aee9d tempest-GroupsTest-1552622998 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 25 15:55:51 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-8a8d2f8d-6312-4f9f-aa59-2082563aee9d tempest-GroupsTest-1552622998 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 25 15:55:51 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.quobyte [None req-8a8d2f8d-6312-4f9f-aa59-2082563aee9d tempest-GroupsTest-1552622998 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23e9d725-3e04-4cd9-bfe0-c8ef43305589': None} {{(pid=83528) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 25 15:55:51 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.quobyte [None req-8a8d2f8d-6312-4f9f-aa59-2082563aee9d tempest-GroupsTest-1552622998 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23e9d725-3e04-4cd9-bfe0-c8ef43305589'] {{(pid=83528) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 25 15:55:51 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-8a8d2f8d-6312-4f9f-aa59-2082563aee9d tempest-GroupsTest-1552622998 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 25 15:55:51 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.quobyte [None req-8a8d2f8d-6312-4f9f-aa59-2082563aee9d tempest-GroupsTest-1552622998 None] Selected osci02.corp.quobyte.com/cinder-vol-23e9d725-3e04-4cd9-bfe0-c8ef43305589 as target Quobyte volume. {{(pid=83528) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 25 15:55:51 devstack cinder-volume[83528]: INFO cinder.volume.drivers.remotefs [None req-8a8d2f8d-6312-4f9f-aa59-2082563aee9d tempest-GroupsTest-1552622998 None] casted to osci02.corp.quobyte.com/cinder-vol-23e9d725-3e04-4cd9-bfe0-c8ef43305589 Feb 25 15:55:51 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-8a8d2f8d-6312-4f9f-aa59-2082563aee9d tempest-GroupsTest-1552622998 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-d4ec39fb-2338-4fc5-b4b1-89d9a2faa108 1073741824 {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 25 15:55:51 devstack sudo[87507]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-d4ec39fb-2338-4fc5-b4b1-89d9a2faa108 1073741824 Feb 25 15:55:51 devstack sudo[87507]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 25 15:55:51 devstack sudo[87505]: pam_unix(sudo:session): session closed for user root Feb 25 15:55:51 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-143cd82a-7991-4f33-8f64-f32ec4b1c535 tempest-VolumesActionsTest-872240335 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85" returned: 0 in 0.739s {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 25 15:55:51 devstack cinder-volume[83528]: DEBUG cinder.manager [None req-143cd82a-7991-4f33-8f64-f32ec4b1c535 tempest-VolumesActionsTest-872240335 None] Notifying Schedulers of capabilities ... {{(pid=83528) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 25 15:55:51 devstack cinder-volume[83528]: INFO cinder.volume.manager [None req-143cd82a-7991-4f33-8f64-f32ec4b1c535 tempest-VolumesActionsTest-872240335 None] Deleted volume successfully. Feb 25 15:55:51 devstack cinder-volume[83528]: DEBUG cinder.coordination [None req-143cd82a-7991-4f33-8f64-f32ec4b1c535 tempest-VolumesActionsTest-872240335 None] Lock "cinder-9b63c7fd-433d-47df-874c-6aa6d075fd6a-delete_volume" released by "delete_volume" :: held 2.414s {{(pid=83528) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 25 15:55:52 devstack sudo[87507]: pam_unix(sudo:session): session closed for user root Feb 25 15:55:52 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-8a8d2f8d-6312-4f9f-aa59-2082563aee9d tempest-GroupsTest-1552622998 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-d4ec39fb-2338-4fc5-b4b1-89d9a2faa108 1073741824" returned: 0 in 1.214s {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 25 15:55:52 devstack cinder-volume[83528]: DEBUG cinder.coordination [None req-5a428f31-3b40-4faf-b4cc-ea9b948a6337 tempest-VolumesMetadataTest-266040296 None] Acquiring lock "cinder-0bb037f1-cff3-486b-b1c1-0e13f13dab1f-delete_volume" by "delete_volume" {{(pid=83528) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 25 15:55:52 devstack cinder-volume[83528]: DEBUG cinder.coordination [None req-5a428f31-3b40-4faf-b4cc-ea9b948a6337 tempest-VolumesMetadataTest-266040296 None] Lock "cinder-0bb037f1-cff3-486b-b1c1-0e13f13dab1f-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=83528) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 25 15:55:52 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-8a8d2f8d-6312-4f9f-aa59-2082563aee9d tempest-GroupsTest-1552622998 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-d4ec39fb-2338-4fc5-b4b1-89d9a2faa108 {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 25 15:55:52 devstack sudo[87513]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-d4ec39fb-2338-4fc5-b4b1-89d9a2faa108 Feb 25 15:55:52 devstack sudo[87513]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 25 15:55:52 devstack cinder-volume[83528]: DEBUG cinder.coordination [None req-5a428f31-3b40-4faf-b4cc-ea9b948a6337 tempest-VolumesMetadataTest-266040296 None] Acquiring lock "cinder-quobyte-0bb037f1-cff3-486b-b1c1-0e13f13dab1f" by "delete_volume" {{(pid=83528) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 25 15:55:52 devstack cinder-volume[83528]: DEBUG cinder.coordination [None req-5a428f31-3b40-4faf-b4cc-ea9b948a6337 tempest-VolumesMetadataTest-266040296 None] Lock "cinder-quobyte-0bb037f1-cff3-486b-b1c1-0e13f13dab1f" acquired by "delete_volume" :: waited 0.017s {{(pid=83528) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 25 15:55:52 devstack cinder-volume[83528]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e6e17ce-4f84-43de-8728-3f6956227f14]: (4, 'qcow2') {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 25 15:55:52 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-5a428f31-3b40-4faf-b4cc-ea9b948a6337 tempest-VolumesMetadataTest-266040296 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-0bb037f1-cff3-486b-b1c1-0e13f13dab1f {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 25 15:55:52 devstack sudo[87515]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-0bb037f1-cff3-486b-b1c1-0e13f13dab1f Feb 25 15:55:52 devstack sudo[87515]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 25 15:55:52 devstack sudo[87513]: pam_unix(sudo:session): session closed for user root Feb 25 15:55:52 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-8a8d2f8d-6312-4f9f-aa59-2082563aee9d tempest-GroupsTest-1552622998 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-d4ec39fb-2338-4fc5-b4b1-89d9a2faa108" returned: 0 in 0.599s {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 25 15:55:52 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.quobyte [None req-8a8d2f8d-6312-4f9f-aa59-2082563aee9d tempest-GroupsTest-1552622998 None] <== create_volume: return (1949ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-23e9d725-3e04-4cd9-bfe0-c8ef43305589'} {{(pid=83528) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 25 15:55:52 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-8a8d2f8d-6312-4f9f-aa59-2082563aee9d tempest-GroupsTest-1552622998 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.952s {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 25 15:55:53 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-8a8d2f8d-6312-4f9f-aa59-2082563aee9d tempest-GroupsTest-1552622998 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e1a66903-7e0b-4582-8c95-6485d4918f31) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d4ec39fb-2338-4fc5-b4b1-89d9a2faa108', 'volume_size': 1}' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 25 15:55:53 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-8a8d2f8d-6312-4f9f-aa59-2082563aee9d tempest-GroupsTest-1552622998 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (be113a25-97f4-4122-b7cf-8a76df9a5130) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 25 15:55:53 devstack cinder-volume[83528]: INFO cinder.volume.flows.manager.create_volume [None req-8a8d2f8d-6312-4f9f-aa59-2082563aee9d tempest-GroupsTest-1552622998 None] Volume volume-d4ec39fb-2338-4fc5-b4b1-89d9a2faa108 (d4ec39fb-2338-4fc5-b4b1-89d9a2faa108): created successfully Feb 25 15:55:53 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-8a8d2f8d-6312-4f9f-aa59-2082563aee9d tempest-GroupsTest-1552622998 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (be113a25-97f4-4122-b7cf-8a76df9a5130) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 25 15:55:53 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-8a8d2f8d-6312-4f9f-aa59-2082563aee9d tempest-GroupsTest-1552622998 None] Flow 'volume_create_manager' (17a136c9-3dce-488c-94cd-0f82e0d7f23f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83528) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 25 15:55:53 devstack cinder-volume[83528]: INFO cinder.volume.manager [None req-8a8d2f8d-6312-4f9f-aa59-2082563aee9d tempest-GroupsTest-1552622998 None] Created volume successfully. Feb 25 15:55:53 devstack sudo[87515]: pam_unix(sudo:session): session closed for user root Feb 25 15:55:53 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-5a428f31-3b40-4faf-b4cc-ea9b948a6337 tempest-VolumesMetadataTest-266040296 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-0bb037f1-cff3-486b-b1c1-0e13f13dab1f" returned: 0 in 0.881s {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 25 15:55:53 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-5a428f31-3b40-4faf-b4cc-ea9b948a6337 tempest-VolumesMetadataTest-266040296 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-0bb037f1-cff3-486b-b1c1-0e13f13dab1f {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 25 15:55:53 devstack sudo[87545]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-0bb037f1-cff3-486b-b1c1-0e13f13dab1f Feb 25 15:55:53 devstack sudo[87545]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 25 15:55:53 devstack cinder-volume[83528]: DEBUG cinder.volume.flows.manager.create_volume [None req-771a9226-d831-4d8a-b6d2-604246277a0a tempest-GroupsTest-1552622998 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83528) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 25 15:55:53 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-771a9226-d831-4d8a-b6d2-604246277a0a tempest-GroupsTest-1552622998 None] Flow 'volume_create_manager' (aa7d0ced-3491-46e9-ad3e-18a8656be7ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83528) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 25 15:55:53 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-771a9226-d831-4d8a-b6d2-604246277a0a tempest-GroupsTest-1552622998 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (349e9684-2136-478f-84de-a1795625328f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 25 15:55:53 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-771a9226-d831-4d8a-b6d2-604246277a0a tempest-GroupsTest-1552622998 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (349e9684-2136-478f-84de-a1795625328f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-25T14:55:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-936586599',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=b334470f-8e6d-44a9-9a4e-90075cfcfc25,host='devstack@QuobyteHD#QuobyteHD',id=fbec84ec-2ef7-43bc-b4b4-87c789dcf2c4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0785ca15590d4680ad9b8bad9784d5ca',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-25T14:55:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-25T14:55:54Z,use_quota=True,user_id='34b8223ed571400a993a078d1c0b741a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cf4db4ca-37ff-4554-9a37-aa447dbb8c7b),volume_type_id=cf4db4ca-37ff-4554-9a37-aa447dbb8c7b)' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 25 15:55:53 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-771a9226-d831-4d8a-b6d2-604246277a0a tempest-GroupsTest-1552622998 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (26df6b9f-15ac-4227-8bee-5e4e9403a0ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 25 15:55:53 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-771a9226-d831-4d8a-b6d2-604246277a0a tempest-GroupsTest-1552622998 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (26df6b9f-15ac-4227-8bee-5e4e9403a0ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 25 15:55:53 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-771a9226-d831-4d8a-b6d2-604246277a0a tempest-GroupsTest-1552622998 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3d716160-df69-402c-87f8-8a49f2bc3d20) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 25 15:55:53 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-771a9226-d831-4d8a-b6d2-604246277a0a tempest-GroupsTest-1552622998 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3d716160-df69-402c-87f8-8a49f2bc3d20) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fbec84ec-2ef7-43bc-b4b4-87c789dcf2c4', 'volume_name': 'volume-fbec84ec-2ef7-43bc-b4b4-87c789dcf2c4', 'volume_size': 1}' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 25 15:55:53 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-771a9226-d831-4d8a-b6d2-604246277a0a tempest-GroupsTest-1552622998 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f37eec72-a4f9-490b-89a5-d2d811194ec0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 25 15:55:53 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-771a9226-d831-4d8a-b6d2-604246277a0a tempest-GroupsTest-1552622998 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f37eec72-a4f9-490b-89a5-d2d811194ec0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 25 15:55:53 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-771a9226-d831-4d8a-b6d2-604246277a0a tempest-GroupsTest-1552622998 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (07df3f8f-1b48-4e53-9928-7206b887cbb7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 25 15:55:53 devstack cinder-volume[83528]: INFO cinder.volume.flows.manager.create_volume [None req-771a9226-d831-4d8a-b6d2-604246277a0a tempest-GroupsTest-1552622998 None] Volume fbec84ec-2ef7-43bc-b4b4-87c789dcf2c4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fbec84ec-2ef7-43bc-b4b4-87c789dcf2c4', 'volume_size': 1} Feb 25 15:55:53 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-771a9226-d831-4d8a-b6d2-604246277a0a tempest-GroupsTest-1552622998 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 25 15:55:53 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-771a9226-d831-4d8a-b6d2-604246277a0a tempest-GroupsTest-1552622998 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 25 15:55:53 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.quobyte [None req-771a9226-d831-4d8a-b6d2-604246277a0a tempest-GroupsTest-1552622998 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=b334470f-8e6d-44a9-9a4e-90075cfcfc25,created_at=2026-02-25T14:55:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-936586599',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=b334470f-8e6d-44a9-9a4e-90075cfcfc25,host='devstack@QuobyteHD#QuobyteHD',id=fbec84ec-2ef7-43bc-b4b4-87c789dcf2c4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0785ca15590d4680ad9b8bad9784d5ca',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-25T14:55:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-25T14:55:54Z,use_quota=True,user_id='34b8223ed571400a993a078d1c0b741a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cf4db4ca-37ff-4554-9a37-aa447dbb8c7b),volume_type_id=cf4db4ca-37ff-4554-9a37-aa447dbb8c7b)}" {{(pid=83528) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 25 15:55:53 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.remotefs [None req-771a9226-d831-4d8a-b6d2-604246277a0a tempest-GroupsTest-1552622998 None] Creating volume fbec84ec-2ef7-43bc-b4b4-87c789dcf2c4 {{(pid=83528) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 25 15:55:53 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-771a9226-d831-4d8a-b6d2-604246277a0a tempest-GroupsTest-1552622998 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 25 15:55:53 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-771a9226-d831-4d8a-b6d2-604246277a0a tempest-GroupsTest-1552622998 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 25 15:55:53 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.quobyte [None req-771a9226-d831-4d8a-b6d2-604246277a0a tempest-GroupsTest-1552622998 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23e9d725-3e04-4cd9-bfe0-c8ef43305589': None} {{(pid=83528) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 25 15:55:53 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.quobyte [None req-771a9226-d831-4d8a-b6d2-604246277a0a tempest-GroupsTest-1552622998 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23e9d725-3e04-4cd9-bfe0-c8ef43305589'] {{(pid=83528) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 25 15:55:53 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-771a9226-d831-4d8a-b6d2-604246277a0a tempest-GroupsTest-1552622998 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 25 15:55:53 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.quobyte [None req-771a9226-d831-4d8a-b6d2-604246277a0a tempest-GroupsTest-1552622998 None] Selected osci02.corp.quobyte.com/cinder-vol-23e9d725-3e04-4cd9-bfe0-c8ef43305589 as target Quobyte volume. {{(pid=83528) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 25 15:55:53 devstack cinder-volume[83528]: INFO cinder.volume.drivers.remotefs [None req-771a9226-d831-4d8a-b6d2-604246277a0a tempest-GroupsTest-1552622998 None] casted to osci02.corp.quobyte.com/cinder-vol-23e9d725-3e04-4cd9-bfe0-c8ef43305589 Feb 25 15:55:53 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-771a9226-d831-4d8a-b6d2-604246277a0a tempest-GroupsTest-1552622998 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-fbec84ec-2ef7-43bc-b4b4-87c789dcf2c4 1073741824 {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 25 15:55:53 devstack sudo[87548]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-fbec84ec-2ef7-43bc-b4b4-87c789dcf2c4 1073741824 Feb 25 15:55:53 devstack sudo[87548]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 25 15:55:54 devstack sudo[87545]: pam_unix(sudo:session): session closed for user root Feb 25 15:55:54 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-5a428f31-3b40-4faf-b4cc-ea9b948a6337 tempest-VolumesMetadataTest-266040296 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-0bb037f1-cff3-486b-b1c1-0e13f13dab1f" returned: 0 in 0.757s {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 25 15:55:54 devstack cinder-volume[83528]: DEBUG cinder.coordination [None req-5a428f31-3b40-4faf-b4cc-ea9b948a6337 tempest-VolumesMetadataTest-266040296 None] Lock "cinder-quobyte-0bb037f1-cff3-486b-b1c1-0e13f13dab1f" released by "delete_volume" :: held 1.671s {{(pid=83528) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 25 15:55:54 devstack cinder-volume[83528]: DEBUG cinder.quota [None req-5a428f31-3b40-4faf-b4cc-ea9b948a6337 tempest-VolumesMetadataTest-266040296 None] Created reservations ['2ca61171-2b47-4be5-a7c8-57ec972a58ac', 'b6014465-be03-463b-b8df-b8bc491c6b32', 'f5d4d7eb-1061-4f31-86ab-6e6b913b5cc6', '93ab54a0-daf3-474d-8e12-fa5ba88a18e0'] {{(pid=83528) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 25 15:55:54 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-5a428f31-3b40-4faf-b4cc-ea9b948a6337 tempest-VolumesMetadataTest-266040296 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 25 15:55:54 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-5a428f31-3b40-4faf-b4cc-ea9b948a6337 tempest-VolumesMetadataTest-266040296 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 25 15:55:54 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.quobyte [None req-5a428f31-3b40-4faf-b4cc-ea9b948a6337 tempest-VolumesMetadataTest-266040296 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23e9d725-3e04-4cd9-bfe0-c8ef43305589': None} {{(pid=83528) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 25 15:55:54 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.quobyte [None req-5a428f31-3b40-4faf-b4cc-ea9b948a6337 tempest-VolumesMetadataTest-266040296 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23e9d725-3e04-4cd9-bfe0-c8ef43305589'] {{(pid=83528) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 25 15:55:54 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-5a428f31-3b40-4faf-b4cc-ea9b948a6337 tempest-VolumesMetadataTest-266040296 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 25 15:55:54 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-5a428f31-3b40-4faf-b4cc-ea9b948a6337 tempest-VolumesMetadataTest-266040296 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85 {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 25 15:55:54 devstack sudo[87551]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85 Feb 25 15:55:54 devstack sudo[87551]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 25 15:55:54 devstack sudo[87548]: pam_unix(sudo:session): session closed for user root Feb 25 15:55:54 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-771a9226-d831-4d8a-b6d2-604246277a0a tempest-GroupsTest-1552622998 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-fbec84ec-2ef7-43bc-b4b4-87c789dcf2c4 1073741824" returned: 0 in 0.757s {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 25 15:55:54 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-771a9226-d831-4d8a-b6d2-604246277a0a tempest-GroupsTest-1552622998 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-fbec84ec-2ef7-43bc-b4b4-87c789dcf2c4 {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 25 15:55:54 devstack sudo[87558]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-fbec84ec-2ef7-43bc-b4b4-87c789dcf2c4 Feb 25 15:55:54 devstack sudo[87558]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 25 15:55:54 devstack sudo[87551]: pam_unix(sudo:session): session closed for user root Feb 25 15:55:54 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-5a428f31-3b40-4faf-b4cc-ea9b948a6337 tempest-VolumesMetadataTest-266040296 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85" returned: 0 in 0.697s {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 25 15:55:54 devstack cinder-volume[83528]: DEBUG cinder.manager [None req-5a428f31-3b40-4faf-b4cc-ea9b948a6337 tempest-VolumesMetadataTest-266040296 None] Notifying Schedulers of capabilities ... {{(pid=83528) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 25 15:55:54 devstack cinder-volume[83528]: INFO cinder.volume.manager [None req-5a428f31-3b40-4faf-b4cc-ea9b948a6337 tempest-VolumesMetadataTest-266040296 None] Deleted volume successfully. Feb 25 15:55:54 devstack cinder-volume[83528]: DEBUG cinder.coordination [None req-5a428f31-3b40-4faf-b4cc-ea9b948a6337 tempest-VolumesMetadataTest-266040296 None] Lock "cinder-0bb037f1-cff3-486b-b1c1-0e13f13dab1f-delete_volume" released by "delete_volume" :: held 2.634s {{(pid=83528) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 25 15:55:55 devstack sudo[87558]: pam_unix(sudo:session): session closed for user root Feb 25 15:55:55 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-771a9226-d831-4d8a-b6d2-604246277a0a tempest-GroupsTest-1552622998 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-fbec84ec-2ef7-43bc-b4b4-87c789dcf2c4" returned: 0 in 0.682s {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 25 15:55:55 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.quobyte [None req-771a9226-d831-4d8a-b6d2-604246277a0a tempest-GroupsTest-1552622998 None] <== create_volume: return (1497ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-23e9d725-3e04-4cd9-bfe0-c8ef43305589'} {{(pid=83528) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 25 15:55:55 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-771a9226-d831-4d8a-b6d2-604246277a0a tempest-GroupsTest-1552622998 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.500s {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 25 15:55:55 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-771a9226-d831-4d8a-b6d2-604246277a0a tempest-GroupsTest-1552622998 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (07df3f8f-1b48-4e53-9928-7206b887cbb7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fbec84ec-2ef7-43bc-b4b4-87c789dcf2c4', 'volume_size': 1}' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 25 15:55:55 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-771a9226-d831-4d8a-b6d2-604246277a0a tempest-GroupsTest-1552622998 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (05186384-aa21-43eb-9364-3e2a965b60b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 25 15:55:55 devstack cinder-volume[83528]: INFO cinder.volume.flows.manager.create_volume [None req-771a9226-d831-4d8a-b6d2-604246277a0a tempest-GroupsTest-1552622998 None] Volume volume-fbec84ec-2ef7-43bc-b4b4-87c789dcf2c4 (fbec84ec-2ef7-43bc-b4b4-87c789dcf2c4): created successfully Feb 25 15:55:55 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-771a9226-d831-4d8a-b6d2-604246277a0a tempest-GroupsTest-1552622998 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (05186384-aa21-43eb-9364-3e2a965b60b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 25 15:55:55 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-771a9226-d831-4d8a-b6d2-604246277a0a tempest-GroupsTest-1552622998 None] Flow 'volume_create_manager' (aa7d0ced-3491-46e9-ad3e-18a8656be7ca) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83528) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 25 15:55:55 devstack cinder-volume[83528]: INFO cinder.volume.manager [None req-771a9226-d831-4d8a-b6d2-604246277a0a tempest-GroupsTest-1552622998 None] Created volume successfully. Feb 25 15:55:56 devstack cinder-volume[83528]: INFO cinder.volume.manager [None req-f50a772e-3c1f-4af9-86e9-8b32e004fd21 tempest-GroupsTest-1552622998 None] Update group completed successfully. Feb 25 15:55:57 devstack cinder-volume[83528]: INFO cinder.volume.manager [None req-dd0ca51c-7db0-46c5-a9f2-e4bfe1c7d34d tempest-GroupsTest-1552622998 None] Update group completed successfully. Feb 25 15:55:58 devstack cinder-volume[83528]: DEBUG cinder.volume.flows.manager.create_volume [None req-55b8f9a4-35be-4d9f-adda-7d2b5c81d246 tempest-VolumesTransfersV355Test-928018940 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83528) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 25 15:55:58 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-55b8f9a4-35be-4d9f-adda-7d2b5c81d246 tempest-VolumesTransfersV355Test-928018940 None] Flow 'volume_create_manager' (3c5d9a19-8904-4052-8b0b-061a9acf3a0b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83528) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 25 15:55:58 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-55b8f9a4-35be-4d9f-adda-7d2b5c81d246 tempest-VolumesTransfersV355Test-928018940 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d8268ed2-660e-4e6e-9b50-dbc42392b736) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 25 15:55:58 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-55b8f9a4-35be-4d9f-adda-7d2b5c81d246 tempest-VolumesTransfersV355Test-928018940 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d8268ed2-660e-4e6e-9b50-dbc42392b736) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-25T14:55:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-28894576',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f90390e0-709f-4415-9845-818432ce61c8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='66c78ab529ce4ae8b40840b304126d10',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-25T14:55:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-25T14:55:58Z,use_quota=True,user_id='a55db46110774cf384cb9ab83403f4d4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ce71c2f9-6543-4165-9653-a1529b2ea243),volume_type_id=ce71c2f9-6543-4165-9653-a1529b2ea243)' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 25 15:55:58 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-55b8f9a4-35be-4d9f-adda-7d2b5c81d246 tempest-VolumesTransfersV355Test-928018940 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5a1af6d9-2c08-4bd8-af79-4d5426de777f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 25 15:55:58 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-55b8f9a4-35be-4d9f-adda-7d2b5c81d246 tempest-VolumesTransfersV355Test-928018940 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5a1af6d9-2c08-4bd8-af79-4d5426de777f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 25 15:55:58 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-55b8f9a4-35be-4d9f-adda-7d2b5c81d246 tempest-VolumesTransfersV355Test-928018940 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e9979747-f762-4220-9dbd-f24f18b71576) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 25 15:55:58 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-55b8f9a4-35be-4d9f-adda-7d2b5c81d246 tempest-VolumesTransfersV355Test-928018940 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e9979747-f762-4220-9dbd-f24f18b71576) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f90390e0-709f-4415-9845-818432ce61c8', 'volume_name': 'volume-f90390e0-709f-4415-9845-818432ce61c8', 'volume_size': 1}' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 25 15:55:58 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-55b8f9a4-35be-4d9f-adda-7d2b5c81d246 tempest-VolumesTransfersV355Test-928018940 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5064e27f-d3da-4646-b310-08b50e926f42) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 25 15:55:58 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-55b8f9a4-35be-4d9f-adda-7d2b5c81d246 tempest-VolumesTransfersV355Test-928018940 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5064e27f-d3da-4646-b310-08b50e926f42) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 25 15:55:58 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-55b8f9a4-35be-4d9f-adda-7d2b5c81d246 tempest-VolumesTransfersV355Test-928018940 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b271be79-b0fc-4581-aaf4-1ac3fd3637f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 25 15:55:58 devstack cinder-volume[83528]: INFO cinder.volume.flows.manager.create_volume [None req-55b8f9a4-35be-4d9f-adda-7d2b5c81d246 tempest-VolumesTransfersV355Test-928018940 None] Volume f90390e0-709f-4415-9845-818432ce61c8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f90390e0-709f-4415-9845-818432ce61c8', 'volume_size': 1} Feb 25 15:55:58 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-55b8f9a4-35be-4d9f-adda-7d2b5c81d246 tempest-VolumesTransfersV355Test-928018940 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 25 15:55:58 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-55b8f9a4-35be-4d9f-adda-7d2b5c81d246 tempest-VolumesTransfersV355Test-928018940 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 25 15:55:58 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.quobyte [None req-55b8f9a4-35be-4d9f-adda-7d2b5c81d246 tempest-VolumesTransfersV355Test-928018940 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-25T14:55:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-28894576',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f90390e0-709f-4415-9845-818432ce61c8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='66c78ab529ce4ae8b40840b304126d10',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-25T14:55:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-25T14:55:58Z,use_quota=True,user_id='a55db46110774cf384cb9ab83403f4d4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ce71c2f9-6543-4165-9653-a1529b2ea243),volume_type_id=ce71c2f9-6543-4165-9653-a1529b2ea243)}" {{(pid=83528) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 25 15:55:58 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.remotefs [None req-55b8f9a4-35be-4d9f-adda-7d2b5c81d246 tempest-VolumesTransfersV355Test-928018940 None] Creating volume f90390e0-709f-4415-9845-818432ce61c8 {{(pid=83528) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 25 15:55:58 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-55b8f9a4-35be-4d9f-adda-7d2b5c81d246 tempest-VolumesTransfersV355Test-928018940 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 25 15:55:58 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-55b8f9a4-35be-4d9f-adda-7d2b5c81d246 tempest-VolumesTransfersV355Test-928018940 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 25 15:55:58 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.quobyte [None req-55b8f9a4-35be-4d9f-adda-7d2b5c81d246 tempest-VolumesTransfersV355Test-928018940 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23e9d725-3e04-4cd9-bfe0-c8ef43305589': None} {{(pid=83528) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 25 15:55:58 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.quobyte [None req-55b8f9a4-35be-4d9f-adda-7d2b5c81d246 tempest-VolumesTransfersV355Test-928018940 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23e9d725-3e04-4cd9-bfe0-c8ef43305589'] {{(pid=83528) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 25 15:55:58 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-55b8f9a4-35be-4d9f-adda-7d2b5c81d246 tempest-VolumesTransfersV355Test-928018940 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.033s {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 25 15:55:58 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.quobyte [None req-55b8f9a4-35be-4d9f-adda-7d2b5c81d246 tempest-VolumesTransfersV355Test-928018940 None] Selected osci02.corp.quobyte.com/cinder-vol-23e9d725-3e04-4cd9-bfe0-c8ef43305589 as target Quobyte volume. {{(pid=83528) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 25 15:55:58 devstack cinder-volume[83528]: INFO cinder.volume.drivers.remotefs [None req-55b8f9a4-35be-4d9f-adda-7d2b5c81d246 tempest-VolumesTransfersV355Test-928018940 None] casted to osci02.corp.quobyte.com/cinder-vol-23e9d725-3e04-4cd9-bfe0-c8ef43305589 Feb 25 15:55:58 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-55b8f9a4-35be-4d9f-adda-7d2b5c81d246 tempest-VolumesTransfersV355Test-928018940 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-f90390e0-709f-4415-9845-818432ce61c8 1073741824 {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 25 15:55:58 devstack sudo[87562]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-f90390e0-709f-4415-9845-818432ce61c8 1073741824 Feb 25 15:55:58 devstack sudo[87562]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 25 15:55:58 devstack cinder-volume[83528]: DEBUG cinder.volume.flows.manager.create_volume [None req-615351cd-ef5f-41dc-99c7-42bd148e2cdd tempest-VolumesActionsTest-872240335 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83528) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 25 15:55:58 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-615351cd-ef5f-41dc-99c7-42bd148e2cdd tempest-VolumesActionsTest-872240335 None] Flow 'volume_create_manager' (e1679a21-c7c6-48e0-aa40-259dee26b8a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83528) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 25 15:55:58 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-615351cd-ef5f-41dc-99c7-42bd148e2cdd tempest-VolumesActionsTest-872240335 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d20d8964-3ff3-401d-b782-03d2fedf4c0d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 25 15:55:58 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-615351cd-ef5f-41dc-99c7-42bd148e2cdd tempest-VolumesActionsTest-872240335 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d20d8964-3ff3-401d-b782-03d2fedf4c0d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-25T14:55:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-621351414',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d7a94ff2-5361-4bb5-9c74-0c02f2a1e673,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='da136677879e424b82ce0c4ab6e11f76',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-25T14:55:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-25T14:55:59Z,use_quota=True,user_id='8b2df249d4dc442f91f55f39a5a775f4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ce71c2f9-6543-4165-9653-a1529b2ea243),volume_type_id=ce71c2f9-6543-4165-9653-a1529b2ea243)' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 25 15:55:58 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-615351cd-ef5f-41dc-99c7-42bd148e2cdd tempest-VolumesActionsTest-872240335 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (38f3ea38-8df6-44cf-ac6e-d941c2adf235) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 25 15:55:58 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-615351cd-ef5f-41dc-99c7-42bd148e2cdd tempest-VolumesActionsTest-872240335 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (38f3ea38-8df6-44cf-ac6e-d941c2adf235) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 25 15:55:58 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-615351cd-ef5f-41dc-99c7-42bd148e2cdd tempest-VolumesActionsTest-872240335 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5edfc7f8-bc0d-4202-b098-c373c73acb70) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 25 15:55:58 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-615351cd-ef5f-41dc-99c7-42bd148e2cdd tempest-VolumesActionsTest-872240335 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5edfc7f8-bc0d-4202-b098-c373c73acb70) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd7a94ff2-5361-4bb5-9c74-0c02f2a1e673', 'volume_name': 'volume-d7a94ff2-5361-4bb5-9c74-0c02f2a1e673', 'volume_size': 1}' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 25 15:55:58 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-615351cd-ef5f-41dc-99c7-42bd148e2cdd tempest-VolumesActionsTest-872240335 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2208d289-b7ec-4209-9351-d8082bfbbb7b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 25 15:55:58 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-615351cd-ef5f-41dc-99c7-42bd148e2cdd tempest-VolumesActionsTest-872240335 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2208d289-b7ec-4209-9351-d8082bfbbb7b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 25 15:55:58 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-615351cd-ef5f-41dc-99c7-42bd148e2cdd tempest-VolumesActionsTest-872240335 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ca08aa5f-0583-49d4-b58c-f64cdd5e0916) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 25 15:55:58 devstack cinder-volume[83528]: INFO cinder.volume.flows.manager.create_volume [None req-615351cd-ef5f-41dc-99c7-42bd148e2cdd tempest-VolumesActionsTest-872240335 None] Volume d7a94ff2-5361-4bb5-9c74-0c02f2a1e673: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d7a94ff2-5361-4bb5-9c74-0c02f2a1e673', 'volume_size': 1} Feb 25 15:55:58 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-615351cd-ef5f-41dc-99c7-42bd148e2cdd tempest-VolumesActionsTest-872240335 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 25 15:55:58 devstack cinder-volume[83528]: DEBUG cinder.coordination [None req-2ba4890a-b6e9-46cb-ab6b-a79145dbe826 tempest-GroupsTest-1552622998 None] Acquiring lock "cinder-quobyte-d4ec39fb-2338-4fc5-b4b1-89d9a2faa108" by "delete_volume" {{(pid=83528) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 25 15:55:58 devstack cinder-volume[83528]: DEBUG cinder.coordination [None req-2ba4890a-b6e9-46cb-ab6b-a79145dbe826 tempest-GroupsTest-1552622998 None] Lock "cinder-quobyte-d4ec39fb-2338-4fc5-b4b1-89d9a2faa108" acquired by "delete_volume" :: waited 0.011s {{(pid=83528) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 25 15:55:58 devstack cinder-volume[83528]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca8ce299-2947-45d9-8bd5-2d528c06bf5f]: (4, 'qcow2') {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 25 15:55:58 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-2ba4890a-b6e9-46cb-ab6b-a79145dbe826 tempest-GroupsTest-1552622998 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-d4ec39fb-2338-4fc5-b4b1-89d9a2faa108 {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 25 15:55:58 devstack sudo[87564]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-d4ec39fb-2338-4fc5-b4b1-89d9a2faa108 Feb 25 15:55:58 devstack sudo[87564]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 25 15:55:59 devstack sudo[87562]: pam_unix(sudo:session): session closed for user root Feb 25 15:55:59 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-55b8f9a4-35be-4d9f-adda-7d2b5c81d246 tempest-VolumesTransfersV355Test-928018940 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-f90390e0-709f-4415-9845-818432ce61c8 1073741824" returned: 0 in 0.678s {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 25 15:55:59 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-55b8f9a4-35be-4d9f-adda-7d2b5c81d246 tempest-VolumesTransfersV355Test-928018940 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-f90390e0-709f-4415-9845-818432ce61c8 {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 25 15:55:59 devstack sudo[87569]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-f90390e0-709f-4415-9845-818432ce61c8 Feb 25 15:55:59 devstack sudo[87569]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 25 15:55:59 devstack sudo[87564]: pam_unix(sudo:session): session closed for user root Feb 25 15:55:59 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-2ba4890a-b6e9-46cb-ab6b-a79145dbe826 tempest-GroupsTest-1552622998 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-d4ec39fb-2338-4fc5-b4b1-89d9a2faa108" returned: 0 in 0.564s {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 25 15:55:59 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-2ba4890a-b6e9-46cb-ab6b-a79145dbe826 tempest-GroupsTest-1552622998 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-d4ec39fb-2338-4fc5-b4b1-89d9a2faa108 {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 25 15:55:59 devstack sudo[87574]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-d4ec39fb-2338-4fc5-b4b1-89d9a2faa108 Feb 25 15:55:59 devstack sudo[87574]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 25 15:55:59 devstack sudo[87569]: pam_unix(sudo:session): session closed for user root Feb 25 15:55:59 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-55b8f9a4-35be-4d9f-adda-7d2b5c81d246 tempest-VolumesTransfersV355Test-928018940 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-f90390e0-709f-4415-9845-818432ce61c8" returned: 0 in 0.497s {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 25 15:55:59 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.quobyte [None req-55b8f9a4-35be-4d9f-adda-7d2b5c81d246 tempest-VolumesTransfersV355Test-928018940 None] <== create_volume: return (1237ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-23e9d725-3e04-4cd9-bfe0-c8ef43305589'} {{(pid=83528) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 25 15:55:59 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-55b8f9a4-35be-4d9f-adda-7d2b5c81d246 tempest-VolumesTransfersV355Test-928018940 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.241s {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 25 15:55:59 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-615351cd-ef5f-41dc-99c7-42bd148e2cdd tempest-VolumesActionsTest-872240335 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.921s {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 25 15:55:59 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.quobyte [None req-615351cd-ef5f-41dc-99c7-42bd148e2cdd tempest-VolumesActionsTest-872240335 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-25T14:55:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-621351414',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d7a94ff2-5361-4bb5-9c74-0c02f2a1e673,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='da136677879e424b82ce0c4ab6e11f76',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-25T14:55:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-25T14:55:59Z,use_quota=True,user_id='8b2df249d4dc442f91f55f39a5a775f4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ce71c2f9-6543-4165-9653-a1529b2ea243),volume_type_id=ce71c2f9-6543-4165-9653-a1529b2ea243)}" {{(pid=83528) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 25 15:55:59 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.remotefs [None req-615351cd-ef5f-41dc-99c7-42bd148e2cdd tempest-VolumesActionsTest-872240335 None] Creating volume d7a94ff2-5361-4bb5-9c74-0c02f2a1e673 {{(pid=83528) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 25 15:55:59 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-615351cd-ef5f-41dc-99c7-42bd148e2cdd tempest-VolumesActionsTest-872240335 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 25 15:55:59 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-615351cd-ef5f-41dc-99c7-42bd148e2cdd tempest-VolumesActionsTest-872240335 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 25 15:55:59 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.quobyte [None req-615351cd-ef5f-41dc-99c7-42bd148e2cdd tempest-VolumesActionsTest-872240335 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23e9d725-3e04-4cd9-bfe0-c8ef43305589': None} {{(pid=83528) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 25 15:55:59 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.quobyte [None req-615351cd-ef5f-41dc-99c7-42bd148e2cdd tempest-VolumesActionsTest-872240335 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23e9d725-3e04-4cd9-bfe0-c8ef43305589'] {{(pid=83528) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 25 15:55:59 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-615351cd-ef5f-41dc-99c7-42bd148e2cdd tempest-VolumesActionsTest-872240335 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 25 15:55:59 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.quobyte [None req-615351cd-ef5f-41dc-99c7-42bd148e2cdd tempest-VolumesActionsTest-872240335 None] Selected osci02.corp.quobyte.com/cinder-vol-23e9d725-3e04-4cd9-bfe0-c8ef43305589 as target Quobyte volume. {{(pid=83528) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 25 15:55:59 devstack cinder-volume[83528]: INFO cinder.volume.drivers.remotefs [None req-615351cd-ef5f-41dc-99c7-42bd148e2cdd tempest-VolumesActionsTest-872240335 None] casted to osci02.corp.quobyte.com/cinder-vol-23e9d725-3e04-4cd9-bfe0-c8ef43305589 Feb 25 15:55:59 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-615351cd-ef5f-41dc-99c7-42bd148e2cdd tempest-VolumesActionsTest-872240335 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-d7a94ff2-5361-4bb5-9c74-0c02f2a1e673 1073741824 {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 25 15:55:59 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-55b8f9a4-35be-4d9f-adda-7d2b5c81d246 tempest-VolumesTransfersV355Test-928018940 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b271be79-b0fc-4581-aaf4-1ac3fd3637f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f90390e0-709f-4415-9845-818432ce61c8', 'volume_size': 1}' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 25 15:55:59 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-55b8f9a4-35be-4d9f-adda-7d2b5c81d246 tempest-VolumesTransfersV355Test-928018940 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (18066a42-b8cd-4e25-add0-b82ed13d429b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 25 15:55:59 devstack sudo[87577]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-d7a94ff2-5361-4bb5-9c74-0c02f2a1e673 1073741824 Feb 25 15:55:59 devstack sudo[87577]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 25 15:55:59 devstack cinder-volume[83528]: INFO cinder.volume.flows.manager.create_volume [None req-55b8f9a4-35be-4d9f-adda-7d2b5c81d246 tempest-VolumesTransfersV355Test-928018940 None] Volume volume-f90390e0-709f-4415-9845-818432ce61c8 (f90390e0-709f-4415-9845-818432ce61c8): created successfully Feb 25 15:55:59 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-55b8f9a4-35be-4d9f-adda-7d2b5c81d246 tempest-VolumesTransfersV355Test-928018940 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (18066a42-b8cd-4e25-add0-b82ed13d429b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 25 15:55:59 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-55b8f9a4-35be-4d9f-adda-7d2b5c81d246 tempest-VolumesTransfersV355Test-928018940 None] Flow 'volume_create_manager' (3c5d9a19-8904-4052-8b0b-061a9acf3a0b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83528) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 25 15:55:59 devstack cinder-volume[83528]: INFO cinder.volume.manager [None req-55b8f9a4-35be-4d9f-adda-7d2b5c81d246 tempest-VolumesTransfersV355Test-928018940 None] Created volume successfully. Feb 25 15:55:59 devstack sudo[87574]: pam_unix(sudo:session): session closed for user root Feb 25 15:55:59 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-2ba4890a-b6e9-46cb-ab6b-a79145dbe826 tempest-GroupsTest-1552622998 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-d4ec39fb-2338-4fc5-b4b1-89d9a2faa108" returned: 0 in 0.509s {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 25 15:56:00 devstack cinder-volume[83528]: DEBUG cinder.coordination [None req-2ba4890a-b6e9-46cb-ab6b-a79145dbe826 tempest-GroupsTest-1552622998 None] Lock "cinder-quobyte-d4ec39fb-2338-4fc5-b4b1-89d9a2faa108" released by "delete_volume" :: held 1.106s {{(pid=83528) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 25 15:56:00 devstack cinder-volume[83528]: DEBUG cinder.coordination [None req-2ba4890a-b6e9-46cb-ab6b-a79145dbe826 tempest-GroupsTest-1552622998 None] Acquiring lock "cinder-quobyte-fbec84ec-2ef7-43bc-b4b4-87c789dcf2c4" by "delete_volume" {{(pid=83528) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 25 15:56:00 devstack cinder-volume[83528]: DEBUG cinder.coordination [None req-2ba4890a-b6e9-46cb-ab6b-a79145dbe826 tempest-GroupsTest-1552622998 None] Lock "cinder-quobyte-fbec84ec-2ef7-43bc-b4b4-87c789dcf2c4" acquired by "delete_volume" :: waited 0.009s {{(pid=83528) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 25 15:56:00 devstack cinder-volume[83528]: DEBUG oslo.privsep.daemon [-] privsep: reply[ebbdddff-c0dc-4d14-99c6-191b9e6c26ca]: (4, 'qcow2') {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 25 15:56:00 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-2ba4890a-b6e9-46cb-ab6b-a79145dbe826 tempest-GroupsTest-1552622998 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-fbec84ec-2ef7-43bc-b4b4-87c789dcf2c4 {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 25 15:56:00 devstack sudo[87580]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-fbec84ec-2ef7-43bc-b4b4-87c789dcf2c4 Feb 25 15:56:00 devstack sudo[87580]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 25 15:56:00 devstack sudo[87577]: pam_unix(sudo:session): session closed for user root Feb 25 15:56:00 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-615351cd-ef5f-41dc-99c7-42bd148e2cdd tempest-VolumesActionsTest-872240335 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-d7a94ff2-5361-4bb5-9c74-0c02f2a1e673 1073741824" returned: 0 in 0.637s {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 25 15:56:00 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-615351cd-ef5f-41dc-99c7-42bd148e2cdd tempest-VolumesActionsTest-872240335 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-d7a94ff2-5361-4bb5-9c74-0c02f2a1e673 {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 25 15:56:00 devstack sudo[87585]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-d7a94ff2-5361-4bb5-9c74-0c02f2a1e673 Feb 25 15:56:00 devstack sudo[87585]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 25 15:56:00 devstack sudo[87580]: pam_unix(sudo:session): session closed for user root Feb 25 15:56:00 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-2ba4890a-b6e9-46cb-ab6b-a79145dbe826 tempest-GroupsTest-1552622998 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-fbec84ec-2ef7-43bc-b4b4-87c789dcf2c4" returned: 0 in 0.633s {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 25 15:56:00 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-2ba4890a-b6e9-46cb-ab6b-a79145dbe826 tempest-GroupsTest-1552622998 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-fbec84ec-2ef7-43bc-b4b4-87c789dcf2c4 {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 25 15:56:00 devstack sudo[87590]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-fbec84ec-2ef7-43bc-b4b4-87c789dcf2c4 Feb 25 15:56:00 devstack sudo[87590]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 25 15:56:00 devstack sudo[87585]: pam_unix(sudo:session): session closed for user root Feb 25 15:56:00 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-615351cd-ef5f-41dc-99c7-42bd148e2cdd tempest-VolumesActionsTest-872240335 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-d7a94ff2-5361-4bb5-9c74-0c02f2a1e673" returned: 0 in 0.535s {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 25 15:56:00 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.quobyte [None req-615351cd-ef5f-41dc-99c7-42bd148e2cdd tempest-VolumesActionsTest-872240335 None] <== create_volume: return (1201ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-23e9d725-3e04-4cd9-bfe0-c8ef43305589'} {{(pid=83528) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 25 15:56:00 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-615351cd-ef5f-41dc-99c7-42bd148e2cdd tempest-VolumesActionsTest-872240335 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.204s {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 25 15:56:01 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-615351cd-ef5f-41dc-99c7-42bd148e2cdd tempest-VolumesActionsTest-872240335 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ca08aa5f-0583-49d4-b58c-f64cdd5e0916) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d7a94ff2-5361-4bb5-9c74-0c02f2a1e673', 'volume_size': 1}' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 25 15:56:01 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-615351cd-ef5f-41dc-99c7-42bd148e2cdd tempest-VolumesActionsTest-872240335 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d3bb99e6-6730-4e26-ba25-5f8fd9255aca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 25 15:56:01 devstack cinder-volume[83528]: INFO cinder.volume.flows.manager.create_volume [None req-615351cd-ef5f-41dc-99c7-42bd148e2cdd tempest-VolumesActionsTest-872240335 None] Volume volume-d7a94ff2-5361-4bb5-9c74-0c02f2a1e673 (d7a94ff2-5361-4bb5-9c74-0c02f2a1e673): created successfully Feb 25 15:56:01 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-615351cd-ef5f-41dc-99c7-42bd148e2cdd tempest-VolumesActionsTest-872240335 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d3bb99e6-6730-4e26-ba25-5f8fd9255aca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 25 15:56:01 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-615351cd-ef5f-41dc-99c7-42bd148e2cdd tempest-VolumesActionsTest-872240335 None] Flow 'volume_create_manager' (e1679a21-c7c6-48e0-aa40-259dee26b8a3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83528) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 25 15:56:01 devstack cinder-volume[83528]: INFO cinder.volume.manager [None req-615351cd-ef5f-41dc-99c7-42bd148e2cdd tempest-VolumesActionsTest-872240335 None] Created volume successfully. Feb 25 15:56:01 devstack cinder-volume[83528]: INFO cinder.volume.manager [None req-1ee21a0a-75eb-4ab0-8a31-92f26c53ca28 tempest-VolumesTransfersV355Test-594412493 None] Transfer volume completed successfully. Feb 25 15:56:01 devstack sudo[87590]: pam_unix(sudo:session): session closed for user root Feb 25 15:56:01 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-2ba4890a-b6e9-46cb-ab6b-a79145dbe826 tempest-GroupsTest-1552622998 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-fbec84ec-2ef7-43bc-b4b4-87c789dcf2c4" returned: 0 in 0.570s {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 25 15:56:01 devstack cinder-volume[83528]: DEBUG cinder.coordination [None req-2ba4890a-b6e9-46cb-ab6b-a79145dbe826 tempest-GroupsTest-1552622998 None] Lock "cinder-quobyte-fbec84ec-2ef7-43bc-b4b4-87c789dcf2c4" released by "delete_volume" :: held 1.227s {{(pid=83528) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 25 15:56:01 devstack cinder-volume[83528]: DEBUG cinder.quota [None req-2ba4890a-b6e9-46cb-ab6b-a79145dbe826 tempest-GroupsTest-1552622998 None] Created reservations ['8520ebcd-6ad8-4464-8298-687c2015fc08'] {{(pid=83528) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 25 15:56:01 devstack cinder-volume[83528]: WARNING cinder.quota [None req-2ba4890a-b6e9-46cb-ab6b-a79145dbe826 tempest-GroupsTest-1552622998 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-2110808974 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-2110808974, it is now deprecated. Please use the default quota class for default quota. Feb 25 15:56:01 devstack cinder-volume[83528]: WARNING cinder.quota [None req-2ba4890a-b6e9-46cb-ab6b-a79145dbe826 tempest-GroupsTest-1552622998 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-2110808974 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-2110808974, it is now deprecated. Please use the default quota class for default quota. Feb 25 15:56:01 devstack cinder-volume[83528]: DEBUG cinder.quota [None req-2ba4890a-b6e9-46cb-ab6b-a79145dbe826 tempest-GroupsTest-1552622998 None] Created reservations ['a1af9ab8-8314-41d9-a0d7-5a902e6bb254', '5bb0449b-1563-4e99-87d4-a3d05aeace4c', '54e05022-bc0e-4bf2-ac3b-c19700e15aa5', 'c9da353c-bec0-44b9-916d-5dda8646ecb6'] {{(pid=83528) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 25 15:56:01 devstack cinder-volume[83528]: DEBUG cinder.quota [None req-2ba4890a-b6e9-46cb-ab6b-a79145dbe826 tempest-GroupsTest-1552622998 None] Created reservations ['94fed1ef-20fe-47dc-b5b0-08bc4afdb3e2', '3406a6bf-1687-4bfd-bfdc-f4ea0faa9e31', 'df949be6-0cef-4a49-8461-0c75981343f5', 'ffdc833b-7733-4ef5-bc6e-642b470f7cc8'] {{(pid=83528) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 25 15:56:01 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-2ba4890a-b6e9-46cb-ab6b-a79145dbe826 tempest-GroupsTest-1552622998 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 25 15:56:01 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-2ba4890a-b6e9-46cb-ab6b-a79145dbe826 tempest-GroupsTest-1552622998 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 25 15:56:01 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.quobyte [None req-2ba4890a-b6e9-46cb-ab6b-a79145dbe826 tempest-GroupsTest-1552622998 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23e9d725-3e04-4cd9-bfe0-c8ef43305589': None} {{(pid=83528) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 25 15:56:01 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.quobyte [None req-2ba4890a-b6e9-46cb-ab6b-a79145dbe826 tempest-GroupsTest-1552622998 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23e9d725-3e04-4cd9-bfe0-c8ef43305589'] {{(pid=83528) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 25 15:56:01 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-2ba4890a-b6e9-46cb-ab6b-a79145dbe826 tempest-GroupsTest-1552622998 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 25 15:56:01 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-2ba4890a-b6e9-46cb-ab6b-a79145dbe826 tempest-GroupsTest-1552622998 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85 {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 25 15:56:01 devstack sudo[87594]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85 Feb 25 15:56:01 devstack sudo[87594]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 25 15:56:02 devstack sudo[87594]: pam_unix(sudo:session): session closed for user root Feb 25 15:56:02 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-2ba4890a-b6e9-46cb-ab6b-a79145dbe826 tempest-GroupsTest-1552622998 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85" returned: 0 in 0.525s {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 25 15:56:02 devstack cinder-volume[83528]: DEBUG cinder.manager [None req-2ba4890a-b6e9-46cb-ab6b-a79145dbe826 tempest-GroupsTest-1552622998 None] Notifying Schedulers of capabilities ... {{(pid=83528) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 25 15:56:02 devstack cinder-volume[83528]: INFO cinder.volume.manager [None req-2ba4890a-b6e9-46cb-ab6b-a79145dbe826 tempest-GroupsTest-1552622998 None] Delete group completed successfully. Feb 25 15:56:02 devstack cinder-volume[83528]: DEBUG cinder.coordination [None req-413b8be8-c765-4076-9f9f-159f271479f5 tempest-VolumesActionsTest-1068253837 None] Acquiring lock "cinder-d7a94ff2-5361-4bb5-9c74-0c02f2a1e673-delete_volume" by "delete_volume" {{(pid=83528) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 25 15:56:02 devstack cinder-volume[83528]: DEBUG cinder.coordination [None req-413b8be8-c765-4076-9f9f-159f271479f5 tempest-VolumesActionsTest-1068253837 None] Lock "cinder-d7a94ff2-5361-4bb5-9c74-0c02f2a1e673-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=83528) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 25 15:56:02 devstack cinder-volume[83528]: DEBUG cinder.coordination [None req-413b8be8-c765-4076-9f9f-159f271479f5 tempest-VolumesActionsTest-1068253837 None] Acquiring lock "cinder-quobyte-d7a94ff2-5361-4bb5-9c74-0c02f2a1e673" by "delete_volume" {{(pid=83528) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 25 15:56:02 devstack cinder-volume[83528]: DEBUG cinder.coordination [None req-413b8be8-c765-4076-9f9f-159f271479f5 tempest-VolumesActionsTest-1068253837 None] Lock "cinder-quobyte-d7a94ff2-5361-4bb5-9c74-0c02f2a1e673" acquired by "delete_volume" :: waited 0.010s {{(pid=83528) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 25 15:56:02 devstack cinder-volume[83528]: DEBUG oslo.privsep.daemon [-] privsep: reply[35cb85a2-0c13-42a3-a121-87be59bce339]: (4, 'qcow2') {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 25 15:56:02 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-413b8be8-c765-4076-9f9f-159f271479f5 tempest-VolumesActionsTest-1068253837 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-d7a94ff2-5361-4bb5-9c74-0c02f2a1e673 {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 25 15:56:02 devstack sudo[87597]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-d7a94ff2-5361-4bb5-9c74-0c02f2a1e673 Feb 25 15:56:02 devstack sudo[87597]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 25 15:56:02 devstack cinder-volume[83528]: DEBUG cinder.coordination [None req-08173447-4c99-4d0f-8289-ece36afa2c21 tempest-VolumesTransfersV355Test-313299346 None] Acquiring lock "cinder-f90390e0-709f-4415-9845-818432ce61c8-delete_volume" by "delete_volume" {{(pid=83528) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 25 15:56:02 devstack cinder-volume[83528]: DEBUG cinder.coordination [None req-08173447-4c99-4d0f-8289-ece36afa2c21 tempest-VolumesTransfersV355Test-313299346 None] Lock "cinder-f90390e0-709f-4415-9845-818432ce61c8-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=83528) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 25 15:56:02 devstack cinder-volume[83528]: DEBUG cinder.coordination [None req-08173447-4c99-4d0f-8289-ece36afa2c21 tempest-VolumesTransfersV355Test-313299346 None] Acquiring lock "cinder-quobyte-f90390e0-709f-4415-9845-818432ce61c8" by "delete_volume" {{(pid=83528) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 25 15:56:02 devstack cinder-volume[83528]: DEBUG cinder.coordination [None req-08173447-4c99-4d0f-8289-ece36afa2c21 tempest-VolumesTransfersV355Test-313299346 None] Lock "cinder-quobyte-f90390e0-709f-4415-9845-818432ce61c8" acquired by "delete_volume" :: waited 0.013s {{(pid=83528) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 25 15:56:02 devstack cinder-volume[83528]: DEBUG oslo.privsep.daemon [-] privsep: reply[efa2ee78-f20b-4b08-8ac7-fa68ad53e74b]: (4, 'qcow2') {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 25 15:56:02 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-08173447-4c99-4d0f-8289-ece36afa2c21 tempest-VolumesTransfersV355Test-313299346 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-f90390e0-709f-4415-9845-818432ce61c8 {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 25 15:56:02 devstack sudo[87599]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-f90390e0-709f-4415-9845-818432ce61c8 Feb 25 15:56:02 devstack sudo[87599]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 25 15:56:02 devstack sudo[87597]: pam_unix(sudo:session): session closed for user root Feb 25 15:56:02 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-413b8be8-c765-4076-9f9f-159f271479f5 tempest-VolumesActionsTest-1068253837 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-d7a94ff2-5361-4bb5-9c74-0c02f2a1e673" returned: 0 in 0.615s {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 25 15:56:02 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-413b8be8-c765-4076-9f9f-159f271479f5 tempest-VolumesActionsTest-1068253837 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-d7a94ff2-5361-4bb5-9c74-0c02f2a1e673 {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 25 15:56:02 devstack sudo[87604]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-d7a94ff2-5361-4bb5-9c74-0c02f2a1e673 Feb 25 15:56:02 devstack sudo[87604]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 25 15:56:03 devstack sudo[87599]: pam_unix(sudo:session): session closed for user root Feb 25 15:56:03 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-08173447-4c99-4d0f-8289-ece36afa2c21 tempest-VolumesTransfersV355Test-313299346 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-f90390e0-709f-4415-9845-818432ce61c8" returned: 0 in 0.706s {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 25 15:56:03 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-08173447-4c99-4d0f-8289-ece36afa2c21 tempest-VolumesTransfersV355Test-313299346 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-f90390e0-709f-4415-9845-818432ce61c8 {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 25 15:56:03 devstack sudo[87609]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-f90390e0-709f-4415-9845-818432ce61c8 Feb 25 15:56:03 devstack sudo[87609]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 25 15:56:03 devstack sudo[87604]: pam_unix(sudo:session): session closed for user root Feb 25 15:56:03 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-413b8be8-c765-4076-9f9f-159f271479f5 tempest-VolumesActionsTest-1068253837 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-d7a94ff2-5361-4bb5-9c74-0c02f2a1e673" returned: 0 in 0.669s {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 25 15:56:03 devstack cinder-volume[83528]: DEBUG cinder.coordination [None req-413b8be8-c765-4076-9f9f-159f271479f5 tempest-VolumesActionsTest-1068253837 None] Lock "cinder-quobyte-d7a94ff2-5361-4bb5-9c74-0c02f2a1e673" released by "delete_volume" :: held 1.315s {{(pid=83528) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 25 15:56:03 devstack cinder-volume[83528]: DEBUG cinder.quota [None req-413b8be8-c765-4076-9f9f-159f271479f5 tempest-VolumesActionsTest-1068253837 None] Created reservations ['c912e717-87e5-4339-9961-2f210b4f7457', '5b6715c3-dd85-4a79-8f23-93e6368bf9a2', '65242659-eb23-48ed-addf-bd7521aa2a10', 'fac8b363-21b2-45d9-9f66-395464556aaf'] {{(pid=83528) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 25 15:56:03 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-413b8be8-c765-4076-9f9f-159f271479f5 tempest-VolumesActionsTest-1068253837 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 25 15:56:03 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-413b8be8-c765-4076-9f9f-159f271479f5 tempest-VolumesActionsTest-1068253837 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 25 15:56:03 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.quobyte [None req-413b8be8-c765-4076-9f9f-159f271479f5 tempest-VolumesActionsTest-1068253837 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23e9d725-3e04-4cd9-bfe0-c8ef43305589': None} {{(pid=83528) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 25 15:56:03 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.quobyte [None req-413b8be8-c765-4076-9f9f-159f271479f5 tempest-VolumesActionsTest-1068253837 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23e9d725-3e04-4cd9-bfe0-c8ef43305589'] {{(pid=83528) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 25 15:56:03 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-413b8be8-c765-4076-9f9f-159f271479f5 tempest-VolumesActionsTest-1068253837 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 25 15:56:03 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-413b8be8-c765-4076-9f9f-159f271479f5 tempest-VolumesActionsTest-1068253837 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85 {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 25 15:56:03 devstack sudo[87613]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85 Feb 25 15:56:03 devstack sudo[87613]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 25 15:56:03 devstack sudo[87609]: pam_unix(sudo:session): session closed for user root Feb 25 15:56:03 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-08173447-4c99-4d0f-8289-ece36afa2c21 tempest-VolumesTransfersV355Test-313299346 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-f90390e0-709f-4415-9845-818432ce61c8" returned: 0 in 0.575s {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 25 15:56:03 devstack cinder-volume[83528]: DEBUG cinder.coordination [None req-08173447-4c99-4d0f-8289-ece36afa2c21 tempest-VolumesTransfersV355Test-313299346 None] Lock "cinder-quobyte-f90390e0-709f-4415-9845-818432ce61c8" released by "delete_volume" :: held 1.317s {{(pid=83528) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 25 15:56:03 devstack cinder-volume[83528]: DEBUG cinder.quota [None req-08173447-4c99-4d0f-8289-ece36afa2c21 tempest-VolumesTransfersV355Test-313299346 None] Created reservations ['5a4751fd-c829-4c32-84f4-668e034bb500', '0b71e676-1c6f-4bc0-a9a7-fde2aa6489f9', '44c3cd2f-bbf6-4be4-83e7-091db0bb4b1d', 'be0a7e60-4d69-479e-b1c2-81d991c04561'] {{(pid=83528) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 25 15:56:03 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-08173447-4c99-4d0f-8289-ece36afa2c21 tempest-VolumesTransfersV355Test-313299346 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 25 15:56:03 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-08173447-4c99-4d0f-8289-ece36afa2c21 tempest-VolumesTransfersV355Test-313299346 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 25 15:56:03 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.quobyte [None req-08173447-4c99-4d0f-8289-ece36afa2c21 tempest-VolumesTransfersV355Test-313299346 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23e9d725-3e04-4cd9-bfe0-c8ef43305589': None} {{(pid=83528) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 25 15:56:03 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.quobyte [None req-08173447-4c99-4d0f-8289-ece36afa2c21 tempest-VolumesTransfersV355Test-313299346 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23e9d725-3e04-4cd9-bfe0-c8ef43305589'] {{(pid=83528) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 25 15:56:03 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-08173447-4c99-4d0f-8289-ece36afa2c21 tempest-VolumesTransfersV355Test-313299346 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 25 15:56:03 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-08173447-4c99-4d0f-8289-ece36afa2c21 tempest-VolumesTransfersV355Test-313299346 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85 {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 25 15:56:03 devstack sudo[87615]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85 Feb 25 15:56:03 devstack sudo[87615]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 25 15:56:04 devstack sudo[87613]: pam_unix(sudo:session): session closed for user root Feb 25 15:56:04 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-413b8be8-c765-4076-9f9f-159f271479f5 tempest-VolumesActionsTest-1068253837 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85" returned: 0 in 0.532s {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 25 15:56:04 devstack cinder-volume[83528]: DEBUG cinder.manager [None req-413b8be8-c765-4076-9f9f-159f271479f5 tempest-VolumesActionsTest-1068253837 None] Notifying Schedulers of capabilities ... {{(pid=83528) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 25 15:56:04 devstack cinder-volume[83528]: INFO cinder.volume.manager [None req-413b8be8-c765-4076-9f9f-159f271479f5 tempest-VolumesActionsTest-1068253837 None] Deleted volume successfully. Feb 25 15:56:04 devstack cinder-volume[83528]: DEBUG cinder.coordination [None req-413b8be8-c765-4076-9f9f-159f271479f5 tempest-VolumesActionsTest-1068253837 None] Lock "cinder-d7a94ff2-5361-4bb5-9c74-0c02f2a1e673-delete_volume" released by "delete_volume" :: held 2.047s {{(pid=83528) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 25 15:56:04 devstack sudo[87615]: pam_unix(sudo:session): session closed for user root Feb 25 15:56:04 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-08173447-4c99-4d0f-8289-ece36afa2c21 tempest-VolumesTransfersV355Test-313299346 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85" returned: 0 in 0.540s {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 25 15:56:04 devstack cinder-volume[83528]: DEBUG cinder.manager [None req-08173447-4c99-4d0f-8289-ece36afa2c21 tempest-VolumesTransfersV355Test-313299346 None] Notifying Schedulers of capabilities ... {{(pid=83528) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 25 15:56:04 devstack cinder-volume[83528]: INFO cinder.volume.manager [None req-08173447-4c99-4d0f-8289-ece36afa2c21 tempest-VolumesTransfersV355Test-313299346 None] Deleted volume successfully. Feb 25 15:56:04 devstack cinder-volume[83528]: DEBUG cinder.coordination [None req-08173447-4c99-4d0f-8289-ece36afa2c21 tempest-VolumesTransfersV355Test-313299346 None] Lock "cinder-f90390e0-709f-4415-9845-818432ce61c8-delete_volume" released by "delete_volume" :: held 2.035s {{(pid=83528) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 25 15:56:05 devstack cinder-volume[83528]: DEBUG cinder.volume.flows.manager.create_volume [None req-90cc83db-46ca-4e12-aba5-eac72fb118ce tempest-VolumesActionsTest-872240335 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83528) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 25 15:56:05 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-90cc83db-46ca-4e12-aba5-eac72fb118ce tempest-VolumesActionsTest-872240335 None] Flow 'volume_create_manager' (aea878a6-375c-4a48-b6af-61f9a263137d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83528) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 25 15:56:05 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-90cc83db-46ca-4e12-aba5-eac72fb118ce tempest-VolumesActionsTest-872240335 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6929a64c-e403-43f3-bca3-8a7a1a708704) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 25 15:56:05 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-90cc83db-46ca-4e12-aba5-eac72fb118ce tempest-VolumesActionsTest-872240335 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6929a64c-e403-43f3-bca3-8a7a1a708704) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-25T14:56:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-2050149571',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8d790827-260a-4d2a-bcf8-63dfca95ee61,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='da136677879e424b82ce0c4ab6e11f76',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-25T14:56:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-25T14:56:05Z,use_quota=True,user_id='8b2df249d4dc442f91f55f39a5a775f4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ce71c2f9-6543-4165-9653-a1529b2ea243),volume_type_id=ce71c2f9-6543-4165-9653-a1529b2ea243)' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 25 15:56:05 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-90cc83db-46ca-4e12-aba5-eac72fb118ce tempest-VolumesActionsTest-872240335 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (636fb63a-f7a9-4a73-b4e0-407630aca5d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 25 15:56:05 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-90cc83db-46ca-4e12-aba5-eac72fb118ce tempest-VolumesActionsTest-872240335 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (636fb63a-f7a9-4a73-b4e0-407630aca5d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 25 15:56:05 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-90cc83db-46ca-4e12-aba5-eac72fb118ce tempest-VolumesActionsTest-872240335 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (337840e7-524c-4078-a7fa-41395973adb4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 25 15:56:05 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-90cc83db-46ca-4e12-aba5-eac72fb118ce tempest-VolumesActionsTest-872240335 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (337840e7-524c-4078-a7fa-41395973adb4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8d790827-260a-4d2a-bcf8-63dfca95ee61', 'volume_name': 'volume-8d790827-260a-4d2a-bcf8-63dfca95ee61', 'volume_size': 1}' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 25 15:56:05 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-90cc83db-46ca-4e12-aba5-eac72fb118ce tempest-VolumesActionsTest-872240335 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (05ab1e36-7c76-490c-b5d2-84d5baf4510d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 25 15:56:05 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-90cc83db-46ca-4e12-aba5-eac72fb118ce tempest-VolumesActionsTest-872240335 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (05ab1e36-7c76-490c-b5d2-84d5baf4510d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 25 15:56:05 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-90cc83db-46ca-4e12-aba5-eac72fb118ce tempest-VolumesActionsTest-872240335 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b5847a02-37ea-4663-905b-d14d9e8d6326) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 25 15:56:05 devstack cinder-volume[83528]: INFO cinder.volume.flows.manager.create_volume [None req-90cc83db-46ca-4e12-aba5-eac72fb118ce tempest-VolumesActionsTest-872240335 None] Volume 8d790827-260a-4d2a-bcf8-63dfca95ee61: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8d790827-260a-4d2a-bcf8-63dfca95ee61', 'volume_size': 1} Feb 25 15:56:05 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-90cc83db-46ca-4e12-aba5-eac72fb118ce tempest-VolumesActionsTest-872240335 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 25 15:56:05 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-90cc83db-46ca-4e12-aba5-eac72fb118ce tempest-VolumesActionsTest-872240335 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 25 15:56:05 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.quobyte [None req-90cc83db-46ca-4e12-aba5-eac72fb118ce tempest-VolumesActionsTest-872240335 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-25T14:56:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-2050149571',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8d790827-260a-4d2a-bcf8-63dfca95ee61,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='da136677879e424b82ce0c4ab6e11f76',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-25T14:56:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-25T14:56:05Z,use_quota=True,user_id='8b2df249d4dc442f91f55f39a5a775f4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ce71c2f9-6543-4165-9653-a1529b2ea243),volume_type_id=ce71c2f9-6543-4165-9653-a1529b2ea243)}" {{(pid=83528) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 25 15:56:05 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.remotefs [None req-90cc83db-46ca-4e12-aba5-eac72fb118ce tempest-VolumesActionsTest-872240335 None] Creating volume 8d790827-260a-4d2a-bcf8-63dfca95ee61 {{(pid=83528) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 25 15:56:05 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-90cc83db-46ca-4e12-aba5-eac72fb118ce tempest-VolumesActionsTest-872240335 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 25 15:56:05 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-90cc83db-46ca-4e12-aba5-eac72fb118ce tempest-VolumesActionsTest-872240335 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 25 15:56:05 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.quobyte [None req-90cc83db-46ca-4e12-aba5-eac72fb118ce tempest-VolumesActionsTest-872240335 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23e9d725-3e04-4cd9-bfe0-c8ef43305589': None} {{(pid=83528) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 25 15:56:05 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.quobyte [None req-90cc83db-46ca-4e12-aba5-eac72fb118ce tempest-VolumesActionsTest-872240335 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23e9d725-3e04-4cd9-bfe0-c8ef43305589'] {{(pid=83528) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 25 15:56:05 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-90cc83db-46ca-4e12-aba5-eac72fb118ce tempest-VolumesActionsTest-872240335 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 25 15:56:05 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.quobyte [None req-90cc83db-46ca-4e12-aba5-eac72fb118ce tempest-VolumesActionsTest-872240335 None] Selected osci02.corp.quobyte.com/cinder-vol-23e9d725-3e04-4cd9-bfe0-c8ef43305589 as target Quobyte volume. {{(pid=83528) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 25 15:56:05 devstack cinder-volume[83528]: INFO cinder.volume.drivers.remotefs [None req-90cc83db-46ca-4e12-aba5-eac72fb118ce tempest-VolumesActionsTest-872240335 None] casted to osci02.corp.quobyte.com/cinder-vol-23e9d725-3e04-4cd9-bfe0-c8ef43305589 Feb 25 15:56:05 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-90cc83db-46ca-4e12-aba5-eac72fb118ce tempest-VolumesActionsTest-872240335 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-8d790827-260a-4d2a-bcf8-63dfca95ee61 1073741824 {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 25 15:56:05 devstack cinder-volume[83528]: DEBUG cinder.volume.flows.manager.create_volume [None req-8e4177a0-ae4c-4689-bfe5-342a4335641f tempest-VolumesTransfersV355Test-928018940 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83528) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 25 15:56:05 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-8e4177a0-ae4c-4689-bfe5-342a4335641f tempest-VolumesTransfersV355Test-928018940 None] Flow 'volume_create_manager' (711175df-487f-4296-81e6-66f06c785eb3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83528) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 25 15:56:05 devstack sudo[87622]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-8d790827-260a-4d2a-bcf8-63dfca95ee61 1073741824 Feb 25 15:56:05 devstack sudo[87622]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 25 15:56:05 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-8e4177a0-ae4c-4689-bfe5-342a4335641f tempest-VolumesTransfersV355Test-928018940 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (829d09f0-e7a3-49b6-a5e5-4a7f0fe2a514) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 25 15:56:05 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-8e4177a0-ae4c-4689-bfe5-342a4335641f tempest-VolumesTransfersV355Test-928018940 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (829d09f0-e7a3-49b6-a5e5-4a7f0fe2a514) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-25T14:56:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1644954468',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3e55ca62-397b-49ae-a08b-0745339a75c0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='66c78ab529ce4ae8b40840b304126d10',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-25T14:56:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-25T14:56:05Z,use_quota=True,user_id='a55db46110774cf384cb9ab83403f4d4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ce71c2f9-6543-4165-9653-a1529b2ea243),volume_type_id=ce71c2f9-6543-4165-9653-a1529b2ea243)' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 25 15:56:05 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-8e4177a0-ae4c-4689-bfe5-342a4335641f tempest-VolumesTransfersV355Test-928018940 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a13354d1-de8a-4b53-a423-8c340e8dd82d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 25 15:56:05 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-8e4177a0-ae4c-4689-bfe5-342a4335641f tempest-VolumesTransfersV355Test-928018940 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a13354d1-de8a-4b53-a423-8c340e8dd82d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 25 15:56:05 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-8e4177a0-ae4c-4689-bfe5-342a4335641f tempest-VolumesTransfersV355Test-928018940 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (72bc9bab-2283-494b-8a3b-5d96d77d0944) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 25 15:56:05 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-8e4177a0-ae4c-4689-bfe5-342a4335641f tempest-VolumesTransfersV355Test-928018940 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (72bc9bab-2283-494b-8a3b-5d96d77d0944) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3e55ca62-397b-49ae-a08b-0745339a75c0', 'volume_name': 'volume-3e55ca62-397b-49ae-a08b-0745339a75c0', 'volume_size': 1}' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 25 15:56:05 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-8e4177a0-ae4c-4689-bfe5-342a4335641f tempest-VolumesTransfersV355Test-928018940 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d2e547f8-4535-4511-b5f6-ffc3d89df75f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 25 15:56:05 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-8e4177a0-ae4c-4689-bfe5-342a4335641f tempest-VolumesTransfersV355Test-928018940 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d2e547f8-4535-4511-b5f6-ffc3d89df75f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 25 15:56:05 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-8e4177a0-ae4c-4689-bfe5-342a4335641f tempest-VolumesTransfersV355Test-928018940 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1e51bf3b-756d-4e4b-9797-89cea5f6d313) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 25 15:56:05 devstack cinder-volume[83528]: INFO cinder.volume.flows.manager.create_volume [None req-8e4177a0-ae4c-4689-bfe5-342a4335641f tempest-VolumesTransfersV355Test-928018940 None] Volume 3e55ca62-397b-49ae-a08b-0745339a75c0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3e55ca62-397b-49ae-a08b-0745339a75c0', 'volume_size': 1} Feb 25 15:56:05 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-8e4177a0-ae4c-4689-bfe5-342a4335641f tempest-VolumesTransfersV355Test-928018940 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 25 15:56:05 devstack sudo[87622]: pam_unix(sudo:session): session closed for user root Feb 25 15:56:05 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-90cc83db-46ca-4e12-aba5-eac72fb118ce tempest-VolumesActionsTest-872240335 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-8d790827-260a-4d2a-bcf8-63dfca95ee61 1073741824" returned: 0 in 0.666s {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 25 15:56:05 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-90cc83db-46ca-4e12-aba5-eac72fb118ce tempest-VolumesActionsTest-872240335 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-8d790827-260a-4d2a-bcf8-63dfca95ee61 {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 25 15:56:05 devstack sudo[87627]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-8d790827-260a-4d2a-bcf8-63dfca95ee61 Feb 25 15:56:05 devstack sudo[87627]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 25 15:56:06 devstack cinder-volume[83528]: DEBUG cinder.volume.flows.manager.create_volume [None req-36cf470a-fde5-42d8-90ab-982fc123a8af tempest-VolumeQuotasAdminTestJSON-712697963 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83528) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 25 15:56:06 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-36cf470a-fde5-42d8-90ab-982fc123a8af tempest-VolumeQuotasAdminTestJSON-712697963 None] Flow 'volume_create_manager' (466f3181-a14e-4b1e-977e-cba907e8527d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83528) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 25 15:56:06 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-36cf470a-fde5-42d8-90ab-982fc123a8af tempest-VolumeQuotasAdminTestJSON-712697963 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (02fdddc5-59ec-4e09-8e13-89d6abcd2cd9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 25 15:56:06 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-36cf470a-fde5-42d8-90ab-982fc123a8af tempest-VolumeQuotasAdminTestJSON-712697963 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (02fdddc5-59ec-4e09-8e13-89d6abcd2cd9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-25T14:56:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1834576007',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9ff97426-a344-449d-a312-b4f8f498e75c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2d6b72b20e4c4b94aed6f5899d95911f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-25T14:56:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-25T14:56:06Z,use_quota=True,user_id='71b064175e9a41b4bd7caa31d2e67e3d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ce71c2f9-6543-4165-9653-a1529b2ea243),volume_type_id=ce71c2f9-6543-4165-9653-a1529b2ea243)' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 25 15:56:06 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-36cf470a-fde5-42d8-90ab-982fc123a8af tempest-VolumeQuotasAdminTestJSON-712697963 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5d93c8f3-0301-494f-86bf-725cc02743ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 25 15:56:06 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-36cf470a-fde5-42d8-90ab-982fc123a8af tempest-VolumeQuotasAdminTestJSON-712697963 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5d93c8f3-0301-494f-86bf-725cc02743ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 25 15:56:06 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-36cf470a-fde5-42d8-90ab-982fc123a8af tempest-VolumeQuotasAdminTestJSON-712697963 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f200f1d5-b09a-4bc8-b60d-9aa781bbf5e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 25 15:56:06 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-36cf470a-fde5-42d8-90ab-982fc123a8af tempest-VolumeQuotasAdminTestJSON-712697963 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f200f1d5-b09a-4bc8-b60d-9aa781bbf5e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9ff97426-a344-449d-a312-b4f8f498e75c', 'volume_name': 'volume-9ff97426-a344-449d-a312-b4f8f498e75c', 'volume_size': 1}' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 25 15:56:06 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-36cf470a-fde5-42d8-90ab-982fc123a8af tempest-VolumeQuotasAdminTestJSON-712697963 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9b7b50d6-c750-4bc3-b019-7a7d4b77d734) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 25 15:56:06 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-36cf470a-fde5-42d8-90ab-982fc123a8af tempest-VolumeQuotasAdminTestJSON-712697963 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9b7b50d6-c750-4bc3-b019-7a7d4b77d734) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 25 15:56:06 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-36cf470a-fde5-42d8-90ab-982fc123a8af tempest-VolumeQuotasAdminTestJSON-712697963 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (55fc2b05-7038-4d5b-b038-62819be6c91d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 25 15:56:06 devstack cinder-volume[83528]: INFO cinder.volume.flows.manager.create_volume [None req-36cf470a-fde5-42d8-90ab-982fc123a8af tempest-VolumeQuotasAdminTestJSON-712697963 None] Volume 9ff97426-a344-449d-a312-b4f8f498e75c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9ff97426-a344-449d-a312-b4f8f498e75c', 'volume_size': 1} Feb 25 15:56:06 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-36cf470a-fde5-42d8-90ab-982fc123a8af tempest-VolumeQuotasAdminTestJSON-712697963 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 25 15:56:06 devstack sudo[87627]: pam_unix(sudo:session): session closed for user root Feb 25 15:56:06 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-90cc83db-46ca-4e12-aba5-eac72fb118ce tempest-VolumesActionsTest-872240335 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-8d790827-260a-4d2a-bcf8-63dfca95ee61" returned: 0 in 0.492s {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 25 15:56:06 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.quobyte [None req-90cc83db-46ca-4e12-aba5-eac72fb118ce tempest-VolumesActionsTest-872240335 None] <== create_volume: return (1191ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-23e9d725-3e04-4cd9-bfe0-c8ef43305589'} {{(pid=83528) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 25 15:56:06 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-90cc83db-46ca-4e12-aba5-eac72fb118ce tempest-VolumesActionsTest-872240335 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.194s {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 25 15:56:06 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-8e4177a0-ae4c-4689-bfe5-342a4335641f tempest-VolumesTransfersV355Test-928018940 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.088s {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 25 15:56:06 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.quobyte [None req-8e4177a0-ae4c-4689-bfe5-342a4335641f tempest-VolumesTransfersV355Test-928018940 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-25T14:56:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1644954468',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3e55ca62-397b-49ae-a08b-0745339a75c0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='66c78ab529ce4ae8b40840b304126d10',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-25T14:56:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-25T14:56:05Z,use_quota=True,user_id='a55db46110774cf384cb9ab83403f4d4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ce71c2f9-6543-4165-9653-a1529b2ea243),volume_type_id=ce71c2f9-6543-4165-9653-a1529b2ea243)}" {{(pid=83528) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 25 15:56:06 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.remotefs [None req-8e4177a0-ae4c-4689-bfe5-342a4335641f tempest-VolumesTransfersV355Test-928018940 None] Creating volume 3e55ca62-397b-49ae-a08b-0745339a75c0 {{(pid=83528) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 25 15:56:06 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-8e4177a0-ae4c-4689-bfe5-342a4335641f tempest-VolumesTransfersV355Test-928018940 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 25 15:56:06 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-8e4177a0-ae4c-4689-bfe5-342a4335641f tempest-VolumesTransfersV355Test-928018940 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 25 15:56:06 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.quobyte [None req-8e4177a0-ae4c-4689-bfe5-342a4335641f tempest-VolumesTransfersV355Test-928018940 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23e9d725-3e04-4cd9-bfe0-c8ef43305589': None} {{(pid=83528) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 25 15:56:06 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.quobyte [None req-8e4177a0-ae4c-4689-bfe5-342a4335641f tempest-VolumesTransfersV355Test-928018940 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23e9d725-3e04-4cd9-bfe0-c8ef43305589'] {{(pid=83528) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 25 15:56:06 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-8e4177a0-ae4c-4689-bfe5-342a4335641f tempest-VolumesTransfersV355Test-928018940 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 25 15:56:06 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.quobyte [None req-8e4177a0-ae4c-4689-bfe5-342a4335641f tempest-VolumesTransfersV355Test-928018940 None] Selected osci02.corp.quobyte.com/cinder-vol-23e9d725-3e04-4cd9-bfe0-c8ef43305589 as target Quobyte volume. {{(pid=83528) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 25 15:56:06 devstack cinder-volume[83528]: INFO cinder.volume.drivers.remotefs [None req-8e4177a0-ae4c-4689-bfe5-342a4335641f tempest-VolumesTransfersV355Test-928018940 None] casted to osci02.corp.quobyte.com/cinder-vol-23e9d725-3e04-4cd9-bfe0-c8ef43305589 Feb 25 15:56:06 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-8e4177a0-ae4c-4689-bfe5-342a4335641f tempest-VolumesTransfersV355Test-928018940 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-3e55ca62-397b-49ae-a08b-0745339a75c0 1073741824 {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 25 15:56:06 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-90cc83db-46ca-4e12-aba5-eac72fb118ce tempest-VolumesActionsTest-872240335 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b5847a02-37ea-4663-905b-d14d9e8d6326) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8d790827-260a-4d2a-bcf8-63dfca95ee61', 'volume_size': 1}' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 25 15:56:06 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-90cc83db-46ca-4e12-aba5-eac72fb118ce tempest-VolumesActionsTest-872240335 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2e32a3b6-ed2d-487e-9615-05b4564b53fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 25 15:56:06 devstack sudo[87630]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-3e55ca62-397b-49ae-a08b-0745339a75c0 1073741824 Feb 25 15:56:06 devstack sudo[87630]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 25 15:56:06 devstack cinder-volume[83528]: INFO cinder.volume.flows.manager.create_volume [None req-90cc83db-46ca-4e12-aba5-eac72fb118ce tempest-VolumesActionsTest-872240335 None] Volume volume-8d790827-260a-4d2a-bcf8-63dfca95ee61 (8d790827-260a-4d2a-bcf8-63dfca95ee61): created successfully Feb 25 15:56:06 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-90cc83db-46ca-4e12-aba5-eac72fb118ce tempest-VolumesActionsTest-872240335 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2e32a3b6-ed2d-487e-9615-05b4564b53fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 25 15:56:06 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-90cc83db-46ca-4e12-aba5-eac72fb118ce tempest-VolumesActionsTest-872240335 None] Flow 'volume_create_manager' (aea878a6-375c-4a48-b6af-61f9a263137d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83528) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 25 15:56:06 devstack cinder-volume[83528]: INFO cinder.volume.manager [None req-90cc83db-46ca-4e12-aba5-eac72fb118ce tempest-VolumesActionsTest-872240335 None] Created volume successfully. Feb 25 15:56:06 devstack cinder-volume[83528]: INFO cinder.volume.manager [None req-b4093a9f-5143-438c-be7a-35a0b9fa98c0 tempest-GroupsV320Test-2141290695 None] Group tempest-GroupsV320Test-Group-602576785: creating Feb 25 15:56:06 devstack cinder-volume[83528]: INFO cinder.volume.manager [None req-b4093a9f-5143-438c-be7a-35a0b9fa98c0 tempest-GroupsV320Test-2141290695 None] Group tempest-GroupsV320Test-Group-602576785: created successfully Feb 25 15:56:06 devstack cinder-volume[83528]: INFO cinder.volume.manager [None req-b4093a9f-5143-438c-be7a-35a0b9fa98c0 tempest-GroupsV320Test-2141290695 None] Create group completed successfully. Feb 25 15:56:06 devstack sudo[87630]: pam_unix(sudo:session): session closed for user root Feb 25 15:56:06 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-8e4177a0-ae4c-4689-bfe5-342a4335641f tempest-VolumesTransfersV355Test-928018940 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-3e55ca62-397b-49ae-a08b-0745339a75c0 1073741824" returned: 0 in 0.564s {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 25 15:56:07 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-8e4177a0-ae4c-4689-bfe5-342a4335641f tempest-VolumesTransfersV355Test-928018940 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-3e55ca62-397b-49ae-a08b-0745339a75c0 {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 25 15:56:07 devstack sudo[87635]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-3e55ca62-397b-49ae-a08b-0745339a75c0 Feb 25 15:56:07 devstack sudo[87635]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 25 15:56:07 devstack cinder-volume[83528]: DEBUG cinder.coordination [None req-538e9669-9b7b-4702-a612-3e35981ddf43 tempest-VolumesActionsTest-1068253837 None] Acquiring lock "cinder-8d790827-260a-4d2a-bcf8-63dfca95ee61-delete_volume" by "delete_volume" {{(pid=83528) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 25 15:56:07 devstack cinder-volume[83528]: DEBUG cinder.coordination [None req-538e9669-9b7b-4702-a612-3e35981ddf43 tempest-VolumesActionsTest-1068253837 None] Lock "cinder-8d790827-260a-4d2a-bcf8-63dfca95ee61-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=83528) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 25 15:56:07 devstack cinder-volume[83528]: DEBUG cinder.coordination [None req-538e9669-9b7b-4702-a612-3e35981ddf43 tempest-VolumesActionsTest-1068253837 None] Acquiring lock "cinder-quobyte-8d790827-260a-4d2a-bcf8-63dfca95ee61" by "delete_volume" {{(pid=83528) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 25 15:56:07 devstack cinder-volume[83528]: DEBUG cinder.coordination [None req-538e9669-9b7b-4702-a612-3e35981ddf43 tempest-VolumesActionsTest-1068253837 None] Lock "cinder-quobyte-8d790827-260a-4d2a-bcf8-63dfca95ee61" acquired by "delete_volume" :: waited 0.017s {{(pid=83528) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 25 15:56:07 devstack cinder-volume[83528]: DEBUG oslo.privsep.daemon [-] privsep: reply[909cefbb-fea1-46de-a510-f987c8c38cd2]: (4, 'qcow2') {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 25 15:56:07 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-538e9669-9b7b-4702-a612-3e35981ddf43 tempest-VolumesActionsTest-1068253837 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-8d790827-260a-4d2a-bcf8-63dfca95ee61 {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 25 15:56:07 devstack sudo[87635]: pam_unix(sudo:session): session closed for user root Feb 25 15:56:07 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-8e4177a0-ae4c-4689-bfe5-342a4335641f tempest-VolumesTransfersV355Test-928018940 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-3e55ca62-397b-49ae-a08b-0745339a75c0" returned: 0 in 0.472s {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 25 15:56:07 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.quobyte [None req-8e4177a0-ae4c-4689-bfe5-342a4335641f tempest-VolumesTransfersV355Test-928018940 None] <== create_volume: return (1069ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-23e9d725-3e04-4cd9-bfe0-c8ef43305589'} {{(pid=83528) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 25 15:56:07 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-8e4177a0-ae4c-4689-bfe5-342a4335641f tempest-VolumesTransfersV355Test-928018940 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.072s {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 25 15:56:07 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-36cf470a-fde5-42d8-90ab-982fc123a8af tempest-VolumeQuotasAdminTestJSON-712697963 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.149s {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 25 15:56:07 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.quobyte [None req-36cf470a-fde5-42d8-90ab-982fc123a8af tempest-VolumeQuotasAdminTestJSON-712697963 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-25T14:56:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1834576007',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9ff97426-a344-449d-a312-b4f8f498e75c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2d6b72b20e4c4b94aed6f5899d95911f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-25T14:56:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-25T14:56:06Z,use_quota=True,user_id='71b064175e9a41b4bd7caa31d2e67e3d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ce71c2f9-6543-4165-9653-a1529b2ea243),volume_type_id=ce71c2f9-6543-4165-9653-a1529b2ea243)}" {{(pid=83528) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 25 15:56:07 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.remotefs [None req-36cf470a-fde5-42d8-90ab-982fc123a8af tempest-VolumeQuotasAdminTestJSON-712697963 None] Creating volume 9ff97426-a344-449d-a312-b4f8f498e75c {{(pid=83528) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 25 15:56:07 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-36cf470a-fde5-42d8-90ab-982fc123a8af tempest-VolumeQuotasAdminTestJSON-712697963 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 25 15:56:07 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-36cf470a-fde5-42d8-90ab-982fc123a8af tempest-VolumeQuotasAdminTestJSON-712697963 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 25 15:56:07 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.quobyte [None req-36cf470a-fde5-42d8-90ab-982fc123a8af tempest-VolumeQuotasAdminTestJSON-712697963 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23e9d725-3e04-4cd9-bfe0-c8ef43305589': None} {{(pid=83528) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 25 15:56:07 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.quobyte [None req-36cf470a-fde5-42d8-90ab-982fc123a8af tempest-VolumeQuotasAdminTestJSON-712697963 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23e9d725-3e04-4cd9-bfe0-c8ef43305589'] {{(pid=83528) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 25 15:56:07 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-36cf470a-fde5-42d8-90ab-982fc123a8af tempest-VolumeQuotasAdminTestJSON-712697963 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 25 15:56:07 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.quobyte [None req-36cf470a-fde5-42d8-90ab-982fc123a8af tempest-VolumeQuotasAdminTestJSON-712697963 None] Selected osci02.corp.quobyte.com/cinder-vol-23e9d725-3e04-4cd9-bfe0-c8ef43305589 as target Quobyte volume. {{(pid=83528) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 25 15:56:07 devstack cinder-volume[83528]: INFO cinder.volume.drivers.remotefs [None req-36cf470a-fde5-42d8-90ab-982fc123a8af tempest-VolumeQuotasAdminTestJSON-712697963 None] casted to osci02.corp.quobyte.com/cinder-vol-23e9d725-3e04-4cd9-bfe0-c8ef43305589 Feb 25 15:56:07 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-36cf470a-fde5-42d8-90ab-982fc123a8af tempest-VolumeQuotasAdminTestJSON-712697963 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-9ff97426-a344-449d-a312-b4f8f498e75c 1073741824 {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 25 15:56:07 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-8e4177a0-ae4c-4689-bfe5-342a4335641f tempest-VolumesTransfersV355Test-928018940 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1e51bf3b-756d-4e4b-9797-89cea5f6d313) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3e55ca62-397b-49ae-a08b-0745339a75c0', 'volume_size': 1}' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 25 15:56:07 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-8e4177a0-ae4c-4689-bfe5-342a4335641f tempest-VolumesTransfersV355Test-928018940 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (48564f63-d41b-4e74-b68a-bcb0b5899d78) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 25 15:56:07 devstack sudo[87639]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-9ff97426-a344-449d-a312-b4f8f498e75c 1073741824 Feb 25 15:56:07 devstack sudo[87639]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 25 15:56:07 devstack sudo[87638]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-8d790827-260a-4d2a-bcf8-63dfca95ee61 Feb 25 15:56:07 devstack sudo[87638]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 25 15:56:07 devstack cinder-volume[83528]: INFO cinder.volume.flows.manager.create_volume [None req-8e4177a0-ae4c-4689-bfe5-342a4335641f tempest-VolumesTransfersV355Test-928018940 None] Volume volume-3e55ca62-397b-49ae-a08b-0745339a75c0 (3e55ca62-397b-49ae-a08b-0745339a75c0): created successfully Feb 25 15:56:07 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-8e4177a0-ae4c-4689-bfe5-342a4335641f tempest-VolumesTransfersV355Test-928018940 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (48564f63-d41b-4e74-b68a-bcb0b5899d78) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 25 15:56:07 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-8e4177a0-ae4c-4689-bfe5-342a4335641f tempest-VolumesTransfersV355Test-928018940 None] Flow 'volume_create_manager' (711175df-487f-4296-81e6-66f06c785eb3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83528) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 25 15:56:07 devstack cinder-volume[83528]: INFO cinder.volume.manager [None req-8e4177a0-ae4c-4689-bfe5-342a4335641f tempest-VolumesTransfersV355Test-928018940 None] Created volume successfully. Feb 25 15:56:08 devstack sudo[87639]: pam_unix(sudo:session): session closed for user root Feb 25 15:56:08 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-36cf470a-fde5-42d8-90ab-982fc123a8af tempest-VolumeQuotasAdminTestJSON-712697963 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-9ff97426-a344-449d-a312-b4f8f498e75c 1073741824" returned: 0 in 0.595s {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 25 15:56:08 devstack cinder-volume[83528]: DEBUG cinder.quota [None req-ea9748f5-93e7-4c64-ab54-ca59bd56ae51 tempest-GroupsV320Test-2141290695 None] Created reservations ['c67d0c4e-226b-4642-8eff-0e53555a0091'] {{(pid=83528) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 25 15:56:08 devstack sudo[87638]: pam_unix(sudo:session): session closed for user root Feb 25 15:56:08 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-538e9669-9b7b-4702-a612-3e35981ddf43 tempest-VolumesActionsTest-1068253837 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-8d790827-260a-4d2a-bcf8-63dfca95ee61" returned: 0 in 0.665s {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 25 15:56:08 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-538e9669-9b7b-4702-a612-3e35981ddf43 tempest-VolumesActionsTest-1068253837 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-8d790827-260a-4d2a-bcf8-63dfca95ee61 {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 25 15:56:08 devstack sudo[87648]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-8d790827-260a-4d2a-bcf8-63dfca95ee61 Feb 25 15:56:08 devstack sudo[87648]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 25 15:56:08 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-36cf470a-fde5-42d8-90ab-982fc123a8af tempest-VolumeQuotasAdminTestJSON-712697963 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-9ff97426-a344-449d-a312-b4f8f498e75c {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 25 15:56:08 devstack sudo[87650]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-9ff97426-a344-449d-a312-b4f8f498e75c Feb 25 15:56:08 devstack sudo[87650]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 25 15:56:08 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-ea9748f5-93e7-4c64-ab54-ca59bd56ae51 tempest-GroupsV320Test-2141290695 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 25 15:56:08 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-ea9748f5-93e7-4c64-ab54-ca59bd56ae51 tempest-GroupsV320Test-2141290695 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 25 15:56:08 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.quobyte [None req-ea9748f5-93e7-4c64-ab54-ca59bd56ae51 tempest-GroupsV320Test-2141290695 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23e9d725-3e04-4cd9-bfe0-c8ef43305589': None} {{(pid=83528) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 25 15:56:08 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.quobyte [None req-ea9748f5-93e7-4c64-ab54-ca59bd56ae51 tempest-GroupsV320Test-2141290695 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23e9d725-3e04-4cd9-bfe0-c8ef43305589'] {{(pid=83528) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 25 15:56:08 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-ea9748f5-93e7-4c64-ab54-ca59bd56ae51 tempest-GroupsV320Test-2141290695 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 25 15:56:08 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-ea9748f5-93e7-4c64-ab54-ca59bd56ae51 tempest-GroupsV320Test-2141290695 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85 {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 25 15:56:08 devstack sudo[87652]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85 Feb 25 15:56:08 devstack sudo[87652]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 25 15:56:08 devstack cinder-volume[83528]: DEBUG cinder.coordination [None req-b23f4b00-b0f9-4f5e-849a-885896c18a3f tempest-VolumesTransfersV355Test-313299346 None] Acquiring lock "cinder-3e55ca62-397b-49ae-a08b-0745339a75c0-delete_volume" by "delete_volume" {{(pid=83528) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 25 15:56:08 devstack cinder-volume[83528]: DEBUG cinder.coordination [None req-b23f4b00-b0f9-4f5e-849a-885896c18a3f tempest-VolumesTransfersV355Test-313299346 None] Lock "cinder-3e55ca62-397b-49ae-a08b-0745339a75c0-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=83528) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 25 15:56:08 devstack sudo[87648]: pam_unix(sudo:session): session closed for user root Feb 25 15:56:08 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-538e9669-9b7b-4702-a612-3e35981ddf43 tempest-VolumesActionsTest-1068253837 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-8d790827-260a-4d2a-bcf8-63dfca95ee61" returned: 0 in 0.498s {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 25 15:56:08 devstack cinder-volume[83528]: DEBUG cinder.coordination [None req-538e9669-9b7b-4702-a612-3e35981ddf43 tempest-VolumesActionsTest-1068253837 None] Lock "cinder-quobyte-8d790827-260a-4d2a-bcf8-63dfca95ee61" released by "delete_volume" :: held 1.187s {{(pid=83528) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 25 15:56:08 devstack cinder-volume[83528]: DEBUG cinder.coordination [None req-b23f4b00-b0f9-4f5e-849a-885896c18a3f tempest-VolumesTransfersV355Test-313299346 None] Acquiring lock "cinder-quobyte-3e55ca62-397b-49ae-a08b-0745339a75c0" by "delete_volume" {{(pid=83528) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 25 15:56:08 devstack cinder-volume[83528]: DEBUG cinder.coordination [None req-b23f4b00-b0f9-4f5e-849a-885896c18a3f tempest-VolumesTransfersV355Test-313299346 None] Lock "cinder-quobyte-3e55ca62-397b-49ae-a08b-0745339a75c0" acquired by "delete_volume" :: waited 0.012s {{(pid=83528) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 25 15:56:08 devstack cinder-volume[83528]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c8f3f98-77e1-4dc5-b8a3-ac5ce80cfcd2]: (4, 'qcow2') {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 25 15:56:08 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-b23f4b00-b0f9-4f5e-849a-885896c18a3f tempest-VolumesTransfersV355Test-313299346 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-3e55ca62-397b-49ae-a08b-0745339a75c0 {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 25 15:56:08 devstack cinder-volume[83528]: DEBUG cinder.quota [None req-538e9669-9b7b-4702-a612-3e35981ddf43 tempest-VolumesActionsTest-1068253837 None] Created reservations ['53b4946f-ca63-447b-9242-f09fd5f01ec7', '44fdf37a-9550-45c8-bb54-1f2a9bce19f6', 'd0fd182a-e072-4ba9-baa2-6a58c20b3865', 'a87988df-c1f3-4a88-85fc-f3db6185d259'] {{(pid=83528) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 25 15:56:08 devstack sudo[87650]: pam_unix(sudo:session): session closed for user root Feb 25 15:56:08 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-36cf470a-fde5-42d8-90ab-982fc123a8af tempest-VolumeQuotasAdminTestJSON-712697963 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-9ff97426-a344-449d-a312-b4f8f498e75c" returned: 0 in 0.593s {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 25 15:56:08 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.quobyte [None req-36cf470a-fde5-42d8-90ab-982fc123a8af tempest-VolumeQuotasAdminTestJSON-712697963 None] <== create_volume: return (1244ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-23e9d725-3e04-4cd9-bfe0-c8ef43305589'} {{(pid=83528) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 25 15:56:08 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-36cf470a-fde5-42d8-90ab-982fc123a8af tempest-VolumeQuotasAdminTestJSON-712697963 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.247s {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 25 15:56:08 devstack sudo[87652]: pam_unix(sudo:session): session closed for user root Feb 25 15:56:08 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-36cf470a-fde5-42d8-90ab-982fc123a8af tempest-VolumeQuotasAdminTestJSON-712697963 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (55fc2b05-7038-4d5b-b038-62819be6c91d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9ff97426-a344-449d-a312-b4f8f498e75c', 'volume_size': 1}' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 25 15:56:08 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-36cf470a-fde5-42d8-90ab-982fc123a8af tempest-VolumeQuotasAdminTestJSON-712697963 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9ad35d7e-aeed-4a6a-84ca-a8969d267d79) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 25 15:56:08 devstack sudo[87657]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-3e55ca62-397b-49ae-a08b-0745339a75c0 Feb 25 15:56:08 devstack sudo[87657]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 25 15:56:08 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-ea9748f5-93e7-4c64-ab54-ca59bd56ae51 tempest-GroupsV320Test-2141290695 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85" returned: 0 in 0.587s {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 25 15:56:08 devstack cinder-volume[83528]: DEBUG cinder.manager [None req-ea9748f5-93e7-4c64-ab54-ca59bd56ae51 tempest-GroupsV320Test-2141290695 None] Notifying Schedulers of capabilities ... {{(pid=83528) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 25 15:56:08 devstack cinder-volume[83528]: INFO cinder.volume.flows.manager.create_volume [None req-36cf470a-fde5-42d8-90ab-982fc123a8af tempest-VolumeQuotasAdminTestJSON-712697963 None] Volume volume-9ff97426-a344-449d-a312-b4f8f498e75c (9ff97426-a344-449d-a312-b4f8f498e75c): created successfully Feb 25 15:56:08 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-36cf470a-fde5-42d8-90ab-982fc123a8af tempest-VolumeQuotasAdminTestJSON-712697963 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9ad35d7e-aeed-4a6a-84ca-a8969d267d79) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 25 15:56:08 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-36cf470a-fde5-42d8-90ab-982fc123a8af tempest-VolumeQuotasAdminTestJSON-712697963 None] Flow 'volume_create_manager' (466f3181-a14e-4b1e-977e-cba907e8527d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83528) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 25 15:56:08 devstack cinder-volume[83528]: INFO cinder.volume.manager [None req-ea9748f5-93e7-4c64-ab54-ca59bd56ae51 tempest-GroupsV320Test-2141290695 None] Delete group completed successfully. Feb 25 15:56:08 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-538e9669-9b7b-4702-a612-3e35981ddf43 tempest-VolumesActionsTest-1068253837 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 25 15:56:08 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-538e9669-9b7b-4702-a612-3e35981ddf43 tempest-VolumesActionsTest-1068253837 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 25 15:56:08 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.quobyte [None req-538e9669-9b7b-4702-a612-3e35981ddf43 tempest-VolumesActionsTest-1068253837 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23e9d725-3e04-4cd9-bfe0-c8ef43305589': None} {{(pid=83528) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 25 15:56:08 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.quobyte [None req-538e9669-9b7b-4702-a612-3e35981ddf43 tempest-VolumesActionsTest-1068253837 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23e9d725-3e04-4cd9-bfe0-c8ef43305589'] {{(pid=83528) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 25 15:56:08 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-538e9669-9b7b-4702-a612-3e35981ddf43 tempest-VolumesActionsTest-1068253837 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 25 15:56:08 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-538e9669-9b7b-4702-a612-3e35981ddf43 tempest-VolumesActionsTest-1068253837 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85 {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 25 15:56:08 devstack cinder-volume[83528]: INFO cinder.volume.manager [None req-36cf470a-fde5-42d8-90ab-982fc123a8af tempest-VolumeQuotasAdminTestJSON-712697963 None] Created volume successfully. Feb 25 15:56:08 devstack sudo[87659]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85 Feb 25 15:56:08 devstack sudo[87659]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 25 15:56:09 devstack sudo[87657]: pam_unix(sudo:session): session closed for user root Feb 25 15:56:09 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-b23f4b00-b0f9-4f5e-849a-885896c18a3f tempest-VolumesTransfersV355Test-313299346 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-3e55ca62-397b-49ae-a08b-0745339a75c0" returned: 0 in 0.523s {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 25 15:56:09 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-b23f4b00-b0f9-4f5e-849a-885896c18a3f tempest-VolumesTransfersV355Test-313299346 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-3e55ca62-397b-49ae-a08b-0745339a75c0 {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 25 15:56:09 devstack sudo[87665]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-3e55ca62-397b-49ae-a08b-0745339a75c0 Feb 25 15:56:09 devstack sudo[87665]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 25 15:56:09 devstack sudo[87659]: pam_unix(sudo:session): session closed for user root Feb 25 15:56:09 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-538e9669-9b7b-4702-a612-3e35981ddf43 tempest-VolumesActionsTest-1068253837 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85" returned: 0 in 0.453s {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 25 15:56:09 devstack cinder-volume[83528]: DEBUG cinder.manager [None req-538e9669-9b7b-4702-a612-3e35981ddf43 tempest-VolumesActionsTest-1068253837 None] Notifying Schedulers of capabilities ... {{(pid=83528) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 25 15:56:09 devstack cinder-volume[83528]: INFO cinder.volume.manager [None req-538e9669-9b7b-4702-a612-3e35981ddf43 tempest-VolumesActionsTest-1068253837 None] Deleted volume successfully. Feb 25 15:56:09 devstack cinder-volume[83528]: DEBUG cinder.coordination [None req-538e9669-9b7b-4702-a612-3e35981ddf43 tempest-VolumesActionsTest-1068253837 None] Lock "cinder-8d790827-260a-4d2a-bcf8-63dfca95ee61-delete_volume" released by "delete_volume" :: held 1.880s {{(pid=83528) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 25 15:56:09 devstack cinder-volume[83528]: DEBUG cinder.coordination [None req-0512ef8b-b36b-46ac-bc00-7b4386a995a5 tempest-VolumeQuotasAdminTestJSON-712697963 None] Acquiring lock "cinder-9ff97426-a344-449d-a312-b4f8f498e75c-delete_volume" by "delete_volume" {{(pid=83528) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 25 15:56:09 devstack cinder-volume[83528]: DEBUG cinder.coordination [None req-0512ef8b-b36b-46ac-bc00-7b4386a995a5 tempest-VolumeQuotasAdminTestJSON-712697963 None] Lock "cinder-9ff97426-a344-449d-a312-b4f8f498e75c-delete_volume" acquired by "delete_volume" :: waited 0.012s {{(pid=83528) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 25 15:56:09 devstack cinder-volume[83528]: DEBUG cinder.coordination [None req-0512ef8b-b36b-46ac-bc00-7b4386a995a5 tempest-VolumeQuotasAdminTestJSON-712697963 None] Acquiring lock "cinder-quobyte-9ff97426-a344-449d-a312-b4f8f498e75c" by "delete_volume" {{(pid=83528) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 25 15:56:09 devstack cinder-volume[83528]: DEBUG cinder.coordination [None req-0512ef8b-b36b-46ac-bc00-7b4386a995a5 tempest-VolumeQuotasAdminTestJSON-712697963 None] Lock "cinder-quobyte-9ff97426-a344-449d-a312-b4f8f498e75c" acquired by "delete_volume" :: waited 0.010s {{(pid=83528) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 25 15:56:09 devstack cinder-volume[83528]: DEBUG oslo.privsep.daemon [-] privsep: reply[4954b33f-1d92-4839-ac78-cbc458aa4bd8]: (4, 'qcow2') {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 25 15:56:09 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-0512ef8b-b36b-46ac-bc00-7b4386a995a5 tempest-VolumeQuotasAdminTestJSON-712697963 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-9ff97426-a344-449d-a312-b4f8f498e75c {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 25 15:56:09 devstack sudo[87665]: pam_unix(sudo:session): session closed for user root Feb 25 15:56:09 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-b23f4b00-b0f9-4f5e-849a-885896c18a3f tempest-VolumesTransfersV355Test-313299346 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-3e55ca62-397b-49ae-a08b-0745339a75c0" returned: 0 in 0.545s {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 25 15:56:09 devstack cinder-volume[83528]: DEBUG cinder.coordination [None req-b23f4b00-b0f9-4f5e-849a-885896c18a3f tempest-VolumesTransfersV355Test-313299346 None] Lock "cinder-quobyte-3e55ca62-397b-49ae-a08b-0745339a75c0" released by "delete_volume" :: held 1.099s {{(pid=83528) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 25 15:56:09 devstack sudo[87668]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-9ff97426-a344-449d-a312-b4f8f498e75c Feb 25 15:56:09 devstack sudo[87668]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 25 15:56:09 devstack cinder-volume[83528]: DEBUG cinder.quota [None req-b23f4b00-b0f9-4f5e-849a-885896c18a3f tempest-VolumesTransfersV355Test-313299346 None] Created reservations ['a625fc68-4310-4178-b126-c12b30c78b23', 'df6ee9a3-9514-429b-adcc-cd45ec309306', 'a95b21c2-6092-462a-ae6a-b96f4d40c30e', '20bd4479-70dc-4cf4-afa7-b9c0a814cdf9'] {{(pid=83528) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 25 15:56:09 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-b23f4b00-b0f9-4f5e-849a-885896c18a3f tempest-VolumesTransfersV355Test-313299346 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 25 15:56:09 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-b23f4b00-b0f9-4f5e-849a-885896c18a3f tempest-VolumesTransfersV355Test-313299346 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 25 15:56:09 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.quobyte [None req-b23f4b00-b0f9-4f5e-849a-885896c18a3f tempest-VolumesTransfersV355Test-313299346 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23e9d725-3e04-4cd9-bfe0-c8ef43305589': None} {{(pid=83528) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 25 15:56:09 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.quobyte [None req-b23f4b00-b0f9-4f5e-849a-885896c18a3f tempest-VolumesTransfersV355Test-313299346 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23e9d725-3e04-4cd9-bfe0-c8ef43305589'] {{(pid=83528) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 25 15:56:09 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-b23f4b00-b0f9-4f5e-849a-885896c18a3f tempest-VolumesTransfersV355Test-313299346 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 25 15:56:09 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-b23f4b00-b0f9-4f5e-849a-885896c18a3f tempest-VolumesTransfersV355Test-313299346 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85 {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 25 15:56:09 devstack sudo[87670]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85 Feb 25 15:56:09 devstack sudo[87670]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 25 15:56:09 devstack cinder-volume[83528]: DEBUG cinder.volume.flows.manager.create_volume [None req-1a3da64a-cc7a-4905-aa5e-01afb4ac7a29 tempest-VolumesActionsTest-872240335 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83528) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 25 15:56:09 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-1a3da64a-cc7a-4905-aa5e-01afb4ac7a29 tempest-VolumesActionsTest-872240335 None] Flow 'volume_create_manager' (a6b7054f-f1db-4c2e-8a19-c571a4cc28ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83528) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 25 15:56:09 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-1a3da64a-cc7a-4905-aa5e-01afb4ac7a29 tempest-VolumesActionsTest-872240335 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (342deac0-0585-4213-8275-2df203ee379f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 25 15:56:09 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-1a3da64a-cc7a-4905-aa5e-01afb4ac7a29 tempest-VolumesActionsTest-872240335 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (342deac0-0585-4213-8275-2df203ee379f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-25T14:56:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1733707729',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cece5774-b8f9-4ac9-af95-452ea32b25b6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='da136677879e424b82ce0c4ab6e11f76',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-25T14:56:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-25T14:56:10Z,use_quota=True,user_id='8b2df249d4dc442f91f55f39a5a775f4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ce71c2f9-6543-4165-9653-a1529b2ea243),volume_type_id=ce71c2f9-6543-4165-9653-a1529b2ea243)' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 25 15:56:09 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-1a3da64a-cc7a-4905-aa5e-01afb4ac7a29 tempest-VolumesActionsTest-872240335 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (28f0ee01-addd-43b3-b7a5-33dbda6dc0c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 25 15:56:09 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-1a3da64a-cc7a-4905-aa5e-01afb4ac7a29 tempest-VolumesActionsTest-872240335 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (28f0ee01-addd-43b3-b7a5-33dbda6dc0c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 25 15:56:09 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-1a3da64a-cc7a-4905-aa5e-01afb4ac7a29 tempest-VolumesActionsTest-872240335 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (66ec35a5-9ec4-4ab0-99d9-993802fe2faa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 25 15:56:09 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-1a3da64a-cc7a-4905-aa5e-01afb4ac7a29 tempest-VolumesActionsTest-872240335 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (66ec35a5-9ec4-4ab0-99d9-993802fe2faa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cece5774-b8f9-4ac9-af95-452ea32b25b6', 'volume_name': 'volume-cece5774-b8f9-4ac9-af95-452ea32b25b6', 'volume_size': 1}' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 25 15:56:10 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-1a3da64a-cc7a-4905-aa5e-01afb4ac7a29 tempest-VolumesActionsTest-872240335 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (748a0730-21f7-492b-8b99-39e3bfc4f33e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 25 15:56:10 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-1a3da64a-cc7a-4905-aa5e-01afb4ac7a29 tempest-VolumesActionsTest-872240335 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (748a0730-21f7-492b-8b99-39e3bfc4f33e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 25 15:56:10 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-1a3da64a-cc7a-4905-aa5e-01afb4ac7a29 tempest-VolumesActionsTest-872240335 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7198b57b-b4b4-4d75-b9bb-7d8b6f0f2bd4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 25 15:56:10 devstack cinder-volume[83528]: INFO cinder.volume.flows.manager.create_volume [None req-1a3da64a-cc7a-4905-aa5e-01afb4ac7a29 tempest-VolumesActionsTest-872240335 None] Volume cece5774-b8f9-4ac9-af95-452ea32b25b6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cece5774-b8f9-4ac9-af95-452ea32b25b6', 'volume_size': 1} Feb 25 15:56:10 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-1a3da64a-cc7a-4905-aa5e-01afb4ac7a29 tempest-VolumesActionsTest-872240335 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 25 15:56:10 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-1a3da64a-cc7a-4905-aa5e-01afb4ac7a29 tempest-VolumesActionsTest-872240335 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 25 15:56:10 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.quobyte [None req-1a3da64a-cc7a-4905-aa5e-01afb4ac7a29 tempest-VolumesActionsTest-872240335 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-25T14:56:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1733707729',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cece5774-b8f9-4ac9-af95-452ea32b25b6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='da136677879e424b82ce0c4ab6e11f76',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-25T14:56:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-25T14:56:10Z,use_quota=True,user_id='8b2df249d4dc442f91f55f39a5a775f4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ce71c2f9-6543-4165-9653-a1529b2ea243),volume_type_id=ce71c2f9-6543-4165-9653-a1529b2ea243)}" {{(pid=83528) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 25 15:56:10 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.remotefs [None req-1a3da64a-cc7a-4905-aa5e-01afb4ac7a29 tempest-VolumesActionsTest-872240335 None] Creating volume cece5774-b8f9-4ac9-af95-452ea32b25b6 {{(pid=83528) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 25 15:56:10 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-1a3da64a-cc7a-4905-aa5e-01afb4ac7a29 tempest-VolumesActionsTest-872240335 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 25 15:56:10 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-1a3da64a-cc7a-4905-aa5e-01afb4ac7a29 tempest-VolumesActionsTest-872240335 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 25 15:56:10 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.quobyte [None req-1a3da64a-cc7a-4905-aa5e-01afb4ac7a29 tempest-VolumesActionsTest-872240335 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23e9d725-3e04-4cd9-bfe0-c8ef43305589': None} {{(pid=83528) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 25 15:56:10 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.quobyte [None req-1a3da64a-cc7a-4905-aa5e-01afb4ac7a29 tempest-VolumesActionsTest-872240335 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23e9d725-3e04-4cd9-bfe0-c8ef43305589'] {{(pid=83528) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 25 15:56:10 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-1a3da64a-cc7a-4905-aa5e-01afb4ac7a29 tempest-VolumesActionsTest-872240335 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 25 15:56:10 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.quobyte [None req-1a3da64a-cc7a-4905-aa5e-01afb4ac7a29 tempest-VolumesActionsTest-872240335 None] Selected osci02.corp.quobyte.com/cinder-vol-23e9d725-3e04-4cd9-bfe0-c8ef43305589 as target Quobyte volume. {{(pid=83528) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 25 15:56:10 devstack cinder-volume[83528]: INFO cinder.volume.drivers.remotefs [None req-1a3da64a-cc7a-4905-aa5e-01afb4ac7a29 tempest-VolumesActionsTest-872240335 None] casted to osci02.corp.quobyte.com/cinder-vol-23e9d725-3e04-4cd9-bfe0-c8ef43305589 Feb 25 15:56:10 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-1a3da64a-cc7a-4905-aa5e-01afb4ac7a29 tempest-VolumesActionsTest-872240335 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-cece5774-b8f9-4ac9-af95-452ea32b25b6 1073741824 {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 25 15:56:10 devstack sudo[87672]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-cece5774-b8f9-4ac9-af95-452ea32b25b6 1073741824 Feb 25 15:56:10 devstack sudo[87672]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 25 15:56:10 devstack sudo[87668]: pam_unix(sudo:session): session closed for user root Feb 25 15:56:10 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-0512ef8b-b36b-46ac-bc00-7b4386a995a5 tempest-VolumeQuotasAdminTestJSON-712697963 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-9ff97426-a344-449d-a312-b4f8f498e75c" returned: 0 in 0.620s {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 25 15:56:10 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-0512ef8b-b36b-46ac-bc00-7b4386a995a5 tempest-VolumeQuotasAdminTestJSON-712697963 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-9ff97426-a344-449d-a312-b4f8f498e75c {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 25 15:56:10 devstack sudo[87677]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-9ff97426-a344-449d-a312-b4f8f498e75c Feb 25 15:56:10 devstack sudo[87677]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 25 15:56:10 devstack sudo[87670]: pam_unix(sudo:session): session closed for user root Feb 25 15:56:10 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-b23f4b00-b0f9-4f5e-849a-885896c18a3f tempest-VolumesTransfersV355Test-313299346 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85" returned: 0 in 0.639s {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 25 15:56:10 devstack cinder-volume[83528]: DEBUG cinder.manager [None req-b23f4b00-b0f9-4f5e-849a-885896c18a3f tempest-VolumesTransfersV355Test-313299346 None] Notifying Schedulers of capabilities ... {{(pid=83528) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 25 15:56:10 devstack cinder-volume[83528]: INFO cinder.volume.manager [None req-b23f4b00-b0f9-4f5e-849a-885896c18a3f tempest-VolumesTransfersV355Test-313299346 None] Deleted volume successfully. Feb 25 15:56:10 devstack cinder-volume[83528]: DEBUG cinder.coordination [None req-b23f4b00-b0f9-4f5e-849a-885896c18a3f tempest-VolumesTransfersV355Test-313299346 None] Lock "cinder-3e55ca62-397b-49ae-a08b-0745339a75c0-delete_volume" released by "delete_volume" :: held 1.952s {{(pid=83528) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 25 15:56:10 devstack sudo[87672]: pam_unix(sudo:session): session closed for user root Feb 25 15:56:10 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-1a3da64a-cc7a-4905-aa5e-01afb4ac7a29 tempest-VolumesActionsTest-872240335 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-cece5774-b8f9-4ac9-af95-452ea32b25b6 1073741824" returned: 0 in 0.776s {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 25 15:56:10 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-1a3da64a-cc7a-4905-aa5e-01afb4ac7a29 tempest-VolumesActionsTest-872240335 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-cece5774-b8f9-4ac9-af95-452ea32b25b6 {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 25 15:56:10 devstack sudo[87685]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-cece5774-b8f9-4ac9-af95-452ea32b25b6 Feb 25 15:56:10 devstack sudo[87685]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 25 15:56:10 devstack sudo[87677]: pam_unix(sudo:session): session closed for user root Feb 25 15:56:10 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-0512ef8b-b36b-46ac-bc00-7b4386a995a5 tempest-VolumeQuotasAdminTestJSON-712697963 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-9ff97426-a344-449d-a312-b4f8f498e75c" returned: 0 in 0.649s {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 25 15:56:10 devstack cinder-volume[83528]: DEBUG cinder.coordination [None req-0512ef8b-b36b-46ac-bc00-7b4386a995a5 tempest-VolumeQuotasAdminTestJSON-712697963 None] Lock "cinder-quobyte-9ff97426-a344-449d-a312-b4f8f498e75c" released by "delete_volume" :: held 1.304s {{(pid=83528) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 25 15:56:11 devstack cinder-volume[83528]: DEBUG cinder.quota [None req-0512ef8b-b36b-46ac-bc00-7b4386a995a5 tempest-VolumeQuotasAdminTestJSON-712697963 None] Created reservations ['54e19225-5e4e-4574-af3f-0f2f642ac8b7', 'a9f982bd-a9b7-40a7-a784-30424fa245c1', 'b802daa0-8e60-40c8-9680-571aa8d1a609', '34ca476b-6128-4ec6-9e4e-fda25c593dd1'] {{(pid=83528) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 25 15:56:11 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-0512ef8b-b36b-46ac-bc00-7b4386a995a5 tempest-VolumeQuotasAdminTestJSON-712697963 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 25 15:56:11 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-0512ef8b-b36b-46ac-bc00-7b4386a995a5 tempest-VolumeQuotasAdminTestJSON-712697963 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 25 15:56:11 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.quobyte [None req-0512ef8b-b36b-46ac-bc00-7b4386a995a5 tempest-VolumeQuotasAdminTestJSON-712697963 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23e9d725-3e04-4cd9-bfe0-c8ef43305589': None} {{(pid=83528) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 25 15:56:11 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.quobyte [None req-0512ef8b-b36b-46ac-bc00-7b4386a995a5 tempest-VolumeQuotasAdminTestJSON-712697963 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23e9d725-3e04-4cd9-bfe0-c8ef43305589'] {{(pid=83528) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 25 15:56:11 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-0512ef8b-b36b-46ac-bc00-7b4386a995a5 tempest-VolumeQuotasAdminTestJSON-712697963 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 25 15:56:11 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-0512ef8b-b36b-46ac-bc00-7b4386a995a5 tempest-VolumeQuotasAdminTestJSON-712697963 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85 {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 25 15:56:11 devstack sudo[87687]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85 Feb 25 15:56:11 devstack sudo[87687]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 25 15:56:11 devstack sudo[87685]: pam_unix(sudo:session): session closed for user root Feb 25 15:56:11 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-1a3da64a-cc7a-4905-aa5e-01afb4ac7a29 tempest-VolumesActionsTest-872240335 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-cece5774-b8f9-4ac9-af95-452ea32b25b6" returned: 0 in 0.491s {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 25 15:56:11 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.quobyte [None req-1a3da64a-cc7a-4905-aa5e-01afb4ac7a29 tempest-VolumesActionsTest-872240335 None] <== create_volume: return (1334ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-23e9d725-3e04-4cd9-bfe0-c8ef43305589'} {{(pid=83528) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 25 15:56:11 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-1a3da64a-cc7a-4905-aa5e-01afb4ac7a29 tempest-VolumesActionsTest-872240335 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.339s {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 25 15:56:11 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-1a3da64a-cc7a-4905-aa5e-01afb4ac7a29 tempest-VolumesActionsTest-872240335 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7198b57b-b4b4-4d75-b9bb-7d8b6f0f2bd4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cece5774-b8f9-4ac9-af95-452ea32b25b6', 'volume_size': 1}' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 25 15:56:11 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-1a3da64a-cc7a-4905-aa5e-01afb4ac7a29 tempest-VolumesActionsTest-872240335 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (40ba075d-04a3-406e-90c1-719d97d4ebcc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 25 15:56:11 devstack cinder-volume[83528]: INFO cinder.volume.flows.manager.create_volume [None req-1a3da64a-cc7a-4905-aa5e-01afb4ac7a29 tempest-VolumesActionsTest-872240335 None] Volume volume-cece5774-b8f9-4ac9-af95-452ea32b25b6 (cece5774-b8f9-4ac9-af95-452ea32b25b6): created successfully Feb 25 15:56:11 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-1a3da64a-cc7a-4905-aa5e-01afb4ac7a29 tempest-VolumesActionsTest-872240335 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (40ba075d-04a3-406e-90c1-719d97d4ebcc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 25 15:56:11 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-1a3da64a-cc7a-4905-aa5e-01afb4ac7a29 tempest-VolumesActionsTest-872240335 None] Flow 'volume_create_manager' (a6b7054f-f1db-4c2e-8a19-c571a4cc28ad) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83528) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 25 15:56:11 devstack cinder-volume[83528]: INFO cinder.volume.manager [None req-1a3da64a-cc7a-4905-aa5e-01afb4ac7a29 tempest-VolumesActionsTest-872240335 None] Created volume successfully. Feb 25 15:56:11 devstack sudo[87687]: pam_unix(sudo:session): session closed for user root Feb 25 15:56:11 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-0512ef8b-b36b-46ac-bc00-7b4386a995a5 tempest-VolumeQuotasAdminTestJSON-712697963 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85" returned: 0 in 0.477s {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 25 15:56:11 devstack cinder-volume[83528]: DEBUG cinder.manager [None req-0512ef8b-b36b-46ac-bc00-7b4386a995a5 tempest-VolumeQuotasAdminTestJSON-712697963 None] Notifying Schedulers of capabilities ... {{(pid=83528) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 25 15:56:11 devstack cinder-volume[83528]: INFO cinder.volume.manager [None req-0512ef8b-b36b-46ac-bc00-7b4386a995a5 tempest-VolumeQuotasAdminTestJSON-712697963 None] Deleted volume successfully. Feb 25 15:56:11 devstack cinder-volume[83528]: DEBUG cinder.coordination [None req-0512ef8b-b36b-46ac-bc00-7b4386a995a5 tempest-VolumeQuotasAdminTestJSON-712697963 None] Lock "cinder-9ff97426-a344-449d-a312-b4f8f498e75c-delete_volume" released by "delete_volume" :: held 2.240s {{(pid=83528) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 25 15:56:12 devstack cinder-volume[83528]: DEBUG cinder.volume.flows.manager.create_volume [None req-2316e9f6-c225-45c0-898c-bbbe1f74d4b9 tempest-VolumeQuotasAdminTestJSON-712697963 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83528) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 25 15:56:12 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-2316e9f6-c225-45c0-898c-bbbe1f74d4b9 tempest-VolumeQuotasAdminTestJSON-712697963 None] Flow 'volume_create_manager' (966f7883-75a2-4ab8-a182-54ae660ec8ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83528) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 25 15:56:12 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-2316e9f6-c225-45c0-898c-bbbe1f74d4b9 tempest-VolumeQuotasAdminTestJSON-712697963 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (713a062d-32fb-402f-a8d8-b3596a4b562d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 25 15:56:12 devstack cinder-volume[83528]: DEBUG cinder.coordination [None req-b258ac01-16aa-466e-8c70-2292edf892e1 tempest-VolumesActionsTest-1068253837 None] Acquiring lock "cinder-cece5774-b8f9-4ac9-af95-452ea32b25b6-delete_volume" by "delete_volume" {{(pid=83528) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 25 15:56:12 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-2316e9f6-c225-45c0-898c-bbbe1f74d4b9 tempest-VolumeQuotasAdminTestJSON-712697963 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (713a062d-32fb-402f-a8d8-b3596a4b562d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-25T14:56:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-830739440',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=791b0d52-019e-4bc6-88b0-c96c0716f22a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2d6b72b20e4c4b94aed6f5899d95911f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-25T14:56:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-25T14:56:12Z,use_quota=True,user_id='71b064175e9a41b4bd7caa31d2e67e3d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ce71c2f9-6543-4165-9653-a1529b2ea243),volume_type_id=ce71c2f9-6543-4165-9653-a1529b2ea243)' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 25 15:56:12 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-2316e9f6-c225-45c0-898c-bbbe1f74d4b9 tempest-VolumeQuotasAdminTestJSON-712697963 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5d4b3afe-527b-4714-8d9c-ee6bbc3b31ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 25 15:56:12 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-2316e9f6-c225-45c0-898c-bbbe1f74d4b9 tempest-VolumeQuotasAdminTestJSON-712697963 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5d4b3afe-527b-4714-8d9c-ee6bbc3b31ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 25 15:56:12 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-2316e9f6-c225-45c0-898c-bbbe1f74d4b9 tempest-VolumeQuotasAdminTestJSON-712697963 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (87fdcf24-a642-442c-872b-c81bb950cde2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 25 15:56:12 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-2316e9f6-c225-45c0-898c-bbbe1f74d4b9 tempest-VolumeQuotasAdminTestJSON-712697963 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (87fdcf24-a642-442c-872b-c81bb950cde2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '791b0d52-019e-4bc6-88b0-c96c0716f22a', 'volume_name': 'volume-791b0d52-019e-4bc6-88b0-c96c0716f22a', 'volume_size': 1}' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 25 15:56:12 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-2316e9f6-c225-45c0-898c-bbbe1f74d4b9 tempest-VolumeQuotasAdminTestJSON-712697963 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (25148370-9b94-4cc9-9a34-83d768895cc3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 25 15:56:12 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-2316e9f6-c225-45c0-898c-bbbe1f74d4b9 tempest-VolumeQuotasAdminTestJSON-712697963 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (25148370-9b94-4cc9-9a34-83d768895cc3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 25 15:56:12 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-2316e9f6-c225-45c0-898c-bbbe1f74d4b9 tempest-VolumeQuotasAdminTestJSON-712697963 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (926b45e1-a929-4b33-a5bc-274b4323048d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 25 15:56:12 devstack cinder-volume[83528]: INFO cinder.volume.flows.manager.create_volume [None req-2316e9f6-c225-45c0-898c-bbbe1f74d4b9 tempest-VolumeQuotasAdminTestJSON-712697963 None] Volume 791b0d52-019e-4bc6-88b0-c96c0716f22a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-791b0d52-019e-4bc6-88b0-c96c0716f22a', 'volume_size': 1} Feb 25 15:56:12 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-2316e9f6-c225-45c0-898c-bbbe1f74d4b9 tempest-VolumeQuotasAdminTestJSON-712697963 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 25 15:56:12 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-2316e9f6-c225-45c0-898c-bbbe1f74d4b9 tempest-VolumeQuotasAdminTestJSON-712697963 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 25 15:56:12 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.quobyte [None req-2316e9f6-c225-45c0-898c-bbbe1f74d4b9 tempest-VolumeQuotasAdminTestJSON-712697963 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-25T14:56:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-830739440',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=791b0d52-019e-4bc6-88b0-c96c0716f22a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2d6b72b20e4c4b94aed6f5899d95911f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-25T14:56:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-25T14:56:12Z,use_quota=True,user_id='71b064175e9a41b4bd7caa31d2e67e3d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ce71c2f9-6543-4165-9653-a1529b2ea243),volume_type_id=ce71c2f9-6543-4165-9653-a1529b2ea243)}" {{(pid=83528) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 25 15:56:12 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.remotefs [None req-2316e9f6-c225-45c0-898c-bbbe1f74d4b9 tempest-VolumeQuotasAdminTestJSON-712697963 None] Creating volume 791b0d52-019e-4bc6-88b0-c96c0716f22a {{(pid=83528) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 25 15:56:12 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-2316e9f6-c225-45c0-898c-bbbe1f74d4b9 tempest-VolumeQuotasAdminTestJSON-712697963 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 25 15:56:12 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-2316e9f6-c225-45c0-898c-bbbe1f74d4b9 tempest-VolumeQuotasAdminTestJSON-712697963 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 25 15:56:12 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.quobyte [None req-2316e9f6-c225-45c0-898c-bbbe1f74d4b9 tempest-VolumeQuotasAdminTestJSON-712697963 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23e9d725-3e04-4cd9-bfe0-c8ef43305589': None} {{(pid=83528) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 25 15:56:12 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.quobyte [None req-2316e9f6-c225-45c0-898c-bbbe1f74d4b9 tempest-VolumeQuotasAdminTestJSON-712697963 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23e9d725-3e04-4cd9-bfe0-c8ef43305589'] {{(pid=83528) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 25 15:56:12 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-2316e9f6-c225-45c0-898c-bbbe1f74d4b9 tempest-VolumeQuotasAdminTestJSON-712697963 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 25 15:56:12 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.quobyte [None req-2316e9f6-c225-45c0-898c-bbbe1f74d4b9 tempest-VolumeQuotasAdminTestJSON-712697963 None] Selected osci02.corp.quobyte.com/cinder-vol-23e9d725-3e04-4cd9-bfe0-c8ef43305589 as target Quobyte volume. {{(pid=83528) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 25 15:56:12 devstack cinder-volume[83528]: INFO cinder.volume.drivers.remotefs [None req-2316e9f6-c225-45c0-898c-bbbe1f74d4b9 tempest-VolumeQuotasAdminTestJSON-712697963 None] casted to osci02.corp.quobyte.com/cinder-vol-23e9d725-3e04-4cd9-bfe0-c8ef43305589 Feb 25 15:56:12 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-2316e9f6-c225-45c0-898c-bbbe1f74d4b9 tempest-VolumeQuotasAdminTestJSON-712697963 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-791b0d52-019e-4bc6-88b0-c96c0716f22a 1073741824 {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 25 15:56:12 devstack cinder-volume[83528]: DEBUG cinder.coordination [None req-b258ac01-16aa-466e-8c70-2292edf892e1 tempest-VolumesActionsTest-1068253837 None] Lock "cinder-cece5774-b8f9-4ac9-af95-452ea32b25b6-delete_volume" acquired by "delete_volume" :: waited 0.070s {{(pid=83528) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 25 15:56:12 devstack sudo[87725]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-791b0d52-019e-4bc6-88b0-c96c0716f22a 1073741824 Feb 25 15:56:12 devstack cinder-volume[83528]: DEBUG dbcounter [-] [83528] Writing DB stats cinder:UPDATE=214,cinder:SELECT=167,cinder:INSERT=48,cinder:DELETE=15 {{(pid=83528) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Feb 25 15:56:12 devstack sudo[87725]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 25 15:56:12 devstack cinder-volume[83528]: DEBUG dbcounter [-] [83528] Writing DB stats cinder:SELECT=183,cinder:DELETE=14,cinder:UPDATE=202,cinder:INSERT=47 {{(pid=83528) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Feb 25 15:56:12 devstack cinder-volume[83528]: DEBUG cinder.coordination [None req-b258ac01-16aa-466e-8c70-2292edf892e1 tempest-VolumesActionsTest-1068253837 None] Acquiring lock "cinder-quobyte-cece5774-b8f9-4ac9-af95-452ea32b25b6" by "delete_volume" {{(pid=83528) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 25 15:56:12 devstack cinder-volume[83528]: DEBUG cinder.coordination [None req-b258ac01-16aa-466e-8c70-2292edf892e1 tempest-VolumesActionsTest-1068253837 None] Lock "cinder-quobyte-cece5774-b8f9-4ac9-af95-452ea32b25b6" acquired by "delete_volume" :: waited 0.010s {{(pid=83528) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 25 15:56:12 devstack cinder-volume[83528]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba23a5d9-ebfe-45e4-ab96-e668fcb3e329]: (4, 'qcow2') {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 25 15:56:12 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-b258ac01-16aa-466e-8c70-2292edf892e1 tempest-VolumesActionsTest-1068253837 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-cece5774-b8f9-4ac9-af95-452ea32b25b6 {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 25 15:56:12 devstack sudo[87727]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-cece5774-b8f9-4ac9-af95-452ea32b25b6 Feb 25 15:56:12 devstack sudo[87727]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 25 15:56:13 devstack sudo[87725]: pam_unix(sudo:session): session closed for user root Feb 25 15:56:13 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-2316e9f6-c225-45c0-898c-bbbe1f74d4b9 tempest-VolumeQuotasAdminTestJSON-712697963 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-791b0d52-019e-4bc6-88b0-c96c0716f22a 1073741824" returned: 0 in 0.720s {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 25 15:56:13 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-2316e9f6-c225-45c0-898c-bbbe1f74d4b9 tempest-VolumeQuotasAdminTestJSON-712697963 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-791b0d52-019e-4bc6-88b0-c96c0716f22a {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 25 15:56:13 devstack sudo[87741]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-791b0d52-019e-4bc6-88b0-c96c0716f22a Feb 25 15:56:13 devstack sudo[87741]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 25 15:56:13 devstack sudo[87727]: pam_unix(sudo:session): session closed for user root Feb 25 15:56:13 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-b258ac01-16aa-466e-8c70-2292edf892e1 tempest-VolumesActionsTest-1068253837 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-cece5774-b8f9-4ac9-af95-452ea32b25b6" returned: 0 in 0.686s {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 25 15:56:13 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-b258ac01-16aa-466e-8c70-2292edf892e1 tempest-VolumesActionsTest-1068253837 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-cece5774-b8f9-4ac9-af95-452ea32b25b6 {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 25 15:56:13 devstack sudo[87743]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-cece5774-b8f9-4ac9-af95-452ea32b25b6 Feb 25 15:56:13 devstack sudo[87743]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 25 15:56:13 devstack sudo[87741]: pam_unix(sudo:session): session closed for user root Feb 25 15:56:13 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-2316e9f6-c225-45c0-898c-bbbe1f74d4b9 tempest-VolumeQuotasAdminTestJSON-712697963 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-791b0d52-019e-4bc6-88b0-c96c0716f22a" returned: 0 in 0.552s {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 25 15:56:13 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.quobyte [None req-2316e9f6-c225-45c0-898c-bbbe1f74d4b9 tempest-VolumeQuotasAdminTestJSON-712697963 None] <== create_volume: return (1307ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-23e9d725-3e04-4cd9-bfe0-c8ef43305589'} {{(pid=83528) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 25 15:56:13 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-2316e9f6-c225-45c0-898c-bbbe1f74d4b9 tempest-VolumeQuotasAdminTestJSON-712697963 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.310s {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 25 15:56:13 devstack sudo[87743]: pam_unix(sudo:session): session closed for user root Feb 25 15:56:13 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-2316e9f6-c225-45c0-898c-bbbe1f74d4b9 tempest-VolumeQuotasAdminTestJSON-712697963 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (926b45e1-a929-4b33-a5bc-274b4323048d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-791b0d52-019e-4bc6-88b0-c96c0716f22a', 'volume_size': 1}' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 25 15:56:13 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-2316e9f6-c225-45c0-898c-bbbe1f74d4b9 tempest-VolumeQuotasAdminTestJSON-712697963 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (14f45926-5fbb-4420-ab7f-30a08fbf0fc3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 25 15:56:13 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-b258ac01-16aa-466e-8c70-2292edf892e1 tempest-VolumesActionsTest-1068253837 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-cece5774-b8f9-4ac9-af95-452ea32b25b6" returned: 0 in 0.531s {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 25 15:56:13 devstack cinder-volume[83528]: DEBUG cinder.coordination [None req-b258ac01-16aa-466e-8c70-2292edf892e1 tempest-VolumesActionsTest-1068253837 None] Lock "cinder-quobyte-cece5774-b8f9-4ac9-af95-452ea32b25b6" released by "delete_volume" :: held 1.245s {{(pid=83528) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 25 15:56:13 devstack cinder-volume[83528]: INFO cinder.volume.flows.manager.create_volume [None req-2316e9f6-c225-45c0-898c-bbbe1f74d4b9 tempest-VolumeQuotasAdminTestJSON-712697963 None] Volume volume-791b0d52-019e-4bc6-88b0-c96c0716f22a (791b0d52-019e-4bc6-88b0-c96c0716f22a): created successfully Feb 25 15:56:13 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-2316e9f6-c225-45c0-898c-bbbe1f74d4b9 tempest-VolumeQuotasAdminTestJSON-712697963 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (14f45926-5fbb-4420-ab7f-30a08fbf0fc3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 25 15:56:13 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-2316e9f6-c225-45c0-898c-bbbe1f74d4b9 tempest-VolumeQuotasAdminTestJSON-712697963 None] Flow 'volume_create_manager' (966f7883-75a2-4ab8-a182-54ae660ec8ea) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83528) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 25 15:56:13 devstack cinder-volume[83528]: INFO cinder.volume.manager [None req-2316e9f6-c225-45c0-898c-bbbe1f74d4b9 tempest-VolumeQuotasAdminTestJSON-712697963 None] Created volume successfully. Feb 25 15:56:13 devstack cinder-volume[83528]: DEBUG cinder.quota [None req-b258ac01-16aa-466e-8c70-2292edf892e1 tempest-VolumesActionsTest-1068253837 None] Created reservations ['23d9769f-86b1-4573-84ef-728073f622a8', '782a86ac-8d71-482f-9a19-4d7272d10247', 'e7851e5c-e95b-4d43-92c9-6fef00f75daa', 'a6055325-9b0f-4a48-ab95-c4d856c7fe67'] {{(pid=83528) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 25 15:56:13 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-b258ac01-16aa-466e-8c70-2292edf892e1 tempest-VolumesActionsTest-1068253837 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 25 15:56:13 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-b258ac01-16aa-466e-8c70-2292edf892e1 tempest-VolumesActionsTest-1068253837 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 25 15:56:13 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.quobyte [None req-b258ac01-16aa-466e-8c70-2292edf892e1 tempest-VolumesActionsTest-1068253837 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23e9d725-3e04-4cd9-bfe0-c8ef43305589': None} {{(pid=83528) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 25 15:56:13 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.quobyte [None req-b258ac01-16aa-466e-8c70-2292edf892e1 tempest-VolumesActionsTest-1068253837 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23e9d725-3e04-4cd9-bfe0-c8ef43305589'] {{(pid=83528) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 25 15:56:13 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-b258ac01-16aa-466e-8c70-2292edf892e1 tempest-VolumesActionsTest-1068253837 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 25 15:56:13 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-b258ac01-16aa-466e-8c70-2292edf892e1 tempest-VolumesActionsTest-1068253837 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85 {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 25 15:56:14 devstack sudo[87747]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85 Feb 25 15:56:14 devstack sudo[87747]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 25 15:56:14 devstack sudo[87747]: pam_unix(sudo:session): session closed for user root Feb 25 15:56:14 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-b258ac01-16aa-466e-8c70-2292edf892e1 tempest-VolumesActionsTest-1068253837 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85" returned: 0 in 0.509s {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 25 15:56:14 devstack cinder-volume[83528]: DEBUG cinder.manager [None req-b258ac01-16aa-466e-8c70-2292edf892e1 tempest-VolumesActionsTest-1068253837 None] Notifying Schedulers of capabilities ... {{(pid=83528) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 25 15:56:14 devstack cinder-volume[83528]: INFO cinder.volume.manager [None req-b258ac01-16aa-466e-8c70-2292edf892e1 tempest-VolumesActionsTest-1068253837 None] Deleted volume successfully. Feb 25 15:56:14 devstack cinder-volume[83528]: DEBUG cinder.coordination [None req-b258ac01-16aa-466e-8c70-2292edf892e1 tempest-VolumesActionsTest-1068253837 None] Lock "cinder-cece5774-b8f9-4ac9-af95-452ea32b25b6-delete_volume" released by "delete_volume" :: held 1.977s {{(pid=83528) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 25 15:56:15 devstack cinder-volume[83528]: DEBUG cinder.volume.flows.manager.create_volume [None req-c3917914-0fd0-47ad-9af4-0a455621216e tempest-VolumesActionsTest-872240335 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83528) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 25 15:56:15 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-c3917914-0fd0-47ad-9af4-0a455621216e tempest-VolumesActionsTest-872240335 None] Flow 'volume_create_manager' (d2ce944d-7f15-41fb-94ec-d8db3c623ced) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83528) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 25 15:56:15 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-c3917914-0fd0-47ad-9af4-0a455621216e tempest-VolumesActionsTest-872240335 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5095daf5-3e06-40b3-a14a-0bcdc7b64413) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 25 15:56:15 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-c3917914-0fd0-47ad-9af4-0a455621216e tempest-VolumesActionsTest-872240335 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5095daf5-3e06-40b3-a14a-0bcdc7b64413) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-25T14:56:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-15568179',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ea5df267-6d8c-4870-b52e-5a1cc315ebe5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='da136677879e424b82ce0c4ab6e11f76',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-25T14:56:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-25T14:56:15Z,use_quota=True,user_id='8b2df249d4dc442f91f55f39a5a775f4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ce71c2f9-6543-4165-9653-a1529b2ea243),volume_type_id=ce71c2f9-6543-4165-9653-a1529b2ea243)' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 25 15:56:15 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-c3917914-0fd0-47ad-9af4-0a455621216e tempest-VolumesActionsTest-872240335 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a3b99c20-d2d6-4718-99b2-39ffcacbe4a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 25 15:56:15 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-c3917914-0fd0-47ad-9af4-0a455621216e tempest-VolumesActionsTest-872240335 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a3b99c20-d2d6-4718-99b2-39ffcacbe4a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 25 15:56:15 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-c3917914-0fd0-47ad-9af4-0a455621216e tempest-VolumesActionsTest-872240335 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b138b78f-c126-433a-8d8e-baf363f7b6f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 25 15:56:15 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-c3917914-0fd0-47ad-9af4-0a455621216e tempest-VolumesActionsTest-872240335 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b138b78f-c126-433a-8d8e-baf363f7b6f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ea5df267-6d8c-4870-b52e-5a1cc315ebe5', 'volume_name': 'volume-ea5df267-6d8c-4870-b52e-5a1cc315ebe5', 'volume_size': 1}' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 25 15:56:15 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-c3917914-0fd0-47ad-9af4-0a455621216e tempest-VolumesActionsTest-872240335 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bcb4367c-d183-462b-bd1c-1bb6eeb372f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 25 15:56:15 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-c3917914-0fd0-47ad-9af4-0a455621216e tempest-VolumesActionsTest-872240335 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bcb4367c-d183-462b-bd1c-1bb6eeb372f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 25 15:56:15 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-c3917914-0fd0-47ad-9af4-0a455621216e tempest-VolumesActionsTest-872240335 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (72ff0aca-4ccc-42bc-b608-ae94e9ecd587) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 25 15:56:15 devstack cinder-volume[83528]: INFO cinder.volume.flows.manager.create_volume [None req-c3917914-0fd0-47ad-9af4-0a455621216e tempest-VolumesActionsTest-872240335 None] Volume ea5df267-6d8c-4870-b52e-5a1cc315ebe5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ea5df267-6d8c-4870-b52e-5a1cc315ebe5', 'volume_size': 1} Feb 25 15:56:15 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-c3917914-0fd0-47ad-9af4-0a455621216e tempest-VolumesActionsTest-872240335 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 25 15:56:15 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-c3917914-0fd0-47ad-9af4-0a455621216e tempest-VolumesActionsTest-872240335 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 25 15:56:15 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.quobyte [None req-c3917914-0fd0-47ad-9af4-0a455621216e tempest-VolumesActionsTest-872240335 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-25T14:56:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-15568179',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ea5df267-6d8c-4870-b52e-5a1cc315ebe5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='da136677879e424b82ce0c4ab6e11f76',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-25T14:56:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-25T14:56:15Z,use_quota=True,user_id='8b2df249d4dc442f91f55f39a5a775f4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ce71c2f9-6543-4165-9653-a1529b2ea243),volume_type_id=ce71c2f9-6543-4165-9653-a1529b2ea243)}" {{(pid=83528) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 25 15:56:15 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.remotefs [None req-c3917914-0fd0-47ad-9af4-0a455621216e tempest-VolumesActionsTest-872240335 None] Creating volume ea5df267-6d8c-4870-b52e-5a1cc315ebe5 {{(pid=83528) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 25 15:56:15 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-c3917914-0fd0-47ad-9af4-0a455621216e tempest-VolumesActionsTest-872240335 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 25 15:56:15 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-c3917914-0fd0-47ad-9af4-0a455621216e tempest-VolumesActionsTest-872240335 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 25 15:56:15 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.quobyte [None req-c3917914-0fd0-47ad-9af4-0a455621216e tempest-VolumesActionsTest-872240335 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23e9d725-3e04-4cd9-bfe0-c8ef43305589': None} {{(pid=83528) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 25 15:56:15 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.quobyte [None req-c3917914-0fd0-47ad-9af4-0a455621216e tempest-VolumesActionsTest-872240335 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23e9d725-3e04-4cd9-bfe0-c8ef43305589'] {{(pid=83528) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 25 15:56:15 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-c3917914-0fd0-47ad-9af4-0a455621216e tempest-VolumesActionsTest-872240335 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 25 15:56:15 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.quobyte [None req-c3917914-0fd0-47ad-9af4-0a455621216e tempest-VolumesActionsTest-872240335 None] Selected osci02.corp.quobyte.com/cinder-vol-23e9d725-3e04-4cd9-bfe0-c8ef43305589 as target Quobyte volume. {{(pid=83528) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 25 15:56:15 devstack cinder-volume[83528]: INFO cinder.volume.drivers.remotefs [None req-c3917914-0fd0-47ad-9af4-0a455621216e tempest-VolumesActionsTest-872240335 None] casted to osci02.corp.quobyte.com/cinder-vol-23e9d725-3e04-4cd9-bfe0-c8ef43305589 Feb 25 15:56:15 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-c3917914-0fd0-47ad-9af4-0a455621216e tempest-VolumesActionsTest-872240335 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-ea5df267-6d8c-4870-b52e-5a1cc315ebe5 1073741824 {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 25 15:56:15 devstack sudo[87751]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-ea5df267-6d8c-4870-b52e-5a1cc315ebe5 1073741824 Feb 25 15:56:15 devstack sudo[87751]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 25 15:56:15 devstack cinder-volume[83528]: INFO cinder.volume.manager [None req-46fdb1c2-91c0-4ea4-8963-748fd514ad51 tempest-VolumeQuotasAdminTestJSON-1826326540 None] Transfer volume completed successfully. Feb 25 15:56:15 devstack sudo[87751]: pam_unix(sudo:session): session closed for user root Feb 25 15:56:15 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-c3917914-0fd0-47ad-9af4-0a455621216e tempest-VolumesActionsTest-872240335 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-ea5df267-6d8c-4870-b52e-5a1cc315ebe5 1073741824" returned: 0 in 0.614s {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 25 15:56:15 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-c3917914-0fd0-47ad-9af4-0a455621216e tempest-VolumesActionsTest-872240335 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-ea5df267-6d8c-4870-b52e-5a1cc315ebe5 {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 25 15:56:15 devstack sudo[87756]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-ea5df267-6d8c-4870-b52e-5a1cc315ebe5 Feb 25 15:56:15 devstack sudo[87756]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 25 15:56:15 devstack cinder-volume[83528]: DEBUG cinder.volume.flows.manager.create_volume [None req-3ae05178-0d7b-4711-ab74-1c1e7d73c32c tempest-VolumesCloneTest-1068722893 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83528) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 25 15:56:15 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-3ae05178-0d7b-4711-ab74-1c1e7d73c32c tempest-VolumesCloneTest-1068722893 None] Flow 'volume_create_manager' (43f1f32d-bd34-4840-89ed-f304e9e0f94f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83528) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 25 15:56:15 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-3ae05178-0d7b-4711-ab74-1c1e7d73c32c tempest-VolumesCloneTest-1068722893 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fb3662e4-2e29-4093-a75d-ccbe73620d6f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 25 15:56:15 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-3ae05178-0d7b-4711-ab74-1c1e7d73c32c tempest-VolumesCloneTest-1068722893 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fb3662e4-2e29-4093-a75d-ccbe73620d6f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-25T14:56:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-2053957456',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2e5e9fe7-2922-4406-b8b8-56fcd71b9dfd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5d89a2670aa1436b892bab17bb33a341',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-25T14:56:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-25T14:56:16Z,use_quota=True,user_id='d32f4fcdd6954a7182059dbbee4e1336',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ce71c2f9-6543-4165-9653-a1529b2ea243),volume_type_id=ce71c2f9-6543-4165-9653-a1529b2ea243)' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 25 15:56:15 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-3ae05178-0d7b-4711-ab74-1c1e7d73c32c tempest-VolumesCloneTest-1068722893 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (77143a5b-63f8-48ce-8fe1-6a0142562ff0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 25 15:56:15 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-3ae05178-0d7b-4711-ab74-1c1e7d73c32c tempest-VolumesCloneTest-1068722893 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (77143a5b-63f8-48ce-8fe1-6a0142562ff0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 25 15:56:15 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-3ae05178-0d7b-4711-ab74-1c1e7d73c32c tempest-VolumesCloneTest-1068722893 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0f1a28b5-acf0-45b1-851b-dbd8c19c655d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 25 15:56:15 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-3ae05178-0d7b-4711-ab74-1c1e7d73c32c tempest-VolumesCloneTest-1068722893 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0f1a28b5-acf0-45b1-851b-dbd8c19c655d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2e5e9fe7-2922-4406-b8b8-56fcd71b9dfd', 'volume_name': 'volume-2e5e9fe7-2922-4406-b8b8-56fcd71b9dfd', 'volume_size': 1}' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 25 15:56:15 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-3ae05178-0d7b-4711-ab74-1c1e7d73c32c tempest-VolumesCloneTest-1068722893 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4782dedd-7f1c-4741-ad77-4157f44fbdad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 25 15:56:15 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-3ae05178-0d7b-4711-ab74-1c1e7d73c32c tempest-VolumesCloneTest-1068722893 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4782dedd-7f1c-4741-ad77-4157f44fbdad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 25 15:56:15 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-3ae05178-0d7b-4711-ab74-1c1e7d73c32c tempest-VolumesCloneTest-1068722893 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (40edefdf-5765-4d46-9ecf-51f53b6abba5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 25 15:56:15 devstack cinder-volume[83528]: INFO cinder.volume.flows.manager.create_volume [None req-3ae05178-0d7b-4711-ab74-1c1e7d73c32c tempest-VolumesCloneTest-1068722893 None] Volume 2e5e9fe7-2922-4406-b8b8-56fcd71b9dfd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2e5e9fe7-2922-4406-b8b8-56fcd71b9dfd', 'volume_size': 1} Feb 25 15:56:15 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-3ae05178-0d7b-4711-ab74-1c1e7d73c32c tempest-VolumesCloneTest-1068722893 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 25 15:56:16 devstack sudo[87756]: pam_unix(sudo:session): session closed for user root Feb 25 15:56:16 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-c3917914-0fd0-47ad-9af4-0a455621216e tempest-VolumesActionsTest-872240335 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-ea5df267-6d8c-4870-b52e-5a1cc315ebe5" returned: 0 in 0.484s {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 25 15:56:16 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.quobyte [None req-c3917914-0fd0-47ad-9af4-0a455621216e tempest-VolumesActionsTest-872240335 None] <== create_volume: return (1124ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-23e9d725-3e04-4cd9-bfe0-c8ef43305589'} {{(pid=83528) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 25 15:56:16 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-c3917914-0fd0-47ad-9af4-0a455621216e tempest-VolumesActionsTest-872240335 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.126s {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 25 15:56:16 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-3ae05178-0d7b-4711-ab74-1c1e7d73c32c tempest-VolumesCloneTest-1068722893 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.271s {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 25 15:56:16 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.quobyte [None req-3ae05178-0d7b-4711-ab74-1c1e7d73c32c tempest-VolumesCloneTest-1068722893 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-25T14:56:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-2053957456',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2e5e9fe7-2922-4406-b8b8-56fcd71b9dfd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5d89a2670aa1436b892bab17bb33a341',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-25T14:56:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-25T14:56:16Z,use_quota=True,user_id='d32f4fcdd6954a7182059dbbee4e1336',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ce71c2f9-6543-4165-9653-a1529b2ea243),volume_type_id=ce71c2f9-6543-4165-9653-a1529b2ea243)}" {{(pid=83528) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 25 15:56:16 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.remotefs [None req-3ae05178-0d7b-4711-ab74-1c1e7d73c32c tempest-VolumesCloneTest-1068722893 None] Creating volume 2e5e9fe7-2922-4406-b8b8-56fcd71b9dfd {{(pid=83528) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 25 15:56:16 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-3ae05178-0d7b-4711-ab74-1c1e7d73c32c tempest-VolumesCloneTest-1068722893 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 25 15:56:16 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-3ae05178-0d7b-4711-ab74-1c1e7d73c32c tempest-VolumesCloneTest-1068722893 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 25 15:56:16 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.quobyte [None req-3ae05178-0d7b-4711-ab74-1c1e7d73c32c tempest-VolumesCloneTest-1068722893 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23e9d725-3e04-4cd9-bfe0-c8ef43305589': None} {{(pid=83528) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 25 15:56:16 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.quobyte [None req-3ae05178-0d7b-4711-ab74-1c1e7d73c32c tempest-VolumesCloneTest-1068722893 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23e9d725-3e04-4cd9-bfe0-c8ef43305589'] {{(pid=83528) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 25 15:56:16 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-3ae05178-0d7b-4711-ab74-1c1e7d73c32c tempest-VolumesCloneTest-1068722893 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 25 15:56:16 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.quobyte [None req-3ae05178-0d7b-4711-ab74-1c1e7d73c32c tempest-VolumesCloneTest-1068722893 None] Selected osci02.corp.quobyte.com/cinder-vol-23e9d725-3e04-4cd9-bfe0-c8ef43305589 as target Quobyte volume. {{(pid=83528) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 25 15:56:16 devstack cinder-volume[83528]: INFO cinder.volume.drivers.remotefs [None req-3ae05178-0d7b-4711-ab74-1c1e7d73c32c tempest-VolumesCloneTest-1068722893 None] casted to osci02.corp.quobyte.com/cinder-vol-23e9d725-3e04-4cd9-bfe0-c8ef43305589 Feb 25 15:56:16 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-3ae05178-0d7b-4711-ab74-1c1e7d73c32c tempest-VolumesCloneTest-1068722893 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-2e5e9fe7-2922-4406-b8b8-56fcd71b9dfd 1073741824 {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 25 15:56:16 devstack sudo[87759]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-2e5e9fe7-2922-4406-b8b8-56fcd71b9dfd 1073741824 Feb 25 15:56:16 devstack sudo[87759]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 25 15:56:16 devstack cinder-volume[83528]: DEBUG cinder.coordination [None req-2e721060-1d39-43b2-b6ea-4acddde6a4bf tempest-VolumeQuotasAdminTestJSON-1603945634 None] Acquiring lock "cinder-791b0d52-019e-4bc6-88b0-c96c0716f22a-delete_volume" by "delete_volume" {{(pid=83528) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 25 15:56:16 devstack cinder-volume[83528]: DEBUG cinder.coordination [None req-2e721060-1d39-43b2-b6ea-4acddde6a4bf tempest-VolumeQuotasAdminTestJSON-1603945634 None] Lock "cinder-791b0d52-019e-4bc6-88b0-c96c0716f22a-delete_volume" acquired by "delete_volume" :: waited 0.009s {{(pid=83528) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 25 15:56:16 devstack sudo[87759]: pam_unix(sudo:session): session closed for user root Feb 25 15:56:16 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-3ae05178-0d7b-4711-ab74-1c1e7d73c32c tempest-VolumesCloneTest-1068722893 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-2e5e9fe7-2922-4406-b8b8-56fcd71b9dfd 1073741824" returned: 0 in 0.454s {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 25 15:56:16 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-c3917914-0fd0-47ad-9af4-0a455621216e tempest-VolumesActionsTest-872240335 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (72ff0aca-4ccc-42bc-b608-ae94e9ecd587) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ea5df267-6d8c-4870-b52e-5a1cc315ebe5', 'volume_size': 1}' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 25 15:56:16 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-c3917914-0fd0-47ad-9af4-0a455621216e tempest-VolumesActionsTest-872240335 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (913cfb39-27e6-4680-86fd-eb522912c218) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 25 15:56:19 devstack cinder-volume[83528]: INFO cinder.volume.flows.manager.create_volume [None req-c3917914-0fd0-47ad-9af4-0a455621216e tempest-VolumesActionsTest-872240335 None] Volume volume-ea5df267-6d8c-4870-b52e-5a1cc315ebe5 (ea5df267-6d8c-4870-b52e-5a1cc315ebe5): created successfully Feb 25 15:56:19 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-c3917914-0fd0-47ad-9af4-0a455621216e tempest-VolumesActionsTest-872240335 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (913cfb39-27e6-4680-86fd-eb522912c218) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 25 15:56:19 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-c3917914-0fd0-47ad-9af4-0a455621216e tempest-VolumesActionsTest-872240335 None] Flow 'volume_create_manager' (d2ce944d-7f15-41fb-94ec-d8db3c623ced) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83528) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 25 15:56:19 devstack cinder-volume[83528]: DEBUG cinder.coordination [None req-2e721060-1d39-43b2-b6ea-4acddde6a4bf tempest-VolumeQuotasAdminTestJSON-1603945634 None] Acquiring lock "cinder-quobyte-791b0d52-019e-4bc6-88b0-c96c0716f22a" by "delete_volume" {{(pid=83528) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 25 15:56:19 devstack cinder-volume[83528]: DEBUG cinder.coordination [None req-2e721060-1d39-43b2-b6ea-4acddde6a4bf tempest-VolumeQuotasAdminTestJSON-1603945634 None] Lock "cinder-quobyte-791b0d52-019e-4bc6-88b0-c96c0716f22a" acquired by "delete_volume" :: waited 0.006s {{(pid=83528) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 25 15:56:19 devstack cinder-volume[83528]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed813eb0-3d49-4ceb-b375-3756810ff1fc]: (4, 'qcow2') {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 25 15:56:19 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-2e721060-1d39-43b2-b6ea-4acddde6a4bf tempest-VolumeQuotasAdminTestJSON-1603945634 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-791b0d52-019e-4bc6-88b0-c96c0716f22a {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 25 15:56:19 devstack sudo[87764]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-791b0d52-019e-4bc6-88b0-c96c0716f22a Feb 25 15:56:19 devstack sudo[87764]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 25 15:56:20 devstack sudo[87764]: pam_unix(sudo:session): session closed for user root Feb 25 15:56:20 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-2e721060-1d39-43b2-b6ea-4acddde6a4bf tempest-VolumeQuotasAdminTestJSON-1603945634 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-791b0d52-019e-4bc6-88b0-c96c0716f22a" returned: 0 in 0.458s {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 25 15:56:20 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-2e721060-1d39-43b2-b6ea-4acddde6a4bf tempest-VolumeQuotasAdminTestJSON-1603945634 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-791b0d52-019e-4bc6-88b0-c96c0716f22a {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 25 15:56:20 devstack sudo[87769]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-791b0d52-019e-4bc6-88b0-c96c0716f22a Feb 25 15:56:20 devstack sudo[87769]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 25 15:56:20 devstack sudo[87769]: pam_unix(sudo:session): session closed for user root Feb 25 15:56:20 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-2e721060-1d39-43b2-b6ea-4acddde6a4bf tempest-VolumeQuotasAdminTestJSON-1603945634 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-791b0d52-019e-4bc6-88b0-c96c0716f22a" returned: 0 in 0.385s {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 25 15:56:20 devstack cinder-volume[83528]: DEBUG cinder.coordination [None req-2e721060-1d39-43b2-b6ea-4acddde6a4bf tempest-VolumeQuotasAdminTestJSON-1603945634 None] Lock "cinder-quobyte-791b0d52-019e-4bc6-88b0-c96c0716f22a" released by "delete_volume" :: held 0.864s {{(pid=83528) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 25 15:56:20 devstack cinder-volume[83528]: INFO cinder.volume.manager [None req-c3917914-0fd0-47ad-9af4-0a455621216e tempest-VolumesActionsTest-872240335 None] Created volume successfully. Feb 25 15:56:20 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-3ae05178-0d7b-4711-ab74-1c1e7d73c32c tempest-VolumesCloneTest-1068722893 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-2e5e9fe7-2922-4406-b8b8-56fcd71b9dfd {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 25 15:56:20 devstack sudo[87772]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-2e5e9fe7-2922-4406-b8b8-56fcd71b9dfd Feb 25 15:56:20 devstack sudo[87772]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 25 15:56:20 devstack cinder-volume[83528]: DEBUG cinder.quota [None req-2e721060-1d39-43b2-b6ea-4acddde6a4bf tempest-VolumeQuotasAdminTestJSON-1603945634 None] Created reservations ['9e426ec0-9b19-4589-b744-44a4854d77fe', '6536bbf3-1e46-4b31-8f35-66c7305443f4', 'e2bc8c99-6678-4b50-b74a-eefd84122ac3', '4bc84b87-cfd7-43c5-8e3a-15c62d843dbe'] {{(pid=83528) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 25 15:56:20 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-2e721060-1d39-43b2-b6ea-4acddde6a4bf tempest-VolumeQuotasAdminTestJSON-1603945634 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 25 15:56:20 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-2e721060-1d39-43b2-b6ea-4acddde6a4bf tempest-VolumeQuotasAdminTestJSON-1603945634 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 25 15:56:20 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.quobyte [None req-2e721060-1d39-43b2-b6ea-4acddde6a4bf tempest-VolumeQuotasAdminTestJSON-1603945634 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23e9d725-3e04-4cd9-bfe0-c8ef43305589': None} {{(pid=83528) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 25 15:56:20 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.quobyte [None req-2e721060-1d39-43b2-b6ea-4acddde6a4bf tempest-VolumeQuotasAdminTestJSON-1603945634 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23e9d725-3e04-4cd9-bfe0-c8ef43305589'] {{(pid=83528) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 25 15:56:20 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-2e721060-1d39-43b2-b6ea-4acddde6a4bf tempest-VolumeQuotasAdminTestJSON-1603945634 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 25 15:56:20 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-2e721060-1d39-43b2-b6ea-4acddde6a4bf tempest-VolumeQuotasAdminTestJSON-1603945634 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85 {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 25 15:56:20 devstack sudo[87775]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85 Feb 25 15:56:20 devstack sudo[87775]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 25 15:56:20 devstack cinder-volume[83528]: DEBUG cinder.coordination [None req-96ef3677-1933-4317-9361-ebd7bef74dbe tempest-VolumesActionsTest-1068253837 None] Acquiring lock "cinder-ea5df267-6d8c-4870-b52e-5a1cc315ebe5-delete_volume" by "delete_volume" {{(pid=83528) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 25 15:56:20 devstack cinder-volume[83528]: DEBUG cinder.coordination [None req-96ef3677-1933-4317-9361-ebd7bef74dbe tempest-VolumesActionsTest-1068253837 None] Lock "cinder-ea5df267-6d8c-4870-b52e-5a1cc315ebe5-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=83528) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 25 15:56:20 devstack cinder-volume[83528]: DEBUG cinder.coordination [None req-96ef3677-1933-4317-9361-ebd7bef74dbe tempest-VolumesActionsTest-1068253837 None] Acquiring lock "cinder-quobyte-ea5df267-6d8c-4870-b52e-5a1cc315ebe5" by "delete_volume" {{(pid=83528) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 25 15:56:20 devstack cinder-volume[83528]: DEBUG cinder.coordination [None req-96ef3677-1933-4317-9361-ebd7bef74dbe tempest-VolumesActionsTest-1068253837 None] Lock "cinder-quobyte-ea5df267-6d8c-4870-b52e-5a1cc315ebe5" acquired by "delete_volume" :: waited 0.015s {{(pid=83528) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 25 15:56:20 devstack cinder-volume[83528]: DEBUG oslo.privsep.daemon [-] privsep: reply[250d089e-61a1-4e9c-afda-b3c094c030a6]: (4, 'qcow2') {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 25 15:56:20 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-96ef3677-1933-4317-9361-ebd7bef74dbe tempest-VolumesActionsTest-1068253837 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-ea5df267-6d8c-4870-b52e-5a1cc315ebe5 {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 25 15:56:21 devstack sudo[87772]: pam_unix(sudo:session): session closed for user root Feb 25 15:56:21 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-3ae05178-0d7b-4711-ab74-1c1e7d73c32c tempest-VolumesCloneTest-1068722893 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-2e5e9fe7-2922-4406-b8b8-56fcd71b9dfd" returned: 0 in 0.593s {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 25 15:56:21 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.quobyte [None req-3ae05178-0d7b-4711-ab74-1c1e7d73c32c tempest-VolumesCloneTest-1068722893 None] <== create_volume: return (4843ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-23e9d725-3e04-4cd9-bfe0-c8ef43305589'} {{(pid=83528) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 25 15:56:21 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-3ae05178-0d7b-4711-ab74-1c1e7d73c32c tempest-VolumesCloneTest-1068722893 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 4.848s {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 25 15:56:21 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-3ae05178-0d7b-4711-ab74-1c1e7d73c32c tempest-VolumesCloneTest-1068722893 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (40edefdf-5765-4d46-9ecf-51f53b6abba5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2e5e9fe7-2922-4406-b8b8-56fcd71b9dfd', 'volume_size': 1}' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 25 15:56:21 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-3ae05178-0d7b-4711-ab74-1c1e7d73c32c tempest-VolumesCloneTest-1068722893 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (13981c28-4a74-4157-a700-ebd3a827e619) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 25 15:56:21 devstack cinder-volume[83528]: INFO cinder.volume.flows.manager.create_volume [None req-3ae05178-0d7b-4711-ab74-1c1e7d73c32c tempest-VolumesCloneTest-1068722893 None] Volume volume-2e5e9fe7-2922-4406-b8b8-56fcd71b9dfd (2e5e9fe7-2922-4406-b8b8-56fcd71b9dfd): created successfully Feb 25 15:56:21 devstack sudo[87778]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-ea5df267-6d8c-4870-b52e-5a1cc315ebe5 Feb 25 15:56:21 devstack sudo[87778]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 25 15:56:21 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-3ae05178-0d7b-4711-ab74-1c1e7d73c32c tempest-VolumesCloneTest-1068722893 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (13981c28-4a74-4157-a700-ebd3a827e619) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 25 15:56:21 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-3ae05178-0d7b-4711-ab74-1c1e7d73c32c tempest-VolumesCloneTest-1068722893 None] Flow 'volume_create_manager' (43f1f32d-bd34-4840-89ed-f304e9e0f94f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83528) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 25 15:56:21 devstack sudo[87775]: pam_unix(sudo:session): session closed for user root Feb 25 15:56:21 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-2e721060-1d39-43b2-b6ea-4acddde6a4bf tempest-VolumeQuotasAdminTestJSON-1603945634 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85" returned: 0 in 0.549s {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 25 15:56:21 devstack cinder-volume[83528]: DEBUG cinder.manager [None req-2e721060-1d39-43b2-b6ea-4acddde6a4bf tempest-VolumeQuotasAdminTestJSON-1603945634 None] Notifying Schedulers of capabilities ... {{(pid=83528) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 25 15:56:21 devstack cinder-volume[83528]: INFO cinder.volume.manager [None req-3ae05178-0d7b-4711-ab74-1c1e7d73c32c tempest-VolumesCloneTest-1068722893 None] Created volume successfully. Feb 25 15:56:21 devstack cinder-volume[83528]: INFO cinder.volume.manager [None req-2e721060-1d39-43b2-b6ea-4acddde6a4bf tempest-VolumeQuotasAdminTestJSON-1603945634 None] Deleted volume successfully. Feb 25 15:56:21 devstack cinder-volume[83528]: DEBUG cinder.coordination [None req-2e721060-1d39-43b2-b6ea-4acddde6a4bf tempest-VolumeQuotasAdminTestJSON-1603945634 None] Lock "cinder-791b0d52-019e-4bc6-88b0-c96c0716f22a-delete_volume" released by "delete_volume" :: held 4.638s {{(pid=83528) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 25 15:56:21 devstack sudo[87778]: pam_unix(sudo:session): session closed for user root Feb 25 15:56:21 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-96ef3677-1933-4317-9361-ebd7bef74dbe tempest-VolumesActionsTest-1068253837 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-ea5df267-6d8c-4870-b52e-5a1cc315ebe5" returned: 0 in 0.620s {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 25 15:56:21 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-96ef3677-1933-4317-9361-ebd7bef74dbe tempest-VolumesActionsTest-1068253837 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-ea5df267-6d8c-4870-b52e-5a1cc315ebe5 {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 25 15:56:21 devstack sudo[87784]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-ea5df267-6d8c-4870-b52e-5a1cc315ebe5 Feb 25 15:56:21 devstack sudo[87784]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 25 15:56:22 devstack sudo[87784]: pam_unix(sudo:session): session closed for user root Feb 25 15:56:22 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-96ef3677-1933-4317-9361-ebd7bef74dbe tempest-VolumesActionsTest-1068253837 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-ea5df267-6d8c-4870-b52e-5a1cc315ebe5" returned: 0 in 0.503s {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 25 15:56:22 devstack cinder-volume[83528]: DEBUG cinder.coordination [None req-96ef3677-1933-4317-9361-ebd7bef74dbe tempest-VolumesActionsTest-1068253837 None] Lock "cinder-quobyte-ea5df267-6d8c-4870-b52e-5a1cc315ebe5" released by "delete_volume" :: held 1.156s {{(pid=83528) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 25 15:56:22 devstack cinder-volume[83528]: DEBUG cinder.quota [None req-96ef3677-1933-4317-9361-ebd7bef74dbe tempest-VolumesActionsTest-1068253837 None] Created reservations ['af974dd5-c1ce-44a7-98c2-6cc58f35b6c2', '22f5f68b-e581-4e80-b90e-aab546e6b6c4', '17508c0c-5ca9-49cf-ba97-cad5d7488793', '094d8d74-5bf6-4660-9574-3c285d7134e5'] {{(pid=83528) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 25 15:56:22 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-96ef3677-1933-4317-9361-ebd7bef74dbe tempest-VolumesActionsTest-1068253837 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 25 15:56:22 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-96ef3677-1933-4317-9361-ebd7bef74dbe tempest-VolumesActionsTest-1068253837 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 25 15:56:22 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.quobyte [None req-96ef3677-1933-4317-9361-ebd7bef74dbe tempest-VolumesActionsTest-1068253837 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23e9d725-3e04-4cd9-bfe0-c8ef43305589': None} {{(pid=83528) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 25 15:56:22 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.quobyte [None req-96ef3677-1933-4317-9361-ebd7bef74dbe tempest-VolumesActionsTest-1068253837 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23e9d725-3e04-4cd9-bfe0-c8ef43305589'] {{(pid=83528) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 25 15:56:22 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-96ef3677-1933-4317-9361-ebd7bef74dbe tempest-VolumesActionsTest-1068253837 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 25 15:56:22 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-96ef3677-1933-4317-9361-ebd7bef74dbe tempest-VolumesActionsTest-1068253837 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85 {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 25 15:56:22 devstack sudo[87787]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85 Feb 25 15:56:22 devstack sudo[87787]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 25 15:56:22 devstack cinder-volume[83528]: DEBUG cinder.volume.flows.manager.create_volume [None req-cba7f88d-f907-4670-ab26-59d0eae2668a tempest-VolumesCloneTest-1068722893 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83528) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 25 15:56:22 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-cba7f88d-f907-4670-ab26-59d0eae2668a tempest-VolumesCloneTest-1068722893 None] Flow 'volume_create_manager' (9db4d6b6-71d7-43f7-88c0-e0c0dc27fdbc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83528) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 25 15:56:22 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-cba7f88d-f907-4670-ab26-59d0eae2668a tempest-VolumesCloneTest-1068722893 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1c8ba518-066c-4a5e-8009-d575d73dc295) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 25 15:56:22 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-cba7f88d-f907-4670-ab26-59d0eae2668a tempest-VolumesCloneTest-1068722893 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1c8ba518-066c-4a5e-8009-d575d73dc295) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-25T14:56:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-1271006867',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4cd03df0-8398-4a0c-b190-976c5aad9b48,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5d89a2670aa1436b892bab17bb33a341',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-25T14:56:23Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=2e5e9fe7-2922-4406-b8b8-56fcd71b9dfd,status='creating',terminated_at=None,updated_at=2026-02-25T14:56:23Z,use_quota=True,user_id='d32f4fcdd6954a7182059dbbee4e1336',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ce71c2f9-6543-4165-9653-a1529b2ea243),volume_type_id=ce71c2f9-6543-4165-9653-a1529b2ea243)' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 25 15:56:22 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-cba7f88d-f907-4670-ab26-59d0eae2668a tempest-VolumesCloneTest-1068722893 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fcb568eb-e27c-4c40-96fa-4f9e574d768e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 25 15:56:22 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-cba7f88d-f907-4670-ab26-59d0eae2668a tempest-VolumesCloneTest-1068722893 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fcb568eb-e27c-4c40-96fa-4f9e574d768e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 25 15:56:22 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-cba7f88d-f907-4670-ab26-59d0eae2668a tempest-VolumesCloneTest-1068722893 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7883a247-2127-4d7a-a662-bf3c231a2c53) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 25 15:56:22 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-cba7f88d-f907-4670-ab26-59d0eae2668a tempest-VolumesCloneTest-1068722893 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7883a247-2127-4d7a-a662-bf3c231a2c53) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': '4cd03df0-8398-4a0c-b190-976c5aad9b48', 'volume_name': 'volume-4cd03df0-8398-4a0c-b190-976c5aad9b48', 'volume_size': 2, 'source_volid': '2e5e9fe7-2922-4406-b8b8-56fcd71b9dfd', 'source_volstatus': 'available'}' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 25 15:56:22 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-cba7f88d-f907-4670-ab26-59d0eae2668a tempest-VolumesCloneTest-1068722893 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a1cf32eb-c7fe-424c-8ece-cf536ab0e10b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 25 15:56:22 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-cba7f88d-f907-4670-ab26-59d0eae2668a tempest-VolumesCloneTest-1068722893 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a1cf32eb-c7fe-424c-8ece-cf536ab0e10b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 25 15:56:22 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-cba7f88d-f907-4670-ab26-59d0eae2668a tempest-VolumesCloneTest-1068722893 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4f447725-76d1-48c7-81a3-b1648a418989) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 25 15:56:22 devstack cinder-volume[83528]: INFO cinder.volume.flows.manager.create_volume [None req-cba7f88d-f907-4670-ab26-59d0eae2668a tempest-VolumesCloneTest-1068722893 None] Volume 4cd03df0-8398-4a0c-b190-976c5aad9b48: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-4cd03df0-8398-4a0c-b190-976c5aad9b48', 'volume_size': 2, 'source_volid': '2e5e9fe7-2922-4406-b8b8-56fcd71b9dfd', 'source_volstatus': 'available'} Feb 25 15:56:22 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-cba7f88d-f907-4670-ab26-59d0eae2668a tempest-VolumesCloneTest-1068722893 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 25 15:56:22 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-cba7f88d-f907-4670-ab26-59d0eae2668a tempest-VolumesCloneTest-1068722893 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 25 15:56:22 devstack cinder-volume[83528]: INFO cinder.volume.drivers.remotefs [None req-cba7f88d-f907-4670-ab26-59d0eae2668a tempest-VolumesCloneTest-1068722893 None] Cloning volume 2e5e9fe7-2922-4406-b8b8-56fcd71b9dfd to volume 4cd03df0-8398-4a0c-b190-976c5aad9b48 Feb 25 15:56:22 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.remotefs [None req-cba7f88d-f907-4670-ab26-59d0eae2668a tempest-VolumesCloneTest-1068722893 None] Creating offline snapshot 35901fb7-4c2e-47dd-af08-615fa5810186 of volume 2e5e9fe7-2922-4406-b8b8-56fcd71b9dfd {{(pid=83528) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Feb 25 15:56:22 devstack cinder-volume[83528]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e5d0457-8e13-4095-8ef7-d2af08846a39]: (4, 'qcow2') {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 25 15:56:22 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-cba7f88d-f907-4670-ab26-59d0eae2668a tempest-VolumesCloneTest-1068722893 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-2e5e9fe7-2922-4406-b8b8-56fcd71b9dfd {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 25 15:56:22 devstack sudo[87787]: pam_unix(sudo:session): session closed for user root Feb 25 15:56:22 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-96ef3677-1933-4317-9361-ebd7bef74dbe tempest-VolumesActionsTest-1068253837 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85" returned: 0 in 0.629s {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 25 15:56:22 devstack cinder-volume[83528]: DEBUG cinder.manager [None req-96ef3677-1933-4317-9361-ebd7bef74dbe tempest-VolumesActionsTest-1068253837 None] Notifying Schedulers of capabilities ... {{(pid=83528) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 25 15:56:22 devstack sudo[87790]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-2e5e9fe7-2922-4406-b8b8-56fcd71b9dfd Feb 25 15:56:22 devstack sudo[87790]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 25 15:56:22 devstack cinder-volume[83528]: INFO cinder.volume.manager [None req-96ef3677-1933-4317-9361-ebd7bef74dbe tempest-VolumesActionsTest-1068253837 None] Deleted volume successfully. Feb 25 15:56:22 devstack cinder-volume[83528]: DEBUG cinder.coordination [None req-96ef3677-1933-4317-9361-ebd7bef74dbe tempest-VolumesActionsTest-1068253837 None] Lock "cinder-ea5df267-6d8c-4870-b52e-5a1cc315ebe5-delete_volume" released by "delete_volume" :: held 1.997s {{(pid=83528) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 25 15:56:23 devstack cinder-volume[83528]: DEBUG cinder.volume.flows.manager.create_volume [None req-bea08c4b-5800-4865-9407-6170ced65abf tempest-VolumesServicesTestJSON-1996612783 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83528) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 25 15:56:23 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-bea08c4b-5800-4865-9407-6170ced65abf tempest-VolumesServicesTestJSON-1996612783 None] Flow 'volume_create_manager' (e064d3ee-d00a-4122-b881-6be2f3bedc34) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83528) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 25 15:56:23 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-bea08c4b-5800-4865-9407-6170ced65abf tempest-VolumesServicesTestJSON-1996612783 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (23361c04-11ce-474a-bc26-b3483088b34c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 25 15:56:23 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-bea08c4b-5800-4865-9407-6170ced65abf tempest-VolumesServicesTestJSON-1996612783 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (23361c04-11ce-474a-bc26-b3483088b34c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-25T14:56:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-1362636943',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0ec412e2-b4af-4438-8a99-540f5fb537e7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d47020fc21dd47a787cc33c5c5cbc429',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-25T14:56:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-25T14:56:23Z,use_quota=True,user_id='eb7cc9ee0b694a8b8eb841d477cd9989',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ce71c2f9-6543-4165-9653-a1529b2ea243),volume_type_id=ce71c2f9-6543-4165-9653-a1529b2ea243)' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 25 15:56:23 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-bea08c4b-5800-4865-9407-6170ced65abf tempest-VolumesServicesTestJSON-1996612783 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1548690b-18bb-4610-8e85-f7d6d0b61522) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 25 15:56:23 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-bea08c4b-5800-4865-9407-6170ced65abf tempest-VolumesServicesTestJSON-1996612783 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1548690b-18bb-4610-8e85-f7d6d0b61522) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 25 15:56:23 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-bea08c4b-5800-4865-9407-6170ced65abf tempest-VolumesServicesTestJSON-1996612783 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b94e1039-15be-45e1-801e-c9894ec33375) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 25 15:56:23 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-bea08c4b-5800-4865-9407-6170ced65abf tempest-VolumesServicesTestJSON-1996612783 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b94e1039-15be-45e1-801e-c9894ec33375) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0ec412e2-b4af-4438-8a99-540f5fb537e7', 'volume_name': 'volume-0ec412e2-b4af-4438-8a99-540f5fb537e7', 'volume_size': 1}' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 25 15:56:23 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-bea08c4b-5800-4865-9407-6170ced65abf tempest-VolumesServicesTestJSON-1996612783 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a7fac1a8-18b9-46ae-afbb-b8ac841126ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 25 15:56:23 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-bea08c4b-5800-4865-9407-6170ced65abf tempest-VolumesServicesTestJSON-1996612783 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a7fac1a8-18b9-46ae-afbb-b8ac841126ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 25 15:56:23 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-bea08c4b-5800-4865-9407-6170ced65abf tempest-VolumesServicesTestJSON-1996612783 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6d60b8df-8326-4825-bb89-a493c11c33e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 25 15:56:23 devstack cinder-volume[83528]: INFO cinder.volume.flows.manager.create_volume [None req-bea08c4b-5800-4865-9407-6170ced65abf tempest-VolumesServicesTestJSON-1996612783 None] Volume 0ec412e2-b4af-4438-8a99-540f5fb537e7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0ec412e2-b4af-4438-8a99-540f5fb537e7', 'volume_size': 1} Feb 25 15:56:23 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-bea08c4b-5800-4865-9407-6170ced65abf tempest-VolumesServicesTestJSON-1996612783 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 25 15:56:23 devstack sudo[87790]: pam_unix(sudo:session): session closed for user root Feb 25 15:56:23 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-cba7f88d-f907-4670-ab26-59d0eae2668a tempest-VolumesCloneTest-1068722893 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-2e5e9fe7-2922-4406-b8b8-56fcd71b9dfd" returned: 0 in 0.601s {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 25 15:56:23 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-cba7f88d-f907-4670-ab26-59d0eae2668a tempest-VolumesCloneTest-1068722893 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-2e5e9fe7-2922-4406-b8b8-56fcd71b9dfd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-2e5e9fe7-2922-4406-b8b8-56fcd71b9dfd.35901fb7-4c2e-47dd-af08-615fa5810186 1G {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 25 15:56:23 devstack sudo[87795]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-2e5e9fe7-2922-4406-b8b8-56fcd71b9dfd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-2e5e9fe7-2922-4406-b8b8-56fcd71b9dfd.35901fb7-4c2e-47dd-af08-615fa5810186 1G Feb 25 15:56:23 devstack sudo[87795]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 25 15:56:23 devstack cinder-volume[83528]: DEBUG cinder.volume.flows.manager.create_volume [None req-4493bb94-0a4c-4f6b-91f9-46bb2288b398 tempest-VolumesActionsTest-872240335 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83528) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 25 15:56:23 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-4493bb94-0a4c-4f6b-91f9-46bb2288b398 tempest-VolumesActionsTest-872240335 None] Flow 'volume_create_manager' (b7a8a610-05eb-4e1d-bbc2-f976b1c361c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83528) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 25 15:56:23 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-4493bb94-0a4c-4f6b-91f9-46bb2288b398 tempest-VolumesActionsTest-872240335 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d05fc1a6-0dd8-4c31-8d35-29d6d0b43550) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 25 15:56:23 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-4493bb94-0a4c-4f6b-91f9-46bb2288b398 tempest-VolumesActionsTest-872240335 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d05fc1a6-0dd8-4c31-8d35-29d6d0b43550) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-25T14:56:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1890904396',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fc2e47da-0295-42f2-b012-09940e103fdc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='da136677879e424b82ce0c4ab6e11f76',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-25T14:56:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-25T14:56:23Z,use_quota=True,user_id='8b2df249d4dc442f91f55f39a5a775f4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ce71c2f9-6543-4165-9653-a1529b2ea243),volume_type_id=ce71c2f9-6543-4165-9653-a1529b2ea243)' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 25 15:56:23 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-4493bb94-0a4c-4f6b-91f9-46bb2288b398 tempest-VolumesActionsTest-872240335 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (04a9db7f-f208-4aa7-be84-405a7101aee4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 25 15:56:23 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-4493bb94-0a4c-4f6b-91f9-46bb2288b398 tempest-VolumesActionsTest-872240335 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (04a9db7f-f208-4aa7-be84-405a7101aee4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 25 15:56:23 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-4493bb94-0a4c-4f6b-91f9-46bb2288b398 tempest-VolumesActionsTest-872240335 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1623b7ab-7228-467d-9463-fc3cbb0954a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 25 15:56:23 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-4493bb94-0a4c-4f6b-91f9-46bb2288b398 tempest-VolumesActionsTest-872240335 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1623b7ab-7228-467d-9463-fc3cbb0954a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fc2e47da-0295-42f2-b012-09940e103fdc', 'volume_name': 'volume-fc2e47da-0295-42f2-b012-09940e103fdc', 'volume_size': 1}' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 25 15:56:23 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-4493bb94-0a4c-4f6b-91f9-46bb2288b398 tempest-VolumesActionsTest-872240335 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (17db134e-ff1d-43ca-9f9c-1175142be08a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 25 15:56:23 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-4493bb94-0a4c-4f6b-91f9-46bb2288b398 tempest-VolumesActionsTest-872240335 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (17db134e-ff1d-43ca-9f9c-1175142be08a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 25 15:56:23 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-4493bb94-0a4c-4f6b-91f9-46bb2288b398 tempest-VolumesActionsTest-872240335 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (011daa56-afc9-4d47-bc66-770851effaec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 25 15:56:23 devstack cinder-volume[83528]: INFO cinder.volume.flows.manager.create_volume [None req-4493bb94-0a4c-4f6b-91f9-46bb2288b398 tempest-VolumesActionsTest-872240335 None] Volume fc2e47da-0295-42f2-b012-09940e103fdc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fc2e47da-0295-42f2-b012-09940e103fdc', 'volume_size': 1} Feb 25 15:56:23 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-4493bb94-0a4c-4f6b-91f9-46bb2288b398 tempest-VolumesActionsTest-872240335 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 25 15:56:23 devstack sudo[87795]: pam_unix(sudo:session): session closed for user root Feb 25 15:56:23 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-cba7f88d-f907-4670-ab26-59d0eae2668a tempest-VolumesCloneTest-1068722893 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-2e5e9fe7-2922-4406-b8b8-56fcd71b9dfd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-2e5e9fe7-2922-4406-b8b8-56fcd71b9dfd.35901fb7-4c2e-47dd-af08-615fa5810186 1G" returned: 0 in 0.573s {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 25 15:56:23 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-cba7f88d-f907-4670-ab26-59d0eae2668a tempest-VolumesCloneTest-1068722893 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2e5e9fe7-2922-4406-b8b8-56fcd71b9dfd -F qcow2 /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-2e5e9fe7-2922-4406-b8b8-56fcd71b9dfd.35901fb7-4c2e-47dd-af08-615fa5810186 {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 25 15:56:23 devstack sudo[87800]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2e5e9fe7-2922-4406-b8b8-56fcd71b9dfd -F qcow2 /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-2e5e9fe7-2922-4406-b8b8-56fcd71b9dfd.35901fb7-4c2e-47dd-af08-615fa5810186 Feb 25 15:56:23 devstack sudo[87800]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 25 15:56:24 devstack sudo[87800]: pam_unix(sudo:session): session closed for user root Feb 25 15:56:24 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-cba7f88d-f907-4670-ab26-59d0eae2668a tempest-VolumesCloneTest-1068722893 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2e5e9fe7-2922-4406-b8b8-56fcd71b9dfd -F qcow2 /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-2e5e9fe7-2922-4406-b8b8-56fcd71b9dfd.35901fb7-4c2e-47dd-af08-615fa5810186" returned: 0 in 0.520s {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 25 15:56:24 devstack cinder-volume[83528]: WARNING cinder.volume.drivers.remotefs [None req-cba7f88d-f907-4670-ab26-59d0eae2668a tempest-VolumesCloneTest-1068722893 None] /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-2e5e9fe7-2922-4406-b8b8-56fcd71b9dfd.35901fb7-4c2e-47dd-af08-615fa5810186 is being set with open permissions: ugo+rw Feb 25 15:56:24 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-cba7f88d-f907-4670-ab26-59d0eae2668a tempest-VolumesCloneTest-1068722893 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-2e5e9fe7-2922-4406-b8b8-56fcd71b9dfd.35901fb7-4c2e-47dd-af08-615fa5810186 {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 25 15:56:24 devstack sudo[87805]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-2e5e9fe7-2922-4406-b8b8-56fcd71b9dfd.35901fb7-4c2e-47dd-af08-615fa5810186 Feb 25 15:56:24 devstack sudo[87805]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 25 15:56:24 devstack sudo[87805]: pam_unix(sudo:session): session closed for user root Feb 25 15:56:24 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-cba7f88d-f907-4670-ab26-59d0eae2668a tempest-VolumesCloneTest-1068722893 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-2e5e9fe7-2922-4406-b8b8-56fcd71b9dfd.35901fb7-4c2e-47dd-af08-615fa5810186" returned: 0 in 0.471s {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 25 15:56:24 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-cba7f88d-f907-4670-ab26-59d0eae2668a tempest-VolumesCloneTest-1068722893 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-2e5e9fe7-2922-4406-b8b8-56fcd71b9dfd.info {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 25 15:56:24 devstack sudo[87809]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-2e5e9fe7-2922-4406-b8b8-56fcd71b9dfd.info Feb 25 15:56:24 devstack sudo[87809]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 25 15:56:25 devstack sudo[87809]: pam_unix(sudo:session): session closed for user root Feb 25 15:56:25 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-cba7f88d-f907-4670-ab26-59d0eae2668a tempest-VolumesCloneTest-1068722893 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-2e5e9fe7-2922-4406-b8b8-56fcd71b9dfd.info" returned: 0 in 0.491s {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 25 15:56:25 devstack cinder-volume[83528]: WARNING cinder.volume.drivers.remotefs [None req-cba7f88d-f907-4670-ab26-59d0eae2668a tempest-VolumesCloneTest-1068722893 None] /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-2e5e9fe7-2922-4406-b8b8-56fcd71b9dfd.info is being set with open permissions: ugo+rw Feb 25 15:56:25 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-cba7f88d-f907-4670-ab26-59d0eae2668a tempest-VolumesCloneTest-1068722893 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-2e5e9fe7-2922-4406-b8b8-56fcd71b9dfd.info {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 25 15:56:25 devstack sudo[87812]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-2e5e9fe7-2922-4406-b8b8-56fcd71b9dfd.info Feb 25 15:56:25 devstack sudo[87812]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 25 15:56:25 devstack sudo[87812]: pam_unix(sudo:session): session closed for user root Feb 25 15:56:25 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-cba7f88d-f907-4670-ab26-59d0eae2668a tempest-VolumesCloneTest-1068722893 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-2e5e9fe7-2922-4406-b8b8-56fcd71b9dfd.info" returned: 0 in 0.520s {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 25 15:56:25 devstack cinder-volume[83528]: DEBUG cinder.coordination [None req-cba7f88d-f907-4670-ab26-59d0eae2668a tempest-VolumesCloneTest-1068722893 None] Acquiring lock "cinder-quobyte-4cd03df0-8398-4a0c-b190-976c5aad9b48" by "_copy_volume_from_snapshot" {{(pid=83528) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 25 15:56:26 devstack cinder-volume[83528]: DEBUG cinder.coordination [None req-cba7f88d-f907-4670-ab26-59d0eae2668a tempest-VolumesCloneTest-1068722893 None] Lock "cinder-quobyte-4cd03df0-8398-4a0c-b190-976c5aad9b48" acquired by "_copy_volume_from_snapshot" :: waited 0.012s {{(pid=83528) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 25 15:56:26 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.quobyte [None req-cba7f88d-f907-4670-ab26-59d0eae2668a tempest-VolumesCloneTest-1068722893 None] snapshot: 35901fb7-4c2e-47dd-af08-615fa5810186, volume: 4cd03df0-8398-4a0c-b190-976c5aad9b48, {{(pid=83528) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Feb 25 15:56:26 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-cba7f88d-f907-4670-ab26-59d0eae2668a tempest-VolumesCloneTest-1068722893 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 25 15:56:26 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-cba7f88d-f907-4670-ab26-59d0eae2668a tempest-VolumesCloneTest-1068722893 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 25 15:56:26 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.quobyte [None req-cba7f88d-f907-4670-ab26-59d0eae2668a tempest-VolumesCloneTest-1068722893 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23e9d725-3e04-4cd9-bfe0-c8ef43305589': None} {{(pid=83528) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 25 15:56:26 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.quobyte [None req-cba7f88d-f907-4670-ab26-59d0eae2668a tempest-VolumesCloneTest-1068722893 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23e9d725-3e04-4cd9-bfe0-c8ef43305589'] {{(pid=83528) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 25 15:56:26 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-cba7f88d-f907-4670-ab26-59d0eae2668a tempest-VolumesCloneTest-1068722893 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 25 15:56:26 devstack cinder-volume[83528]: DEBUG oslo.privsep.daemon [-] privsep: reply[1113d1fb-8b65-4bc5-bd5d-2c0700a6889d]: (4, 'qcow2') {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 25 15:56:26 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-cba7f88d-f907-4670-ab26-59d0eae2668a tempest-VolumesCloneTest-1068722893 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-2e5e9fe7-2922-4406-b8b8-56fcd71b9dfd.35901fb7-4c2e-47dd-af08-615fa5810186 {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 25 15:56:26 devstack cinder-volume[83528]: DEBUG cinder.volume.flows.manager.create_volume [None req-6a43a33b-b969-4cee-9a5e-e902fd19e8b5 tempest-VolumesListAdminTestJSON-248510173 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83528) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 25 15:56:26 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-6a43a33b-b969-4cee-9a5e-e902fd19e8b5 tempest-VolumesListAdminTestJSON-248510173 None] Flow 'volume_create_manager' (2c906e93-60b4-422e-be6e-2383cf853251) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83528) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 25 15:56:26 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-6a43a33b-b969-4cee-9a5e-e902fd19e8b5 tempest-VolumesListAdminTestJSON-248510173 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (10c09d3e-e025-413e-a138-b7a3b1b22cdb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 25 15:56:26 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-6a43a33b-b969-4cee-9a5e-e902fd19e8b5 tempest-VolumesListAdminTestJSON-248510173 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (10c09d3e-e025-413e-a138-b7a3b1b22cdb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-25T14:56:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-414910271',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d4bfef2f-cfb5-4d43-976d-746fb61d9613,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='aeaf59da7a7141c79481a1e16522b8df',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-25T14:56:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-25T14:56:26Z,use_quota=True,user_id='992cac101fa04a039db50b0c5cc4503a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ce71c2f9-6543-4165-9653-a1529b2ea243),volume_type_id=ce71c2f9-6543-4165-9653-a1529b2ea243)' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 25 15:56:26 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-6a43a33b-b969-4cee-9a5e-e902fd19e8b5 tempest-VolumesListAdminTestJSON-248510173 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9a84855f-f89d-4bf4-b4af-e4306edaf267) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 25 15:56:26 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-6a43a33b-b969-4cee-9a5e-e902fd19e8b5 tempest-VolumesListAdminTestJSON-248510173 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9a84855f-f89d-4bf4-b4af-e4306edaf267) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 25 15:56:26 devstack sudo[87815]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-2e5e9fe7-2922-4406-b8b8-56fcd71b9dfd.35901fb7-4c2e-47dd-af08-615fa5810186 Feb 25 15:56:26 devstack sudo[87815]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 25 15:56:26 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-6a43a33b-b969-4cee-9a5e-e902fd19e8b5 tempest-VolumesListAdminTestJSON-248510173 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b250927f-cc11-42fb-8992-c83703b952f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 25 15:56:26 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-6a43a33b-b969-4cee-9a5e-e902fd19e8b5 tempest-VolumesListAdminTestJSON-248510173 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b250927f-cc11-42fb-8992-c83703b952f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd4bfef2f-cfb5-4d43-976d-746fb61d9613', 'volume_name': 'volume-d4bfef2f-cfb5-4d43-976d-746fb61d9613', 'volume_size': 1}' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 25 15:56:26 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-6a43a33b-b969-4cee-9a5e-e902fd19e8b5 tempest-VolumesListAdminTestJSON-248510173 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (00ba6e48-0968-4538-b9f7-8da41d2ecbaf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 25 15:56:26 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-6a43a33b-b969-4cee-9a5e-e902fd19e8b5 tempest-VolumesListAdminTestJSON-248510173 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (00ba6e48-0968-4538-b9f7-8da41d2ecbaf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 25 15:56:26 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-6a43a33b-b969-4cee-9a5e-e902fd19e8b5 tempest-VolumesListAdminTestJSON-248510173 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e2b52302-83a5-4ed2-992a-a8a7763f7c02) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 25 15:56:26 devstack cinder-volume[83528]: INFO cinder.volume.flows.manager.create_volume [None req-6a43a33b-b969-4cee-9a5e-e902fd19e8b5 tempest-VolumesListAdminTestJSON-248510173 None] Volume d4bfef2f-cfb5-4d43-976d-746fb61d9613: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d4bfef2f-cfb5-4d43-976d-746fb61d9613', 'volume_size': 1} Feb 25 15:56:26 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-6a43a33b-b969-4cee-9a5e-e902fd19e8b5 tempest-VolumesListAdminTestJSON-248510173 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 25 15:56:26 devstack sudo[87815]: pam_unix(sudo:session): session closed for user root Feb 25 15:56:26 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-cba7f88d-f907-4670-ab26-59d0eae2668a tempest-VolumesCloneTest-1068722893 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-2e5e9fe7-2922-4406-b8b8-56fcd71b9dfd.35901fb7-4c2e-47dd-af08-615fa5810186" returned: 0 in 0.530s {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 25 15:56:26 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.remotefs [None req-cba7f88d-f907-4670-ab26-59d0eae2668a tempest-VolumesCloneTest-1068722893 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2e5e9fe7-2922-4406-b8b8-56fcd71b9dfd(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83528) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Feb 25 15:56:26 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.quobyte [None req-cba7f88d-f907-4670-ab26-59d0eae2668a tempest-VolumesCloneTest-1068722893 None] will copy from snapshot at /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-2e5e9fe7-2922-4406-b8b8-56fcd71b9dfd {{(pid=83528) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Feb 25 15:56:26 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.quobyte [None req-cba7f88d-f907-4670-ab26-59d0eae2668a tempest-VolumesCloneTest-1068722893 None] Creating direct copy from snapshot {{(pid=83528) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Feb 25 15:56:26 devstack cinder-volume[83528]: DEBUG oslo.privsep.daemon [-] privsep: reply[26109443-9b99-47d2-aec1-60586d9f27e0]: (4, 'qcow2') {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 25 15:56:26 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-cba7f88d-f907-4670-ab26-59d0eae2668a tempest-VolumesCloneTest-1068722893 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-2e5e9fe7-2922-4406-b8b8-56fcd71b9dfd {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 25 15:56:26 devstack sudo[87820]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-2e5e9fe7-2922-4406-b8b8-56fcd71b9dfd Feb 25 15:56:26 devstack sudo[87820]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 25 15:56:27 devstack sudo[87820]: pam_unix(sudo:session): session closed for user root Feb 25 15:56:27 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-cba7f88d-f907-4670-ab26-59d0eae2668a tempest-VolumesCloneTest-1068722893 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-2e5e9fe7-2922-4406-b8b8-56fcd71b9dfd" returned: 0 in 0.513s {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 25 15:56:27 devstack cinder-volume[83528]: DEBUG cinder.utils [None req-cba7f88d-f907-4670-ab26-59d0eae2668a tempest-VolumesCloneTest-1068722893 None] Path /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-4cd03df0-8398-4a0c-b190-976c5aad9b48 not found in is_blk_device check {{(pid=83528) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Feb 25 15:56:27 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-cba7f88d-f907-4670-ab26-59d0eae2668a tempest-VolumesCloneTest-1068722893 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-2e5e9fe7-2922-4406-b8b8-56fcd71b9dfd /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-4cd03df0-8398-4a0c-b190-976c5aad9b48 {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 25 15:56:27 devstack sudo[87825]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-2e5e9fe7-2922-4406-b8b8-56fcd71b9dfd /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-4cd03df0-8398-4a0c-b190-976c5aad9b48 Feb 25 15:56:27 devstack sudo[87825]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 25 15:56:29 devstack sudo[87825]: pam_unix(sudo:session): session closed for user root Feb 25 15:56:29 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-cba7f88d-f907-4670-ab26-59d0eae2668a tempest-VolumesCloneTest-1068722893 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-2e5e9fe7-2922-4406-b8b8-56fcd71b9dfd /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-4cd03df0-8398-4a0c-b190-976c5aad9b48" returned: 0 in 2.178s {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 25 15:56:29 devstack cinder-volume[83528]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4b9a11d-9f25-485d-bde1-e0b340e982d0]: (4, 'qcow2') {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 25 15:56:29 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-cba7f88d-f907-4670-ab26-59d0eae2668a tempest-VolumesCloneTest-1068722893 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-2e5e9fe7-2922-4406-b8b8-56fcd71b9dfd {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 25 15:56:29 devstack sudo[87838]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-2e5e9fe7-2922-4406-b8b8-56fcd71b9dfd Feb 25 15:56:29 devstack sudo[87838]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 25 15:56:29 devstack sudo[87838]: pam_unix(sudo:session): session closed for user root Feb 25 15:56:29 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-cba7f88d-f907-4670-ab26-59d0eae2668a tempest-VolumesCloneTest-1068722893 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-2e5e9fe7-2922-4406-b8b8-56fcd71b9dfd" returned: 0 in 0.689s {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 25 15:56:29 devstack cinder-volume[83528]: DEBUG cinder.image.image_utils [None req-cba7f88d-f907-4670-ab26-59d0eae2668a tempest-VolumesCloneTest-1068722893 None] Image conversion details: src /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-2e5e9fe7-2922-4406-b8b8-56fcd71b9dfd, size 1024.00 MB, duration 2.18 sec, destination /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-4cd03df0-8398-4a0c-b190-976c5aad9b48 {{(pid=83528) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Feb 25 15:56:29 devstack cinder-volume[83528]: INFO cinder.image.image_utils [None req-cba7f88d-f907-4670-ab26-59d0eae2668a tempest-VolumesCloneTest-1068722893 None] Converted 1024.00 MB image at 469.91 MB/s Feb 25 15:56:29 devstack cinder-volume[83528]: WARNING cinder.volume.drivers.remotefs [None req-cba7f88d-f907-4670-ab26-59d0eae2668a tempest-VolumesCloneTest-1068722893 None] /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-4cd03df0-8398-4a0c-b190-976c5aad9b48 is being set with open permissions: ugo+rw Feb 25 15:56:29 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-cba7f88d-f907-4670-ab26-59d0eae2668a tempest-VolumesCloneTest-1068722893 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-4cd03df0-8398-4a0c-b190-976c5aad9b48 {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 25 15:56:29 devstack sudo[87843]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-4cd03df0-8398-4a0c-b190-976c5aad9b48 Feb 25 15:56:29 devstack sudo[87843]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 25 15:56:30 devstack sudo[87843]: pam_unix(sudo:session): session closed for user root Feb 25 15:56:30 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-cba7f88d-f907-4670-ab26-59d0eae2668a tempest-VolumesCloneTest-1068722893 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-4cd03df0-8398-4a0c-b190-976c5aad9b48" returned: 0 in 0.439s {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 25 15:56:30 devstack cinder-volume[83528]: DEBUG cinder.coordination [None req-cba7f88d-f907-4670-ab26-59d0eae2668a tempest-VolumesCloneTest-1068722893 None] Lock "cinder-quobyte-4cd03df0-8398-4a0c-b190-976c5aad9b48" released by "_copy_volume_from_snapshot" :: held 4.413s {{(pid=83528) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 25 15:56:30 devstack cinder-volume[83528]: DEBUG cinder.coordination [None req-cba7f88d-f907-4670-ab26-59d0eae2668a tempest-VolumesCloneTest-1068722893 None] Acquiring lock "cinder-quobyte-35901fb7-4c2e-47dd-af08-615fa5810186" by "_delete_snapshot" {{(pid=83528) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 25 15:56:30 devstack cinder-volume[83528]: DEBUG cinder.coordination [None req-cba7f88d-f907-4670-ab26-59d0eae2668a tempest-VolumesCloneTest-1068722893 None] Lock "cinder-quobyte-35901fb7-4c2e-47dd-af08-615fa5810186" acquired by "_delete_snapshot" :: waited 0.009s {{(pid=83528) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 25 15:56:30 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.remotefs [None req-cba7f88d-f907-4670-ab26-59d0eae2668a tempest-VolumesCloneTest-1068722893 None] Deleting offline snapshot 35901fb7-4c2e-47dd-af08-615fa5810186 of volume 2e5e9fe7-2922-4406-b8b8-56fcd71b9dfd {{(pid=83528) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Feb 25 15:56:30 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.remotefs [None req-cba7f88d-f907-4670-ab26-59d0eae2668a tempest-VolumesCloneTest-1068722893 None] snapshot_file for this snap is: volume-2e5e9fe7-2922-4406-b8b8-56fcd71b9dfd.35901fb7-4c2e-47dd-af08-615fa5810186 {{(pid=83528) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Feb 25 15:56:30 devstack cinder-volume[83528]: DEBUG oslo.privsep.daemon [-] privsep: reply[12960983-bb99-48fe-bdcc-d4a381f65d6e]: (4, 'qcow2') {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 25 15:56:30 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-cba7f88d-f907-4670-ab26-59d0eae2668a tempest-VolumesCloneTest-1068722893 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-2e5e9fe7-2922-4406-b8b8-56fcd71b9dfd.35901fb7-4c2e-47dd-af08-615fa5810186 {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 25 15:56:30 devstack sudo[87846]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-2e5e9fe7-2922-4406-b8b8-56fcd71b9dfd.35901fb7-4c2e-47dd-af08-615fa5810186 Feb 25 15:56:30 devstack sudo[87846]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 25 15:56:30 devstack sudo[87846]: pam_unix(sudo:session): session closed for user root Feb 25 15:56:30 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-cba7f88d-f907-4670-ab26-59d0eae2668a tempest-VolumesCloneTest-1068722893 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-2e5e9fe7-2922-4406-b8b8-56fcd71b9dfd.35901fb7-4c2e-47dd-af08-615fa5810186" returned: 0 in 0.537s {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 25 15:56:30 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.remotefs [None req-cba7f88d-f907-4670-ab26-59d0eae2668a tempest-VolumesCloneTest-1068722893 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2e5e9fe7-2922-4406-b8b8-56fcd71b9dfd(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83528) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Feb 25 15:56:31 devstack cinder-volume[83528]: DEBUG oslo.privsep.daemon [-] privsep: reply[b97b0aa8-1f5f-46b1-b140-0cc519446410]: (4, 'qcow2') {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 25 15:56:31 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-cba7f88d-f907-4670-ab26-59d0eae2668a tempest-VolumesCloneTest-1068722893 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-2e5e9fe7-2922-4406-b8b8-56fcd71b9dfd {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 25 15:56:31 devstack sudo[87851]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-2e5e9fe7-2922-4406-b8b8-56fcd71b9dfd Feb 25 15:56:31 devstack sudo[87851]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 25 15:56:31 devstack sudo[87851]: pam_unix(sudo:session): session closed for user root Feb 25 15:56:31 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-cba7f88d-f907-4670-ab26-59d0eae2668a tempest-VolumesCloneTest-1068722893 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-2e5e9fe7-2922-4406-b8b8-56fcd71b9dfd" returned: 0 in 0.551s {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 25 15:56:31 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-cba7f88d-f907-4670-ab26-59d0eae2668a tempest-VolumesCloneTest-1068722893 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-2e5e9fe7-2922-4406-b8b8-56fcd71b9dfd.35901fb7-4c2e-47dd-af08-615fa5810186 {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 25 15:56:31 devstack sudo[87856]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-2e5e9fe7-2922-4406-b8b8-56fcd71b9dfd.35901fb7-4c2e-47dd-af08-615fa5810186 Feb 25 15:56:31 devstack sudo[87856]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 25 15:56:32 devstack sudo[87856]: pam_unix(sudo:session): session closed for user root Feb 25 15:56:32 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-cba7f88d-f907-4670-ab26-59d0eae2668a tempest-VolumesCloneTest-1068722893 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-2e5e9fe7-2922-4406-b8b8-56fcd71b9dfd.35901fb7-4c2e-47dd-af08-615fa5810186" returned: 0 in 0.502s {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 25 15:56:32 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-cba7f88d-f907-4670-ab26-59d0eae2668a tempest-VolumesCloneTest-1068722893 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-2e5e9fe7-2922-4406-b8b8-56fcd71b9dfd.35901fb7-4c2e-47dd-af08-615fa5810186 {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 25 15:56:32 devstack sudo[87861]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-2e5e9fe7-2922-4406-b8b8-56fcd71b9dfd.35901fb7-4c2e-47dd-af08-615fa5810186 Feb 25 15:56:32 devstack sudo[87861]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 25 15:56:32 devstack sudo[87861]: pam_unix(sudo:session): session closed for user root Feb 25 15:56:32 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-cba7f88d-f907-4670-ab26-59d0eae2668a tempest-VolumesCloneTest-1068722893 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-2e5e9fe7-2922-4406-b8b8-56fcd71b9dfd.35901fb7-4c2e-47dd-af08-615fa5810186" returned: 0 in 0.463s {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 25 15:56:32 devstack cinder-volume[83528]: DEBUG cinder.coordination [None req-cba7f88d-f907-4670-ab26-59d0eae2668a tempest-VolumesCloneTest-1068722893 None] Lock "cinder-quobyte-35901fb7-4c2e-47dd-af08-615fa5810186" released by "_delete_snapshot" :: held 2.106s {{(pid=83528) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 25 15:56:32 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-cba7f88d-f907-4670-ab26-59d0eae2668a tempest-VolumesCloneTest-1068722893 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 9.831s {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 25 15:56:32 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-bea08c4b-5800-4865-9407-6170ced65abf tempest-VolumesServicesTestJSON-1996612783 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 9.340s {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 25 15:56:32 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.quobyte [None req-bea08c4b-5800-4865-9407-6170ced65abf tempest-VolumesServicesTestJSON-1996612783 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-25T14:56:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-1362636943',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0ec412e2-b4af-4438-8a99-540f5fb537e7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d47020fc21dd47a787cc33c5c5cbc429',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-25T14:56:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-25T14:56:23Z,use_quota=True,user_id='eb7cc9ee0b694a8b8eb841d477cd9989',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ce71c2f9-6543-4165-9653-a1529b2ea243),volume_type_id=ce71c2f9-6543-4165-9653-a1529b2ea243)}" {{(pid=83528) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 25 15:56:32 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.remotefs [None req-bea08c4b-5800-4865-9407-6170ced65abf tempest-VolumesServicesTestJSON-1996612783 None] Creating volume 0ec412e2-b4af-4438-8a99-540f5fb537e7 {{(pid=83528) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 25 15:56:32 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-bea08c4b-5800-4865-9407-6170ced65abf tempest-VolumesServicesTestJSON-1996612783 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 25 15:56:32 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-bea08c4b-5800-4865-9407-6170ced65abf tempest-VolumesServicesTestJSON-1996612783 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 25 15:56:32 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.quobyte [None req-bea08c4b-5800-4865-9407-6170ced65abf tempest-VolumesServicesTestJSON-1996612783 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23e9d725-3e04-4cd9-bfe0-c8ef43305589': None} {{(pid=83528) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 25 15:56:32 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.quobyte [None req-bea08c4b-5800-4865-9407-6170ced65abf tempest-VolumesServicesTestJSON-1996612783 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23e9d725-3e04-4cd9-bfe0-c8ef43305589'] {{(pid=83528) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 25 15:56:32 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-bea08c4b-5800-4865-9407-6170ced65abf tempest-VolumesServicesTestJSON-1996612783 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 25 15:56:32 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.quobyte [None req-bea08c4b-5800-4865-9407-6170ced65abf tempest-VolumesServicesTestJSON-1996612783 None] Selected osci02.corp.quobyte.com/cinder-vol-23e9d725-3e04-4cd9-bfe0-c8ef43305589 as target Quobyte volume. {{(pid=83528) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 25 15:56:32 devstack cinder-volume[83528]: INFO cinder.volume.drivers.remotefs [None req-bea08c4b-5800-4865-9407-6170ced65abf tempest-VolumesServicesTestJSON-1996612783 None] casted to osci02.corp.quobyte.com/cinder-vol-23e9d725-3e04-4cd9-bfe0-c8ef43305589 Feb 25 15:56:32 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-bea08c4b-5800-4865-9407-6170ced65abf tempest-VolumesServicesTestJSON-1996612783 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-0ec412e2-b4af-4438-8a99-540f5fb537e7 1073741824 {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 25 15:56:32 devstack sudo[87864]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-0ec412e2-b4af-4438-8a99-540f5fb537e7 1073741824 Feb 25 15:56:32 devstack sudo[87864]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 25 15:56:32 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-cba7f88d-f907-4670-ab26-59d0eae2668a tempest-VolumesCloneTest-1068722893 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4f447725-76d1-48c7-81a3-b1648a418989) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4cd03df0-8398-4a0c-b190-976c5aad9b48', 'volume_size': 2, 'source_volid': '2e5e9fe7-2922-4406-b8b8-56fcd71b9dfd', 'source_volstatus': 'available'}' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 25 15:56:32 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-cba7f88d-f907-4670-ab26-59d0eae2668a tempest-VolumesCloneTest-1068722893 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fdc05329-1888-4b38-b886-78760ad079af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 25 15:56:32 devstack cinder-volume[83528]: INFO cinder.volume.flows.manager.create_volume [None req-cba7f88d-f907-4670-ab26-59d0eae2668a tempest-VolumesCloneTest-1068722893 None] Volume volume-4cd03df0-8398-4a0c-b190-976c5aad9b48 (4cd03df0-8398-4a0c-b190-976c5aad9b48): created successfully Feb 25 15:56:32 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-cba7f88d-f907-4670-ab26-59d0eae2668a tempest-VolumesCloneTest-1068722893 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fdc05329-1888-4b38-b886-78760ad079af) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 25 15:56:32 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-cba7f88d-f907-4670-ab26-59d0eae2668a tempest-VolumesCloneTest-1068722893 None] Flow 'volume_create_manager' (9db4d6b6-71d7-43f7-88c0-e0c0dc27fdbc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83528) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 25 15:56:32 devstack cinder-volume[83528]: INFO cinder.volume.manager [None req-cba7f88d-f907-4670-ab26-59d0eae2668a tempest-VolumesCloneTest-1068722893 None] Created volume successfully. Feb 25 15:56:33 devstack sudo[87864]: pam_unix(sudo:session): session closed for user root Feb 25 15:56:33 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-bea08c4b-5800-4865-9407-6170ced65abf tempest-VolumesServicesTestJSON-1996612783 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-0ec412e2-b4af-4438-8a99-540f5fb537e7 1073741824" returned: 0 in 0.481s {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 25 15:56:33 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-bea08c4b-5800-4865-9407-6170ced65abf tempest-VolumesServicesTestJSON-1996612783 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-0ec412e2-b4af-4438-8a99-540f5fb537e7 {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 25 15:56:33 devstack sudo[87871]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-0ec412e2-b4af-4438-8a99-540f5fb537e7 Feb 25 15:56:33 devstack sudo[87871]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 25 15:56:33 devstack cinder-volume[83528]: DEBUG cinder.coordination [None req-cd573dcf-f2ef-4685-8750-cb42a2bbf12e tempest-VolumesCloneTest-1068722893 None] Acquiring lock "cinder-4cd03df0-8398-4a0c-b190-976c5aad9b48-delete_volume" by "delete_volume" {{(pid=83528) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 25 15:56:33 devstack cinder-volume[83528]: DEBUG cinder.coordination [None req-cd573dcf-f2ef-4685-8750-cb42a2bbf12e tempest-VolumesCloneTest-1068722893 None] Lock "cinder-4cd03df0-8398-4a0c-b190-976c5aad9b48-delete_volume" acquired by "delete_volume" :: waited 0.014s {{(pid=83528) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 25 15:56:33 devstack cinder-volume[83528]: DEBUG cinder.coordination [None req-cd573dcf-f2ef-4685-8750-cb42a2bbf12e tempest-VolumesCloneTest-1068722893 None] Acquiring lock "cinder-quobyte-4cd03df0-8398-4a0c-b190-976c5aad9b48" by "delete_volume" {{(pid=83528) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 25 15:56:33 devstack cinder-volume[83528]: DEBUG cinder.coordination [None req-cd573dcf-f2ef-4685-8750-cb42a2bbf12e tempest-VolumesCloneTest-1068722893 None] Lock "cinder-quobyte-4cd03df0-8398-4a0c-b190-976c5aad9b48" acquired by "delete_volume" :: waited 0.009s {{(pid=83528) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 25 15:56:33 devstack cinder-volume[83528]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2fca07a-832a-4848-ad38-7e2ba0df70a1]: (4, 'qcow2') {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 25 15:56:33 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-cd573dcf-f2ef-4685-8750-cb42a2bbf12e tempest-VolumesCloneTest-1068722893 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-4cd03df0-8398-4a0c-b190-976c5aad9b48 {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 25 15:56:33 devstack sudo[87871]: pam_unix(sudo:session): session closed for user root Feb 25 15:56:33 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-bea08c4b-5800-4865-9407-6170ced65abf tempest-VolumesServicesTestJSON-1996612783 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-0ec412e2-b4af-4438-8a99-540f5fb537e7" returned: 0 in 0.448s {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 25 15:56:33 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.quobyte [None req-bea08c4b-5800-4865-9407-6170ced65abf tempest-VolumesServicesTestJSON-1996612783 None] <== create_volume: return (959ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-23e9d725-3e04-4cd9-bfe0-c8ef43305589'} {{(pid=83528) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 25 15:56:33 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-bea08c4b-5800-4865-9407-6170ced65abf tempest-VolumesServicesTestJSON-1996612783 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.963s {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 25 15:56:33 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-4493bb94-0a4c-4f6b-91f9-46bb2288b398 tempest-VolumesActionsTest-872240335 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 9.965s {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 25 15:56:33 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.quobyte [None req-4493bb94-0a4c-4f6b-91f9-46bb2288b398 tempest-VolumesActionsTest-872240335 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-25T14:56:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1890904396',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fc2e47da-0295-42f2-b012-09940e103fdc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='da136677879e424b82ce0c4ab6e11f76',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-25T14:56:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-25T14:56:23Z,use_quota=True,user_id='8b2df249d4dc442f91f55f39a5a775f4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ce71c2f9-6543-4165-9653-a1529b2ea243),volume_type_id=ce71c2f9-6543-4165-9653-a1529b2ea243)}" {{(pid=83528) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 25 15:56:33 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.remotefs [None req-4493bb94-0a4c-4f6b-91f9-46bb2288b398 tempest-VolumesActionsTest-872240335 None] Creating volume fc2e47da-0295-42f2-b012-09940e103fdc {{(pid=83528) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 25 15:56:33 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-4493bb94-0a4c-4f6b-91f9-46bb2288b398 tempest-VolumesActionsTest-872240335 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 25 15:56:33 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-4493bb94-0a4c-4f6b-91f9-46bb2288b398 tempest-VolumesActionsTest-872240335 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 25 15:56:33 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.quobyte [None req-4493bb94-0a4c-4f6b-91f9-46bb2288b398 tempest-VolumesActionsTest-872240335 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23e9d725-3e04-4cd9-bfe0-c8ef43305589': None} {{(pid=83528) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 25 15:56:33 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.quobyte [None req-4493bb94-0a4c-4f6b-91f9-46bb2288b398 tempest-VolumesActionsTest-872240335 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23e9d725-3e04-4cd9-bfe0-c8ef43305589'] {{(pid=83528) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 25 15:56:33 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-4493bb94-0a4c-4f6b-91f9-46bb2288b398 tempest-VolumesActionsTest-872240335 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 25 15:56:33 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.quobyte [None req-4493bb94-0a4c-4f6b-91f9-46bb2288b398 tempest-VolumesActionsTest-872240335 None] Selected osci02.corp.quobyte.com/cinder-vol-23e9d725-3e04-4cd9-bfe0-c8ef43305589 as target Quobyte volume. {{(pid=83528) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 25 15:56:33 devstack cinder-volume[83528]: INFO cinder.volume.drivers.remotefs [None req-4493bb94-0a4c-4f6b-91f9-46bb2288b398 tempest-VolumesActionsTest-872240335 None] casted to osci02.corp.quobyte.com/cinder-vol-23e9d725-3e04-4cd9-bfe0-c8ef43305589 Feb 25 15:56:33 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-4493bb94-0a4c-4f6b-91f9-46bb2288b398 tempest-VolumesActionsTest-872240335 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-fc2e47da-0295-42f2-b012-09940e103fdc 1073741824 {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 25 15:56:33 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-bea08c4b-5800-4865-9407-6170ced65abf tempest-VolumesServicesTestJSON-1996612783 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6d60b8df-8326-4825-bb89-a493c11c33e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0ec412e2-b4af-4438-8a99-540f5fb537e7', 'volume_size': 1}' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 25 15:56:33 devstack sudo[87875]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-fc2e47da-0295-42f2-b012-09940e103fdc 1073741824 Feb 25 15:56:33 devstack sudo[87875]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 25 15:56:33 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-bea08c4b-5800-4865-9407-6170ced65abf tempest-VolumesServicesTestJSON-1996612783 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (41d1ad81-8068-4da4-8037-56e8e13a2348) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 25 15:56:33 devstack cinder-volume[83528]: INFO cinder.volume.flows.manager.create_volume [None req-bea08c4b-5800-4865-9407-6170ced65abf tempest-VolumesServicesTestJSON-1996612783 None] Volume volume-0ec412e2-b4af-4438-8a99-540f5fb537e7 (0ec412e2-b4af-4438-8a99-540f5fb537e7): created successfully Feb 25 15:56:33 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-bea08c4b-5800-4865-9407-6170ced65abf tempest-VolumesServicesTestJSON-1996612783 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (41d1ad81-8068-4da4-8037-56e8e13a2348) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 25 15:56:33 devstack sudo[87874]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-4cd03df0-8398-4a0c-b190-976c5aad9b48 Feb 25 15:56:33 devstack sudo[87874]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 25 15:56:33 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-bea08c4b-5800-4865-9407-6170ced65abf tempest-VolumesServicesTestJSON-1996612783 None] Flow 'volume_create_manager' (e064d3ee-d00a-4122-b881-6be2f3bedc34) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83528) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 25 15:56:33 devstack cinder-volume[83528]: INFO cinder.volume.manager [None req-bea08c4b-5800-4865-9407-6170ced65abf tempest-VolumesServicesTestJSON-1996612783 None] Created volume successfully. Feb 25 15:56:33 devstack cinder-volume[83528]: DEBUG cinder.coordination [None req-6fa66e29-9589-4e90-b625-562c143e2e3b tempest-VolumesServicesTestJSON-1996612783 None] Acquiring lock "cinder-0ec412e2-b4af-4438-8a99-540f5fb537e7-delete_volume" by "delete_volume" {{(pid=83528) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 25 15:56:33 devstack cinder-volume[83528]: DEBUG cinder.coordination [None req-6fa66e29-9589-4e90-b625-562c143e2e3b tempest-VolumesServicesTestJSON-1996612783 None] Lock "cinder-0ec412e2-b4af-4438-8a99-540f5fb537e7-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=83528) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 25 15:56:33 devstack cinder-volume[83528]: DEBUG cinder.coordination [None req-6fa66e29-9589-4e90-b625-562c143e2e3b tempest-VolumesServicesTestJSON-1996612783 None] Acquiring lock "cinder-quobyte-0ec412e2-b4af-4438-8a99-540f5fb537e7" by "delete_volume" {{(pid=83528) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 25 15:56:33 devstack cinder-volume[83528]: DEBUG cinder.coordination [None req-6fa66e29-9589-4e90-b625-562c143e2e3b tempest-VolumesServicesTestJSON-1996612783 None] Lock "cinder-quobyte-0ec412e2-b4af-4438-8a99-540f5fb537e7" acquired by "delete_volume" :: waited 0.012s {{(pid=83528) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 25 15:56:33 devstack cinder-volume[83528]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ca331d5-983e-42d8-b22e-21eb25d62831]: (4, 'qcow2') {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 25 15:56:33 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-6fa66e29-9589-4e90-b625-562c143e2e3b tempest-VolumesServicesTestJSON-1996612783 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-0ec412e2-b4af-4438-8a99-540f5fb537e7 {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 25 15:56:33 devstack sudo[87878]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-0ec412e2-b4af-4438-8a99-540f5fb537e7 Feb 25 15:56:33 devstack sudo[87878]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 25 15:56:34 devstack sudo[87874]: pam_unix(sudo:session): session closed for user root Feb 25 15:56:34 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-cd573dcf-f2ef-4685-8750-cb42a2bbf12e tempest-VolumesCloneTest-1068722893 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-4cd03df0-8398-4a0c-b190-976c5aad9b48" returned: 0 in 0.572s {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 25 15:56:34 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-cd573dcf-f2ef-4685-8750-cb42a2bbf12e tempest-VolumesCloneTest-1068722893 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-4cd03df0-8398-4a0c-b190-976c5aad9b48 {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 25 15:56:34 devstack sudo[87886]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-4cd03df0-8398-4a0c-b190-976c5aad9b48 Feb 25 15:56:34 devstack sudo[87886]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 25 15:56:34 devstack sudo[87875]: pam_unix(sudo:session): session closed for user root Feb 25 15:56:34 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-4493bb94-0a4c-4f6b-91f9-46bb2288b398 tempest-VolumesActionsTest-872240335 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-fc2e47da-0295-42f2-b012-09940e103fdc 1073741824" returned: 0 in 0.601s {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 25 15:56:34 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-4493bb94-0a4c-4f6b-91f9-46bb2288b398 tempest-VolumesActionsTest-872240335 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-fc2e47da-0295-42f2-b012-09940e103fdc {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 25 15:56:34 devstack sudo[87888]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-fc2e47da-0295-42f2-b012-09940e103fdc Feb 25 15:56:34 devstack sudo[87888]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 25 15:56:34 devstack sudo[87878]: pam_unix(sudo:session): session closed for user root Feb 25 15:56:34 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-6fa66e29-9589-4e90-b625-562c143e2e3b tempest-VolumesServicesTestJSON-1996612783 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-0ec412e2-b4af-4438-8a99-540f5fb537e7" returned: 0 in 0.543s {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 25 15:56:34 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-6fa66e29-9589-4e90-b625-562c143e2e3b tempest-VolumesServicesTestJSON-1996612783 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-0ec412e2-b4af-4438-8a99-540f5fb537e7 {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 25 15:56:34 devstack sudo[87894]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-0ec412e2-b4af-4438-8a99-540f5fb537e7 Feb 25 15:56:34 devstack sudo[87894]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 25 15:56:34 devstack sudo[87886]: pam_unix(sudo:session): session closed for user root Feb 25 15:56:34 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-cd573dcf-f2ef-4685-8750-cb42a2bbf12e tempest-VolumesCloneTest-1068722893 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-4cd03df0-8398-4a0c-b190-976c5aad9b48" returned: 0 in 0.446s {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 25 15:56:34 devstack cinder-volume[83528]: DEBUG cinder.coordination [None req-cd573dcf-f2ef-4685-8750-cb42a2bbf12e tempest-VolumesCloneTest-1068722893 None] Lock "cinder-quobyte-4cd03df0-8398-4a0c-b190-976c5aad9b48" released by "delete_volume" :: held 1.062s {{(pid=83528) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 25 15:56:34 devstack cinder-volume[83528]: DEBUG cinder.quota [None req-cd573dcf-f2ef-4685-8750-cb42a2bbf12e tempest-VolumesCloneTest-1068722893 None] Created reservations ['aa8164af-2d08-4179-87f5-e6fb35a17f7b', '096b4833-68a1-4a40-b70d-10f6b68cf17a', 'ce627194-71a5-4a6f-b5be-a947b7b9d0a4', 'e5803fbc-30d6-444b-88b5-9893ca0461f8'] {{(pid=83528) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 25 15:56:34 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-cd573dcf-f2ef-4685-8750-cb42a2bbf12e tempest-VolumesCloneTest-1068722893 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 25 15:56:34 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-cd573dcf-f2ef-4685-8750-cb42a2bbf12e tempest-VolumesCloneTest-1068722893 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 25 15:56:34 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.quobyte [None req-cd573dcf-f2ef-4685-8750-cb42a2bbf12e tempest-VolumesCloneTest-1068722893 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23e9d725-3e04-4cd9-bfe0-c8ef43305589': None} {{(pid=83528) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 25 15:56:34 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.quobyte [None req-cd573dcf-f2ef-4685-8750-cb42a2bbf12e tempest-VolumesCloneTest-1068722893 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23e9d725-3e04-4cd9-bfe0-c8ef43305589'] {{(pid=83528) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 25 15:56:34 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-cd573dcf-f2ef-4685-8750-cb42a2bbf12e tempest-VolumesCloneTest-1068722893 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 25 15:56:34 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-cd573dcf-f2ef-4685-8750-cb42a2bbf12e tempest-VolumesCloneTest-1068722893 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85 {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 25 15:56:34 devstack sudo[87898]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85 Feb 25 15:56:34 devstack sudo[87898]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 25 15:56:34 devstack sudo[87888]: pam_unix(sudo:session): session closed for user root Feb 25 15:56:34 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-4493bb94-0a4c-4f6b-91f9-46bb2288b398 tempest-VolumesActionsTest-872240335 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-fc2e47da-0295-42f2-b012-09940e103fdc" returned: 0 in 0.491s {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 25 15:56:34 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.quobyte [None req-4493bb94-0a4c-4f6b-91f9-46bb2288b398 tempest-VolumesActionsTest-872240335 None] <== create_volume: return (1124ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-23e9d725-3e04-4cd9-bfe0-c8ef43305589'} {{(pid=83528) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 25 15:56:34 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-4493bb94-0a4c-4f6b-91f9-46bb2288b398 tempest-VolumesActionsTest-872240335 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.127s {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 25 15:56:34 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-6a43a33b-b969-4cee-9a5e-e902fd19e8b5 tempest-VolumesListAdminTestJSON-248510173 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 8.537s {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 25 15:56:34 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.quobyte [None req-6a43a33b-b969-4cee-9a5e-e902fd19e8b5 tempest-VolumesListAdminTestJSON-248510173 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-25T14:56:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-414910271',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d4bfef2f-cfb5-4d43-976d-746fb61d9613,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='aeaf59da7a7141c79481a1e16522b8df',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-25T14:56:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-25T14:56:26Z,use_quota=True,user_id='992cac101fa04a039db50b0c5cc4503a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ce71c2f9-6543-4165-9653-a1529b2ea243),volume_type_id=ce71c2f9-6543-4165-9653-a1529b2ea243)}" {{(pid=83528) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 25 15:56:34 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.remotefs [None req-6a43a33b-b969-4cee-9a5e-e902fd19e8b5 tempest-VolumesListAdminTestJSON-248510173 None] Creating volume d4bfef2f-cfb5-4d43-976d-746fb61d9613 {{(pid=83528) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 25 15:56:34 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-6a43a33b-b969-4cee-9a5e-e902fd19e8b5 tempest-VolumesListAdminTestJSON-248510173 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 25 15:56:34 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-6a43a33b-b969-4cee-9a5e-e902fd19e8b5 tempest-VolumesListAdminTestJSON-248510173 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 25 15:56:34 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.quobyte [None req-6a43a33b-b969-4cee-9a5e-e902fd19e8b5 tempest-VolumesListAdminTestJSON-248510173 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23e9d725-3e04-4cd9-bfe0-c8ef43305589': None} {{(pid=83528) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 25 15:56:34 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.quobyte [None req-6a43a33b-b969-4cee-9a5e-e902fd19e8b5 tempest-VolumesListAdminTestJSON-248510173 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23e9d725-3e04-4cd9-bfe0-c8ef43305589'] {{(pid=83528) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 25 15:56:34 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-6a43a33b-b969-4cee-9a5e-e902fd19e8b5 tempest-VolumesListAdminTestJSON-248510173 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 25 15:56:34 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.quobyte [None req-6a43a33b-b969-4cee-9a5e-e902fd19e8b5 tempest-VolumesListAdminTestJSON-248510173 None] Selected osci02.corp.quobyte.com/cinder-vol-23e9d725-3e04-4cd9-bfe0-c8ef43305589 as target Quobyte volume. {{(pid=83528) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 25 15:56:34 devstack cinder-volume[83528]: INFO cinder.volume.drivers.remotefs [None req-6a43a33b-b969-4cee-9a5e-e902fd19e8b5 tempest-VolumesListAdminTestJSON-248510173 None] casted to osci02.corp.quobyte.com/cinder-vol-23e9d725-3e04-4cd9-bfe0-c8ef43305589 Feb 25 15:56:34 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-6a43a33b-b969-4cee-9a5e-e902fd19e8b5 tempest-VolumesListAdminTestJSON-248510173 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-d4bfef2f-cfb5-4d43-976d-746fb61d9613 1073741824 {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 25 15:56:34 devstack sudo[87900]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-d4bfef2f-cfb5-4d43-976d-746fb61d9613 1073741824 Feb 25 15:56:34 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-4493bb94-0a4c-4f6b-91f9-46bb2288b398 tempest-VolumesActionsTest-872240335 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (011daa56-afc9-4d47-bc66-770851effaec) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fc2e47da-0295-42f2-b012-09940e103fdc', 'volume_size': 1}' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 25 15:56:34 devstack sudo[87900]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 25 15:56:34 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-4493bb94-0a4c-4f6b-91f9-46bb2288b398 tempest-VolumesActionsTest-872240335 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1df9a780-ac94-49d4-b941-405fbf0c2023) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 25 15:56:34 devstack cinder-volume[83528]: INFO cinder.volume.flows.manager.create_volume [None req-4493bb94-0a4c-4f6b-91f9-46bb2288b398 tempest-VolumesActionsTest-872240335 None] Volume volume-fc2e47da-0295-42f2-b012-09940e103fdc (fc2e47da-0295-42f2-b012-09940e103fdc): created successfully Feb 25 15:56:34 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-4493bb94-0a4c-4f6b-91f9-46bb2288b398 tempest-VolumesActionsTest-872240335 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1df9a780-ac94-49d4-b941-405fbf0c2023) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 25 15:56:34 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-4493bb94-0a4c-4f6b-91f9-46bb2288b398 tempest-VolumesActionsTest-872240335 None] Flow 'volume_create_manager' (b7a8a610-05eb-4e1d-bbc2-f976b1c361c2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83528) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 25 15:56:34 devstack cinder-volume[83528]: INFO cinder.volume.manager [None req-4493bb94-0a4c-4f6b-91f9-46bb2288b398 tempest-VolumesActionsTest-872240335 None] Created volume successfully. Feb 25 15:56:34 devstack sudo[87894]: pam_unix(sudo:session): session closed for user root Feb 25 15:56:34 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-6fa66e29-9589-4e90-b625-562c143e2e3b tempest-VolumesServicesTestJSON-1996612783 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-0ec412e2-b4af-4438-8a99-540f5fb537e7" returned: 0 in 0.474s {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 25 15:56:34 devstack cinder-volume[83528]: DEBUG cinder.coordination [None req-6fa66e29-9589-4e90-b625-562c143e2e3b tempest-VolumesServicesTestJSON-1996612783 None] Lock "cinder-quobyte-0ec412e2-b4af-4438-8a99-540f5fb537e7" released by "delete_volume" :: held 1.039s {{(pid=83528) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 25 15:56:34 devstack cinder-volume[83528]: DEBUG cinder.quota [None req-6fa66e29-9589-4e90-b625-562c143e2e3b tempest-VolumesServicesTestJSON-1996612783 None] Created reservations ['c048ce78-f3f9-4245-8757-1f30495fc103', '1521fdd2-257b-4a6f-91d2-798c1232f076', 'f6db3554-e778-4fd1-87a0-9602a55ccf01', 'c0bc3243-4624-487c-900f-0820828a860a'] {{(pid=83528) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 25 15:56:35 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-6fa66e29-9589-4e90-b625-562c143e2e3b tempest-VolumesServicesTestJSON-1996612783 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 25 15:56:35 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-6fa66e29-9589-4e90-b625-562c143e2e3b tempest-VolumesServicesTestJSON-1996612783 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 25 15:56:35 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.quobyte [None req-6fa66e29-9589-4e90-b625-562c143e2e3b tempest-VolumesServicesTestJSON-1996612783 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23e9d725-3e04-4cd9-bfe0-c8ef43305589': None} {{(pid=83528) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 25 15:56:35 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.quobyte [None req-6fa66e29-9589-4e90-b625-562c143e2e3b tempest-VolumesServicesTestJSON-1996612783 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23e9d725-3e04-4cd9-bfe0-c8ef43305589'] {{(pid=83528) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 25 15:56:35 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-6fa66e29-9589-4e90-b625-562c143e2e3b tempest-VolumesServicesTestJSON-1996612783 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 25 15:56:35 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-6fa66e29-9589-4e90-b625-562c143e2e3b tempest-VolumesServicesTestJSON-1996612783 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85 {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 25 15:56:35 devstack sudo[87904]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85 Feb 25 15:56:35 devstack sudo[87904]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 25 15:56:35 devstack sudo[87898]: pam_unix(sudo:session): session closed for user root Feb 25 15:56:35 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-cd573dcf-f2ef-4685-8750-cb42a2bbf12e tempest-VolumesCloneTest-1068722893 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85" returned: 0 in 0.481s {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 25 15:56:35 devstack cinder-volume[83528]: DEBUG cinder.manager [None req-cd573dcf-f2ef-4685-8750-cb42a2bbf12e tempest-VolumesCloneTest-1068722893 None] Notifying Schedulers of capabilities ... {{(pid=83528) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 25 15:56:35 devstack cinder-volume[83528]: INFO cinder.volume.manager [None req-cd573dcf-f2ef-4685-8750-cb42a2bbf12e tempest-VolumesCloneTest-1068722893 None] Deleted volume successfully. Feb 25 15:56:35 devstack cinder-volume[83528]: DEBUG cinder.coordination [None req-cd573dcf-f2ef-4685-8750-cb42a2bbf12e tempest-VolumesCloneTest-1068722893 None] Lock "cinder-4cd03df0-8398-4a0c-b190-976c5aad9b48-delete_volume" released by "delete_volume" :: held 1.723s {{(pid=83528) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 25 15:56:35 devstack sudo[87900]: pam_unix(sudo:session): session closed for user root Feb 25 15:56:35 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-6a43a33b-b969-4cee-9a5e-e902fd19e8b5 tempest-VolumesListAdminTestJSON-248510173 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-d4bfef2f-cfb5-4d43-976d-746fb61d9613 1073741824" returned: 0 in 0.557s {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 25 15:56:35 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-6a43a33b-b969-4cee-9a5e-e902fd19e8b5 tempest-VolumesListAdminTestJSON-248510173 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-d4bfef2f-cfb5-4d43-976d-746fb61d9613 {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 25 15:56:35 devstack sudo[87909]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-d4bfef2f-cfb5-4d43-976d-746fb61d9613 Feb 25 15:56:35 devstack sudo[87909]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 25 15:56:35 devstack sudo[87904]: pam_unix(sudo:session): session closed for user root Feb 25 15:56:35 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-6fa66e29-9589-4e90-b625-562c143e2e3b tempest-VolumesServicesTestJSON-1996612783 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85" returned: 0 in 0.486s {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 25 15:56:35 devstack cinder-volume[83528]: DEBUG cinder.manager [None req-6fa66e29-9589-4e90-b625-562c143e2e3b tempest-VolumesServicesTestJSON-1996612783 None] Notifying Schedulers of capabilities ... {{(pid=83528) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 25 15:56:35 devstack cinder-volume[83528]: INFO cinder.volume.manager [None req-6fa66e29-9589-4e90-b625-562c143e2e3b tempest-VolumesServicesTestJSON-1996612783 None] Deleted volume successfully. Feb 25 15:56:35 devstack cinder-volume[83528]: DEBUG cinder.coordination [None req-6fa66e29-9589-4e90-b625-562c143e2e3b tempest-VolumesServicesTestJSON-1996612783 None] Lock "cinder-0ec412e2-b4af-4438-8a99-540f5fb537e7-delete_volume" released by "delete_volume" :: held 1.689s {{(pid=83528) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 25 15:56:35 devstack cinder-volume[83528]: DEBUG cinder.coordination [None req-8988f0cc-c927-4216-ab0b-66b1c75bdf33 tempest-VolumesCloneTest-1068722893 None] Acquiring lock "cinder-2e5e9fe7-2922-4406-b8b8-56fcd71b9dfd-delete_volume" by "delete_volume" {{(pid=83528) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 25 15:56:35 devstack cinder-volume[83528]: DEBUG cinder.coordination [None req-8988f0cc-c927-4216-ab0b-66b1c75bdf33 tempest-VolumesCloneTest-1068722893 None] Lock "cinder-2e5e9fe7-2922-4406-b8b8-56fcd71b9dfd-delete_volume" acquired by "delete_volume" :: waited 0.009s {{(pid=83528) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 25 15:56:35 devstack sudo[87909]: pam_unix(sudo:session): session closed for user root Feb 25 15:56:35 devstack cinder-volume[83528]: DEBUG cinder.coordination [None req-7f510d4d-92fc-4737-83d5-6c1efadbe89c tempest-VolumesActionsTest-872240335 None] Acquiring lock "cinder-fc2e47da-0295-42f2-b012-09940e103fdc-delete_volume" by "delete_volume" {{(pid=83528) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 25 15:56:35 devstack cinder-volume[83528]: DEBUG cinder.coordination [None req-8988f0cc-c927-4216-ab0b-66b1c75bdf33 tempest-VolumesCloneTest-1068722893 None] Acquiring lock "cinder-quobyte-2e5e9fe7-2922-4406-b8b8-56fcd71b9dfd" by "delete_volume" {{(pid=83528) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 25 15:56:35 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-6a43a33b-b969-4cee-9a5e-e902fd19e8b5 tempest-VolumesListAdminTestJSON-248510173 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-d4bfef2f-cfb5-4d43-976d-746fb61d9613" returned: 0 in 0.482s {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 25 15:56:35 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.quobyte [None req-6a43a33b-b969-4cee-9a5e-e902fd19e8b5 tempest-VolumesListAdminTestJSON-248510173 None] <== create_volume: return (1067ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-23e9d725-3e04-4cd9-bfe0-c8ef43305589'} {{(pid=83528) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 25 15:56:35 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-6a43a33b-b969-4cee-9a5e-e902fd19e8b5 tempest-VolumesListAdminTestJSON-248510173 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.070s {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 25 15:56:35 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-6a43a33b-b969-4cee-9a5e-e902fd19e8b5 tempest-VolumesListAdminTestJSON-248510173 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e2b52302-83a5-4ed2-992a-a8a7763f7c02) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d4bfef2f-cfb5-4d43-976d-746fb61d9613', 'volume_size': 1}' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 25 15:56:35 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-6a43a33b-b969-4cee-9a5e-e902fd19e8b5 tempest-VolumesListAdminTestJSON-248510173 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b808f5c7-58b4-460a-99f1-b93b02da1698) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 25 15:56:35 devstack cinder-volume[83528]: DEBUG cinder.coordination [None req-8988f0cc-c927-4216-ab0b-66b1c75bdf33 tempest-VolumesCloneTest-1068722893 None] Lock "cinder-quobyte-2e5e9fe7-2922-4406-b8b8-56fcd71b9dfd" acquired by "delete_volume" :: waited 0.036s {{(pid=83528) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 25 15:56:35 devstack cinder-volume[83528]: DEBUG cinder.coordination [None req-7f510d4d-92fc-4737-83d5-6c1efadbe89c tempest-VolumesActionsTest-872240335 None] Lock "cinder-fc2e47da-0295-42f2-b012-09940e103fdc-delete_volume" acquired by "delete_volume" :: waited 0.059s {{(pid=83528) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 25 15:56:35 devstack cinder-volume[83528]: INFO cinder.volume.flows.manager.create_volume [None req-6a43a33b-b969-4cee-9a5e-e902fd19e8b5 tempest-VolumesListAdminTestJSON-248510173 None] Volume volume-d4bfef2f-cfb5-4d43-976d-746fb61d9613 (d4bfef2f-cfb5-4d43-976d-746fb61d9613): created successfully Feb 25 15:56:35 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-6a43a33b-b969-4cee-9a5e-e902fd19e8b5 tempest-VolumesListAdminTestJSON-248510173 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b808f5c7-58b4-460a-99f1-b93b02da1698) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 25 15:56:35 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-6a43a33b-b969-4cee-9a5e-e902fd19e8b5 tempest-VolumesListAdminTestJSON-248510173 None] Flow 'volume_create_manager' (2c906e93-60b4-422e-be6e-2383cf853251) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83528) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 25 15:56:35 devstack cinder-volume[83528]: DEBUG oslo.privsep.daemon [-] privsep: reply[73018990-782e-4ab9-9505-68ff249a1c2f]: (4, 'qcow2') {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 25 15:56:35 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-8988f0cc-c927-4216-ab0b-66b1c75bdf33 tempest-VolumesCloneTest-1068722893 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-2e5e9fe7-2922-4406-b8b8-56fcd71b9dfd {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 25 15:56:35 devstack cinder-volume[83528]: INFO cinder.volume.manager [None req-6a43a33b-b969-4cee-9a5e-e902fd19e8b5 tempest-VolumesListAdminTestJSON-248510173 None] Created volume successfully. Feb 25 15:56:35 devstack cinder-volume[83528]: DEBUG cinder.coordination [None req-7f510d4d-92fc-4737-83d5-6c1efadbe89c tempest-VolumesActionsTest-872240335 None] Acquiring lock "cinder-quobyte-fc2e47da-0295-42f2-b012-09940e103fdc" by "delete_volume" {{(pid=83528) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 25 15:56:35 devstack cinder-volume[83528]: DEBUG cinder.coordination [None req-7f510d4d-92fc-4737-83d5-6c1efadbe89c tempest-VolumesActionsTest-872240335 None] Lock "cinder-quobyte-fc2e47da-0295-42f2-b012-09940e103fdc" acquired by "delete_volume" :: waited 0.008s {{(pid=83528) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 25 15:56:35 devstack cinder-volume[83528]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d633f71-7a4b-4c47-b0be-b13e3fb82bf8]: (4, 'qcow2') {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 25 15:56:35 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-7f510d4d-92fc-4737-83d5-6c1efadbe89c tempest-VolumesActionsTest-872240335 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-fc2e47da-0295-42f2-b012-09940e103fdc {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 25 15:56:35 devstack sudo[87913]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-2e5e9fe7-2922-4406-b8b8-56fcd71b9dfd Feb 25 15:56:35 devstack sudo[87913]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 25 15:56:35 devstack sudo[87914]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-fc2e47da-0295-42f2-b012-09940e103fdc Feb 25 15:56:35 devstack sudo[87914]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 25 15:56:36 devstack sudo[87913]: pam_unix(sudo:session): session closed for user root Feb 25 15:56:36 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-8988f0cc-c927-4216-ab0b-66b1c75bdf33 tempest-VolumesCloneTest-1068722893 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-2e5e9fe7-2922-4406-b8b8-56fcd71b9dfd" returned: 0 in 0.542s {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 25 15:56:36 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-8988f0cc-c927-4216-ab0b-66b1c75bdf33 tempest-VolumesCloneTest-1068722893 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-2e5e9fe7-2922-4406-b8b8-56fcd71b9dfd {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 25 15:56:36 devstack sudo[87923]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-2e5e9fe7-2922-4406-b8b8-56fcd71b9dfd Feb 25 15:56:36 devstack sudo[87923]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 25 15:56:36 devstack sudo[87914]: pam_unix(sudo:session): session closed for user root Feb 25 15:56:36 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-7f510d4d-92fc-4737-83d5-6c1efadbe89c tempest-VolumesActionsTest-872240335 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-fc2e47da-0295-42f2-b012-09940e103fdc" returned: 0 in 0.556s {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 25 15:56:36 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-7f510d4d-92fc-4737-83d5-6c1efadbe89c tempest-VolumesActionsTest-872240335 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-fc2e47da-0295-42f2-b012-09940e103fdc {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 25 15:56:36 devstack sudo[87925]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-fc2e47da-0295-42f2-b012-09940e103fdc Feb 25 15:56:36 devstack sudo[87925]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 25 15:56:36 devstack sudo[87925]: pam_unix(sudo:session): session closed for user root Feb 25 15:56:36 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-7f510d4d-92fc-4737-83d5-6c1efadbe89c tempest-VolumesActionsTest-872240335 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-fc2e47da-0295-42f2-b012-09940e103fdc" returned: 0 in 0.500s {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 25 15:56:36 devstack cinder-volume[83528]: DEBUG cinder.coordination [None req-7f510d4d-92fc-4737-83d5-6c1efadbe89c tempest-VolumesActionsTest-872240335 None] Lock "cinder-quobyte-fc2e47da-0295-42f2-b012-09940e103fdc" released by "delete_volume" :: held 1.080s {{(pid=83528) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 25 15:56:36 devstack sudo[87923]: pam_unix(sudo:session): session closed for user root Feb 25 15:56:36 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-8988f0cc-c927-4216-ab0b-66b1c75bdf33 tempest-VolumesCloneTest-1068722893 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-2e5e9fe7-2922-4406-b8b8-56fcd71b9dfd" returned: 0 in 0.608s {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 25 15:56:36 devstack cinder-volume[83528]: DEBUG cinder.coordination [None req-8988f0cc-c927-4216-ab0b-66b1c75bdf33 tempest-VolumesCloneTest-1068722893 None] Lock "cinder-quobyte-2e5e9fe7-2922-4406-b8b8-56fcd71b9dfd" released by "delete_volume" :: held 1.204s {{(pid=83528) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 25 15:56:36 devstack cinder-volume[83528]: DEBUG cinder.quota [None req-7f510d4d-92fc-4737-83d5-6c1efadbe89c tempest-VolumesActionsTest-872240335 None] Created reservations ['eab49344-102e-4059-8d0b-4031e487641f', '53fd884c-a0d5-4142-bb67-947dd4c1eb8b', 'df6da8f3-b8f7-4179-a240-3cf25a248f9c', 'b9a75d27-b428-4ef5-9c2f-c3af0058f093'] {{(pid=83528) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 25 15:56:37 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-7f510d4d-92fc-4737-83d5-6c1efadbe89c tempest-VolumesActionsTest-872240335 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 25 15:56:37 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-7f510d4d-92fc-4737-83d5-6c1efadbe89c tempest-VolumesActionsTest-872240335 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 25 15:56:37 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.quobyte [None req-7f510d4d-92fc-4737-83d5-6c1efadbe89c tempest-VolumesActionsTest-872240335 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23e9d725-3e04-4cd9-bfe0-c8ef43305589': None} {{(pid=83528) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 25 15:56:37 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.quobyte [None req-7f510d4d-92fc-4737-83d5-6c1efadbe89c tempest-VolumesActionsTest-872240335 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23e9d725-3e04-4cd9-bfe0-c8ef43305589'] {{(pid=83528) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 25 15:56:37 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-7f510d4d-92fc-4737-83d5-6c1efadbe89c tempest-VolumesActionsTest-872240335 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 25 15:56:37 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-7f510d4d-92fc-4737-83d5-6c1efadbe89c tempest-VolumesActionsTest-872240335 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85 {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 25 15:56:37 devstack cinder-volume[83528]: DEBUG cinder.quota [None req-8988f0cc-c927-4216-ab0b-66b1c75bdf33 tempest-VolumesCloneTest-1068722893 None] Created reservations ['c275a785-34d0-4dee-bcf6-bd19c4d5f2a4', '5a51fa55-12d9-4b7e-a2cf-d33c7875f7c4', 'fe491f49-5d5d-449e-9fff-3ccd740ad601', 'ea3a0008-5f88-449b-b347-57a98842fc97'] {{(pid=83528) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 25 15:56:37 devstack sudo[87929]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85 Feb 25 15:56:37 devstack sudo[87929]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 25 15:56:37 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-8988f0cc-c927-4216-ab0b-66b1c75bdf33 tempest-VolumesCloneTest-1068722893 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 25 15:56:37 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-8988f0cc-c927-4216-ab0b-66b1c75bdf33 tempest-VolumesCloneTest-1068722893 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 25 15:56:37 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.quobyte [None req-8988f0cc-c927-4216-ab0b-66b1c75bdf33 tempest-VolumesCloneTest-1068722893 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23e9d725-3e04-4cd9-bfe0-c8ef43305589': None} {{(pid=83528) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 25 15:56:37 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.quobyte [None req-8988f0cc-c927-4216-ab0b-66b1c75bdf33 tempest-VolumesCloneTest-1068722893 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23e9d725-3e04-4cd9-bfe0-c8ef43305589'] {{(pid=83528) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 25 15:56:37 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-8988f0cc-c927-4216-ab0b-66b1c75bdf33 tempest-VolumesCloneTest-1068722893 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 25 15:56:37 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-8988f0cc-c927-4216-ab0b-66b1c75bdf33 tempest-VolumesCloneTest-1068722893 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85 {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 25 15:56:37 devstack sudo[87931]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85 Feb 25 15:56:37 devstack sudo[87931]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 25 15:56:37 devstack cinder-volume[83528]: DEBUG cinder.volume.flows.manager.create_volume [None req-ed3eade1-7664-4b87-af80-4d101b11561b tempest-VolumesListAdminTestJSON-248510173 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83528) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 25 15:56:37 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-ed3eade1-7664-4b87-af80-4d101b11561b tempest-VolumesListAdminTestJSON-248510173 None] Flow 'volume_create_manager' (f618124a-af0e-4e77-bd57-7d9421f03a51) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83528) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 25 15:56:37 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-ed3eade1-7664-4b87-af80-4d101b11561b tempest-VolumesListAdminTestJSON-248510173 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (72a6a07c-92a6-4bc3-9407-cf9bea0fe22a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 25 15:56:37 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-ed3eade1-7664-4b87-af80-4d101b11561b tempest-VolumesListAdminTestJSON-248510173 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (72a6a07c-92a6-4bc3-9407-cf9bea0fe22a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-25T14:56:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1325089531',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6f132d25-f3e2-457c-acf5-4b94e2db5e2c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='aeaf59da7a7141c79481a1e16522b8df',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-25T14:56:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-25T14:56:37Z,use_quota=True,user_id='992cac101fa04a039db50b0c5cc4503a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ce71c2f9-6543-4165-9653-a1529b2ea243),volume_type_id=ce71c2f9-6543-4165-9653-a1529b2ea243)' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 25 15:56:37 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-ed3eade1-7664-4b87-af80-4d101b11561b tempest-VolumesListAdminTestJSON-248510173 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (67a9bdae-d012-4cc2-af47-12b90d50c813) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 25 15:56:37 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-ed3eade1-7664-4b87-af80-4d101b11561b tempest-VolumesListAdminTestJSON-248510173 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (67a9bdae-d012-4cc2-af47-12b90d50c813) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 25 15:56:37 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-ed3eade1-7664-4b87-af80-4d101b11561b tempest-VolumesListAdminTestJSON-248510173 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7f451d41-868a-4a7f-b4ca-14708876ba2b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 25 15:56:37 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-ed3eade1-7664-4b87-af80-4d101b11561b tempest-VolumesListAdminTestJSON-248510173 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7f451d41-868a-4a7f-b4ca-14708876ba2b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6f132d25-f3e2-457c-acf5-4b94e2db5e2c', 'volume_name': 'volume-6f132d25-f3e2-457c-acf5-4b94e2db5e2c', 'volume_size': 1}' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 25 15:56:37 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-ed3eade1-7664-4b87-af80-4d101b11561b tempest-VolumesListAdminTestJSON-248510173 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5bb13991-d108-4814-80a1-5a9d03831d72) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 25 15:56:37 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-ed3eade1-7664-4b87-af80-4d101b11561b tempest-VolumesListAdminTestJSON-248510173 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5bb13991-d108-4814-80a1-5a9d03831d72) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 25 15:56:37 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-ed3eade1-7664-4b87-af80-4d101b11561b tempest-VolumesListAdminTestJSON-248510173 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d22eb6c5-77b5-431a-bcf0-65f4711726cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 25 15:56:37 devstack cinder-volume[83528]: INFO cinder.volume.flows.manager.create_volume [None req-ed3eade1-7664-4b87-af80-4d101b11561b tempest-VolumesListAdminTestJSON-248510173 None] Volume 6f132d25-f3e2-457c-acf5-4b94e2db5e2c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6f132d25-f3e2-457c-acf5-4b94e2db5e2c', 'volume_size': 1} Feb 25 15:56:37 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-ed3eade1-7664-4b87-af80-4d101b11561b tempest-VolumesListAdminTestJSON-248510173 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 25 15:56:37 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-ed3eade1-7664-4b87-af80-4d101b11561b tempest-VolumesListAdminTestJSON-248510173 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 25 15:56:37 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.quobyte [None req-ed3eade1-7664-4b87-af80-4d101b11561b tempest-VolumesListAdminTestJSON-248510173 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-25T14:56:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1325089531',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6f132d25-f3e2-457c-acf5-4b94e2db5e2c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='aeaf59da7a7141c79481a1e16522b8df',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-25T14:56:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-25T14:56:37Z,use_quota=True,user_id='992cac101fa04a039db50b0c5cc4503a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ce71c2f9-6543-4165-9653-a1529b2ea243),volume_type_id=ce71c2f9-6543-4165-9653-a1529b2ea243)}" {{(pid=83528) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 25 15:56:37 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.remotefs [None req-ed3eade1-7664-4b87-af80-4d101b11561b tempest-VolumesListAdminTestJSON-248510173 None] Creating volume 6f132d25-f3e2-457c-acf5-4b94e2db5e2c {{(pid=83528) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 25 15:56:37 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-ed3eade1-7664-4b87-af80-4d101b11561b tempest-VolumesListAdminTestJSON-248510173 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 25 15:56:37 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-ed3eade1-7664-4b87-af80-4d101b11561b tempest-VolumesListAdminTestJSON-248510173 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 25 15:56:37 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.quobyte [None req-ed3eade1-7664-4b87-af80-4d101b11561b tempest-VolumesListAdminTestJSON-248510173 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23e9d725-3e04-4cd9-bfe0-c8ef43305589': None} {{(pid=83528) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 25 15:56:37 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.quobyte [None req-ed3eade1-7664-4b87-af80-4d101b11561b tempest-VolumesListAdminTestJSON-248510173 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23e9d725-3e04-4cd9-bfe0-c8ef43305589'] {{(pid=83528) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 25 15:56:37 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-ed3eade1-7664-4b87-af80-4d101b11561b tempest-VolumesListAdminTestJSON-248510173 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 25 15:56:37 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.quobyte [None req-ed3eade1-7664-4b87-af80-4d101b11561b tempest-VolumesListAdminTestJSON-248510173 None] Selected osci02.corp.quobyte.com/cinder-vol-23e9d725-3e04-4cd9-bfe0-c8ef43305589 as target Quobyte volume. {{(pid=83528) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 25 15:56:37 devstack cinder-volume[83528]: INFO cinder.volume.drivers.remotefs [None req-ed3eade1-7664-4b87-af80-4d101b11561b tempest-VolumesListAdminTestJSON-248510173 None] casted to osci02.corp.quobyte.com/cinder-vol-23e9d725-3e04-4cd9-bfe0-c8ef43305589 Feb 25 15:56:37 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-ed3eade1-7664-4b87-af80-4d101b11561b tempest-VolumesListAdminTestJSON-248510173 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-6f132d25-f3e2-457c-acf5-4b94e2db5e2c 1073741824 {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 25 15:56:37 devstack sudo[87933]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-6f132d25-f3e2-457c-acf5-4b94e2db5e2c 1073741824 Feb 25 15:56:37 devstack sudo[87933]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 25 15:56:37 devstack sudo[87929]: pam_unix(sudo:session): session closed for user root Feb 25 15:56:37 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-7f510d4d-92fc-4737-83d5-6c1efadbe89c tempest-VolumesActionsTest-872240335 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85" returned: 0 in 0.554s {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 25 15:56:37 devstack cinder-volume[83528]: DEBUG cinder.manager [None req-7f510d4d-92fc-4737-83d5-6c1efadbe89c tempest-VolumesActionsTest-872240335 None] Notifying Schedulers of capabilities ... {{(pid=83528) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 25 15:56:37 devstack cinder-volume[83528]: INFO cinder.volume.manager [None req-7f510d4d-92fc-4737-83d5-6c1efadbe89c tempest-VolumesActionsTest-872240335 None] Deleted volume successfully. Feb 25 15:56:37 devstack cinder-volume[83528]: DEBUG cinder.coordination [None req-7f510d4d-92fc-4737-83d5-6c1efadbe89c tempest-VolumesActionsTest-872240335 None] Lock "cinder-fc2e47da-0295-42f2-b012-09940e103fdc-delete_volume" released by "delete_volume" :: held 1.864s {{(pid=83528) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 25 15:56:37 devstack sudo[87931]: pam_unix(sudo:session): session closed for user root Feb 25 15:56:37 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-8988f0cc-c927-4216-ab0b-66b1c75bdf33 tempest-VolumesCloneTest-1068722893 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85" returned: 0 in 0.578s {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 25 15:56:37 devstack cinder-volume[83528]: DEBUG cinder.manager [None req-8988f0cc-c927-4216-ab0b-66b1c75bdf33 tempest-VolumesCloneTest-1068722893 None] Notifying Schedulers of capabilities ... {{(pid=83528) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 25 15:56:37 devstack cinder-volume[83528]: INFO cinder.volume.manager [None req-8988f0cc-c927-4216-ab0b-66b1c75bdf33 tempest-VolumesCloneTest-1068722893 None] Deleted volume successfully. Feb 25 15:56:37 devstack cinder-volume[83528]: DEBUG cinder.coordination [None req-8988f0cc-c927-4216-ab0b-66b1c75bdf33 tempest-VolumesCloneTest-1068722893 None] Lock "cinder-2e5e9fe7-2922-4406-b8b8-56fcd71b9dfd-delete_volume" released by "delete_volume" :: held 2.049s {{(pid=83528) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 25 15:56:37 devstack sudo[87933]: pam_unix(sudo:session): session closed for user root Feb 25 15:56:37 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-ed3eade1-7664-4b87-af80-4d101b11561b tempest-VolumesListAdminTestJSON-248510173 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-6f132d25-f3e2-457c-acf5-4b94e2db5e2c 1073741824" returned: 0 in 0.592s {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 25 15:56:37 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-ed3eade1-7664-4b87-af80-4d101b11561b tempest-VolumesListAdminTestJSON-248510173 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-6f132d25-f3e2-457c-acf5-4b94e2db5e2c {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 25 15:56:37 devstack sudo[87940]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-6f132d25-f3e2-457c-acf5-4b94e2db5e2c Feb 25 15:56:37 devstack sudo[87940]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 25 15:56:38 devstack sudo[87940]: pam_unix(sudo:session): session closed for user root Feb 25 15:56:38 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-ed3eade1-7664-4b87-af80-4d101b11561b tempest-VolumesListAdminTestJSON-248510173 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-6f132d25-f3e2-457c-acf5-4b94e2db5e2c" returned: 0 in 0.623s {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 25 15:56:38 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.quobyte [None req-ed3eade1-7664-4b87-af80-4d101b11561b tempest-VolumesListAdminTestJSON-248510173 None] <== create_volume: return (1255ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-23e9d725-3e04-4cd9-bfe0-c8ef43305589'} {{(pid=83528) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 25 15:56:38 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-ed3eade1-7664-4b87-af80-4d101b11561b tempest-VolumesListAdminTestJSON-248510173 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.257s {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 25 15:56:38 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-ed3eade1-7664-4b87-af80-4d101b11561b tempest-VolumesListAdminTestJSON-248510173 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d22eb6c5-77b5-431a-bcf0-65f4711726cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6f132d25-f3e2-457c-acf5-4b94e2db5e2c', 'volume_size': 1}' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 25 15:56:38 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-ed3eade1-7664-4b87-af80-4d101b11561b tempest-VolumesListAdminTestJSON-248510173 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (885d5aa9-b7f7-467d-a386-9a1fcd86d712) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 25 15:56:38 devstack cinder-volume[83528]: INFO cinder.volume.flows.manager.create_volume [None req-ed3eade1-7664-4b87-af80-4d101b11561b tempest-VolumesListAdminTestJSON-248510173 None] Volume volume-6f132d25-f3e2-457c-acf5-4b94e2db5e2c (6f132d25-f3e2-457c-acf5-4b94e2db5e2c): created successfully Feb 25 15:56:38 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-ed3eade1-7664-4b87-af80-4d101b11561b tempest-VolumesListAdminTestJSON-248510173 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (885d5aa9-b7f7-467d-a386-9a1fcd86d712) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 25 15:56:38 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-ed3eade1-7664-4b87-af80-4d101b11561b tempest-VolumesListAdminTestJSON-248510173 None] Flow 'volume_create_manager' (f618124a-af0e-4e77-bd57-7d9421f03a51) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83528) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 25 15:56:38 devstack cinder-volume[83528]: INFO cinder.volume.manager [None req-ed3eade1-7664-4b87-af80-4d101b11561b tempest-VolumesListAdminTestJSON-248510173 None] Created volume successfully. Feb 25 15:56:38 devstack cinder-volume[83528]: DEBUG oslo_service.periodic_task [None req-d4c764ec-0ebb-4b31-b534-c9a53c1ab0dd None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=83528) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Feb 25 15:56:38 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-d4c764ec-0ebb-4b31-b534-c9a53c1ab0dd None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 25 15:56:38 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-d4c764ec-0ebb-4b31-b534-c9a53c1ab0dd None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 25 15:56:38 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.quobyte [None req-d4c764ec-0ebb-4b31-b534-c9a53c1ab0dd None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23e9d725-3e04-4cd9-bfe0-c8ef43305589': None} {{(pid=83528) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 25 15:56:38 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.quobyte [None req-d4c764ec-0ebb-4b31-b534-c9a53c1ab0dd None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23e9d725-3e04-4cd9-bfe0-c8ef43305589'] {{(pid=83528) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 25 15:56:38 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-d4c764ec-0ebb-4b31-b534-c9a53c1ab0dd None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 25 15:56:38 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-d4c764ec-0ebb-4b31-b534-c9a53c1ab0dd None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85 {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 25 15:56:38 devstack sudo[87943]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85 Feb 25 15:56:38 devstack sudo[87943]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 25 15:56:39 devstack sudo[87943]: pam_unix(sudo:session): session closed for user root Feb 25 15:56:39 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-d4c764ec-0ebb-4b31-b534-c9a53c1ab0dd None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85" returned: 0 in 0.655s {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 25 15:56:39 devstack cinder-volume[83528]: DEBUG cinder.manager [None req-d4c764ec-0ebb-4b31-b534-c9a53c1ab0dd None None] Notifying Schedulers of capabilities ... {{(pid=83528) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 25 15:56:39 devstack cinder-volume[83528]: DEBUG cinder.volume.flows.manager.create_volume [None req-36287e40-990b-4c82-b9ef-e83459514c25 tempest-VolumesListAdminTestJSON-248510173 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83528) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 25 15:56:39 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-36287e40-990b-4c82-b9ef-e83459514c25 tempest-VolumesListAdminTestJSON-248510173 None] Flow 'volume_create_manager' (5e28bc91-bd65-4b15-a25a-f8879c48c9a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83528) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 25 15:56:39 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-36287e40-990b-4c82-b9ef-e83459514c25 tempest-VolumesListAdminTestJSON-248510173 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cf7c1d6e-25d9-4379-82ef-381c588e9eeb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 25 15:56:39 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-36287e40-990b-4c82-b9ef-e83459514c25 tempest-VolumesListAdminTestJSON-248510173 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cf7c1d6e-25d9-4379-82ef-381c588e9eeb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-25T14:56:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1245989599',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4ade29ec-8417-491e-b46d-2528bed5d175,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='aeaf59da7a7141c79481a1e16522b8df',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-25T14:56:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-25T14:56:40Z,use_quota=True,user_id='992cac101fa04a039db50b0c5cc4503a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ce71c2f9-6543-4165-9653-a1529b2ea243),volume_type_id=ce71c2f9-6543-4165-9653-a1529b2ea243)' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 25 15:56:39 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-36287e40-990b-4c82-b9ef-e83459514c25 tempest-VolumesListAdminTestJSON-248510173 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cfb1e3de-9be0-4fa8-a659-4c5fbe18ba29) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 25 15:56:39 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-36287e40-990b-4c82-b9ef-e83459514c25 tempest-VolumesListAdminTestJSON-248510173 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cfb1e3de-9be0-4fa8-a659-4c5fbe18ba29) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 25 15:56:39 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-36287e40-990b-4c82-b9ef-e83459514c25 tempest-VolumesListAdminTestJSON-248510173 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0e58e478-9b9e-4de3-ac6d-066a3192fbcb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 25 15:56:39 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-36287e40-990b-4c82-b9ef-e83459514c25 tempest-VolumesListAdminTestJSON-248510173 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0e58e478-9b9e-4de3-ac6d-066a3192fbcb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4ade29ec-8417-491e-b46d-2528bed5d175', 'volume_name': 'volume-4ade29ec-8417-491e-b46d-2528bed5d175', 'volume_size': 1}' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 25 15:56:39 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-36287e40-990b-4c82-b9ef-e83459514c25 tempest-VolumesListAdminTestJSON-248510173 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1a9b2c7b-c6ae-43fc-9e40-af6a951f68c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 25 15:56:39 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-36287e40-990b-4c82-b9ef-e83459514c25 tempest-VolumesListAdminTestJSON-248510173 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1a9b2c7b-c6ae-43fc-9e40-af6a951f68c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 25 15:56:39 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-36287e40-990b-4c82-b9ef-e83459514c25 tempest-VolumesListAdminTestJSON-248510173 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f047e8bb-97ed-4dcc-b1ca-490fc2c6f029) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 25 15:56:39 devstack cinder-volume[83528]: INFO cinder.volume.flows.manager.create_volume [None req-36287e40-990b-4c82-b9ef-e83459514c25 tempest-VolumesListAdminTestJSON-248510173 None] Volume 4ade29ec-8417-491e-b46d-2528bed5d175: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4ade29ec-8417-491e-b46d-2528bed5d175', 'volume_size': 1} Feb 25 15:56:39 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-36287e40-990b-4c82-b9ef-e83459514c25 tempest-VolumesListAdminTestJSON-248510173 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 25 15:56:39 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-36287e40-990b-4c82-b9ef-e83459514c25 tempest-VolumesListAdminTestJSON-248510173 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 25 15:56:39 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.quobyte [None req-36287e40-990b-4c82-b9ef-e83459514c25 tempest-VolumesListAdminTestJSON-248510173 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-25T14:56:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1245989599',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4ade29ec-8417-491e-b46d-2528bed5d175,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='aeaf59da7a7141c79481a1e16522b8df',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-25T14:56:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-25T14:56:40Z,use_quota=True,user_id='992cac101fa04a039db50b0c5cc4503a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ce71c2f9-6543-4165-9653-a1529b2ea243),volume_type_id=ce71c2f9-6543-4165-9653-a1529b2ea243)}" {{(pid=83528) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 25 15:56:39 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.remotefs [None req-36287e40-990b-4c82-b9ef-e83459514c25 tempest-VolumesListAdminTestJSON-248510173 None] Creating volume 4ade29ec-8417-491e-b46d-2528bed5d175 {{(pid=83528) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 25 15:56:39 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-36287e40-990b-4c82-b9ef-e83459514c25 tempest-VolumesListAdminTestJSON-248510173 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 25 15:56:39 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-36287e40-990b-4c82-b9ef-e83459514c25 tempest-VolumesListAdminTestJSON-248510173 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 25 15:56:39 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.quobyte [None req-36287e40-990b-4c82-b9ef-e83459514c25 tempest-VolumesListAdminTestJSON-248510173 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23e9d725-3e04-4cd9-bfe0-c8ef43305589': None} {{(pid=83528) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 25 15:56:39 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.quobyte [None req-36287e40-990b-4c82-b9ef-e83459514c25 tempest-VolumesListAdminTestJSON-248510173 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23e9d725-3e04-4cd9-bfe0-c8ef43305589'] {{(pid=83528) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 25 15:56:39 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-36287e40-990b-4c82-b9ef-e83459514c25 tempest-VolumesListAdminTestJSON-248510173 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 25 15:56:39 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.quobyte [None req-36287e40-990b-4c82-b9ef-e83459514c25 tempest-VolumesListAdminTestJSON-248510173 None] Selected osci02.corp.quobyte.com/cinder-vol-23e9d725-3e04-4cd9-bfe0-c8ef43305589 as target Quobyte volume. {{(pid=83528) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 25 15:56:39 devstack cinder-volume[83528]: INFO cinder.volume.drivers.remotefs [None req-36287e40-990b-4c82-b9ef-e83459514c25 tempest-VolumesListAdminTestJSON-248510173 None] casted to osci02.corp.quobyte.com/cinder-vol-23e9d725-3e04-4cd9-bfe0-c8ef43305589 Feb 25 15:56:39 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-36287e40-990b-4c82-b9ef-e83459514c25 tempest-VolumesListAdminTestJSON-248510173 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-4ade29ec-8417-491e-b46d-2528bed5d175 1073741824 {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 25 15:56:39 devstack sudo[87946]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-4ade29ec-8417-491e-b46d-2528bed5d175 1073741824 Feb 25 15:56:39 devstack sudo[87946]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 25 15:56:40 devstack sudo[87946]: pam_unix(sudo:session): session closed for user root Feb 25 15:56:40 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-36287e40-990b-4c82-b9ef-e83459514c25 tempest-VolumesListAdminTestJSON-248510173 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-4ade29ec-8417-491e-b46d-2528bed5d175 1073741824" returned: 0 in 0.770s {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 25 15:56:40 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-36287e40-990b-4c82-b9ef-e83459514c25 tempest-VolumesListAdminTestJSON-248510173 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-4ade29ec-8417-491e-b46d-2528bed5d175 {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 25 15:56:40 devstack sudo[87952]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-4ade29ec-8417-491e-b46d-2528bed5d175 Feb 25 15:56:40 devstack sudo[87952]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 25 15:56:40 devstack cinder-volume[83528]: DEBUG cinder.volume.flows.manager.create_volume [None req-6db607ed-ede0-4707-a51a-9cf4986972af tempest-VolumesExtendTest-1653409646 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83528) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 25 15:56:40 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-6db607ed-ede0-4707-a51a-9cf4986972af tempest-VolumesExtendTest-1653409646 None] Flow 'volume_create_manager' (d7a601fe-6eba-4357-904e-88b4bf172953) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83528) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 25 15:56:40 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-6db607ed-ede0-4707-a51a-9cf4986972af tempest-VolumesExtendTest-1653409646 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (949061ee-a24c-4da3-9856-2d0fd433eb63) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 25 15:56:40 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-6db607ed-ede0-4707-a51a-9cf4986972af tempest-VolumesExtendTest-1653409646 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (949061ee-a24c-4da3-9856-2d0fd433eb63) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-25T14:56:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1250681839',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6128762f-0997-49a7-b003-83bc847ca750,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4e100b25ed944f5387843bf79988c4c1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-25T14:56:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-25T14:56:41Z,use_quota=True,user_id='0efb7c6adabb488b9b6983c194febe7f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ce71c2f9-6543-4165-9653-a1529b2ea243),volume_type_id=ce71c2f9-6543-4165-9653-a1529b2ea243)' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 25 15:56:40 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-6db607ed-ede0-4707-a51a-9cf4986972af tempest-VolumesExtendTest-1653409646 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7a83bd9a-67e8-49d8-bdf4-c6656ab3e7be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 25 15:56:40 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-6db607ed-ede0-4707-a51a-9cf4986972af tempest-VolumesExtendTest-1653409646 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7a83bd9a-67e8-49d8-bdf4-c6656ab3e7be) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 25 15:56:40 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-6db607ed-ede0-4707-a51a-9cf4986972af tempest-VolumesExtendTest-1653409646 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (75adc942-9fe5-42b1-9982-2d1cddde19f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 25 15:56:40 devstack cinder-volume[83528]: DEBUG cinder.image.glance [None req-6db607ed-ede0-4707-a51a-9cf4986972af tempest-VolumesExtendTest-1653409646 None] Creating Keystone auth plugin from conf {{(pid=83528) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Feb 25 15:56:41 devstack sudo[87952]: pam_unix(sudo:session): session closed for user root Feb 25 15:56:41 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-36287e40-990b-4c82-b9ef-e83459514c25 tempest-VolumesListAdminTestJSON-248510173 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-4ade29ec-8417-491e-b46d-2528bed5d175" returned: 0 in 0.612s {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 25 15:56:41 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.quobyte [None req-36287e40-990b-4c82-b9ef-e83459514c25 tempest-VolumesListAdminTestJSON-248510173 None] <== create_volume: return (1445ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-23e9d725-3e04-4cd9-bfe0-c8ef43305589'} {{(pid=83528) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 25 15:56:41 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-36287e40-990b-4c82-b9ef-e83459514c25 tempest-VolumesListAdminTestJSON-248510173 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.448s {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 25 15:56:41 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-6db607ed-ede0-4707-a51a-9cf4986972af tempest-VolumesExtendTest-1653409646 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (75adc942-9fe5-42b1-9982-2d1cddde19f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '6128762f-0997-49a7-b003-83bc847ca750', 'volume_name': 'volume-6128762f-0997-49a7-b003-83bc847ca750', 'volume_size': 1, 'image_id': 'c50f3ecd-5e88-4737-aa36-6e073ce70c60', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/c50f3ecd-5e88-4737-aa36-6e073ce70c60', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '75f8571da0ad46ec8e734ab2a4fa231d', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'c50f3ecd-5e88-4737-aa36-6e073ce70c60', 'created_at': datetime.datetime(2026, 2, 25, 14, 47, 16, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 2, 25, 14, 47, 18, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/c50f3ecd-5e88-4737-aa36-6e073ce70c60/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 25 15:56:41 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-6db607ed-ede0-4707-a51a-9cf4986972af tempest-VolumesExtendTest-1653409646 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (af78a754-f441-42f1-8af9-05189863b33d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 25 15:56:41 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-6db607ed-ede0-4707-a51a-9cf4986972af tempest-VolumesExtendTest-1653409646 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (af78a754-f441-42f1-8af9-05189863b33d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 25 15:56:41 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-6db607ed-ede0-4707-a51a-9cf4986972af tempest-VolumesExtendTest-1653409646 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6d8565bd-d6ab-4783-8328-3005f64d7eb5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 25 15:56:41 devstack cinder-volume[83528]: INFO cinder.volume.flows.manager.create_volume [None req-6db607ed-ede0-4707-a51a-9cf4986972af tempest-VolumesExtendTest-1653409646 None] Volume 6128762f-0997-49a7-b003-83bc847ca750: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-6128762f-0997-49a7-b003-83bc847ca750', 'volume_size': 1, 'image_id': 'c50f3ecd-5e88-4737-aa36-6e073ce70c60', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/c50f3ecd-5e88-4737-aa36-6e073ce70c60', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '75f8571da0ad46ec8e734ab2a4fa231d', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'c50f3ecd-5e88-4737-aa36-6e073ce70c60', 'created_at': datetime.datetime(2026, 2, 25, 14, 47, 16, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 2, 25, 14, 47, 18, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/c50f3ecd-5e88-4737-aa36-6e073ce70c60/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Feb 25 15:56:41 devstack cinder-volume[83528]: DEBUG cinder.volume.flows.manager.create_volume [None req-6db607ed-ede0-4707-a51a-9cf4986972af tempest-VolumesExtendTest-1653409646 None] Trying to clone 6128762f-0997-49a7-b003-83bc847ca750 from image c50f3ecd-5e88-4737-aa36-6e073ce70c60 at location (None, [{'url': 'file:///opt/stack/data/glance/images/c50f3ecd-5e88-4737-aa36-6e073ce70c60', 'metadata': {}}]). {{(pid=83528) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1082}} Feb 25 15:56:41 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-36287e40-990b-4c82-b9ef-e83459514c25 tempest-VolumesListAdminTestJSON-248510173 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f047e8bb-97ed-4dcc-b1ca-490fc2c6f029) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4ade29ec-8417-491e-b46d-2528bed5d175', 'volume_size': 1}' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 25 15:56:41 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-36287e40-990b-4c82-b9ef-e83459514c25 tempest-VolumesListAdminTestJSON-248510173 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8e384408-bd63-4a8f-a77e-b7654d4fa4e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 25 15:56:41 devstack cinder-volume[83528]: INFO cinder.volume.flows.manager.create_volume [None req-36287e40-990b-4c82-b9ef-e83459514c25 tempest-VolumesListAdminTestJSON-248510173 None] Volume volume-4ade29ec-8417-491e-b46d-2528bed5d175 (4ade29ec-8417-491e-b46d-2528bed5d175): created successfully Feb 25 15:56:41 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-36287e40-990b-4c82-b9ef-e83459514c25 tempest-VolumesListAdminTestJSON-248510173 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8e384408-bd63-4a8f-a77e-b7654d4fa4e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 25 15:56:41 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-36287e40-990b-4c82-b9ef-e83459514c25 tempest-VolumesListAdminTestJSON-248510173 None] Flow 'volume_create_manager' (5e28bc91-bd65-4b15-a25a-f8879c48c9a1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83528) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 25 15:56:41 devstack cinder-volume[83528]: INFO cinder.volume.manager [None req-36287e40-990b-4c82-b9ef-e83459514c25 tempest-VolumesListAdminTestJSON-248510173 None] Created volume successfully. Feb 25 15:56:41 devstack cinder-volume[83528]: DEBUG cinder.image.image_utils [None req-6db607ed-ede0-4707-a51a-9cf4986972af tempest-VolumesExtendTest-1653409646 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_c50f3ecd-5e88-4737-aa36-6e073ce70c60_qrtd_ka1devstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=83528) fetch /opt/stack/cinder/cinder/image/image_utils.py:732}} Feb 25 15:56:41 devstack cinder-volume[83528]: INFO cinder.image.image_utils [None req-6db607ed-ede0-4707-a51a-9cf4986972af tempest-VolumesExtendTest-1653409646 None] Image download 20.69 MB at 20.69 MB/s Feb 25 15:56:41 devstack cinder-volume[83528]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d6e4f31-ea70-4b74-91c8-636335bd6392]: (4, 'qcow2') {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 25 15:56:41 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-6db607ed-ede0-4707-a51a-9cf4986972af tempest-VolumesExtendTest-1653409646 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c50f3ecd-5e88-4737-aa36-6e073ce70c60_qrtd_ka1devstack@QuobyteHD {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 25 15:56:41 devstack sudo[87956]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c50f3ecd-5e88-4737-aa36-6e073ce70c60_qrtd_ka1devstack@QuobyteHD Feb 25 15:56:41 devstack sudo[87956]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 25 15:56:42 devstack sudo[87956]: pam_unix(sudo:session): session closed for user root Feb 25 15:56:42 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-6db607ed-ede0-4707-a51a-9cf4986972af tempest-VolumesExtendTest-1653409646 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c50f3ecd-5e88-4737-aa36-6e073ce70c60_qrtd_ka1devstack@QuobyteHD" returned: 0 in 0.801s {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 25 15:56:42 devstack cinder-volume[83528]: DEBUG cinder.image.image_utils [None req-6db607ed-ede0-4707-a51a-9cf4986972af tempest-VolumesExtendTest-1653409646 None] Temporary image c50f3ecd-5e88-4737-aa36-6e073ce70c60 is fetched for user 0efb7c6adabb488b9b6983c194febe7f. {{(pid=83528) fetch /opt/stack/cinder/cinder/image/image_utils.py:1431}} Feb 25 15:56:42 devstack cinder-volume[83528]: DEBUG oslo.privsep.daemon [-] privsep: reply[84dcaa5f-498a-49ab-b7f2-a68be4412c4d]: (4, 'qcow2') {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 25 15:56:42 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-6db607ed-ede0-4707-a51a-9cf4986972af tempest-VolumesExtendTest-1653409646 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c50f3ecd-5e88-4737-aa36-6e073ce70c60_qrtd_ka1devstack@QuobyteHD {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 25 15:56:42 devstack sudo[87961]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c50f3ecd-5e88-4737-aa36-6e073ce70c60_qrtd_ka1devstack@QuobyteHD Feb 25 15:56:42 devstack sudo[87961]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 25 15:56:42 devstack cinder-volume[83528]: DEBUG cinder.volume.flows.manager.create_volume [None req-66e90e74-7dd2-42d5-af06-68dc321375e9 tempest-VolumesListAdminTestJSON-163646571 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83528) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 25 15:56:42 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-66e90e74-7dd2-42d5-af06-68dc321375e9 tempest-VolumesListAdminTestJSON-163646571 None] Flow 'volume_create_manager' (cdd3c350-6dae-4a8c-abac-15853962d6c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83528) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 25 15:56:42 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-66e90e74-7dd2-42d5-af06-68dc321375e9 tempest-VolumesListAdminTestJSON-163646571 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c4ce5616-3850-4c8d-bc61-4af2396fe08e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 25 15:56:42 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-66e90e74-7dd2-42d5-af06-68dc321375e9 tempest-VolumesListAdminTestJSON-163646571 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c4ce5616-3850-4c8d-bc61-4af2396fe08e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-25T14:56:42Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8da63c5f-622c-427a-aa29-ab4c8c9de34a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dc00649d696941c89c1cc8d6bae43ae8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-25T14:56:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-25T14:56:43Z,use_quota=True,user_id='fceaf91d3bd24d5c82b66dd588f8634d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ce71c2f9-6543-4165-9653-a1529b2ea243),volume_type_id=ce71c2f9-6543-4165-9653-a1529b2ea243)' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 25 15:56:42 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-66e90e74-7dd2-42d5-af06-68dc321375e9 tempest-VolumesListAdminTestJSON-163646571 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (558857f1-037a-4601-b7a5-c6c14e000243) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 25 15:56:42 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-66e90e74-7dd2-42d5-af06-68dc321375e9 tempest-VolumesListAdminTestJSON-163646571 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (558857f1-037a-4601-b7a5-c6c14e000243) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 25 15:56:42 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-66e90e74-7dd2-42d5-af06-68dc321375e9 tempest-VolumesListAdminTestJSON-163646571 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (598bf064-5c08-476a-a11c-65d44f6dae2c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 25 15:56:42 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-66e90e74-7dd2-42d5-af06-68dc321375e9 tempest-VolumesListAdminTestJSON-163646571 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (598bf064-5c08-476a-a11c-65d44f6dae2c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8da63c5f-622c-427a-aa29-ab4c8c9de34a', 'volume_name': 'volume-8da63c5f-622c-427a-aa29-ab4c8c9de34a', 'volume_size': 1}' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 25 15:56:42 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-66e90e74-7dd2-42d5-af06-68dc321375e9 tempest-VolumesListAdminTestJSON-163646571 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ea6b6078-2f34-4926-bd55-6abcef0893a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 25 15:56:42 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-66e90e74-7dd2-42d5-af06-68dc321375e9 tempest-VolumesListAdminTestJSON-163646571 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ea6b6078-2f34-4926-bd55-6abcef0893a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 25 15:56:42 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-66e90e74-7dd2-42d5-af06-68dc321375e9 tempest-VolumesListAdminTestJSON-163646571 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8d753ef6-9b90-4960-80e9-bdd34df7a635) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 25 15:56:42 devstack cinder-volume[83528]: INFO cinder.volume.flows.manager.create_volume [None req-66e90e74-7dd2-42d5-af06-68dc321375e9 tempest-VolumesListAdminTestJSON-163646571 None] Volume 8da63c5f-622c-427a-aa29-ab4c8c9de34a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8da63c5f-622c-427a-aa29-ab4c8c9de34a', 'volume_size': 1} Feb 25 15:56:42 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-66e90e74-7dd2-42d5-af06-68dc321375e9 tempest-VolumesListAdminTestJSON-163646571 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 25 15:56:42 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-66e90e74-7dd2-42d5-af06-68dc321375e9 tempest-VolumesListAdminTestJSON-163646571 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 25 15:56:42 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.quobyte [None req-66e90e74-7dd2-42d5-af06-68dc321375e9 tempest-VolumesListAdminTestJSON-163646571 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-25T14:56:42Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8da63c5f-622c-427a-aa29-ab4c8c9de34a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dc00649d696941c89c1cc8d6bae43ae8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-25T14:56:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-25T14:56:43Z,use_quota=True,user_id='fceaf91d3bd24d5c82b66dd588f8634d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ce71c2f9-6543-4165-9653-a1529b2ea243),volume_type_id=ce71c2f9-6543-4165-9653-a1529b2ea243)}" {{(pid=83528) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 25 15:56:42 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.remotefs [None req-66e90e74-7dd2-42d5-af06-68dc321375e9 tempest-VolumesListAdminTestJSON-163646571 None] Creating volume 8da63c5f-622c-427a-aa29-ab4c8c9de34a {{(pid=83528) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 25 15:56:42 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-66e90e74-7dd2-42d5-af06-68dc321375e9 tempest-VolumesListAdminTestJSON-163646571 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 25 15:56:42 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-66e90e74-7dd2-42d5-af06-68dc321375e9 tempest-VolumesListAdminTestJSON-163646571 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 25 15:56:42 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.quobyte [None req-66e90e74-7dd2-42d5-af06-68dc321375e9 tempest-VolumesListAdminTestJSON-163646571 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23e9d725-3e04-4cd9-bfe0-c8ef43305589': None} {{(pid=83528) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 25 15:56:42 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.quobyte [None req-66e90e74-7dd2-42d5-af06-68dc321375e9 tempest-VolumesListAdminTestJSON-163646571 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23e9d725-3e04-4cd9-bfe0-c8ef43305589'] {{(pid=83528) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 25 15:56:42 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-66e90e74-7dd2-42d5-af06-68dc321375e9 tempest-VolumesListAdminTestJSON-163646571 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 25 15:56:42 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.quobyte [None req-66e90e74-7dd2-42d5-af06-68dc321375e9 tempest-VolumesListAdminTestJSON-163646571 None] Selected osci02.corp.quobyte.com/cinder-vol-23e9d725-3e04-4cd9-bfe0-c8ef43305589 as target Quobyte volume. {{(pid=83528) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 25 15:56:42 devstack cinder-volume[83528]: INFO cinder.volume.drivers.remotefs [None req-66e90e74-7dd2-42d5-af06-68dc321375e9 tempest-VolumesListAdminTestJSON-163646571 None] casted to osci02.corp.quobyte.com/cinder-vol-23e9d725-3e04-4cd9-bfe0-c8ef43305589 Feb 25 15:56:42 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-66e90e74-7dd2-42d5-af06-68dc321375e9 tempest-VolumesListAdminTestJSON-163646571 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-8da63c5f-622c-427a-aa29-ab4c8c9de34a 1073741824 {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 25 15:56:42 devstack sudo[87964]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-8da63c5f-622c-427a-aa29-ab4c8c9de34a 1073741824 Feb 25 15:56:42 devstack sudo[87964]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 25 15:56:43 devstack sudo[87961]: pam_unix(sudo:session): session closed for user root Feb 25 15:56:43 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-6db607ed-ede0-4707-a51a-9cf4986972af tempest-VolumesExtendTest-1653409646 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c50f3ecd-5e88-4737-aa36-6e073ce70c60_qrtd_ka1devstack@QuobyteHD" returned: 0 in 0.801s {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 25 15:56:43 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-6db607ed-ede0-4707-a51a-9cf4986972af tempest-VolumesExtendTest-1653409646 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 25 15:56:43 devstack sudo[87964]: pam_unix(sudo:session): session closed for user root Feb 25 15:56:43 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-66e90e74-7dd2-42d5-af06-68dc321375e9 tempest-VolumesListAdminTestJSON-163646571 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-8da63c5f-622c-427a-aa29-ab4c8c9de34a 1073741824" returned: 0 in 0.689s {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 25 15:56:43 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-66e90e74-7dd2-42d5-af06-68dc321375e9 tempest-VolumesListAdminTestJSON-163646571 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-8da63c5f-622c-427a-aa29-ab4c8c9de34a {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 25 15:56:43 devstack sudo[87972]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-8da63c5f-622c-427a-aa29-ab4c8c9de34a Feb 25 15:56:43 devstack sudo[87972]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 25 15:56:44 devstack sudo[87972]: pam_unix(sudo:session): session closed for user root Feb 25 15:56:44 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-66e90e74-7dd2-42d5-af06-68dc321375e9 tempest-VolumesListAdminTestJSON-163646571 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-8da63c5f-622c-427a-aa29-ab4c8c9de34a" returned: 0 in 0.594s {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 25 15:56:44 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.quobyte [None req-66e90e74-7dd2-42d5-af06-68dc321375e9 tempest-VolumesListAdminTestJSON-163646571 None] <== create_volume: return (1352ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-23e9d725-3e04-4cd9-bfe0-c8ef43305589'} {{(pid=83528) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 25 15:56:44 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-66e90e74-7dd2-42d5-af06-68dc321375e9 tempest-VolumesListAdminTestJSON-163646571 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.358s {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 25 15:56:44 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-6db607ed-ede0-4707-a51a-9cf4986972af tempest-VolumesExtendTest-1653409646 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.789s {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 25 15:56:44 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.quobyte [None req-6db607ed-ede0-4707-a51a-9cf4986972af tempest-VolumesExtendTest-1653409646 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-25T14:56:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1250681839',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6128762f-0997-49a7-b003-83bc847ca750,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4e100b25ed944f5387843bf79988c4c1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-25T14:56:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-25T14:56:41Z,use_quota=True,user_id='0efb7c6adabb488b9b6983c194febe7f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ce71c2f9-6543-4165-9653-a1529b2ea243),volume_type_id=ce71c2f9-6543-4165-9653-a1529b2ea243)}" {{(pid=83528) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 25 15:56:44 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.remotefs [None req-6db607ed-ede0-4707-a51a-9cf4986972af tempest-VolumesExtendTest-1653409646 None] Creating volume 6128762f-0997-49a7-b003-83bc847ca750 {{(pid=83528) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 25 15:56:44 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-6db607ed-ede0-4707-a51a-9cf4986972af tempest-VolumesExtendTest-1653409646 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 25 15:56:44 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-6db607ed-ede0-4707-a51a-9cf4986972af tempest-VolumesExtendTest-1653409646 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 25 15:56:44 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.quobyte [None req-6db607ed-ede0-4707-a51a-9cf4986972af tempest-VolumesExtendTest-1653409646 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23e9d725-3e04-4cd9-bfe0-c8ef43305589': None} {{(pid=83528) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 25 15:56:44 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.quobyte [None req-6db607ed-ede0-4707-a51a-9cf4986972af tempest-VolumesExtendTest-1653409646 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23e9d725-3e04-4cd9-bfe0-c8ef43305589'] {{(pid=83528) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 25 15:56:44 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-6db607ed-ede0-4707-a51a-9cf4986972af tempest-VolumesExtendTest-1653409646 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 25 15:56:44 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.quobyte [None req-6db607ed-ede0-4707-a51a-9cf4986972af tempest-VolumesExtendTest-1653409646 None] Selected osci02.corp.quobyte.com/cinder-vol-23e9d725-3e04-4cd9-bfe0-c8ef43305589 as target Quobyte volume. {{(pid=83528) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 25 15:56:44 devstack cinder-volume[83528]: INFO cinder.volume.drivers.remotefs [None req-6db607ed-ede0-4707-a51a-9cf4986972af tempest-VolumesExtendTest-1653409646 None] casted to osci02.corp.quobyte.com/cinder-vol-23e9d725-3e04-4cd9-bfe0-c8ef43305589 Feb 25 15:56:44 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-6db607ed-ede0-4707-a51a-9cf4986972af tempest-VolumesExtendTest-1653409646 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-6128762f-0997-49a7-b003-83bc847ca750 1073741824 {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 25 15:56:44 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-66e90e74-7dd2-42d5-af06-68dc321375e9 tempest-VolumesListAdminTestJSON-163646571 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8d753ef6-9b90-4960-80e9-bdd34df7a635) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8da63c5f-622c-427a-aa29-ab4c8c9de34a', 'volume_size': 1}' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 25 15:56:44 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-66e90e74-7dd2-42d5-af06-68dc321375e9 tempest-VolumesListAdminTestJSON-163646571 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d7150ce1-84ed-4116-91f8-2380656ae0f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 25 15:56:44 devstack cinder-volume[83528]: INFO cinder.volume.flows.manager.create_volume [None req-66e90e74-7dd2-42d5-af06-68dc321375e9 tempest-VolumesListAdminTestJSON-163646571 None] Volume volume-8da63c5f-622c-427a-aa29-ab4c8c9de34a (8da63c5f-622c-427a-aa29-ab4c8c9de34a): created successfully Feb 25 15:56:44 devstack sudo[87975]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-6128762f-0997-49a7-b003-83bc847ca750 1073741824 Feb 25 15:56:44 devstack sudo[87975]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 25 15:56:44 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-66e90e74-7dd2-42d5-af06-68dc321375e9 tempest-VolumesListAdminTestJSON-163646571 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d7150ce1-84ed-4116-91f8-2380656ae0f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 25 15:56:44 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-66e90e74-7dd2-42d5-af06-68dc321375e9 tempest-VolumesListAdminTestJSON-163646571 None] Flow 'volume_create_manager' (cdd3c350-6dae-4a8c-abac-15853962d6c1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83528) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 25 15:56:44 devstack cinder-volume[83528]: INFO cinder.volume.manager [None req-66e90e74-7dd2-42d5-af06-68dc321375e9 tempest-VolumesListAdminTestJSON-163646571 None] Created volume successfully. Feb 25 15:56:44 devstack sudo[87975]: pam_unix(sudo:session): session closed for user root Feb 25 15:56:44 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-6db607ed-ede0-4707-a51a-9cf4986972af tempest-VolumesExtendTest-1653409646 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-6128762f-0997-49a7-b003-83bc847ca750 1073741824" returned: 0 in 0.734s {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 25 15:56:44 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-6db607ed-ede0-4707-a51a-9cf4986972af tempest-VolumesExtendTest-1653409646 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-6128762f-0997-49a7-b003-83bc847ca750 {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 25 15:56:44 devstack sudo[87982]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-6128762f-0997-49a7-b003-83bc847ca750 Feb 25 15:56:44 devstack sudo[87982]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 25 15:56:44 devstack cinder-volume[83528]: DEBUG cinder.coordination [None req-101adeec-6671-4be5-ab84-b31376717459 tempest-VolumesListAdminTestJSON-163646571 None] Acquiring lock "cinder-8da63c5f-622c-427a-aa29-ab4c8c9de34a-delete_volume" by "delete_volume" {{(pid=83528) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 25 15:56:45 devstack cinder-volume[83528]: DEBUG cinder.coordination [None req-101adeec-6671-4be5-ab84-b31376717459 tempest-VolumesListAdminTestJSON-163646571 None] Lock "cinder-8da63c5f-622c-427a-aa29-ab4c8c9de34a-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=83528) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 25 15:56:45 devstack cinder-volume[83528]: DEBUG cinder.coordination [None req-101adeec-6671-4be5-ab84-b31376717459 tempest-VolumesListAdminTestJSON-163646571 None] Acquiring lock "cinder-quobyte-8da63c5f-622c-427a-aa29-ab4c8c9de34a" by "delete_volume" {{(pid=83528) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 25 15:56:45 devstack cinder-volume[83528]: DEBUG cinder.coordination [None req-101adeec-6671-4be5-ab84-b31376717459 tempest-VolumesListAdminTestJSON-163646571 None] Lock "cinder-quobyte-8da63c5f-622c-427a-aa29-ab4c8c9de34a" acquired by "delete_volume" :: waited 0.010s {{(pid=83528) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 25 15:56:45 devstack cinder-volume[83528]: DEBUG oslo.privsep.daemon [-] privsep: reply[14d98ab3-3951-488b-8b5c-dd448af083bc]: (4, 'qcow2') {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 25 15:56:45 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-101adeec-6671-4be5-ab84-b31376717459 tempest-VolumesListAdminTestJSON-163646571 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-8da63c5f-622c-427a-aa29-ab4c8c9de34a {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 25 15:56:45 devstack cinder-volume[83528]: DEBUG cinder.coordination [None req-ce03542c-631f-475c-89e8-8f537eee19dd tempest-VolumesListAdminTestJSON-248510173 None] Acquiring lock "cinder-4ade29ec-8417-491e-b46d-2528bed5d175-delete_volume" by "delete_volume" {{(pid=83528) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 25 15:56:45 devstack cinder-volume[83528]: DEBUG cinder.coordination [None req-ce03542c-631f-475c-89e8-8f537eee19dd tempest-VolumesListAdminTestJSON-248510173 None] Lock "cinder-4ade29ec-8417-491e-b46d-2528bed5d175-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=83528) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 25 15:56:45 devstack cinder-volume[83528]: DEBUG cinder.coordination [None req-ce03542c-631f-475c-89e8-8f537eee19dd tempest-VolumesListAdminTestJSON-248510173 None] Acquiring lock "cinder-quobyte-4ade29ec-8417-491e-b46d-2528bed5d175" by "delete_volume" {{(pid=83528) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 25 15:56:45 devstack cinder-volume[83528]: DEBUG cinder.coordination [None req-ce03542c-631f-475c-89e8-8f537eee19dd tempest-VolumesListAdminTestJSON-248510173 None] Lock "cinder-quobyte-4ade29ec-8417-491e-b46d-2528bed5d175" acquired by "delete_volume" :: waited 0.019s {{(pid=83528) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 25 15:56:45 devstack cinder-volume[83528]: DEBUG oslo.privsep.daemon [-] privsep: reply[70fadc27-67ad-4079-8417-16def619edd5]: (4, 'qcow2') {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 25 15:56:45 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-ce03542c-631f-475c-89e8-8f537eee19dd tempest-VolumesListAdminTestJSON-248510173 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-4ade29ec-8417-491e-b46d-2528bed5d175 {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 25 15:56:45 devstack sudo[87984]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-8da63c5f-622c-427a-aa29-ab4c8c9de34a Feb 25 15:56:45 devstack sudo[87984]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 25 15:56:45 devstack sudo[87985]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-4ade29ec-8417-491e-b46d-2528bed5d175 Feb 25 15:56:45 devstack sudo[87985]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 25 15:56:45 devstack sudo[87982]: pam_unix(sudo:session): session closed for user root Feb 25 15:56:45 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-6db607ed-ede0-4707-a51a-9cf4986972af tempest-VolumesExtendTest-1653409646 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-6128762f-0997-49a7-b003-83bc847ca750" returned: 0 in 0.568s {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 25 15:56:45 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.quobyte [None req-6db607ed-ede0-4707-a51a-9cf4986972af tempest-VolumesExtendTest-1653409646 None] <== create_volume: return (1333ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-23e9d725-3e04-4cd9-bfe0-c8ef43305589'} {{(pid=83528) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 25 15:56:45 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-6db607ed-ede0-4707-a51a-9cf4986972af tempest-VolumesExtendTest-1653409646 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.337s {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 25 15:56:45 devstack cinder-volume[83528]: DEBUG cinder.volume.volume_utils [None req-6db607ed-ede0-4707-a51a-9cf4986972af tempest-VolumesExtendTest-1653409646 None] Attempting download of c50f3ecd-5e88-4737-aa36-6e073ce70c60 ((None, [{'url': 'file:///opt/stack/data/glance/images/c50f3ecd-5e88-4737-aa36-6e073ce70c60', 'metadata': {}}])) to volume 6128762f-0997-49a7-b003-83bc847ca750. {{(pid=83528) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1189}} Feb 25 15:56:45 devstack cinder-volume[83528]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ad8fbce-6d57-4c09-8396-fa2ec6608ba9]: (4, 'raw') {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 25 15:56:45 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-6db607ed-ede0-4707-a51a-9cf4986972af tempest-VolumesExtendTest-1653409646 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_c50f3ecd-5e88-4737-aa36-6e073ce70c60_90jzyt7s {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 25 15:56:45 devstack sudo[87989]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_c50f3ecd-5e88-4737-aa36-6e073ce70c60_90jzyt7s Feb 25 15:56:45 devstack sudo[87989]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 25 15:56:45 devstack cinder-volume[83528]: DEBUG cinder.volume.flows.manager.create_volume [None req-681339a0-a57e-45a2-a30f-f0df80514e19 tempest-VolumeTypesAccessTest-2122382728 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83528) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 25 15:56:45 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-681339a0-a57e-45a2-a30f-f0df80514e19 tempest-VolumeTypesAccessTest-2122382728 None] Flow 'volume_create_manager' (7bfb593d-01c9-464f-b33a-5124d0ad816a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83528) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 25 15:56:45 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-681339a0-a57e-45a2-a30f-f0df80514e19 tempest-VolumeTypesAccessTest-2122382728 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0d91948e-2675-472a-b988-cb9ba8be8c9c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 25 15:56:45 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-681339a0-a57e-45a2-a30f-f0df80514e19 tempest-VolumeTypesAccessTest-2122382728 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0d91948e-2675-472a-b988-cb9ba8be8c9c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-25T14:56:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-1285283678',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=34c62cb9-622b-4442-8be6-abf72b3699ec,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7e8de77d173042b3a11eeaf5a199668c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-25T14:56:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-25T14:56:46Z,use_quota=True,user_id='f155a4dcd4c64ed7aa4436be819f8b53',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(893583a4-2529-492e-a0a3-da530ed96e86),volume_type_id=893583a4-2529-492e-a0a3-da530ed96e86)' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 25 15:56:45 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-681339a0-a57e-45a2-a30f-f0df80514e19 tempest-VolumeTypesAccessTest-2122382728 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6aa90a57-4c44-44f6-9b73-960e93cb6af6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 25 15:56:45 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-681339a0-a57e-45a2-a30f-f0df80514e19 tempest-VolumeTypesAccessTest-2122382728 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6aa90a57-4c44-44f6-9b73-960e93cb6af6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 25 15:56:45 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-681339a0-a57e-45a2-a30f-f0df80514e19 tempest-VolumeTypesAccessTest-2122382728 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b8738e7b-078b-46e8-b5bf-5b038fcbf717) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 25 15:56:45 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-681339a0-a57e-45a2-a30f-f0df80514e19 tempest-VolumeTypesAccessTest-2122382728 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b8738e7b-078b-46e8-b5bf-5b038fcbf717) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '34c62cb9-622b-4442-8be6-abf72b3699ec', 'volume_name': 'volume-34c62cb9-622b-4442-8be6-abf72b3699ec', 'volume_size': 1}' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 25 15:56:45 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-681339a0-a57e-45a2-a30f-f0df80514e19 tempest-VolumeTypesAccessTest-2122382728 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bdde8bb5-c036-462d-a41f-2748295760a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 25 15:56:45 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-681339a0-a57e-45a2-a30f-f0df80514e19 tempest-VolumeTypesAccessTest-2122382728 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bdde8bb5-c036-462d-a41f-2748295760a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 25 15:56:45 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-681339a0-a57e-45a2-a30f-f0df80514e19 tempest-VolumeTypesAccessTest-2122382728 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (261d5937-654c-4547-baad-098c775e1bec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 25 15:56:45 devstack cinder-volume[83528]: INFO cinder.volume.flows.manager.create_volume [None req-681339a0-a57e-45a2-a30f-f0df80514e19 tempest-VolumeTypesAccessTest-2122382728 None] Volume 34c62cb9-622b-4442-8be6-abf72b3699ec: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-34c62cb9-622b-4442-8be6-abf72b3699ec', 'volume_size': 1} Feb 25 15:56:45 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-681339a0-a57e-45a2-a30f-f0df80514e19 tempest-VolumeTypesAccessTest-2122382728 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 25 15:56:45 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-681339a0-a57e-45a2-a30f-f0df80514e19 tempest-VolumeTypesAccessTest-2122382728 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 25 15:56:45 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.quobyte [None req-681339a0-a57e-45a2-a30f-f0df80514e19 tempest-VolumeTypesAccessTest-2122382728 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-25T14:56:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-1285283678',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=34c62cb9-622b-4442-8be6-abf72b3699ec,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7e8de77d173042b3a11eeaf5a199668c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-25T14:56:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-25T14:56:46Z,use_quota=True,user_id='f155a4dcd4c64ed7aa4436be819f8b53',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(893583a4-2529-492e-a0a3-da530ed96e86),volume_type_id=893583a4-2529-492e-a0a3-da530ed96e86)}" {{(pid=83528) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 25 15:56:45 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.remotefs [None req-681339a0-a57e-45a2-a30f-f0df80514e19 tempest-VolumeTypesAccessTest-2122382728 None] Creating volume 34c62cb9-622b-4442-8be6-abf72b3699ec {{(pid=83528) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 25 15:56:45 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-681339a0-a57e-45a2-a30f-f0df80514e19 tempest-VolumeTypesAccessTest-2122382728 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 25 15:56:45 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-681339a0-a57e-45a2-a30f-f0df80514e19 tempest-VolumeTypesAccessTest-2122382728 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 25 15:56:45 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.quobyte [None req-681339a0-a57e-45a2-a30f-f0df80514e19 tempest-VolumeTypesAccessTest-2122382728 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23e9d725-3e04-4cd9-bfe0-c8ef43305589': None} {{(pid=83528) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 25 15:56:45 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.quobyte [None req-681339a0-a57e-45a2-a30f-f0df80514e19 tempest-VolumeTypesAccessTest-2122382728 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23e9d725-3e04-4cd9-bfe0-c8ef43305589'] {{(pid=83528) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 25 15:56:45 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-681339a0-a57e-45a2-a30f-f0df80514e19 tempest-VolumeTypesAccessTest-2122382728 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 25 15:56:45 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.quobyte [None req-681339a0-a57e-45a2-a30f-f0df80514e19 tempest-VolumeTypesAccessTest-2122382728 None] Selected osci02.corp.quobyte.com/cinder-vol-23e9d725-3e04-4cd9-bfe0-c8ef43305589 as target Quobyte volume. {{(pid=83528) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 25 15:56:45 devstack cinder-volume[83528]: INFO cinder.volume.drivers.remotefs [None req-681339a0-a57e-45a2-a30f-f0df80514e19 tempest-VolumeTypesAccessTest-2122382728 None] casted to osci02.corp.quobyte.com/cinder-vol-23e9d725-3e04-4cd9-bfe0-c8ef43305589 Feb 25 15:56:45 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-681339a0-a57e-45a2-a30f-f0df80514e19 tempest-VolumeTypesAccessTest-2122382728 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-34c62cb9-622b-4442-8be6-abf72b3699ec 1073741824 {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 25 15:56:45 devstack sudo[87994]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-34c62cb9-622b-4442-8be6-abf72b3699ec 1073741824 Feb 25 15:56:45 devstack sudo[87994]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 25 15:56:46 devstack sudo[87984]: pam_unix(sudo:session): session closed for user root Feb 25 15:56:46 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-101adeec-6671-4be5-ab84-b31376717459 tempest-VolumesListAdminTestJSON-163646571 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-8da63c5f-622c-427a-aa29-ab4c8c9de34a" returned: 0 in 1.015s {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 25 15:56:46 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-101adeec-6671-4be5-ab84-b31376717459 tempest-VolumesListAdminTestJSON-163646571 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-8da63c5f-622c-427a-aa29-ab4c8c9de34a {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 25 15:56:46 devstack sudo[87996]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-8da63c5f-622c-427a-aa29-ab4c8c9de34a Feb 25 15:56:46 devstack sudo[87996]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 25 15:56:46 devstack sudo[87989]: pam_unix(sudo:session): session closed for user root Feb 25 15:56:46 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-6db607ed-ede0-4707-a51a-9cf4986972af tempest-VolumesExtendTest-1653409646 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_c50f3ecd-5e88-4737-aa36-6e073ce70c60_90jzyt7s" returned: 0 in 0.623s {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 25 15:56:46 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-6db607ed-ede0-4707-a51a-9cf4986972af tempest-VolumesExtendTest-1653409646 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_c50f3ecd-5e88-4737-aa36-6e073ce70c60_90jzyt7s {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 25 15:56:46 devstack sudo[88003]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_c50f3ecd-5e88-4737-aa36-6e073ce70c60_90jzyt7s Feb 25 15:56:46 devstack sudo[88003]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 25 15:56:46 devstack sudo[87985]: pam_unix(sudo:session): session closed for user root Feb 25 15:56:46 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-ce03542c-631f-475c-89e8-8f537eee19dd tempest-VolumesListAdminTestJSON-248510173 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-4ade29ec-8417-491e-b46d-2528bed5d175" returned: 0 in 1.097s {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 25 15:56:46 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-ce03542c-631f-475c-89e8-8f537eee19dd tempest-VolumesListAdminTestJSON-248510173 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-4ade29ec-8417-491e-b46d-2528bed5d175 {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 25 15:56:46 devstack sudo[88005]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-4ade29ec-8417-491e-b46d-2528bed5d175 Feb 25 15:56:46 devstack sudo[88005]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 25 15:56:46 devstack sudo[87994]: pam_unix(sudo:session): session closed for user root Feb 25 15:56:46 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-681339a0-a57e-45a2-a30f-f0df80514e19 tempest-VolumeTypesAccessTest-2122382728 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-34c62cb9-622b-4442-8be6-abf72b3699ec 1073741824" returned: 0 in 0.826s {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 25 15:56:46 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-681339a0-a57e-45a2-a30f-f0df80514e19 tempest-VolumeTypesAccessTest-2122382728 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-34c62cb9-622b-4442-8be6-abf72b3699ec {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 25 15:56:46 devstack sudo[88011]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-34c62cb9-622b-4442-8be6-abf72b3699ec Feb 25 15:56:46 devstack sudo[88011]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 25 15:56:46 devstack sudo[87996]: pam_unix(sudo:session): session closed for user root Feb 25 15:56:46 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-101adeec-6671-4be5-ab84-b31376717459 tempest-VolumesListAdminTestJSON-163646571 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-8da63c5f-622c-427a-aa29-ab4c8c9de34a" returned: 0 in 0.682s {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 25 15:56:46 devstack cinder-volume[83528]: DEBUG cinder.coordination [None req-101adeec-6671-4be5-ab84-b31376717459 tempest-VolumesListAdminTestJSON-163646571 None] Lock "cinder-quobyte-8da63c5f-622c-427a-aa29-ab4c8c9de34a" released by "delete_volume" :: held 1.732s {{(pid=83528) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 25 15:56:46 devstack cinder-volume[83528]: DEBUG cinder.quota [None req-101adeec-6671-4be5-ab84-b31376717459 tempest-VolumesListAdminTestJSON-163646571 None] Created reservations ['2f95e83b-fce4-4ba8-935b-85177b3de64a', '83b154cd-a82f-4be4-8e8f-6c95a84dd5a9', '78fc68ed-c8a2-422a-bf04-652c28cbf205', '601c16ef-da9d-4a61-86b6-5ee9db437310'] {{(pid=83528) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 25 15:56:46 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-101adeec-6671-4be5-ab84-b31376717459 tempest-VolumesListAdminTestJSON-163646571 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 25 15:56:46 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-101adeec-6671-4be5-ab84-b31376717459 tempest-VolumesListAdminTestJSON-163646571 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 25 15:56:46 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.quobyte [None req-101adeec-6671-4be5-ab84-b31376717459 tempest-VolumesListAdminTestJSON-163646571 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23e9d725-3e04-4cd9-bfe0-c8ef43305589': None} {{(pid=83528) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 25 15:56:46 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.quobyte [None req-101adeec-6671-4be5-ab84-b31376717459 tempest-VolumesListAdminTestJSON-163646571 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23e9d725-3e04-4cd9-bfe0-c8ef43305589'] {{(pid=83528) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 25 15:56:46 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-101adeec-6671-4be5-ab84-b31376717459 tempest-VolumesListAdminTestJSON-163646571 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 25 15:56:46 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-101adeec-6671-4be5-ab84-b31376717459 tempest-VolumesListAdminTestJSON-163646571 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85 {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 25 15:56:46 devstack sudo[88015]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85 Feb 25 15:56:46 devstack sudo[88015]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 25 15:56:47 devstack sudo[88003]: pam_unix(sudo:session): session closed for user root Feb 25 15:56:47 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-6db607ed-ede0-4707-a51a-9cf4986972af tempest-VolumesExtendTest-1653409646 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_c50f3ecd-5e88-4737-aa36-6e073ce70c60_90jzyt7s" returned: 1 in 0.790s {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 25 15:56:47 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-6db607ed-ede0-4707-a51a-9cf4986972af tempest-VolumesExtendTest-1653409646 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_c50f3ecd-5e88-4737-aa36-6e073ce70c60_90jzyt7s' failed. Not Retrying. {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Feb 25 15:56:47 devstack cinder-volume[83528]: DEBUG oslo.privsep.daemon [-] privsep: reply[e970d10f-9b6e-4c66-a0a6-174e8c5c2c49]: (4, 'qcow2') {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 25 15:56:47 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-6db607ed-ede0-4707-a51a-9cf4986972af tempest-VolumesExtendTest-1653409646 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c50f3ecd-5e88-4737-aa36-6e073ce70c60_qrtd_ka1devstack@QuobyteHD {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 25 15:56:47 devstack sudo[88005]: pam_unix(sudo:session): session closed for user root Feb 25 15:56:47 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-ce03542c-631f-475c-89e8-8f537eee19dd tempest-VolumesListAdminTestJSON-248510173 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-4ade29ec-8417-491e-b46d-2528bed5d175" returned: 0 in 0.727s {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 25 15:56:47 devstack cinder-volume[83528]: DEBUG cinder.coordination [None req-ce03542c-631f-475c-89e8-8f537eee19dd tempest-VolumesListAdminTestJSON-248510173 None] Lock "cinder-quobyte-4ade29ec-8417-491e-b46d-2528bed5d175" released by "delete_volume" :: held 1.859s {{(pid=83528) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 25 15:56:47 devstack sudo[88019]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c50f3ecd-5e88-4737-aa36-6e073ce70c60_qrtd_ka1devstack@QuobyteHD Feb 25 15:56:47 devstack sudo[88019]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 25 15:56:47 devstack cinder-volume[83528]: DEBUG cinder.quota [None req-ce03542c-631f-475c-89e8-8f537eee19dd tempest-VolumesListAdminTestJSON-248510173 None] Created reservations ['84f06ec8-6a95-4746-8f17-73fda5791d32', 'e1c4d12f-ba3c-41f9-9d35-d79bc58eeebb', '7a43b2e2-b481-4cbf-ad64-5165136051a3', '18357a31-f3d7-4524-834c-b50cee1def18'] {{(pid=83528) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 25 15:56:47 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-ce03542c-631f-475c-89e8-8f537eee19dd tempest-VolumesListAdminTestJSON-248510173 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 25 15:56:47 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-ce03542c-631f-475c-89e8-8f537eee19dd tempest-VolumesListAdminTestJSON-248510173 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 25 15:56:47 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.quobyte [None req-ce03542c-631f-475c-89e8-8f537eee19dd tempest-VolumesListAdminTestJSON-248510173 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23e9d725-3e04-4cd9-bfe0-c8ef43305589': None} {{(pid=83528) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 25 15:56:47 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.quobyte [None req-ce03542c-631f-475c-89e8-8f537eee19dd tempest-VolumesListAdminTestJSON-248510173 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23e9d725-3e04-4cd9-bfe0-c8ef43305589'] {{(pid=83528) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 25 15:56:47 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-ce03542c-631f-475c-89e8-8f537eee19dd tempest-VolumesListAdminTestJSON-248510173 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 25 15:56:47 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-ce03542c-631f-475c-89e8-8f537eee19dd tempest-VolumesListAdminTestJSON-248510173 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85 {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 25 15:56:47 devstack sudo[88021]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85 Feb 25 15:56:47 devstack sudo[88021]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 25 15:56:47 devstack sudo[88015]: pam_unix(sudo:session): session closed for user root Feb 25 15:56:47 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-101adeec-6671-4be5-ab84-b31376717459 tempest-VolumesListAdminTestJSON-163646571 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85" returned: 0 in 0.563s {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 25 15:56:47 devstack cinder-volume[83528]: DEBUG cinder.manager [None req-101adeec-6671-4be5-ab84-b31376717459 tempest-VolumesListAdminTestJSON-163646571 None] Notifying Schedulers of capabilities ... {{(pid=83528) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 25 15:56:47 devstack sudo[88011]: pam_unix(sudo:session): session closed for user root Feb 25 15:56:47 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-681339a0-a57e-45a2-a30f-f0df80514e19 tempest-VolumeTypesAccessTest-2122382728 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-34c62cb9-622b-4442-8be6-abf72b3699ec" returned: 0 in 0.747s {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 25 15:56:47 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.quobyte [None req-681339a0-a57e-45a2-a30f-f0df80514e19 tempest-VolumeTypesAccessTest-2122382728 None] <== create_volume: return (1609ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-23e9d725-3e04-4cd9-bfe0-c8ef43305589'} {{(pid=83528) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 25 15:56:47 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-681339a0-a57e-45a2-a30f-f0df80514e19 tempest-VolumeTypesAccessTest-2122382728 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.612s {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 25 15:56:47 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-681339a0-a57e-45a2-a30f-f0df80514e19 tempest-VolumeTypesAccessTest-2122382728 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (261d5937-654c-4547-baad-098c775e1bec) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-34c62cb9-622b-4442-8be6-abf72b3699ec', 'volume_size': 1}' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 25 15:56:47 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-681339a0-a57e-45a2-a30f-f0df80514e19 tempest-VolumeTypesAccessTest-2122382728 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1e096773-da5c-406d-9f5b-499904156d6d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 25 15:56:47 devstack cinder-volume[83528]: INFO cinder.volume.manager [None req-101adeec-6671-4be5-ab84-b31376717459 tempest-VolumesListAdminTestJSON-163646571 None] Deleted volume successfully. Feb 25 15:56:47 devstack cinder-volume[83528]: INFO cinder.volume.flows.manager.create_volume [None req-681339a0-a57e-45a2-a30f-f0df80514e19 tempest-VolumeTypesAccessTest-2122382728 None] Volume volume-34c62cb9-622b-4442-8be6-abf72b3699ec (34c62cb9-622b-4442-8be6-abf72b3699ec): created successfully Feb 25 15:56:47 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-681339a0-a57e-45a2-a30f-f0df80514e19 tempest-VolumeTypesAccessTest-2122382728 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1e096773-da5c-406d-9f5b-499904156d6d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 25 15:56:47 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-681339a0-a57e-45a2-a30f-f0df80514e19 tempest-VolumeTypesAccessTest-2122382728 None] Flow 'volume_create_manager' (7bfb593d-01c9-464f-b33a-5124d0ad816a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83528) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 25 15:56:47 devstack cinder-volume[83528]: INFO cinder.volume.manager [None req-681339a0-a57e-45a2-a30f-f0df80514e19 tempest-VolumeTypesAccessTest-2122382728 None] Created volume successfully. Feb 25 15:56:47 devstack cinder-volume[83528]: DEBUG cinder.coordination [None req-101adeec-6671-4be5-ab84-b31376717459 tempest-VolumesListAdminTestJSON-163646571 None] Lock "cinder-8da63c5f-622c-427a-aa29-ab4c8c9de34a-delete_volume" released by "delete_volume" :: held 2.506s {{(pid=83528) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 25 15:56:47 devstack cinder-volume[83528]: DEBUG cinder.coordination [None req-8a6f8f54-a3cf-4b10-bebe-3bb0f7e344e5 tempest-VolumesListAdminTestJSON-248510173 None] Acquiring lock "cinder-6f132d25-f3e2-457c-acf5-4b94e2db5e2c-delete_volume" by "delete_volume" {{(pid=83528) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 25 15:56:47 devstack cinder-volume[83528]: DEBUG cinder.coordination [None req-8a6f8f54-a3cf-4b10-bebe-3bb0f7e344e5 tempest-VolumesListAdminTestJSON-248510173 None] Lock "cinder-6f132d25-f3e2-457c-acf5-4b94e2db5e2c-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=83528) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 25 15:56:47 devstack cinder-volume[83528]: DEBUG cinder.coordination [None req-8a6f8f54-a3cf-4b10-bebe-3bb0f7e344e5 tempest-VolumesListAdminTestJSON-248510173 None] Acquiring lock "cinder-quobyte-6f132d25-f3e2-457c-acf5-4b94e2db5e2c" by "delete_volume" {{(pid=83528) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 25 15:56:47 devstack cinder-volume[83528]: DEBUG cinder.coordination [None req-8a6f8f54-a3cf-4b10-bebe-3bb0f7e344e5 tempest-VolumesListAdminTestJSON-248510173 None] Lock "cinder-quobyte-6f132d25-f3e2-457c-acf5-4b94e2db5e2c" acquired by "delete_volume" :: waited 0.008s {{(pid=83528) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 25 15:56:47 devstack cinder-volume[83528]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e3a26af-fd2e-4137-98d7-53cede282ce0]: (4, 'qcow2') {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 25 15:56:47 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-8a6f8f54-a3cf-4b10-bebe-3bb0f7e344e5 tempest-VolumesListAdminTestJSON-248510173 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-6f132d25-f3e2-457c-acf5-4b94e2db5e2c {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 25 15:56:47 devstack sudo[88025]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-6f132d25-f3e2-457c-acf5-4b94e2db5e2c Feb 25 15:56:47 devstack sudo[88025]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 25 15:56:47 devstack sudo[88019]: pam_unix(sudo:session): session closed for user root Feb 25 15:56:47 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-6db607ed-ede0-4707-a51a-9cf4986972af tempest-VolumesExtendTest-1653409646 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c50f3ecd-5e88-4737-aa36-6e073ce70c60_qrtd_ka1devstack@QuobyteHD" returned: 0 in 0.855s {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 25 15:56:47 devstack cinder-volume[83528]: DEBUG cinder.image.image_utils [None req-6db607ed-ede0-4707-a51a-9cf4986972af tempest-VolumesExtendTest-1653409646 None] c50f3ecd-5e88-4737-aa36-6e073ce70c60 was qcow2, converting to raw {{(pid=83528) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1120}} Feb 25 15:56:47 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-6db607ed-ede0-4707-a51a-9cf4986972af tempest-VolumesExtendTest-1653409646 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_c50f3ecd-5e88-4737-aa36-6e073ce70c60_qrtd_ka1devstack@QuobyteHD /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-6128762f-0997-49a7-b003-83bc847ca750 {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 25 15:56:47 devstack sudo[88021]: pam_unix(sudo:session): session closed for user root Feb 25 15:56:47 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-ce03542c-631f-475c-89e8-8f537eee19dd tempest-VolumesListAdminTestJSON-248510173 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85" returned: 0 in 0.669s {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 25 15:56:47 devstack cinder-volume[83528]: DEBUG cinder.manager [None req-ce03542c-631f-475c-89e8-8f537eee19dd tempest-VolumesListAdminTestJSON-248510173 None] Notifying Schedulers of capabilities ... {{(pid=83528) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 25 15:56:47 devstack cinder-volume[83528]: INFO cinder.volume.manager [None req-ce03542c-631f-475c-89e8-8f537eee19dd tempest-VolumesListAdminTestJSON-248510173 None] Deleted volume successfully. Feb 25 15:56:47 devstack sudo[88031]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_c50f3ecd-5e88-4737-aa36-6e073ce70c60_qrtd_ka1devstack@QuobyteHD /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-6128762f-0997-49a7-b003-83bc847ca750 Feb 25 15:56:47 devstack sudo[88031]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 25 15:56:47 devstack cinder-volume[83528]: DEBUG cinder.coordination [None req-6141d682-3372-4047-a87b-a56696be48cc tempest-VolumeTypesAccessTest-2122382728 None] Acquiring lock "cinder-34c62cb9-622b-4442-8be6-abf72b3699ec-delete_volume" by "delete_volume" {{(pid=83528) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 25 15:56:47 devstack cinder-volume[83528]: DEBUG cinder.coordination [None req-ce03542c-631f-475c-89e8-8f537eee19dd tempest-VolumesListAdminTestJSON-248510173 None] Lock "cinder-4ade29ec-8417-491e-b46d-2528bed5d175-delete_volume" released by "delete_volume" :: held 2.785s {{(pid=83528) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 25 15:56:47 devstack cinder-volume[83528]: DEBUG cinder.coordination [None req-6141d682-3372-4047-a87b-a56696be48cc tempest-VolumeTypesAccessTest-2122382728 None] Lock "cinder-34c62cb9-622b-4442-8be6-abf72b3699ec-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=83528) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 25 15:56:47 devstack cinder-volume[83528]: DEBUG cinder.coordination [None req-6141d682-3372-4047-a87b-a56696be48cc tempest-VolumeTypesAccessTest-2122382728 None] Acquiring lock "cinder-quobyte-34c62cb9-622b-4442-8be6-abf72b3699ec" by "delete_volume" {{(pid=83528) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 25 15:56:47 devstack cinder-volume[83528]: DEBUG cinder.coordination [None req-6141d682-3372-4047-a87b-a56696be48cc tempest-VolumeTypesAccessTest-2122382728 None] Lock "cinder-quobyte-34c62cb9-622b-4442-8be6-abf72b3699ec" acquired by "delete_volume" :: waited 0.010s {{(pid=83528) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 25 15:56:47 devstack cinder-volume[83528]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f36bff1-6882-49a2-bbb5-4380bb28dbe0]: (4, 'qcow2') {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 25 15:56:47 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-6141d682-3372-4047-a87b-a56696be48cc tempest-VolumeTypesAccessTest-2122382728 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-34c62cb9-622b-4442-8be6-abf72b3699ec {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 25 15:56:48 devstack sudo[88033]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-34c62cb9-622b-4442-8be6-abf72b3699ec Feb 25 15:56:48 devstack sudo[88033]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 25 15:56:48 devstack sudo[88025]: pam_unix(sudo:session): session closed for user root Feb 25 15:56:48 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-8a6f8f54-a3cf-4b10-bebe-3bb0f7e344e5 tempest-VolumesListAdminTestJSON-248510173 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-6f132d25-f3e2-457c-acf5-4b94e2db5e2c" returned: 0 in 0.673s {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 25 15:56:48 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-8a6f8f54-a3cf-4b10-bebe-3bb0f7e344e5 tempest-VolumesListAdminTestJSON-248510173 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-6f132d25-f3e2-457c-acf5-4b94e2db5e2c {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 25 15:56:48 devstack sudo[88038]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-6f132d25-f3e2-457c-acf5-4b94e2db5e2c Feb 25 15:56:48 devstack sudo[88038]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 25 15:56:48 devstack sudo[88033]: pam_unix(sudo:session): session closed for user root Feb 25 15:56:48 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-6141d682-3372-4047-a87b-a56696be48cc tempest-VolumeTypesAccessTest-2122382728 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-34c62cb9-622b-4442-8be6-abf72b3699ec" returned: 0 in 0.732s {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 25 15:56:48 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-6141d682-3372-4047-a87b-a56696be48cc tempest-VolumeTypesAccessTest-2122382728 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-34c62cb9-622b-4442-8be6-abf72b3699ec {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 25 15:56:48 devstack sudo[88059]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-34c62cb9-622b-4442-8be6-abf72b3699ec Feb 25 15:56:48 devstack sudo[88059]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 25 15:56:49 devstack sudo[88038]: pam_unix(sudo:session): session closed for user root Feb 25 15:56:49 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-8a6f8f54-a3cf-4b10-bebe-3bb0f7e344e5 tempest-VolumesListAdminTestJSON-248510173 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-6f132d25-f3e2-457c-acf5-4b94e2db5e2c" returned: 0 in 0.746s {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 25 15:56:49 devstack cinder-volume[83528]: DEBUG cinder.coordination [None req-8a6f8f54-a3cf-4b10-bebe-3bb0f7e344e5 tempest-VolumesListAdminTestJSON-248510173 None] Lock "cinder-quobyte-6f132d25-f3e2-457c-acf5-4b94e2db5e2c" released by "delete_volume" :: held 1.466s {{(pid=83528) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 25 15:56:49 devstack cinder-volume[83528]: DEBUG cinder.quota [None req-8a6f8f54-a3cf-4b10-bebe-3bb0f7e344e5 tempest-VolumesListAdminTestJSON-248510173 None] Created reservations ['73604c2c-f2d7-4659-8960-78557bf7eba7', '8ec95333-cf26-4e6a-867f-e6ad7709de4f', 'a7f94189-841e-41d9-bc9d-d91609788d88', '235f5e1a-77fa-4943-ae04-499b529d63ea'] {{(pid=83528) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 25 15:56:49 devstack sudo[88031]: pam_unix(sudo:session): session closed for user root Feb 25 15:56:49 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-6db607ed-ede0-4707-a51a-9cf4986972af tempest-VolumesExtendTest-1653409646 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_c50f3ecd-5e88-4737-aa36-6e073ce70c60_qrtd_ka1devstack@QuobyteHD /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-6128762f-0997-49a7-b003-83bc847ca750" returned: 0 in 1.302s {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 25 15:56:49 devstack cinder-volume[83528]: DEBUG cinder.image.image_utils [None req-6db607ed-ede0-4707-a51a-9cf4986972af tempest-VolumesExtendTest-1653409646 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_c50f3ecd-5e88-4737-aa36-6e073ce70c60_qrtd_ka1devstack@QuobyteHD, size 112.00 MB, duration 1.30 sec, destination /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-6128762f-0997-49a7-b003-83bc847ca750 {{(pid=83528) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Feb 25 15:56:49 devstack cinder-volume[83528]: INFO cinder.image.image_utils [None req-6db607ed-ede0-4707-a51a-9cf4986972af tempest-VolumesExtendTest-1653409646 None] Converted 112.00 MB image at 85.93 MB/s Feb 25 15:56:49 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-6db607ed-ede0-4707-a51a-9cf4986972af tempest-VolumesExtendTest-1653409646 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-6128762f-0997-49a7-b003-83bc847ca750 1G {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 25 15:56:49 devstack sudo[88063]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-6128762f-0997-49a7-b003-83bc847ca750 1G Feb 25 15:56:49 devstack sudo[88063]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 25 15:56:49 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-8a6f8f54-a3cf-4b10-bebe-3bb0f7e344e5 tempest-VolumesListAdminTestJSON-248510173 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 25 15:56:49 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-8a6f8f54-a3cf-4b10-bebe-3bb0f7e344e5 tempest-VolumesListAdminTestJSON-248510173 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 25 15:56:49 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.quobyte [None req-8a6f8f54-a3cf-4b10-bebe-3bb0f7e344e5 tempest-VolumesListAdminTestJSON-248510173 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23e9d725-3e04-4cd9-bfe0-c8ef43305589': None} {{(pid=83528) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 25 15:56:49 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.quobyte [None req-8a6f8f54-a3cf-4b10-bebe-3bb0f7e344e5 tempest-VolumesListAdminTestJSON-248510173 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23e9d725-3e04-4cd9-bfe0-c8ef43305589'] {{(pid=83528) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 25 15:56:49 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-8a6f8f54-a3cf-4b10-bebe-3bb0f7e344e5 tempest-VolumesListAdminTestJSON-248510173 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 25 15:56:49 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-8a6f8f54-a3cf-4b10-bebe-3bb0f7e344e5 tempest-VolumesListAdminTestJSON-248510173 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85 {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 25 15:56:49 devstack sudo[88065]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85 Feb 25 15:56:49 devstack sudo[88065]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 25 15:56:49 devstack sudo[88059]: pam_unix(sudo:session): session closed for user root Feb 25 15:56:49 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-6141d682-3372-4047-a87b-a56696be48cc tempest-VolumeTypesAccessTest-2122382728 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-34c62cb9-622b-4442-8be6-abf72b3699ec" returned: 0 in 0.567s {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 25 15:56:49 devstack cinder-volume[83528]: DEBUG cinder.coordination [None req-6141d682-3372-4047-a87b-a56696be48cc tempest-VolumeTypesAccessTest-2122382728 None] Lock "cinder-quobyte-34c62cb9-622b-4442-8be6-abf72b3699ec" released by "delete_volume" :: held 1.322s {{(pid=83528) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 25 15:56:49 devstack cinder-volume[83528]: WARNING cinder.quota [None req-6141d682-3372-4047-a87b-a56696be48cc tempest-VolumeTypesAccessTest-2122382728 None] Deprecated: Default quota for resource: volumes_tempest-VolumeTypesAccessTest-volume-type-758389799 is set by the default quota flag: quota_volumes_tempest-VolumeTypesAccessTest-volume-type-758389799, it is now deprecated. Please use the default quota class for default quota. Feb 25 15:56:49 devstack cinder-volume[83528]: WARNING cinder.quota [None req-6141d682-3372-4047-a87b-a56696be48cc tempest-VolumeTypesAccessTest-2122382728 None] Deprecated: Default quota for resource: gigabytes_tempest-VolumeTypesAccessTest-volume-type-758389799 is set by the default quota flag: quota_gigabytes_tempest-VolumeTypesAccessTest-volume-type-758389799, it is now deprecated. Please use the default quota class for default quota. Feb 25 15:56:49 devstack cinder-volume[83528]: DEBUG cinder.quota [None req-6141d682-3372-4047-a87b-a56696be48cc tempest-VolumeTypesAccessTest-2122382728 None] Created reservations ['4fc1f516-2a82-488a-8958-a8ba887c2564', 'd050ac2a-9298-43e5-9956-e4c35e4fa0a5', '79322e33-095d-4fcd-b990-3a7cce04d0aa', '5f89883d-037e-4d88-87b2-d4cf621efde2'] {{(pid=83528) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 25 15:56:49 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-6141d682-3372-4047-a87b-a56696be48cc tempest-VolumeTypesAccessTest-2122382728 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 25 15:56:49 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-6141d682-3372-4047-a87b-a56696be48cc tempest-VolumeTypesAccessTest-2122382728 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 25 15:56:49 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.quobyte [None req-6141d682-3372-4047-a87b-a56696be48cc tempest-VolumeTypesAccessTest-2122382728 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23e9d725-3e04-4cd9-bfe0-c8ef43305589': None} {{(pid=83528) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 25 15:56:49 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.quobyte [None req-6141d682-3372-4047-a87b-a56696be48cc tempest-VolumeTypesAccessTest-2122382728 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23e9d725-3e04-4cd9-bfe0-c8ef43305589'] {{(pid=83528) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 25 15:56:49 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-6141d682-3372-4047-a87b-a56696be48cc tempest-VolumeTypesAccessTest-2122382728 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 25 15:56:49 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-6141d682-3372-4047-a87b-a56696be48cc tempest-VolumeTypesAccessTest-2122382728 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85 {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 25 15:56:49 devstack sudo[88067]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85 Feb 25 15:56:49 devstack sudo[88067]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 25 15:56:49 devstack sudo[88065]: pam_unix(sudo:session): session closed for user root Feb 25 15:56:49 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-8a6f8f54-a3cf-4b10-bebe-3bb0f7e344e5 tempest-VolumesListAdminTestJSON-248510173 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85" returned: 0 in 0.492s {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 25 15:56:49 devstack cinder-volume[83528]: DEBUG cinder.manager [None req-8a6f8f54-a3cf-4b10-bebe-3bb0f7e344e5 tempest-VolumesListAdminTestJSON-248510173 None] Notifying Schedulers of capabilities ... {{(pid=83528) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 25 15:56:49 devstack cinder-volume[83528]: INFO cinder.volume.manager [None req-8a6f8f54-a3cf-4b10-bebe-3bb0f7e344e5 tempest-VolumesListAdminTestJSON-248510173 None] Deleted volume successfully. Feb 25 15:56:49 devstack cinder-volume[83528]: DEBUG cinder.coordination [None req-8a6f8f54-a3cf-4b10-bebe-3bb0f7e344e5 tempest-VolumesListAdminTestJSON-248510173 None] Lock "cinder-6f132d25-f3e2-457c-acf5-4b94e2db5e2c-delete_volume" released by "delete_volume" :: held 2.170s {{(pid=83528) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 25 15:56:49 devstack sudo[88063]: pam_unix(sudo:session): session closed for user root Feb 25 15:56:49 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-6db607ed-ede0-4707-a51a-9cf4986972af tempest-VolumesExtendTest-1653409646 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-6128762f-0997-49a7-b003-83bc847ca750 1G" returned: 0 in 0.604s {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 25 15:56:49 devstack cinder-volume[83528]: DEBUG oslo.privsep.daemon [-] privsep: reply[11087d0b-4a4a-4170-bcdb-8f79137aff70]: (4, 'raw') {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 25 15:56:49 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-6db607ed-ede0-4707-a51a-9cf4986972af tempest-VolumesExtendTest-1653409646 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-6128762f-0997-49a7-b003-83bc847ca750 {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 25 15:56:49 devstack cinder-volume[83528]: DEBUG cinder.coordination [None req-bb034e3c-61f1-4b82-80a9-6732a092eb27 tempest-VolumesListAdminTestJSON-248510173 None] Acquiring lock "cinder-d4bfef2f-cfb5-4d43-976d-746fb61d9613-delete_volume" by "delete_volume" {{(pid=83528) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 25 15:56:49 devstack cinder-volume[83528]: DEBUG cinder.coordination [None req-bb034e3c-61f1-4b82-80a9-6732a092eb27 tempest-VolumesListAdminTestJSON-248510173 None] Lock "cinder-d4bfef2f-cfb5-4d43-976d-746fb61d9613-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=83528) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 25 15:56:49 devstack cinder-volume[83528]: DEBUG cinder.coordination [None req-bb034e3c-61f1-4b82-80a9-6732a092eb27 tempest-VolumesListAdminTestJSON-248510173 None] Acquiring lock "cinder-quobyte-d4bfef2f-cfb5-4d43-976d-746fb61d9613" by "delete_volume" {{(pid=83528) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 25 15:56:49 devstack cinder-volume[83528]: DEBUG cinder.coordination [None req-bb034e3c-61f1-4b82-80a9-6732a092eb27 tempest-VolumesListAdminTestJSON-248510173 None] Lock "cinder-quobyte-d4bfef2f-cfb5-4d43-976d-746fb61d9613" acquired by "delete_volume" :: waited 0.009s {{(pid=83528) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 25 15:56:49 devstack sudo[88067]: pam_unix(sudo:session): session closed for user root Feb 25 15:56:49 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-6141d682-3372-4047-a87b-a56696be48cc tempest-VolumeTypesAccessTest-2122382728 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85" returned: 0 in 0.522s {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 25 15:56:49 devstack cinder-volume[83528]: DEBUG cinder.manager [None req-6141d682-3372-4047-a87b-a56696be48cc tempest-VolumeTypesAccessTest-2122382728 None] Notifying Schedulers of capabilities ... {{(pid=83528) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 25 15:56:49 devstack cinder-volume[83528]: DEBUG oslo.privsep.daemon [-] privsep: reply[a73d82db-379c-4019-995c-51079eda0f04]: (4, 'qcow2') {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 25 15:56:49 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-bb034e3c-61f1-4b82-80a9-6732a092eb27 tempest-VolumesListAdminTestJSON-248510173 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-d4bfef2f-cfb5-4d43-976d-746fb61d9613 {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 25 15:56:49 devstack sudo[88073]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-6128762f-0997-49a7-b003-83bc847ca750 Feb 25 15:56:49 devstack sudo[88073]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 25 15:56:49 devstack cinder-volume[83528]: INFO cinder.volume.manager [None req-6141d682-3372-4047-a87b-a56696be48cc tempest-VolumeTypesAccessTest-2122382728 None] Deleted volume successfully. Feb 25 15:56:49 devstack cinder-volume[83528]: DEBUG cinder.coordination [None req-6141d682-3372-4047-a87b-a56696be48cc tempest-VolumeTypesAccessTest-2122382728 None] Lock "cinder-34c62cb9-622b-4442-8be6-abf72b3699ec-delete_volume" released by "delete_volume" :: held 2.041s {{(pid=83528) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 25 15:56:50 devstack sudo[88075]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-d4bfef2f-cfb5-4d43-976d-746fb61d9613 Feb 25 15:56:50 devstack sudo[88075]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 25 15:56:50 devstack sudo[88073]: pam_unix(sudo:session): session closed for user root Feb 25 15:56:50 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-6db607ed-ede0-4707-a51a-9cf4986972af tempest-VolumesExtendTest-1653409646 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-6128762f-0997-49a7-b003-83bc847ca750" returned: 0 in 0.705s {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 25 15:56:50 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-6db607ed-ede0-4707-a51a-9cf4986972af tempest-VolumesExtendTest-1653409646 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-6128762f-0997-49a7-b003-83bc847ca750 {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 25 15:56:50 devstack sudo[88075]: pam_unix(sudo:session): session closed for user root Feb 25 15:56:50 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-bb034e3c-61f1-4b82-80a9-6732a092eb27 tempest-VolumesListAdminTestJSON-248510173 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-d4bfef2f-cfb5-4d43-976d-746fb61d9613" returned: 0 in 0.665s {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 25 15:56:50 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-bb034e3c-61f1-4b82-80a9-6732a092eb27 tempest-VolumesListAdminTestJSON-248510173 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-d4bfef2f-cfb5-4d43-976d-746fb61d9613 {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 25 15:56:50 devstack sudo[88084]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-d4bfef2f-cfb5-4d43-976d-746fb61d9613 Feb 25 15:56:50 devstack sudo[88084]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 25 15:56:50 devstack sudo[88083]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-6128762f-0997-49a7-b003-83bc847ca750 Feb 25 15:56:50 devstack sudo[88083]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 25 15:56:51 devstack sudo[88083]: pam_unix(sudo:session): session closed for user root Feb 25 15:56:51 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-6db607ed-ede0-4707-a51a-9cf4986972af tempest-VolumesExtendTest-1653409646 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-6128762f-0997-49a7-b003-83bc847ca750" returned: 1 in 0.647s {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 25 15:56:51 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-6db607ed-ede0-4707-a51a-9cf4986972af tempest-VolumesExtendTest-1653409646 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-6128762f-0997-49a7-b003-83bc847ca750' failed. Not Retrying. {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Feb 25 15:56:51 devstack cinder-volume[83528]: DEBUG cinder.volume.volume_utils [None req-6db607ed-ede0-4707-a51a-9cf4986972af tempest-VolumesExtendTest-1653409646 None] Downloaded image c50f3ecd-5e88-4737-aa36-6e073ce70c60 ((None, [{'url': 'file:///opt/stack/data/glance/images/c50f3ecd-5e88-4737-aa36-6e073ce70c60', 'metadata': {}}])) to volume 6128762f-0997-49a7-b003-83bc847ca750 successfully. {{(pid=83528) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1234}} Feb 25 15:56:51 devstack cinder-volume[83528]: DEBUG cinder.image.image_utils [None req-6db607ed-ede0-4707-a51a-9cf4986972af tempest-VolumesExtendTest-1653409646 None] Temporary image c50f3ecd-5e88-4737-aa36-6e073ce70c60 for user 0efb7c6adabb488b9b6983c194febe7f is deleted. {{(pid=83528) fetch /opt/stack/cinder/cinder/image/image_utils.py:1435}} Feb 25 15:56:51 devstack cinder-volume[83528]: DEBUG cinder.volume.volume_utils [None req-6db607ed-ede0-4707-a51a-9cf4986972af tempest-VolumesExtendTest-1653409646 None] Marking volume 6128762f-0997-49a7-b003-83bc847ca750 as bootable. {{(pid=83528) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1138}} Feb 25 15:56:51 devstack cinder-volume[83528]: DEBUG cinder.volume.flows.manager.create_volume [None req-6db607ed-ede0-4707-a51a-9cf4986972af tempest-VolumesExtendTest-1653409646 None] Copying metadata from image c50f3ecd-5e88-4737-aa36-6e073ce70c60 to 6128762f-0997-49a7-b003-83bc847ca750. {{(pid=83528) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Feb 25 15:56:51 devstack cinder-volume[83528]: DEBUG cinder.volume.flows.manager.create_volume [None req-6db607ed-ede0-4707-a51a-9cf4986972af tempest-VolumesExtendTest-1653409646 None] Creating volume glance metadata for volume 6128762f-0997-49a7-b003-83bc847ca750 backed by image c50f3ecd-5e88-4737-aa36-6e073ce70c60 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': 'c50f3ecd-5e88-4737-aa36-6e073ce70c60', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=83528) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Feb 25 15:56:51 devstack sudo[88084]: pam_unix(sudo:session): session closed for user root Feb 25 15:56:51 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-bb034e3c-61f1-4b82-80a9-6732a092eb27 tempest-VolumesListAdminTestJSON-248510173 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-d4bfef2f-cfb5-4d43-976d-746fb61d9613" returned: 0 in 0.651s {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 25 15:56:51 devstack cinder-volume[83528]: DEBUG cinder.coordination [None req-bb034e3c-61f1-4b82-80a9-6732a092eb27 tempest-VolumesListAdminTestJSON-248510173 None] Lock "cinder-quobyte-d4bfef2f-cfb5-4d43-976d-746fb61d9613" released by "delete_volume" :: held 1.353s {{(pid=83528) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 25 15:56:51 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-6db607ed-ede0-4707-a51a-9cf4986972af tempest-VolumesExtendTest-1653409646 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6d8565bd-d6ab-4783-8328-3005f64d7eb5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6128762f-0997-49a7-b003-83bc847ca750', 'volume_size': 1, 'image_id': 'c50f3ecd-5e88-4737-aa36-6e073ce70c60', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/c50f3ecd-5e88-4737-aa36-6e073ce70c60', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '75f8571da0ad46ec8e734ab2a4fa231d', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'c50f3ecd-5e88-4737-aa36-6e073ce70c60', 'created_at': datetime.datetime(2026, 2, 25, 14, 47, 16, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 2, 25, 14, 47, 18, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/c50f3ecd-5e88-4737-aa36-6e073ce70c60/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 25 15:56:51 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-6db607ed-ede0-4707-a51a-9cf4986972af tempest-VolumesExtendTest-1653409646 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8f705532-73c0-49ac-9c8d-336de30bcdef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 25 15:56:51 devstack cinder-volume[83528]: INFO cinder.volume.flows.manager.create_volume [None req-6db607ed-ede0-4707-a51a-9cf4986972af tempest-VolumesExtendTest-1653409646 None] Volume volume-6128762f-0997-49a7-b003-83bc847ca750 (6128762f-0997-49a7-b003-83bc847ca750): created successfully Feb 25 15:56:51 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-6db607ed-ede0-4707-a51a-9cf4986972af tempest-VolumesExtendTest-1653409646 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8f705532-73c0-49ac-9c8d-336de30bcdef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 25 15:56:51 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-6db607ed-ede0-4707-a51a-9cf4986972af tempest-VolumesExtendTest-1653409646 None] Flow 'volume_create_manager' (d7a601fe-6eba-4357-904e-88b4bf172953) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83528) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 25 15:56:51 devstack cinder-volume[83528]: INFO cinder.volume.manager [None req-6db607ed-ede0-4707-a51a-9cf4986972af tempest-VolumesExtendTest-1653409646 None] Created volume successfully. Feb 25 15:56:51 devstack cinder-volume[83528]: DEBUG cinder.quota [None req-bb034e3c-61f1-4b82-80a9-6732a092eb27 tempest-VolumesListAdminTestJSON-248510173 None] Created reservations ['e513fed7-5438-4792-9e54-3e6f58b1d613', 'cef56164-94e8-4852-9bfc-2d65ca898653', 'b8a59740-0697-4094-9053-b2237b514c85', '42c6a7fa-dc22-4a7b-aada-1f66cf99cf6c'] {{(pid=83528) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 25 15:56:51 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-bb034e3c-61f1-4b82-80a9-6732a092eb27 tempest-VolumesListAdminTestJSON-248510173 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 25 15:56:51 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-bb034e3c-61f1-4b82-80a9-6732a092eb27 tempest-VolumesListAdminTestJSON-248510173 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 25 15:56:51 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.quobyte [None req-bb034e3c-61f1-4b82-80a9-6732a092eb27 tempest-VolumesListAdminTestJSON-248510173 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23e9d725-3e04-4cd9-bfe0-c8ef43305589': None} {{(pid=83528) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 25 15:56:51 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.quobyte [None req-bb034e3c-61f1-4b82-80a9-6732a092eb27 tempest-VolumesListAdminTestJSON-248510173 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23e9d725-3e04-4cd9-bfe0-c8ef43305589'] {{(pid=83528) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 25 15:56:51 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-bb034e3c-61f1-4b82-80a9-6732a092eb27 tempest-VolumesListAdminTestJSON-248510173 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 25 15:56:51 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-bb034e3c-61f1-4b82-80a9-6732a092eb27 tempest-VolumesListAdminTestJSON-248510173 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85 {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 25 15:56:51 devstack sudo[88091]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85 Feb 25 15:56:51 devstack sudo[88091]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 25 15:56:51 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-7d131aa9-deeb-409a-9353-26f710070945 tempest-VolumesExtendTest-1653409646 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 25 15:56:51 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-7d131aa9-deeb-409a-9353-26f710070945 tempest-VolumesExtendTest-1653409646 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 0.001s {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 25 15:56:51 devstack cinder-volume[83528]: DEBUG oslo.privsep.daemon [-] privsep: reply[eafe059b-9390-4c29-896e-09754f00b5b4]: (4, 'raw') {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 25 15:56:51 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-7d131aa9-deeb-409a-9353-26f710070945 tempest-VolumesExtendTest-1653409646 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-6128762f-0997-49a7-b003-83bc847ca750 {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 25 15:56:51 devstack sudo[88093]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-6128762f-0997-49a7-b003-83bc847ca750 Feb 25 15:56:51 devstack sudo[88093]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 25 15:56:52 devstack sudo[88091]: pam_unix(sudo:session): session closed for user root Feb 25 15:56:52 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-bb034e3c-61f1-4b82-80a9-6732a092eb27 tempest-VolumesListAdminTestJSON-248510173 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85" returned: 0 in 0.592s {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 25 15:56:52 devstack cinder-volume[83528]: DEBUG cinder.manager [None req-bb034e3c-61f1-4b82-80a9-6732a092eb27 tempest-VolumesListAdminTestJSON-248510173 None] Notifying Schedulers of capabilities ... {{(pid=83528) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 25 15:56:52 devstack cinder-volume[83528]: INFO cinder.volume.manager [None req-bb034e3c-61f1-4b82-80a9-6732a092eb27 tempest-VolumesListAdminTestJSON-248510173 None] Deleted volume successfully. Feb 25 15:56:52 devstack cinder-volume[83528]: DEBUG cinder.coordination [None req-bb034e3c-61f1-4b82-80a9-6732a092eb27 tempest-VolumesListAdminTestJSON-248510173 None] Lock "cinder-d4bfef2f-cfb5-4d43-976d-746fb61d9613-delete_volume" released by "delete_volume" :: held 2.185s {{(pid=83528) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 25 15:56:52 devstack sudo[88093]: pam_unix(sudo:session): session closed for user root Feb 25 15:56:52 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-7d131aa9-deeb-409a-9353-26f710070945 tempest-VolumesExtendTest-1653409646 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-6128762f-0997-49a7-b003-83bc847ca750" returned: 0 in 0.785s {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 25 15:56:52 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-7d131aa9-deeb-409a-9353-26f710070945 tempest-VolumesExtendTest-1653409646 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-6128762f-0997-49a7-b003-83bc847ca750 {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 25 15:56:52 devstack sudo[88098]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-6128762f-0997-49a7-b003-83bc847ca750 Feb 25 15:56:52 devstack sudo[88098]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 25 15:56:53 devstack sudo[88098]: pam_unix(sudo:session): session closed for user root Feb 25 15:56:53 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-7d131aa9-deeb-409a-9353-26f710070945 tempest-VolumesExtendTest-1653409646 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-6128762f-0997-49a7-b003-83bc847ca750" returned: 1 in 0.747s {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 25 15:56:53 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-7d131aa9-deeb-409a-9353-26f710070945 tempest-VolumesExtendTest-1653409646 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-6128762f-0997-49a7-b003-83bc847ca750' failed. Not Retrying. {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Feb 25 15:56:53 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-7d131aa9-deeb-409a-9353-26f710070945 tempest-VolumesExtendTest-1653409646 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-6128762f-0997-49a7-b003-83bc847ca750 2G {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 25 15:56:53 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-7d131aa9-deeb-409a-9353-26f710070945 tempest-VolumesExtendTest-1653409646 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-6128762f-0997-49a7-b003-83bc847ca750 2G" returned: 0 in 0.066s {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 25 15:56:53 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-7d131aa9-deeb-409a-9353-26f710070945 tempest-VolumesExtendTest-1653409646 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 1.653s {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 25 15:56:53 devstack cinder-volume[83528]: INFO cinder.volume.manager [None req-7d131aa9-deeb-409a-9353-26f710070945 tempest-VolumesExtendTest-1653409646 None] Extend volume completed successfully. Feb 25 15:56:54 devstack cinder-volume[83528]: DEBUG cinder.coordination [None req-cd7d6869-416f-49f7-9306-405b985a6ae3 tempest-VolumesExtendTest-1653409646 None] Acquiring lock "cinder-6128762f-0997-49a7-b003-83bc847ca750-delete_volume" by "delete_volume" {{(pid=83528) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 25 15:56:54 devstack cinder-volume[83528]: DEBUG cinder.coordination [None req-cd7d6869-416f-49f7-9306-405b985a6ae3 tempest-VolumesExtendTest-1653409646 None] Lock "cinder-6128762f-0997-49a7-b003-83bc847ca750-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=83528) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 25 15:56:54 devstack cinder-volume[83528]: DEBUG cinder.coordination [None req-cd7d6869-416f-49f7-9306-405b985a6ae3 tempest-VolumesExtendTest-1653409646 None] Acquiring lock "cinder-quobyte-6128762f-0997-49a7-b003-83bc847ca750" by "delete_volume" {{(pid=83528) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 25 15:56:54 devstack cinder-volume[83528]: DEBUG cinder.coordination [None req-cd7d6869-416f-49f7-9306-405b985a6ae3 tempest-VolumesExtendTest-1653409646 None] Lock "cinder-quobyte-6128762f-0997-49a7-b003-83bc847ca750" acquired by "delete_volume" :: waited 0.012s {{(pid=83528) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 25 15:56:54 devstack cinder-volume[83528]: DEBUG oslo.privsep.daemon [-] privsep: reply[206159a9-6add-49e8-ba46-07e03c2a1e61]: (4, 'raw') {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 25 15:56:54 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-cd7d6869-416f-49f7-9306-405b985a6ae3 tempest-VolumesExtendTest-1653409646 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-6128762f-0997-49a7-b003-83bc847ca750 {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 25 15:56:54 devstack sudo[88106]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-6128762f-0997-49a7-b003-83bc847ca750 Feb 25 15:56:54 devstack sudo[88106]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 25 15:56:55 devstack sudo[88106]: pam_unix(sudo:session): session closed for user root Feb 25 15:56:55 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-cd7d6869-416f-49f7-9306-405b985a6ae3 tempest-VolumesExtendTest-1653409646 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-6128762f-0997-49a7-b003-83bc847ca750" returned: 0 in 0.713s {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 25 15:56:55 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-cd7d6869-416f-49f7-9306-405b985a6ae3 tempest-VolumesExtendTest-1653409646 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-6128762f-0997-49a7-b003-83bc847ca750 {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 25 15:56:55 devstack sudo[88111]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-6128762f-0997-49a7-b003-83bc847ca750 Feb 25 15:56:55 devstack sudo[88111]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 25 15:56:55 devstack sudo[88111]: pam_unix(sudo:session): session closed for user root Feb 25 15:56:55 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-cd7d6869-416f-49f7-9306-405b985a6ae3 tempest-VolumesExtendTest-1653409646 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-6128762f-0997-49a7-b003-83bc847ca750" returned: 1 in 0.615s {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 25 15:56:55 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-cd7d6869-416f-49f7-9306-405b985a6ae3 tempest-VolumesExtendTest-1653409646 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-6128762f-0997-49a7-b003-83bc847ca750' failed. Not Retrying. {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Feb 25 15:56:55 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-cd7d6869-416f-49f7-9306-405b985a6ae3 tempest-VolumesExtendTest-1653409646 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-6128762f-0997-49a7-b003-83bc847ca750 {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 25 15:56:55 devstack sudo[88116]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-6128762f-0997-49a7-b003-83bc847ca750 Feb 25 15:56:55 devstack sudo[88116]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 25 15:56:56 devstack cinder-volume[83528]: DEBUG cinder.volume.flows.manager.create_volume [None req-530070a4-38b9-4cec-b2d2-a8b6dc466760 tempest-VolumesTransfersV357Test-597647101 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83528) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 25 15:56:56 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-530070a4-38b9-4cec-b2d2-a8b6dc466760 tempest-VolumesTransfersV357Test-597647101 None] Flow 'volume_create_manager' (c97b3124-60e6-465d-8fb3-f68949638668) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83528) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 25 15:56:56 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-530070a4-38b9-4cec-b2d2-a8b6dc466760 tempest-VolumesTransfersV357Test-597647101 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (895ef2f6-0282-497f-ad3b-85386d95e1e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 25 15:56:56 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-530070a4-38b9-4cec-b2d2-a8b6dc466760 tempest-VolumesTransfersV357Test-597647101 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (895ef2f6-0282-497f-ad3b-85386d95e1e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-25T14:56:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1335858319',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ba5562ff-0d96-4312-8f48-9bcea6789236,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ea9a36022a3f47d3a09f493527cf69c8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-25T14:56:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-25T14:56:56Z,use_quota=True,user_id='d6e64e51f8ae458bba8c170eab37ab0e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ce71c2f9-6543-4165-9653-a1529b2ea243),volume_type_id=ce71c2f9-6543-4165-9653-a1529b2ea243)' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 25 15:56:56 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-530070a4-38b9-4cec-b2d2-a8b6dc466760 tempest-VolumesTransfersV357Test-597647101 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c25796c1-9d28-4e68-9283-423e90ca1acf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 25 15:56:56 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-530070a4-38b9-4cec-b2d2-a8b6dc466760 tempest-VolumesTransfersV357Test-597647101 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c25796c1-9d28-4e68-9283-423e90ca1acf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 25 15:56:56 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-530070a4-38b9-4cec-b2d2-a8b6dc466760 tempest-VolumesTransfersV357Test-597647101 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2950e5fc-2d4d-4263-b5bf-959acf1f6cc3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 25 15:56:56 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-530070a4-38b9-4cec-b2d2-a8b6dc466760 tempest-VolumesTransfersV357Test-597647101 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2950e5fc-2d4d-4263-b5bf-959acf1f6cc3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ba5562ff-0d96-4312-8f48-9bcea6789236', 'volume_name': 'volume-ba5562ff-0d96-4312-8f48-9bcea6789236', 'volume_size': 1}' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 25 15:56:56 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-530070a4-38b9-4cec-b2d2-a8b6dc466760 tempest-VolumesTransfersV357Test-597647101 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6f1088ce-32dc-4528-b3b2-35a0da93f21c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 25 15:56:56 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-530070a4-38b9-4cec-b2d2-a8b6dc466760 tempest-VolumesTransfersV357Test-597647101 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6f1088ce-32dc-4528-b3b2-35a0da93f21c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 25 15:56:56 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-530070a4-38b9-4cec-b2d2-a8b6dc466760 tempest-VolumesTransfersV357Test-597647101 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e613a5ee-79f9-4764-a50f-c9188f59136c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 25 15:56:56 devstack cinder-volume[83528]: INFO cinder.volume.flows.manager.create_volume [None req-530070a4-38b9-4cec-b2d2-a8b6dc466760 tempest-VolumesTransfersV357Test-597647101 None] Volume ba5562ff-0d96-4312-8f48-9bcea6789236: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ba5562ff-0d96-4312-8f48-9bcea6789236', 'volume_size': 1} Feb 25 15:56:56 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-530070a4-38b9-4cec-b2d2-a8b6dc466760 tempest-VolumesTransfersV357Test-597647101 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 25 15:56:56 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-530070a4-38b9-4cec-b2d2-a8b6dc466760 tempest-VolumesTransfersV357Test-597647101 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 25 15:56:56 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.quobyte [None req-530070a4-38b9-4cec-b2d2-a8b6dc466760 tempest-VolumesTransfersV357Test-597647101 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-25T14:56:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1335858319',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ba5562ff-0d96-4312-8f48-9bcea6789236,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ea9a36022a3f47d3a09f493527cf69c8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-25T14:56:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-25T14:56:56Z,use_quota=True,user_id='d6e64e51f8ae458bba8c170eab37ab0e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ce71c2f9-6543-4165-9653-a1529b2ea243),volume_type_id=ce71c2f9-6543-4165-9653-a1529b2ea243)}" {{(pid=83528) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 25 15:56:56 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.remotefs [None req-530070a4-38b9-4cec-b2d2-a8b6dc466760 tempest-VolumesTransfersV357Test-597647101 None] Creating volume ba5562ff-0d96-4312-8f48-9bcea6789236 {{(pid=83528) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 25 15:56:56 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-530070a4-38b9-4cec-b2d2-a8b6dc466760 tempest-VolumesTransfersV357Test-597647101 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 25 15:56:56 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-530070a4-38b9-4cec-b2d2-a8b6dc466760 tempest-VolumesTransfersV357Test-597647101 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 25 15:56:56 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.quobyte [None req-530070a4-38b9-4cec-b2d2-a8b6dc466760 tempest-VolumesTransfersV357Test-597647101 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23e9d725-3e04-4cd9-bfe0-c8ef43305589': None} {{(pid=83528) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 25 15:56:56 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.quobyte [None req-530070a4-38b9-4cec-b2d2-a8b6dc466760 tempest-VolumesTransfersV357Test-597647101 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23e9d725-3e04-4cd9-bfe0-c8ef43305589'] {{(pid=83528) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 25 15:56:56 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-530070a4-38b9-4cec-b2d2-a8b6dc466760 tempest-VolumesTransfersV357Test-597647101 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 25 15:56:56 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.quobyte [None req-530070a4-38b9-4cec-b2d2-a8b6dc466760 tempest-VolumesTransfersV357Test-597647101 None] Selected osci02.corp.quobyte.com/cinder-vol-23e9d725-3e04-4cd9-bfe0-c8ef43305589 as target Quobyte volume. {{(pid=83528) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 25 15:56:56 devstack cinder-volume[83528]: INFO cinder.volume.drivers.remotefs [None req-530070a4-38b9-4cec-b2d2-a8b6dc466760 tempest-VolumesTransfersV357Test-597647101 None] casted to osci02.corp.quobyte.com/cinder-vol-23e9d725-3e04-4cd9-bfe0-c8ef43305589 Feb 25 15:56:56 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-530070a4-38b9-4cec-b2d2-a8b6dc466760 tempest-VolumesTransfersV357Test-597647101 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-ba5562ff-0d96-4312-8f48-9bcea6789236 1073741824 {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 25 15:56:56 devstack sudo[88118]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-ba5562ff-0d96-4312-8f48-9bcea6789236 1073741824 Feb 25 15:56:56 devstack sudo[88118]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 25 15:56:56 devstack sudo[88116]: pam_unix(sudo:session): session closed for user root Feb 25 15:56:56 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-cd7d6869-416f-49f7-9306-405b985a6ae3 tempest-VolumesExtendTest-1653409646 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-6128762f-0997-49a7-b003-83bc847ca750" returned: 0 in 0.637s {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 25 15:56:56 devstack cinder-volume[83528]: DEBUG cinder.coordination [None req-cd7d6869-416f-49f7-9306-405b985a6ae3 tempest-VolumesExtendTest-1653409646 None] Lock "cinder-quobyte-6128762f-0997-49a7-b003-83bc847ca750" released by "delete_volume" :: held 2.029s {{(pid=83528) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 25 15:56:56 devstack cinder-volume[83528]: DEBUG cinder.quota [None req-cd7d6869-416f-49f7-9306-405b985a6ae3 tempest-VolumesExtendTest-1653409646 None] Created reservations ['937798b0-39db-4365-9197-fe63eee8b662', 'd7efd590-9b09-43e7-bbab-40a95a78089a', 'd4420100-4429-44c7-9e29-7551a4ae422a', '7eee6c6b-a809-4e74-bb24-6f83fae93833'] {{(pid=83528) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 25 15:56:56 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-cd7d6869-416f-49f7-9306-405b985a6ae3 tempest-VolumesExtendTest-1653409646 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 25 15:56:56 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-cd7d6869-416f-49f7-9306-405b985a6ae3 tempest-VolumesExtendTest-1653409646 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 25 15:56:56 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.quobyte [None req-cd7d6869-416f-49f7-9306-405b985a6ae3 tempest-VolumesExtendTest-1653409646 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23e9d725-3e04-4cd9-bfe0-c8ef43305589': None} {{(pid=83528) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 25 15:56:56 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.quobyte [None req-cd7d6869-416f-49f7-9306-405b985a6ae3 tempest-VolumesExtendTest-1653409646 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23e9d725-3e04-4cd9-bfe0-c8ef43305589'] {{(pid=83528) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 25 15:56:56 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-cd7d6869-416f-49f7-9306-405b985a6ae3 tempest-VolumesExtendTest-1653409646 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 25 15:56:56 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-cd7d6869-416f-49f7-9306-405b985a6ae3 tempest-VolumesExtendTest-1653409646 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85 {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 25 15:56:56 devstack sudo[88121]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85 Feb 25 15:56:56 devstack sudo[88121]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 25 15:56:56 devstack cinder-volume[83528]: DEBUG cinder.volume.flows.manager.create_volume [None req-d15329ef-a59d-439b-94c9-6ca7d5f6158f tempest-VolumesImageMetadata-2061713185 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83528) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 25 15:56:56 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-d15329ef-a59d-439b-94c9-6ca7d5f6158f tempest-VolumesImageMetadata-2061713185 None] Flow 'volume_create_manager' (f6ebc00b-5164-4298-8ba8-3005b7976157) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83528) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 25 15:56:56 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-d15329ef-a59d-439b-94c9-6ca7d5f6158f tempest-VolumesImageMetadata-2061713185 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6b375ece-d1cb-405f-a010-7ba479930bc5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 25 15:56:56 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-d15329ef-a59d-439b-94c9-6ca7d5f6158f tempest-VolumesImageMetadata-2061713185 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6b375ece-d1cb-405f-a010-7ba479930bc5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-25T14:56:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-1170393425',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4d2cfc74-a216-4f6e-82e4-bfde82916aa2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dba8c0f564e24fd1b06e903ea9329412',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-25T14:56:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-25T14:56:57Z,use_quota=True,user_id='bc230c79eae7406d8098af3a46be140d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ce71c2f9-6543-4165-9653-a1529b2ea243),volume_type_id=ce71c2f9-6543-4165-9653-a1529b2ea243)' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 25 15:56:56 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-d15329ef-a59d-439b-94c9-6ca7d5f6158f tempest-VolumesImageMetadata-2061713185 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8ba8e118-ed22-487e-984f-7dc1bf6a4ae7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 25 15:56:56 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-d15329ef-a59d-439b-94c9-6ca7d5f6158f tempest-VolumesImageMetadata-2061713185 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8ba8e118-ed22-487e-984f-7dc1bf6a4ae7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 25 15:56:56 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-d15329ef-a59d-439b-94c9-6ca7d5f6158f tempest-VolumesImageMetadata-2061713185 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3bf538fa-85b7-4a8a-8df4-3b348c9f8329) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 25 15:56:56 devstack cinder-volume[83528]: DEBUG cinder.image.glance [None req-d15329ef-a59d-439b-94c9-6ca7d5f6158f tempest-VolumesImageMetadata-2061713185 None] Creating Keystone auth plugin from conf {{(pid=83528) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Feb 25 15:56:56 devstack sudo[88118]: pam_unix(sudo:session): session closed for user root Feb 25 15:56:56 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-530070a4-38b9-4cec-b2d2-a8b6dc466760 tempest-VolumesTransfersV357Test-597647101 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-ba5562ff-0d96-4312-8f48-9bcea6789236 1073741824" returned: 0 in 0.757s {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 25 15:56:56 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-530070a4-38b9-4cec-b2d2-a8b6dc466760 tempest-VolumesTransfersV357Test-597647101 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-ba5562ff-0d96-4312-8f48-9bcea6789236 {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 25 15:56:56 devstack sudo[88127]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-ba5562ff-0d96-4312-8f48-9bcea6789236 Feb 25 15:56:56 devstack sudo[88127]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 25 15:56:56 devstack sudo[88121]: pam_unix(sudo:session): session closed for user root Feb 25 15:56:56 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-cd7d6869-416f-49f7-9306-405b985a6ae3 tempest-VolumesExtendTest-1653409646 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85" returned: 0 in 0.523s {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 25 15:56:56 devstack cinder-volume[83528]: DEBUG cinder.manager [None req-cd7d6869-416f-49f7-9306-405b985a6ae3 tempest-VolumesExtendTest-1653409646 None] Notifying Schedulers of capabilities ... {{(pid=83528) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 25 15:56:56 devstack cinder-volume[83528]: INFO cinder.volume.manager [None req-cd7d6869-416f-49f7-9306-405b985a6ae3 tempest-VolumesExtendTest-1653409646 None] Deleted volume successfully. Feb 25 15:56:57 devstack cinder-volume[83528]: DEBUG cinder.coordination [None req-cd7d6869-416f-49f7-9306-405b985a6ae3 tempest-VolumesExtendTest-1653409646 None] Lock "cinder-6128762f-0997-49a7-b003-83bc847ca750-delete_volume" released by "delete_volume" :: held 2.750s {{(pid=83528) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 25 15:56:57 devstack cinder-volume[83528]: DEBUG cinder.volume.flows.manager.create_volume [None req-e619b11a-d050-4b84-878b-7fb1d1f90ca9 tempest-VolumesExtendTest-1653409646 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83528) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 25 15:56:57 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-e619b11a-d050-4b84-878b-7fb1d1f90ca9 tempest-VolumesExtendTest-1653409646 None] Flow 'volume_create_manager' (cc02a6d7-23ec-4064-9537-de46a6fd895e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83528) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 25 15:56:57 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-e619b11a-d050-4b84-878b-7fb1d1f90ca9 tempest-VolumesExtendTest-1653409646 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (50b6789e-1bb6-4a80-a518-58e0be6ee791) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 25 15:56:57 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-e619b11a-d050-4b84-878b-7fb1d1f90ca9 tempest-VolumesExtendTest-1653409646 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (50b6789e-1bb6-4a80-a518-58e0be6ee791) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-25T14:56:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-2043478478',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=34381b60-f4b8-486f-8113-334db7880364,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4e100b25ed944f5387843bf79988c4c1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-25T14:56:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-25T14:56:57Z,use_quota=True,user_id='0efb7c6adabb488b9b6983c194febe7f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ce71c2f9-6543-4165-9653-a1529b2ea243),volume_type_id=ce71c2f9-6543-4165-9653-a1529b2ea243)' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 25 15:56:57 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-e619b11a-d050-4b84-878b-7fb1d1f90ca9 tempest-VolumesExtendTest-1653409646 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (418e053a-f6b6-4314-9c3e-37c1ef415340) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 25 15:56:57 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-e619b11a-d050-4b84-878b-7fb1d1f90ca9 tempest-VolumesExtendTest-1653409646 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (418e053a-f6b6-4314-9c3e-37c1ef415340) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 25 15:56:57 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-e619b11a-d050-4b84-878b-7fb1d1f90ca9 tempest-VolumesExtendTest-1653409646 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (893f5d8a-e2ff-49ef-a72d-afb0b17ac9a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 25 15:56:57 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-e619b11a-d050-4b84-878b-7fb1d1f90ca9 tempest-VolumesExtendTest-1653409646 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (893f5d8a-e2ff-49ef-a72d-afb0b17ac9a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '34381b60-f4b8-486f-8113-334db7880364', 'volume_name': 'volume-34381b60-f4b8-486f-8113-334db7880364', 'volume_size': 1}' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 25 15:56:57 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-e619b11a-d050-4b84-878b-7fb1d1f90ca9 tempest-VolumesExtendTest-1653409646 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ecea936a-139b-4096-814d-cb56cdb7c3c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 25 15:56:57 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-e619b11a-d050-4b84-878b-7fb1d1f90ca9 tempest-VolumesExtendTest-1653409646 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ecea936a-139b-4096-814d-cb56cdb7c3c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 25 15:56:57 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-e619b11a-d050-4b84-878b-7fb1d1f90ca9 tempest-VolumesExtendTest-1653409646 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (df802736-1aab-4ad6-9e71-a3e437ff2ba5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 25 15:56:57 devstack cinder-volume[83528]: INFO cinder.volume.flows.manager.create_volume [None req-e619b11a-d050-4b84-878b-7fb1d1f90ca9 tempest-VolumesExtendTest-1653409646 None] Volume 34381b60-f4b8-486f-8113-334db7880364: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-34381b60-f4b8-486f-8113-334db7880364', 'volume_size': 1} Feb 25 15:56:57 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-e619b11a-d050-4b84-878b-7fb1d1f90ca9 tempest-VolumesExtendTest-1653409646 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 25 15:56:57 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-d15329ef-a59d-439b-94c9-6ca7d5f6158f tempest-VolumesImageMetadata-2061713185 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3bf538fa-85b7-4a8a-8df4-3b348c9f8329) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '4d2cfc74-a216-4f6e-82e4-bfde82916aa2', 'volume_name': 'volume-4d2cfc74-a216-4f6e-82e4-bfde82916aa2', 'volume_size': 1, 'image_id': 'c50f3ecd-5e88-4737-aa36-6e073ce70c60', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/c50f3ecd-5e88-4737-aa36-6e073ce70c60', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '75f8571da0ad46ec8e734ab2a4fa231d', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'c50f3ecd-5e88-4737-aa36-6e073ce70c60', 'created_at': datetime.datetime(2026, 2, 25, 14, 47, 16, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 2, 25, 14, 47, 18, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/c50f3ecd-5e88-4737-aa36-6e073ce70c60/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 25 15:56:57 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-d15329ef-a59d-439b-94c9-6ca7d5f6158f tempest-VolumesImageMetadata-2061713185 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (289326b4-2843-4ee6-be22-a65bc2abb337) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 25 15:56:57 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-d15329ef-a59d-439b-94c9-6ca7d5f6158f tempest-VolumesImageMetadata-2061713185 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (289326b4-2843-4ee6-be22-a65bc2abb337) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 25 15:56:57 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-d15329ef-a59d-439b-94c9-6ca7d5f6158f tempest-VolumesImageMetadata-2061713185 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d2637a53-fc8e-4b3a-822c-17da0a5913d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 25 15:56:57 devstack cinder-volume[83528]: INFO cinder.volume.flows.manager.create_volume [None req-d15329ef-a59d-439b-94c9-6ca7d5f6158f tempest-VolumesImageMetadata-2061713185 None] Volume 4d2cfc74-a216-4f6e-82e4-bfde82916aa2: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-4d2cfc74-a216-4f6e-82e4-bfde82916aa2', 'volume_size': 1, 'image_id': 'c50f3ecd-5e88-4737-aa36-6e073ce70c60', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/c50f3ecd-5e88-4737-aa36-6e073ce70c60', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '75f8571da0ad46ec8e734ab2a4fa231d', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'c50f3ecd-5e88-4737-aa36-6e073ce70c60', 'created_at': datetime.datetime(2026, 2, 25, 14, 47, 16, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 2, 25, 14, 47, 18, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/c50f3ecd-5e88-4737-aa36-6e073ce70c60/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Feb 25 15:56:57 devstack cinder-volume[83528]: DEBUG cinder.volume.flows.manager.create_volume [None req-d15329ef-a59d-439b-94c9-6ca7d5f6158f tempest-VolumesImageMetadata-2061713185 None] Trying to clone 4d2cfc74-a216-4f6e-82e4-bfde82916aa2 from image c50f3ecd-5e88-4737-aa36-6e073ce70c60 at location (None, [{'url': 'file:///opt/stack/data/glance/images/c50f3ecd-5e88-4737-aa36-6e073ce70c60', 'metadata': {}}]). {{(pid=83528) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1082}} Feb 25 15:56:57 devstack cinder-volume[83528]: DEBUG cinder.image.image_utils [None req-d15329ef-a59d-439b-94c9-6ca7d5f6158f tempest-VolumesImageMetadata-2061713185 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_c50f3ecd-5e88-4737-aa36-6e073ce70c60_layp2vnpdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=83528) fetch /opt/stack/cinder/cinder/image/image_utils.py:732}} Feb 25 15:56:57 devstack cinder-volume[83528]: INFO cinder.image.image_utils [None req-d15329ef-a59d-439b-94c9-6ca7d5f6158f tempest-VolumesImageMetadata-2061713185 None] Image download 20.69 MB at 20.69 MB/s Feb 25 15:56:57 devstack sudo[88127]: pam_unix(sudo:session): session closed for user root Feb 25 15:56:57 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-530070a4-38b9-4cec-b2d2-a8b6dc466760 tempest-VolumesTransfersV357Test-597647101 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-ba5562ff-0d96-4312-8f48-9bcea6789236" returned: 0 in 0.571s {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 25 15:56:57 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.quobyte [None req-530070a4-38b9-4cec-b2d2-a8b6dc466760 tempest-VolumesTransfersV357Test-597647101 None] <== create_volume: return (1375ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-23e9d725-3e04-4cd9-bfe0-c8ef43305589'} {{(pid=83528) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 25 15:56:57 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-530070a4-38b9-4cec-b2d2-a8b6dc466760 tempest-VolumesTransfersV357Test-597647101 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.380s {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 25 15:56:57 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-e619b11a-d050-4b84-878b-7fb1d1f90ca9 tempest-VolumesExtendTest-1653409646 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.251s {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 25 15:56:57 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.quobyte [None req-e619b11a-d050-4b84-878b-7fb1d1f90ca9 tempest-VolumesExtendTest-1653409646 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-25T14:56:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-2043478478',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=34381b60-f4b8-486f-8113-334db7880364,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4e100b25ed944f5387843bf79988c4c1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-25T14:56:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-25T14:56:57Z,use_quota=True,user_id='0efb7c6adabb488b9b6983c194febe7f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ce71c2f9-6543-4165-9653-a1529b2ea243),volume_type_id=ce71c2f9-6543-4165-9653-a1529b2ea243)}" {{(pid=83528) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 25 15:56:57 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.remotefs [None req-e619b11a-d050-4b84-878b-7fb1d1f90ca9 tempest-VolumesExtendTest-1653409646 None] Creating volume 34381b60-f4b8-486f-8113-334db7880364 {{(pid=83528) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 25 15:56:57 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-e619b11a-d050-4b84-878b-7fb1d1f90ca9 tempest-VolumesExtendTest-1653409646 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 25 15:56:57 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-e619b11a-d050-4b84-878b-7fb1d1f90ca9 tempest-VolumesExtendTest-1653409646 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 25 15:56:57 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.quobyte [None req-e619b11a-d050-4b84-878b-7fb1d1f90ca9 tempest-VolumesExtendTest-1653409646 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23e9d725-3e04-4cd9-bfe0-c8ef43305589': None} {{(pid=83528) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 25 15:56:57 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.quobyte [None req-e619b11a-d050-4b84-878b-7fb1d1f90ca9 tempest-VolumesExtendTest-1653409646 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23e9d725-3e04-4cd9-bfe0-c8ef43305589'] {{(pid=83528) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 25 15:56:57 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-e619b11a-d050-4b84-878b-7fb1d1f90ca9 tempest-VolumesExtendTest-1653409646 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 25 15:56:57 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.quobyte [None req-e619b11a-d050-4b84-878b-7fb1d1f90ca9 tempest-VolumesExtendTest-1653409646 None] Selected osci02.corp.quobyte.com/cinder-vol-23e9d725-3e04-4cd9-bfe0-c8ef43305589 as target Quobyte volume. {{(pid=83528) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 25 15:56:57 devstack cinder-volume[83528]: INFO cinder.volume.drivers.remotefs [None req-e619b11a-d050-4b84-878b-7fb1d1f90ca9 tempest-VolumesExtendTest-1653409646 None] casted to osci02.corp.quobyte.com/cinder-vol-23e9d725-3e04-4cd9-bfe0-c8ef43305589 Feb 25 15:56:57 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-e619b11a-d050-4b84-878b-7fb1d1f90ca9 tempest-VolumesExtendTest-1653409646 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-34381b60-f4b8-486f-8113-334db7880364 1073741824 {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 25 15:56:57 devstack sudo[88131]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-34381b60-f4b8-486f-8113-334db7880364 1073741824 Feb 25 15:56:57 devstack sudo[88131]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 25 15:56:57 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-530070a4-38b9-4cec-b2d2-a8b6dc466760 tempest-VolumesTransfersV357Test-597647101 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e613a5ee-79f9-4764-a50f-c9188f59136c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ba5562ff-0d96-4312-8f48-9bcea6789236', 'volume_size': 1}' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 25 15:56:57 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-530070a4-38b9-4cec-b2d2-a8b6dc466760 tempest-VolumesTransfersV357Test-597647101 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (565d4028-77b2-4f71-ae05-b4279c66344b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 25 15:56:57 devstack cinder-volume[83528]: DEBUG oslo.privsep.daemon [-] privsep: reply[baaff869-ed28-49da-b875-bc4934cefe8d]: (4, 'qcow2') {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 25 15:56:57 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-d15329ef-a59d-439b-94c9-6ca7d5f6158f tempest-VolumesImageMetadata-2061713185 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c50f3ecd-5e88-4737-aa36-6e073ce70c60_layp2vnpdevstack@QuobyteHD {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 25 15:56:57 devstack cinder-volume[83528]: INFO cinder.volume.flows.manager.create_volume [None req-530070a4-38b9-4cec-b2d2-a8b6dc466760 tempest-VolumesTransfersV357Test-597647101 None] Volume volume-ba5562ff-0d96-4312-8f48-9bcea6789236 (ba5562ff-0d96-4312-8f48-9bcea6789236): created successfully Feb 25 15:56:57 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-530070a4-38b9-4cec-b2d2-a8b6dc466760 tempest-VolumesTransfersV357Test-597647101 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (565d4028-77b2-4f71-ae05-b4279c66344b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 25 15:56:57 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-530070a4-38b9-4cec-b2d2-a8b6dc466760 tempest-VolumesTransfersV357Test-597647101 None] Flow 'volume_create_manager' (c97b3124-60e6-465d-8fb3-f68949638668) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83528) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 25 15:56:57 devstack cinder-volume[83528]: INFO cinder.volume.manager [None req-530070a4-38b9-4cec-b2d2-a8b6dc466760 tempest-VolumesTransfersV357Test-597647101 None] Created volume successfully. Feb 25 15:56:57 devstack sudo[88133]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c50f3ecd-5e88-4737-aa36-6e073ce70c60_layp2vnpdevstack@QuobyteHD Feb 25 15:56:57 devstack sudo[88133]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 25 15:56:58 devstack sudo[88131]: pam_unix(sudo:session): session closed for user root Feb 25 15:56:58 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-e619b11a-d050-4b84-878b-7fb1d1f90ca9 tempest-VolumesExtendTest-1653409646 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-34381b60-f4b8-486f-8113-334db7880364 1073741824" returned: 0 in 0.616s {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 25 15:56:58 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-e619b11a-d050-4b84-878b-7fb1d1f90ca9 tempest-VolumesExtendTest-1653409646 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-34381b60-f4b8-486f-8113-334db7880364 {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 25 15:56:58 devstack sudo[88133]: pam_unix(sudo:session): session closed for user root Feb 25 15:56:58 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-d15329ef-a59d-439b-94c9-6ca7d5f6158f tempest-VolumesImageMetadata-2061713185 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c50f3ecd-5e88-4737-aa36-6e073ce70c60_layp2vnpdevstack@QuobyteHD" returned: 0 in 0.622s {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 25 15:56:58 devstack cinder-volume[83528]: DEBUG cinder.image.image_utils [None req-d15329ef-a59d-439b-94c9-6ca7d5f6158f tempest-VolumesImageMetadata-2061713185 None] Temporary image c50f3ecd-5e88-4737-aa36-6e073ce70c60 is fetched for user bc230c79eae7406d8098af3a46be140d. {{(pid=83528) fetch /opt/stack/cinder/cinder/image/image_utils.py:1431}} Feb 25 15:56:58 devstack sudo[88141]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-34381b60-f4b8-486f-8113-334db7880364 Feb 25 15:56:58 devstack sudo[88141]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 25 15:56:58 devstack cinder-volume[83528]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc123e19-bfc2-4c01-a7a6-e9f41da58587]: (4, 'qcow2') {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 25 15:56:58 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-d15329ef-a59d-439b-94c9-6ca7d5f6158f tempest-VolumesImageMetadata-2061713185 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c50f3ecd-5e88-4737-aa36-6e073ce70c60_layp2vnpdevstack@QuobyteHD {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 25 15:56:58 devstack sudo[88143]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c50f3ecd-5e88-4737-aa36-6e073ce70c60_layp2vnpdevstack@QuobyteHD Feb 25 15:56:58 devstack sudo[88143]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 25 15:56:58 devstack sudo[88141]: pam_unix(sudo:session): session closed for user root Feb 25 15:56:58 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-e619b11a-d050-4b84-878b-7fb1d1f90ca9 tempest-VolumesExtendTest-1653409646 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-34381b60-f4b8-486f-8113-334db7880364" returned: 0 in 0.534s {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 25 15:56:58 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.quobyte [None req-e619b11a-d050-4b84-878b-7fb1d1f90ca9 tempest-VolumesExtendTest-1653409646 None] <== create_volume: return (1193ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-23e9d725-3e04-4cd9-bfe0-c8ef43305589'} {{(pid=83528) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 25 15:56:58 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-e619b11a-d050-4b84-878b-7fb1d1f90ca9 tempest-VolumesExtendTest-1653409646 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.197s {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 25 15:56:58 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-e619b11a-d050-4b84-878b-7fb1d1f90ca9 tempest-VolumesExtendTest-1653409646 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (df802736-1aab-4ad6-9e71-a3e437ff2ba5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-34381b60-f4b8-486f-8113-334db7880364', 'volume_size': 1}' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 25 15:56:58 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-e619b11a-d050-4b84-878b-7fb1d1f90ca9 tempest-VolumesExtendTest-1653409646 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1c6b1143-124a-4dea-a268-04487badffeb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 25 15:56:58 devstack cinder-volume[83528]: INFO cinder.volume.flows.manager.create_volume [None req-e619b11a-d050-4b84-878b-7fb1d1f90ca9 tempest-VolumesExtendTest-1653409646 None] Volume volume-34381b60-f4b8-486f-8113-334db7880364 (34381b60-f4b8-486f-8113-334db7880364): created successfully Feb 25 15:56:58 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-e619b11a-d050-4b84-878b-7fb1d1f90ca9 tempest-VolumesExtendTest-1653409646 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1c6b1143-124a-4dea-a268-04487badffeb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 25 15:56:58 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-e619b11a-d050-4b84-878b-7fb1d1f90ca9 tempest-VolumesExtendTest-1653409646 None] Flow 'volume_create_manager' (cc02a6d7-23ec-4064-9537-de46a6fd895e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83528) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 25 15:56:58 devstack cinder-volume[83528]: INFO cinder.volume.manager [None req-e619b11a-d050-4b84-878b-7fb1d1f90ca9 tempest-VolumesExtendTest-1653409646 None] Created volume successfully. Feb 25 15:56:58 devstack cinder-volume[83528]: INFO cinder.volume.manager [None req-fa0879bb-9c54-4f2e-a393-245d44d0aa3a tempest-VolumesTransfersV357Test-711569659 None] Transfer volume completed successfully. Feb 25 15:56:59 devstack sudo[88143]: pam_unix(sudo:session): session closed for user root Feb 25 15:56:59 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-d15329ef-a59d-439b-94c9-6ca7d5f6158f tempest-VolumesImageMetadata-2061713185 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c50f3ecd-5e88-4737-aa36-6e073ce70c60_layp2vnpdevstack@QuobyteHD" returned: 0 in 0.754s {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 25 15:56:59 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-d15329ef-a59d-439b-94c9-6ca7d5f6158f tempest-VolumesImageMetadata-2061713185 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 25 15:56:59 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-d15329ef-a59d-439b-94c9-6ca7d5f6158f tempest-VolumesImageMetadata-2061713185 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 25 15:56:59 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.quobyte [None req-d15329ef-a59d-439b-94c9-6ca7d5f6158f tempest-VolumesImageMetadata-2061713185 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-25T14:56:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-1170393425',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4d2cfc74-a216-4f6e-82e4-bfde82916aa2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dba8c0f564e24fd1b06e903ea9329412',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-25T14:56:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-25T14:56:57Z,use_quota=True,user_id='bc230c79eae7406d8098af3a46be140d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ce71c2f9-6543-4165-9653-a1529b2ea243),volume_type_id=ce71c2f9-6543-4165-9653-a1529b2ea243)}" {{(pid=83528) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 25 15:56:59 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.remotefs [None req-d15329ef-a59d-439b-94c9-6ca7d5f6158f tempest-VolumesImageMetadata-2061713185 None] Creating volume 4d2cfc74-a216-4f6e-82e4-bfde82916aa2 {{(pid=83528) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 25 15:56:59 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-d15329ef-a59d-439b-94c9-6ca7d5f6158f tempest-VolumesImageMetadata-2061713185 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 25 15:56:59 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-d15329ef-a59d-439b-94c9-6ca7d5f6158f tempest-VolumesImageMetadata-2061713185 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 25 15:56:59 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.quobyte [None req-d15329ef-a59d-439b-94c9-6ca7d5f6158f tempest-VolumesImageMetadata-2061713185 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23e9d725-3e04-4cd9-bfe0-c8ef43305589': None} {{(pid=83528) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 25 15:56:59 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.quobyte [None req-d15329ef-a59d-439b-94c9-6ca7d5f6158f tempest-VolumesImageMetadata-2061713185 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23e9d725-3e04-4cd9-bfe0-c8ef43305589'] {{(pid=83528) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 25 15:56:59 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-d15329ef-a59d-439b-94c9-6ca7d5f6158f tempest-VolumesImageMetadata-2061713185 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 25 15:56:59 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.quobyte [None req-d15329ef-a59d-439b-94c9-6ca7d5f6158f tempest-VolumesImageMetadata-2061713185 None] Selected osci02.corp.quobyte.com/cinder-vol-23e9d725-3e04-4cd9-bfe0-c8ef43305589 as target Quobyte volume. {{(pid=83528) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 25 15:56:59 devstack cinder-volume[83528]: INFO cinder.volume.drivers.remotefs [None req-d15329ef-a59d-439b-94c9-6ca7d5f6158f tempest-VolumesImageMetadata-2061713185 None] casted to osci02.corp.quobyte.com/cinder-vol-23e9d725-3e04-4cd9-bfe0-c8ef43305589 Feb 25 15:56:59 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-d15329ef-a59d-439b-94c9-6ca7d5f6158f tempest-VolumesImageMetadata-2061713185 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-4d2cfc74-a216-4f6e-82e4-bfde82916aa2 1073741824 {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 25 15:56:59 devstack sudo[88149]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-4d2cfc74-a216-4f6e-82e4-bfde82916aa2 1073741824 Feb 25 15:56:59 devstack sudo[88149]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 25 15:56:59 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-52439190-106d-4cc9-bec0-4bdb018ec3ae tempest-VolumesExtendTest-1653409646 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 25 15:56:59 devstack sudo[88149]: pam_unix(sudo:session): session closed for user root Feb 25 15:56:59 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-d15329ef-a59d-439b-94c9-6ca7d5f6158f tempest-VolumesImageMetadata-2061713185 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-4d2cfc74-a216-4f6e-82e4-bfde82916aa2 1073741824" returned: 0 in 0.642s {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 25 15:56:59 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-d15329ef-a59d-439b-94c9-6ca7d5f6158f tempest-VolumesImageMetadata-2061713185 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-4d2cfc74-a216-4f6e-82e4-bfde82916aa2 {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 25 15:56:59 devstack sudo[88154]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-4d2cfc74-a216-4f6e-82e4-bfde82916aa2 Feb 25 15:56:59 devstack sudo[88154]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 25 15:57:00 devstack sudo[88154]: pam_unix(sudo:session): session closed for user root Feb 25 15:57:00 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-d15329ef-a59d-439b-94c9-6ca7d5f6158f tempest-VolumesImageMetadata-2061713185 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-4d2cfc74-a216-4f6e-82e4-bfde82916aa2" returned: 0 in 0.463s {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 25 15:57:00 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.quobyte [None req-d15329ef-a59d-439b-94c9-6ca7d5f6158f tempest-VolumesImageMetadata-2061713185 None] <== create_volume: return (1135ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-23e9d725-3e04-4cd9-bfe0-c8ef43305589'} {{(pid=83528) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 25 15:57:00 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-d15329ef-a59d-439b-94c9-6ca7d5f6158f tempest-VolumesImageMetadata-2061713185 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.137s {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 25 15:57:00 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-52439190-106d-4cc9-bec0-4bdb018ec3ae tempest-VolumesExtendTest-1653409646 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.782s {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 25 15:57:00 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.remotefs [None req-52439190-106d-4cc9-bec0-4bdb018ec3ae tempest-VolumesExtendTest-1653409646 None] Creating offline snapshot 285d38d9-77da-40d4-a4ed-b27158659fc7 of volume 34381b60-f4b8-486f-8113-334db7880364 {{(pid=83528) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Feb 25 15:57:00 devstack cinder-volume[83528]: DEBUG cinder.coordination [None req-2eae74d5-48a4-4c2f-b760-972e25045e2f tempest-VolumesTransfersV357Test-1971368222 None] Acquiring lock "cinder-ba5562ff-0d96-4312-8f48-9bcea6789236-delete_volume" by "delete_volume" {{(pid=83528) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 25 15:57:00 devstack cinder-volume[83528]: DEBUG oslo.privsep.daemon [-] privsep: reply[4be9c089-c3cb-48b5-9ed2-189b0002325a]: (4, 'qcow2') {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 25 15:57:00 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-52439190-106d-4cc9-bec0-4bdb018ec3ae tempest-VolumesExtendTest-1653409646 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-34381b60-f4b8-486f-8113-334db7880364 {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 25 15:57:00 devstack cinder-volume[83528]: DEBUG cinder.volume.volume_utils [None req-d15329ef-a59d-439b-94c9-6ca7d5f6158f tempest-VolumesImageMetadata-2061713185 None] Attempting download of c50f3ecd-5e88-4737-aa36-6e073ce70c60 ((None, [{'url': 'file:///opt/stack/data/glance/images/c50f3ecd-5e88-4737-aa36-6e073ce70c60', 'metadata': {}}])) to volume 4d2cfc74-a216-4f6e-82e4-bfde82916aa2. {{(pid=83528) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1189}} Feb 25 15:57:00 devstack cinder-volume[83528]: DEBUG cinder.coordination [None req-2eae74d5-48a4-4c2f-b760-972e25045e2f tempest-VolumesTransfersV357Test-1971368222 None] Lock "cinder-ba5562ff-0d96-4312-8f48-9bcea6789236-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=83528) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 25 15:57:00 devstack cinder-volume[83528]: DEBUG oslo.privsep.daemon [-] privsep: reply[1739a43d-15ce-4a97-8f20-6902d3f9a18e]: (4, 'raw') {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 25 15:57:00 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-d15329ef-a59d-439b-94c9-6ca7d5f6158f tempest-VolumesImageMetadata-2061713185 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_c50f3ecd-5e88-4737-aa36-6e073ce70c60_dmghpeu9 {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 25 15:57:00 devstack cinder-volume[83528]: DEBUG cinder.coordination [None req-2eae74d5-48a4-4c2f-b760-972e25045e2f tempest-VolumesTransfersV357Test-1971368222 None] Acquiring lock "cinder-quobyte-ba5562ff-0d96-4312-8f48-9bcea6789236" by "delete_volume" {{(pid=83528) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 25 15:57:00 devstack cinder-volume[83528]: DEBUG cinder.coordination [None req-2eae74d5-48a4-4c2f-b760-972e25045e2f tempest-VolumesTransfersV357Test-1971368222 None] Lock "cinder-quobyte-ba5562ff-0d96-4312-8f48-9bcea6789236" acquired by "delete_volume" :: waited 0.012s {{(pid=83528) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 25 15:57:00 devstack sudo[88157]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-34381b60-f4b8-486f-8113-334db7880364 Feb 25 15:57:00 devstack sudo[88157]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 25 15:57:00 devstack cinder-volume[83528]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f3e3517-f66c-4ad9-8dcc-738d9b4bdd0e]: (4, 'qcow2') {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 25 15:57:00 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-2eae74d5-48a4-4c2f-b760-972e25045e2f tempest-VolumesTransfersV357Test-1971368222 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-ba5562ff-0d96-4312-8f48-9bcea6789236 {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 25 15:57:00 devstack sudo[88158]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_c50f3ecd-5e88-4737-aa36-6e073ce70c60_dmghpeu9 Feb 25 15:57:00 devstack sudo[88158]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 25 15:57:00 devstack sudo[88160]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-ba5562ff-0d96-4312-8f48-9bcea6789236 Feb 25 15:57:00 devstack sudo[88160]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 25 15:57:00 devstack sudo[88158]: pam_unix(sudo:session): session closed for user root Feb 25 15:57:00 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-d15329ef-a59d-439b-94c9-6ca7d5f6158f tempest-VolumesImageMetadata-2061713185 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_c50f3ecd-5e88-4737-aa36-6e073ce70c60_dmghpeu9" returned: 0 in 0.559s {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 25 15:57:00 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-d15329ef-a59d-439b-94c9-6ca7d5f6158f tempest-VolumesImageMetadata-2061713185 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_c50f3ecd-5e88-4737-aa36-6e073ce70c60_dmghpeu9 {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 25 15:57:00 devstack sudo[88157]: pam_unix(sudo:session): session closed for user root Feb 25 15:57:00 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-52439190-106d-4cc9-bec0-4bdb018ec3ae tempest-VolumesExtendTest-1653409646 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-34381b60-f4b8-486f-8113-334db7880364" returned: 0 in 0.654s {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 25 15:57:00 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-52439190-106d-4cc9-bec0-4bdb018ec3ae tempest-VolumesExtendTest-1653409646 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-34381b60-f4b8-486f-8113-334db7880364,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-34381b60-f4b8-486f-8113-334db7880364.285d38d9-77da-40d4-a4ed-b27158659fc7 1G {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 25 15:57:00 devstack sudo[88172]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-34381b60-f4b8-486f-8113-334db7880364,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-34381b60-f4b8-486f-8113-334db7880364.285d38d9-77da-40d4-a4ed-b27158659fc7 1G Feb 25 15:57:00 devstack sudo[88172]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 25 15:57:00 devstack sudo[88160]: pam_unix(sudo:session): session closed for user root Feb 25 15:57:00 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-2eae74d5-48a4-4c2f-b760-972e25045e2f tempest-VolumesTransfersV357Test-1971368222 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-ba5562ff-0d96-4312-8f48-9bcea6789236" returned: 0 in 0.560s {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 25 15:57:00 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-2eae74d5-48a4-4c2f-b760-972e25045e2f tempest-VolumesTransfersV357Test-1971368222 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-ba5562ff-0d96-4312-8f48-9bcea6789236 {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 25 15:57:00 devstack sudo[88174]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-ba5562ff-0d96-4312-8f48-9bcea6789236 Feb 25 15:57:00 devstack sudo[88174]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 25 15:57:00 devstack sudo[88171]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_c50f3ecd-5e88-4737-aa36-6e073ce70c60_dmghpeu9 Feb 25 15:57:00 devstack sudo[88171]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 25 15:57:00 devstack cinder-volume[83528]: DEBUG cinder.volume.flows.manager.create_volume [None req-fdf01ef9-1108-4372-804a-bea5bf9897a4 tempest-VolumesDeleteCascade-1036059898 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83528) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 25 15:57:01 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-fdf01ef9-1108-4372-804a-bea5bf9897a4 tempest-VolumesDeleteCascade-1036059898 None] Flow 'volume_create_manager' (158ea9fe-3f29-4d2d-8a6b-0c1e2c69c494) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83528) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 25 15:57:01 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-fdf01ef9-1108-4372-804a-bea5bf9897a4 tempest-VolumesDeleteCascade-1036059898 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (60d649bc-069b-4cbd-addc-7e4038ddb298) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 25 15:57:01 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-fdf01ef9-1108-4372-804a-bea5bf9897a4 tempest-VolumesDeleteCascade-1036059898 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (60d649bc-069b-4cbd-addc-7e4038ddb298) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-25T14:57:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1101467123',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3c93b0b5-b14c-437d-969c-1ebf3dddc971,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f8464253780144d49cfe3aa5fc80be50',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-25T14:57:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-25T14:57:01Z,use_quota=True,user_id='a4405dce3ee9409e92ab33348e52bb5c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ce71c2f9-6543-4165-9653-a1529b2ea243),volume_type_id=ce71c2f9-6543-4165-9653-a1529b2ea243)' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 25 15:57:01 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-fdf01ef9-1108-4372-804a-bea5bf9897a4 tempest-VolumesDeleteCascade-1036059898 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (490d0b9f-71df-4c60-9aef-5c90c46daf69) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 25 15:57:01 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-fdf01ef9-1108-4372-804a-bea5bf9897a4 tempest-VolumesDeleteCascade-1036059898 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (490d0b9f-71df-4c60-9aef-5c90c46daf69) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 25 15:57:01 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-fdf01ef9-1108-4372-804a-bea5bf9897a4 tempest-VolumesDeleteCascade-1036059898 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eba624c7-1a52-40e6-a55a-458a2e2da89e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 25 15:57:01 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-fdf01ef9-1108-4372-804a-bea5bf9897a4 tempest-VolumesDeleteCascade-1036059898 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eba624c7-1a52-40e6-a55a-458a2e2da89e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3c93b0b5-b14c-437d-969c-1ebf3dddc971', 'volume_name': 'volume-3c93b0b5-b14c-437d-969c-1ebf3dddc971', 'volume_size': 1}' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 25 15:57:01 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-fdf01ef9-1108-4372-804a-bea5bf9897a4 tempest-VolumesDeleteCascade-1036059898 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (189fe59f-093b-4b63-bdc7-abca45d5c413) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 25 15:57:01 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-fdf01ef9-1108-4372-804a-bea5bf9897a4 tempest-VolumesDeleteCascade-1036059898 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (189fe59f-093b-4b63-bdc7-abca45d5c413) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 25 15:57:01 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-fdf01ef9-1108-4372-804a-bea5bf9897a4 tempest-VolumesDeleteCascade-1036059898 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (be5f1716-dfcf-4163-8b9c-bd93b55ded1d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 25 15:57:01 devstack cinder-volume[83528]: INFO cinder.volume.flows.manager.create_volume [None req-fdf01ef9-1108-4372-804a-bea5bf9897a4 tempest-VolumesDeleteCascade-1036059898 None] Volume 3c93b0b5-b14c-437d-969c-1ebf3dddc971: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3c93b0b5-b14c-437d-969c-1ebf3dddc971', 'volume_size': 1} Feb 25 15:57:01 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-fdf01ef9-1108-4372-804a-bea5bf9897a4 tempest-VolumesDeleteCascade-1036059898 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 25 15:57:01 devstack sudo[88174]: pam_unix(sudo:session): session closed for user root Feb 25 15:57:01 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-2eae74d5-48a4-4c2f-b760-972e25045e2f tempest-VolumesTransfersV357Test-1971368222 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-ba5562ff-0d96-4312-8f48-9bcea6789236" returned: 0 in 0.497s {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 25 15:57:01 devstack cinder-volume[83528]: DEBUG cinder.coordination [None req-2eae74d5-48a4-4c2f-b760-972e25045e2f tempest-VolumesTransfersV357Test-1971368222 None] Lock "cinder-quobyte-ba5562ff-0d96-4312-8f48-9bcea6789236" released by "delete_volume" :: held 1.094s {{(pid=83528) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 25 15:57:01 devstack sudo[88172]: pam_unix(sudo:session): session closed for user root Feb 25 15:57:01 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-52439190-106d-4cc9-bec0-4bdb018ec3ae tempest-VolumesExtendTest-1653409646 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-34381b60-f4b8-486f-8113-334db7880364,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-34381b60-f4b8-486f-8113-334db7880364.285d38d9-77da-40d4-a4ed-b27158659fc7 1G" returned: 0 in 0.548s {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 25 15:57:01 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-52439190-106d-4cc9-bec0-4bdb018ec3ae tempest-VolumesExtendTest-1653409646 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-34381b60-f4b8-486f-8113-334db7880364 -F qcow2 /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-34381b60-f4b8-486f-8113-334db7880364.285d38d9-77da-40d4-a4ed-b27158659fc7 {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 25 15:57:01 devstack sudo[88183]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-34381b60-f4b8-486f-8113-334db7880364 -F qcow2 /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-34381b60-f4b8-486f-8113-334db7880364.285d38d9-77da-40d4-a4ed-b27158659fc7 Feb 25 15:57:01 devstack sudo[88183]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 25 15:57:01 devstack sudo[88171]: pam_unix(sudo:session): session closed for user root Feb 25 15:57:01 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-d15329ef-a59d-439b-94c9-6ca7d5f6158f tempest-VolumesImageMetadata-2061713185 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_c50f3ecd-5e88-4737-aa36-6e073ce70c60_dmghpeu9" returned: 1 in 0.602s {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 25 15:57:01 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-d15329ef-a59d-439b-94c9-6ca7d5f6158f tempest-VolumesImageMetadata-2061713185 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_c50f3ecd-5e88-4737-aa36-6e073ce70c60_dmghpeu9' failed. Not Retrying. {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Feb 25 15:57:01 devstack cinder-volume[83528]: DEBUG oslo.privsep.daemon [-] privsep: reply[110c9ccf-e46f-40f0-bd37-6e636f8068c5]: (4, 'qcow2') {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 25 15:57:01 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-d15329ef-a59d-439b-94c9-6ca7d5f6158f tempest-VolumesImageMetadata-2061713185 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c50f3ecd-5e88-4737-aa36-6e073ce70c60_layp2vnpdevstack@QuobyteHD {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 25 15:57:01 devstack cinder-volume[83528]: DEBUG cinder.quota [None req-2eae74d5-48a4-4c2f-b760-972e25045e2f tempest-VolumesTransfersV357Test-1971368222 None] Created reservations ['bbc1e272-4723-4f42-b2cb-eff546bc821f', '7c124aa9-621f-46d8-b995-8bf556d198e4', '78c17615-b069-48d6-9523-4987c639ad29', '7814ea3f-6bdb-4705-b0f6-213f358dfe0f'] {{(pid=83528) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 25 15:57:01 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-2eae74d5-48a4-4c2f-b760-972e25045e2f tempest-VolumesTransfersV357Test-1971368222 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 25 15:57:01 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-2eae74d5-48a4-4c2f-b760-972e25045e2f tempest-VolumesTransfersV357Test-1971368222 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 25 15:57:01 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.quobyte [None req-2eae74d5-48a4-4c2f-b760-972e25045e2f tempest-VolumesTransfersV357Test-1971368222 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23e9d725-3e04-4cd9-bfe0-c8ef43305589': None} {{(pid=83528) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 25 15:57:01 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.quobyte [None req-2eae74d5-48a4-4c2f-b760-972e25045e2f tempest-VolumesTransfersV357Test-1971368222 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23e9d725-3e04-4cd9-bfe0-c8ef43305589'] {{(pid=83528) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 25 15:57:01 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-2eae74d5-48a4-4c2f-b760-972e25045e2f tempest-VolumesTransfersV357Test-1971368222 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 25 15:57:01 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-2eae74d5-48a4-4c2f-b760-972e25045e2f tempest-VolumesTransfersV357Test-1971368222 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85 {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 25 15:57:01 devstack sudo[88185]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c50f3ecd-5e88-4737-aa36-6e073ce70c60_layp2vnpdevstack@QuobyteHD Feb 25 15:57:01 devstack sudo[88185]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 25 15:57:01 devstack sudo[88186]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85 Feb 25 15:57:01 devstack sudo[88186]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 25 15:57:01 devstack sudo[88183]: pam_unix(sudo:session): session closed for user root Feb 25 15:57:01 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-52439190-106d-4cc9-bec0-4bdb018ec3ae tempest-VolumesExtendTest-1653409646 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-34381b60-f4b8-486f-8113-334db7880364 -F qcow2 /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-34381b60-f4b8-486f-8113-334db7880364.285d38d9-77da-40d4-a4ed-b27158659fc7" returned: 0 in 0.441s {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 25 15:57:01 devstack cinder-volume[83528]: WARNING cinder.volume.drivers.remotefs [None req-52439190-106d-4cc9-bec0-4bdb018ec3ae tempest-VolumesExtendTest-1653409646 None] /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-34381b60-f4b8-486f-8113-334db7880364.285d38d9-77da-40d4-a4ed-b27158659fc7 is being set with open permissions: ugo+rw Feb 25 15:57:01 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-52439190-106d-4cc9-bec0-4bdb018ec3ae tempest-VolumesExtendTest-1653409646 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-34381b60-f4b8-486f-8113-334db7880364.285d38d9-77da-40d4-a4ed-b27158659fc7 {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 25 15:57:01 devstack sudo[88192]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-34381b60-f4b8-486f-8113-334db7880364.285d38d9-77da-40d4-a4ed-b27158659fc7 Feb 25 15:57:01 devstack sudo[88192]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 25 15:57:02 devstack sudo[88186]: pam_unix(sudo:session): session closed for user root Feb 25 15:57:02 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-2eae74d5-48a4-4c2f-b760-972e25045e2f tempest-VolumesTransfersV357Test-1971368222 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85" returned: 0 in 0.477s {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 25 15:57:02 devstack cinder-volume[83528]: DEBUG cinder.manager [None req-2eae74d5-48a4-4c2f-b760-972e25045e2f tempest-VolumesTransfersV357Test-1971368222 None] Notifying Schedulers of capabilities ... {{(pid=83528) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 25 15:57:02 devstack cinder-volume[83528]: INFO cinder.volume.manager [None req-2eae74d5-48a4-4c2f-b760-972e25045e2f tempest-VolumesTransfersV357Test-1971368222 None] Deleted volume successfully. Feb 25 15:57:02 devstack sudo[88185]: pam_unix(sudo:session): session closed for user root Feb 25 15:57:02 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-d15329ef-a59d-439b-94c9-6ca7d5f6158f tempest-VolumesImageMetadata-2061713185 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c50f3ecd-5e88-4737-aa36-6e073ce70c60_layp2vnpdevstack@QuobyteHD" returned: 0 in 0.568s {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 25 15:57:02 devstack cinder-volume[83528]: DEBUG cinder.image.image_utils [None req-d15329ef-a59d-439b-94c9-6ca7d5f6158f tempest-VolumesImageMetadata-2061713185 None] c50f3ecd-5e88-4737-aa36-6e073ce70c60 was qcow2, converting to raw {{(pid=83528) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1120}} Feb 25 15:57:02 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-d15329ef-a59d-439b-94c9-6ca7d5f6158f tempest-VolumesImageMetadata-2061713185 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_c50f3ecd-5e88-4737-aa36-6e073ce70c60_layp2vnpdevstack@QuobyteHD /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-4d2cfc74-a216-4f6e-82e4-bfde82916aa2 {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 25 15:57:02 devstack sudo[88198]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_c50f3ecd-5e88-4737-aa36-6e073ce70c60_layp2vnpdevstack@QuobyteHD /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-4d2cfc74-a216-4f6e-82e4-bfde82916aa2 Feb 25 15:57:02 devstack sudo[88198]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 25 15:57:02 devstack cinder-volume[83528]: DEBUG cinder.coordination [None req-2eae74d5-48a4-4c2f-b760-972e25045e2f tempest-VolumesTransfersV357Test-1971368222 None] Lock "cinder-ba5562ff-0d96-4312-8f48-9bcea6789236-delete_volume" released by "delete_volume" :: held 1.854s {{(pid=83528) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 25 15:57:02 devstack sudo[88192]: pam_unix(sudo:session): session closed for user root Feb 25 15:57:02 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-52439190-106d-4cc9-bec0-4bdb018ec3ae tempest-VolumesExtendTest-1653409646 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-34381b60-f4b8-486f-8113-334db7880364.285d38d9-77da-40d4-a4ed-b27158659fc7" returned: 0 in 0.447s {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 25 15:57:02 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-52439190-106d-4cc9-bec0-4bdb018ec3ae tempest-VolumesExtendTest-1653409646 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-34381b60-f4b8-486f-8113-334db7880364.info {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 25 15:57:02 devstack sudo[88201]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-34381b60-f4b8-486f-8113-334db7880364.info Feb 25 15:57:02 devstack sudo[88201]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 25 15:57:02 devstack cinder-volume[83528]: DEBUG cinder.volume.flows.manager.create_volume [None req-e35882f3-31c3-4918-893e-ab7c97dc150a tempest-VolumesTransfersV357Test-597647101 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83528) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 25 15:57:02 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-e35882f3-31c3-4918-893e-ab7c97dc150a tempest-VolumesTransfersV357Test-597647101 None] Flow 'volume_create_manager' (c7e9ba03-3dec-4864-9047-95aecafc01a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83528) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 25 15:57:02 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-e35882f3-31c3-4918-893e-ab7c97dc150a tempest-VolumesTransfersV357Test-597647101 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ba872a15-5638-4ed2-ab13-f0a03d03e7cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 25 15:57:02 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-e35882f3-31c3-4918-893e-ab7c97dc150a tempest-VolumesTransfersV357Test-597647101 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ba872a15-5638-4ed2-ab13-f0a03d03e7cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-25T14:57:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-916173030',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=31294be1-662f-4856-a350-a689e69f4fb7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ea9a36022a3f47d3a09f493527cf69c8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-25T14:57:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-25T14:57:03Z,use_quota=True,user_id='d6e64e51f8ae458bba8c170eab37ab0e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ce71c2f9-6543-4165-9653-a1529b2ea243),volume_type_id=ce71c2f9-6543-4165-9653-a1529b2ea243)' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 25 15:57:02 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-e35882f3-31c3-4918-893e-ab7c97dc150a tempest-VolumesTransfersV357Test-597647101 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f8a2c3b0-03cf-4277-8ce2-c922a3296adf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 25 15:57:02 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-e35882f3-31c3-4918-893e-ab7c97dc150a tempest-VolumesTransfersV357Test-597647101 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f8a2c3b0-03cf-4277-8ce2-c922a3296adf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 25 15:57:02 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-e35882f3-31c3-4918-893e-ab7c97dc150a tempest-VolumesTransfersV357Test-597647101 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (14035a4d-4ae6-46c2-87cb-8bde4fb3481a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 25 15:57:02 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-e35882f3-31c3-4918-893e-ab7c97dc150a tempest-VolumesTransfersV357Test-597647101 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (14035a4d-4ae6-46c2-87cb-8bde4fb3481a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '31294be1-662f-4856-a350-a689e69f4fb7', 'volume_name': 'volume-31294be1-662f-4856-a350-a689e69f4fb7', 'volume_size': 1}' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 25 15:57:02 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-e35882f3-31c3-4918-893e-ab7c97dc150a tempest-VolumesTransfersV357Test-597647101 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ba5eee5c-b2bd-4a2b-9cee-6f2252b76c00) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 25 15:57:02 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-e35882f3-31c3-4918-893e-ab7c97dc150a tempest-VolumesTransfersV357Test-597647101 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ba5eee5c-b2bd-4a2b-9cee-6f2252b76c00) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 25 15:57:02 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-e35882f3-31c3-4918-893e-ab7c97dc150a tempest-VolumesTransfersV357Test-597647101 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cbfd71c5-6f3c-4676-b6b7-d602233f8db4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 25 15:57:02 devstack cinder-volume[83528]: INFO cinder.volume.flows.manager.create_volume [None req-e35882f3-31c3-4918-893e-ab7c97dc150a tempest-VolumesTransfersV357Test-597647101 None] Volume 31294be1-662f-4856-a350-a689e69f4fb7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-31294be1-662f-4856-a350-a689e69f4fb7', 'volume_size': 1} Feb 25 15:57:02 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-e35882f3-31c3-4918-893e-ab7c97dc150a tempest-VolumesTransfersV357Test-597647101 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 25 15:57:02 devstack sudo[88201]: pam_unix(sudo:session): session closed for user root Feb 25 15:57:02 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-52439190-106d-4cc9-bec0-4bdb018ec3ae tempest-VolumesExtendTest-1653409646 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-34381b60-f4b8-486f-8113-334db7880364.info" returned: 0 in 0.609s {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 25 15:57:02 devstack cinder-volume[83528]: WARNING cinder.volume.drivers.remotefs [None req-52439190-106d-4cc9-bec0-4bdb018ec3ae tempest-VolumesExtendTest-1653409646 None] /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-34381b60-f4b8-486f-8113-334db7880364.info is being set with open permissions: ugo+rw Feb 25 15:57:02 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-52439190-106d-4cc9-bec0-4bdb018ec3ae tempest-VolumesExtendTest-1653409646 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-34381b60-f4b8-486f-8113-334db7880364.info {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 25 15:57:02 devstack sudo[88209]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-34381b60-f4b8-486f-8113-334db7880364.info Feb 25 15:57:02 devstack sudo[88209]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 25 15:57:03 devstack sudo[88198]: pam_unix(sudo:session): session closed for user root Feb 25 15:57:03 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-d15329ef-a59d-439b-94c9-6ca7d5f6158f tempest-VolumesImageMetadata-2061713185 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_c50f3ecd-5e88-4737-aa36-6e073ce70c60_layp2vnpdevstack@QuobyteHD /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-4d2cfc74-a216-4f6e-82e4-bfde82916aa2" returned: 0 in 1.061s {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 25 15:57:03 devstack cinder-volume[83528]: DEBUG cinder.image.image_utils [None req-d15329ef-a59d-439b-94c9-6ca7d5f6158f tempest-VolumesImageMetadata-2061713185 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_c50f3ecd-5e88-4737-aa36-6e073ce70c60_layp2vnpdevstack@QuobyteHD, size 112.00 MB, duration 1.06 sec, destination /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-4d2cfc74-a216-4f6e-82e4-bfde82916aa2 {{(pid=83528) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Feb 25 15:57:03 devstack cinder-volume[83528]: INFO cinder.image.image_utils [None req-d15329ef-a59d-439b-94c9-6ca7d5f6158f tempest-VolumesImageMetadata-2061713185 None] Converted 112.00 MB image at 105.45 MB/s Feb 25 15:57:03 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-d15329ef-a59d-439b-94c9-6ca7d5f6158f tempest-VolumesImageMetadata-2061713185 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-4d2cfc74-a216-4f6e-82e4-bfde82916aa2 1G {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 25 15:57:03 devstack sudo[88211]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-4d2cfc74-a216-4f6e-82e4-bfde82916aa2 1G Feb 25 15:57:03 devstack sudo[88211]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 25 15:57:03 devstack sudo[88209]: pam_unix(sudo:session): session closed for user root Feb 25 15:57:03 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-52439190-106d-4cc9-bec0-4bdb018ec3ae tempest-VolumesExtendTest-1653409646 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-34381b60-f4b8-486f-8113-334db7880364.info" returned: 0 in 0.437s {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 25 15:57:03 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-52439190-106d-4cc9-bec0-4bdb018ec3ae tempest-VolumesExtendTest-1653409646 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.233s {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 25 15:57:03 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-fdf01ef9-1108-4372-804a-bea5bf9897a4 tempest-VolumesDeleteCascade-1036059898 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.362s {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 25 15:57:03 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.quobyte [None req-fdf01ef9-1108-4372-804a-bea5bf9897a4 tempest-VolumesDeleteCascade-1036059898 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-25T14:57:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1101467123',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3c93b0b5-b14c-437d-969c-1ebf3dddc971,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f8464253780144d49cfe3aa5fc80be50',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-25T14:57:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-25T14:57:01Z,use_quota=True,user_id='a4405dce3ee9409e92ab33348e52bb5c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ce71c2f9-6543-4165-9653-a1529b2ea243),volume_type_id=ce71c2f9-6543-4165-9653-a1529b2ea243)}" {{(pid=83528) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 25 15:57:03 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.remotefs [None req-fdf01ef9-1108-4372-804a-bea5bf9897a4 tempest-VolumesDeleteCascade-1036059898 None] Creating volume 3c93b0b5-b14c-437d-969c-1ebf3dddc971 {{(pid=83528) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 25 15:57:03 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-fdf01ef9-1108-4372-804a-bea5bf9897a4 tempest-VolumesDeleteCascade-1036059898 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 25 15:57:03 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-fdf01ef9-1108-4372-804a-bea5bf9897a4 tempest-VolumesDeleteCascade-1036059898 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 25 15:57:03 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.quobyte [None req-fdf01ef9-1108-4372-804a-bea5bf9897a4 tempest-VolumesDeleteCascade-1036059898 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23e9d725-3e04-4cd9-bfe0-c8ef43305589': None} {{(pid=83528) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 25 15:57:03 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.quobyte [None req-fdf01ef9-1108-4372-804a-bea5bf9897a4 tempest-VolumesDeleteCascade-1036059898 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23e9d725-3e04-4cd9-bfe0-c8ef43305589'] {{(pid=83528) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 25 15:57:03 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-fdf01ef9-1108-4372-804a-bea5bf9897a4 tempest-VolumesDeleteCascade-1036059898 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 25 15:57:03 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.quobyte [None req-fdf01ef9-1108-4372-804a-bea5bf9897a4 tempest-VolumesDeleteCascade-1036059898 None] Selected osci02.corp.quobyte.com/cinder-vol-23e9d725-3e04-4cd9-bfe0-c8ef43305589 as target Quobyte volume. {{(pid=83528) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 25 15:57:03 devstack cinder-volume[83528]: INFO cinder.volume.drivers.remotefs [None req-fdf01ef9-1108-4372-804a-bea5bf9897a4 tempest-VolumesDeleteCascade-1036059898 None] casted to osci02.corp.quobyte.com/cinder-vol-23e9d725-3e04-4cd9-bfe0-c8ef43305589 Feb 25 15:57:03 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-fdf01ef9-1108-4372-804a-bea5bf9897a4 tempest-VolumesDeleteCascade-1036059898 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-3c93b0b5-b14c-437d-969c-1ebf3dddc971 1073741824 {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 25 15:57:03 devstack sudo[88214]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-3c93b0b5-b14c-437d-969c-1ebf3dddc971 1073741824 Feb 25 15:57:03 devstack sudo[88214]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 25 15:57:03 devstack cinder-volume[83528]: INFO cinder.volume.manager [None req-52439190-106d-4cc9-bec0-4bdb018ec3ae tempest-VolumesExtendTest-1653409646 None] Create snapshot completed successfully Feb 25 15:57:03 devstack sudo[88211]: pam_unix(sudo:session): session closed for user root Feb 25 15:57:03 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-d15329ef-a59d-439b-94c9-6ca7d5f6158f tempest-VolumesImageMetadata-2061713185 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-4d2cfc74-a216-4f6e-82e4-bfde82916aa2 1G" returned: 0 in 0.528s {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 25 15:57:03 devstack cinder-volume[83528]: DEBUG oslo.privsep.daemon [-] privsep: reply[01b16ea0-6213-4833-8dbc-e91eab565e10]: (4, 'raw') {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 25 15:57:03 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-d15329ef-a59d-439b-94c9-6ca7d5f6158f tempest-VolumesImageMetadata-2061713185 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-4d2cfc74-a216-4f6e-82e4-bfde82916aa2 {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 25 15:57:03 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-4a3f530f-8a32-4ef3-89c8-12eb9ef19923 tempest-VolumesExtendTest-1653409646 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 25 15:57:03 devstack sudo[88219]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-4d2cfc74-a216-4f6e-82e4-bfde82916aa2 Feb 25 15:57:03 devstack sudo[88219]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 25 15:57:04 devstack sudo[88214]: pam_unix(sudo:session): session closed for user root Feb 25 15:57:04 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-fdf01ef9-1108-4372-804a-bea5bf9897a4 tempest-VolumesDeleteCascade-1036059898 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-3c93b0b5-b14c-437d-969c-1ebf3dddc971 1073741824" returned: 0 in 0.666s {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 25 15:57:04 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-fdf01ef9-1108-4372-804a-bea5bf9897a4 tempest-VolumesDeleteCascade-1036059898 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-3c93b0b5-b14c-437d-969c-1ebf3dddc971 {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 25 15:57:04 devstack sudo[88224]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-3c93b0b5-b14c-437d-969c-1ebf3dddc971 Feb 25 15:57:04 devstack sudo[88224]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 25 15:57:04 devstack sudo[88219]: pam_unix(sudo:session): session closed for user root Feb 25 15:57:04 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-d15329ef-a59d-439b-94c9-6ca7d5f6158f tempest-VolumesImageMetadata-2061713185 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-4d2cfc74-a216-4f6e-82e4-bfde82916aa2" returned: 0 in 0.583s {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 25 15:57:04 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-d15329ef-a59d-439b-94c9-6ca7d5f6158f tempest-VolumesImageMetadata-2061713185 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-4d2cfc74-a216-4f6e-82e4-bfde82916aa2 {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 25 15:57:04 devstack sudo[88228]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-4d2cfc74-a216-4f6e-82e4-bfde82916aa2 Feb 25 15:57:04 devstack sudo[88228]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 25 15:57:04 devstack sudo[88224]: pam_unix(sudo:session): session closed for user root Feb 25 15:57:04 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-fdf01ef9-1108-4372-804a-bea5bf9897a4 tempest-VolumesDeleteCascade-1036059898 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-3c93b0b5-b14c-437d-969c-1ebf3dddc971" returned: 0 in 0.436s {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 25 15:57:04 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.quobyte [None req-fdf01ef9-1108-4372-804a-bea5bf9897a4 tempest-VolumesDeleteCascade-1036059898 None] <== create_volume: return (1133ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-23e9d725-3e04-4cd9-bfe0-c8ef43305589'} {{(pid=83528) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 25 15:57:04 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-fdf01ef9-1108-4372-804a-bea5bf9897a4 tempest-VolumesDeleteCascade-1036059898 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.136s {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 25 15:57:04 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-e35882f3-31c3-4918-893e-ab7c97dc150a tempest-VolumesTransfersV357Test-597647101 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.698s {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 25 15:57:04 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.quobyte [None req-e35882f3-31c3-4918-893e-ab7c97dc150a tempest-VolumesTransfersV357Test-597647101 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-25T14:57:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-916173030',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=31294be1-662f-4856-a350-a689e69f4fb7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ea9a36022a3f47d3a09f493527cf69c8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-25T14:57:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-25T14:57:03Z,use_quota=True,user_id='d6e64e51f8ae458bba8c170eab37ab0e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ce71c2f9-6543-4165-9653-a1529b2ea243),volume_type_id=ce71c2f9-6543-4165-9653-a1529b2ea243)}" {{(pid=83528) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 25 15:57:04 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.remotefs [None req-e35882f3-31c3-4918-893e-ab7c97dc150a tempest-VolumesTransfersV357Test-597647101 None] Creating volume 31294be1-662f-4856-a350-a689e69f4fb7 {{(pid=83528) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 25 15:57:04 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-e35882f3-31c3-4918-893e-ab7c97dc150a tempest-VolumesTransfersV357Test-597647101 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 25 15:57:04 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-e35882f3-31c3-4918-893e-ab7c97dc150a tempest-VolumesTransfersV357Test-597647101 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 25 15:57:04 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.quobyte [None req-e35882f3-31c3-4918-893e-ab7c97dc150a tempest-VolumesTransfersV357Test-597647101 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23e9d725-3e04-4cd9-bfe0-c8ef43305589': None} {{(pid=83528) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 25 15:57:04 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.quobyte [None req-e35882f3-31c3-4918-893e-ab7c97dc150a tempest-VolumesTransfersV357Test-597647101 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23e9d725-3e04-4cd9-bfe0-c8ef43305589'] {{(pid=83528) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 25 15:57:04 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-e35882f3-31c3-4918-893e-ab7c97dc150a tempest-VolumesTransfersV357Test-597647101 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 25 15:57:04 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.quobyte [None req-e35882f3-31c3-4918-893e-ab7c97dc150a tempest-VolumesTransfersV357Test-597647101 None] Selected osci02.corp.quobyte.com/cinder-vol-23e9d725-3e04-4cd9-bfe0-c8ef43305589 as target Quobyte volume. {{(pid=83528) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 25 15:57:04 devstack cinder-volume[83528]: INFO cinder.volume.drivers.remotefs [None req-e35882f3-31c3-4918-893e-ab7c97dc150a tempest-VolumesTransfersV357Test-597647101 None] casted to osci02.corp.quobyte.com/cinder-vol-23e9d725-3e04-4cd9-bfe0-c8ef43305589 Feb 25 15:57:04 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-e35882f3-31c3-4918-893e-ab7c97dc150a tempest-VolumesTransfersV357Test-597647101 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-31294be1-662f-4856-a350-a689e69f4fb7 1073741824 {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 25 15:57:04 devstack sudo[88231]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-31294be1-662f-4856-a350-a689e69f4fb7 1073741824 Feb 25 15:57:04 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-fdf01ef9-1108-4372-804a-bea5bf9897a4 tempest-VolumesDeleteCascade-1036059898 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (be5f1716-dfcf-4163-8b9c-bd93b55ded1d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3c93b0b5-b14c-437d-969c-1ebf3dddc971', 'volume_size': 1}' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 25 15:57:04 devstack sudo[88231]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 25 15:57:04 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-fdf01ef9-1108-4372-804a-bea5bf9897a4 tempest-VolumesDeleteCascade-1036059898 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e59b3c58-8209-4520-b56c-3f6913531ee1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 25 15:57:04 devstack cinder-volume[83528]: INFO cinder.volume.flows.manager.create_volume [None req-fdf01ef9-1108-4372-804a-bea5bf9897a4 tempest-VolumesDeleteCascade-1036059898 None] Volume volume-3c93b0b5-b14c-437d-969c-1ebf3dddc971 (3c93b0b5-b14c-437d-969c-1ebf3dddc971): created successfully Feb 25 15:57:04 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-fdf01ef9-1108-4372-804a-bea5bf9897a4 tempest-VolumesDeleteCascade-1036059898 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e59b3c58-8209-4520-b56c-3f6913531ee1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 25 15:57:04 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-fdf01ef9-1108-4372-804a-bea5bf9897a4 tempest-VolumesDeleteCascade-1036059898 None] Flow 'volume_create_manager' (158ea9fe-3f29-4d2d-8a6b-0c1e2c69c494) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83528) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 25 15:57:04 devstack cinder-volume[83528]: INFO cinder.volume.manager [None req-fdf01ef9-1108-4372-804a-bea5bf9897a4 tempest-VolumesDeleteCascade-1036059898 None] Created volume successfully. Feb 25 15:57:04 devstack sudo[88228]: pam_unix(sudo:session): session closed for user root Feb 25 15:57:04 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-d15329ef-a59d-439b-94c9-6ca7d5f6158f tempest-VolumesImageMetadata-2061713185 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-4d2cfc74-a216-4f6e-82e4-bfde82916aa2" returned: 1 in 0.513s {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 25 15:57:04 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-d15329ef-a59d-439b-94c9-6ca7d5f6158f tempest-VolumesImageMetadata-2061713185 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-4d2cfc74-a216-4f6e-82e4-bfde82916aa2' failed. Not Retrying. {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Feb 25 15:57:04 devstack cinder-volume[83528]: DEBUG cinder.volume.volume_utils [None req-d15329ef-a59d-439b-94c9-6ca7d5f6158f tempest-VolumesImageMetadata-2061713185 None] Downloaded image c50f3ecd-5e88-4737-aa36-6e073ce70c60 ((None, [{'url': 'file:///opt/stack/data/glance/images/c50f3ecd-5e88-4737-aa36-6e073ce70c60', 'metadata': {}}])) to volume 4d2cfc74-a216-4f6e-82e4-bfde82916aa2 successfully. {{(pid=83528) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1234}} Feb 25 15:57:04 devstack cinder-volume[83528]: DEBUG cinder.image.image_utils [None req-d15329ef-a59d-439b-94c9-6ca7d5f6158f tempest-VolumesImageMetadata-2061713185 None] Temporary image c50f3ecd-5e88-4737-aa36-6e073ce70c60 for user bc230c79eae7406d8098af3a46be140d is deleted. {{(pid=83528) fetch /opt/stack/cinder/cinder/image/image_utils.py:1435}} Feb 25 15:57:04 devstack cinder-volume[83528]: DEBUG cinder.volume.volume_utils [None req-d15329ef-a59d-439b-94c9-6ca7d5f6158f tempest-VolumesImageMetadata-2061713185 None] Marking volume 4d2cfc74-a216-4f6e-82e4-bfde82916aa2 as bootable. {{(pid=83528) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1138}} Feb 25 15:57:04 devstack cinder-volume[83528]: DEBUG cinder.volume.flows.manager.create_volume [None req-d15329ef-a59d-439b-94c9-6ca7d5f6158f tempest-VolumesImageMetadata-2061713185 None] Copying metadata from image c50f3ecd-5e88-4737-aa36-6e073ce70c60 to 4d2cfc74-a216-4f6e-82e4-bfde82916aa2. {{(pid=83528) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Feb 25 15:57:04 devstack cinder-volume[83528]: DEBUG cinder.volume.flows.manager.create_volume [None req-d15329ef-a59d-439b-94c9-6ca7d5f6158f tempest-VolumesImageMetadata-2061713185 None] Creating volume glance metadata for volume 4d2cfc74-a216-4f6e-82e4-bfde82916aa2 backed by image c50f3ecd-5e88-4737-aa36-6e073ce70c60 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': 'c50f3ecd-5e88-4737-aa36-6e073ce70c60', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=83528) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Feb 25 15:57:04 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-d15329ef-a59d-439b-94c9-6ca7d5f6158f tempest-VolumesImageMetadata-2061713185 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d2637a53-fc8e-4b3a-822c-17da0a5913d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4d2cfc74-a216-4f6e-82e4-bfde82916aa2', 'volume_size': 1, 'image_id': 'c50f3ecd-5e88-4737-aa36-6e073ce70c60', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/c50f3ecd-5e88-4737-aa36-6e073ce70c60', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '75f8571da0ad46ec8e734ab2a4fa231d', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'c50f3ecd-5e88-4737-aa36-6e073ce70c60', 'created_at': datetime.datetime(2026, 2, 25, 14, 47, 16, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 2, 25, 14, 47, 18, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/c50f3ecd-5e88-4737-aa36-6e073ce70c60/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 25 15:57:04 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-d15329ef-a59d-439b-94c9-6ca7d5f6158f tempest-VolumesImageMetadata-2061713185 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e5526021-e8cc-4e68-beda-cab4994fc6e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 25 15:57:04 devstack cinder-volume[83528]: INFO cinder.volume.flows.manager.create_volume [None req-d15329ef-a59d-439b-94c9-6ca7d5f6158f tempest-VolumesImageMetadata-2061713185 None] Volume volume-4d2cfc74-a216-4f6e-82e4-bfde82916aa2 (4d2cfc74-a216-4f6e-82e4-bfde82916aa2): created successfully Feb 25 15:57:04 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-d15329ef-a59d-439b-94c9-6ca7d5f6158f tempest-VolumesImageMetadata-2061713185 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e5526021-e8cc-4e68-beda-cab4994fc6e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 25 15:57:04 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-d15329ef-a59d-439b-94c9-6ca7d5f6158f tempest-VolumesImageMetadata-2061713185 None] Flow 'volume_create_manager' (f6ebc00b-5164-4298-8ba8-3005b7976157) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83528) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 25 15:57:04 devstack cinder-volume[83528]: INFO cinder.volume.manager [None req-d15329ef-a59d-439b-94c9-6ca7d5f6158f tempest-VolumesImageMetadata-2061713185 None] Created volume successfully. Feb 25 15:57:05 devstack sudo[88231]: pam_unix(sudo:session): session closed for user root Feb 25 15:57:05 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-e35882f3-31c3-4918-893e-ab7c97dc150a tempest-VolumesTransfersV357Test-597647101 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-31294be1-662f-4856-a350-a689e69f4fb7 1073741824" returned: 0 in 0.545s {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 25 15:57:05 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-e35882f3-31c3-4918-893e-ab7c97dc150a tempest-VolumesTransfersV357Test-597647101 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-31294be1-662f-4856-a350-a689e69f4fb7 {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 25 15:57:05 devstack sudo[88240]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-31294be1-662f-4856-a350-a689e69f4fb7 Feb 25 15:57:05 devstack sudo[88240]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 25 15:57:05 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-17b4bc04-4ef6-4dd9-8b6f-1a4c886c9d3c tempest-VolumesDeleteCascade-1036059898 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 25 15:57:05 devstack cinder-volume[83528]: DEBUG cinder.coordination [None req-61040545-92a2-4a3a-a74b-0a0671d48292 tempest-VolumesImageMetadata-2061713185 None] Acquiring lock "cinder-4d2cfc74-a216-4f6e-82e4-bfde82916aa2-delete_volume" by "delete_volume" {{(pid=83528) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 25 15:57:05 devstack cinder-volume[83528]: DEBUG cinder.coordination [None req-61040545-92a2-4a3a-a74b-0a0671d48292 tempest-VolumesImageMetadata-2061713185 None] Lock "cinder-4d2cfc74-a216-4f6e-82e4-bfde82916aa2-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=83528) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 25 15:57:05 devstack cinder-volume[83528]: DEBUG cinder.coordination [None req-61040545-92a2-4a3a-a74b-0a0671d48292 tempest-VolumesImageMetadata-2061713185 None] Acquiring lock "cinder-quobyte-4d2cfc74-a216-4f6e-82e4-bfde82916aa2" by "delete_volume" {{(pid=83528) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 25 15:57:05 devstack cinder-volume[83528]: DEBUG cinder.coordination [None req-61040545-92a2-4a3a-a74b-0a0671d48292 tempest-VolumesImageMetadata-2061713185 None] Lock "cinder-quobyte-4d2cfc74-a216-4f6e-82e4-bfde82916aa2" acquired by "delete_volume" :: waited 0.009s {{(pid=83528) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 25 15:57:05 devstack sudo[88240]: pam_unix(sudo:session): session closed for user root Feb 25 15:57:05 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-e35882f3-31c3-4918-893e-ab7c97dc150a tempest-VolumesTransfersV357Test-597647101 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-31294be1-662f-4856-a350-a689e69f4fb7" returned: 0 in 0.506s {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 25 15:57:05 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.quobyte [None req-e35882f3-31c3-4918-893e-ab7c97dc150a tempest-VolumesTransfersV357Test-597647101 None] <== create_volume: return (1079ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-23e9d725-3e04-4cd9-bfe0-c8ef43305589'} {{(pid=83528) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 25 15:57:05 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-e35882f3-31c3-4918-893e-ab7c97dc150a tempest-VolumesTransfersV357Test-597647101 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.081s {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 25 15:57:05 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-4a3f530f-8a32-4ef3-89c8-12eb9ef19923 tempest-VolumesExtendTest-1653409646 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 1.972s {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 25 15:57:05 devstack cinder-volume[83528]: DEBUG oslo.privsep.daemon [-] privsep: reply[498cd1df-7d27-46f2-8629-0216a2deb8ca]: (4, 'raw') {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 25 15:57:05 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-61040545-92a2-4a3a-a74b-0a0671d48292 tempest-VolumesImageMetadata-2061713185 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-4d2cfc74-a216-4f6e-82e4-bfde82916aa2 {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 25 15:57:05 devstack cinder-volume[83528]: DEBUG oslo.privsep.daemon [-] privsep: reply[a00498d6-b772-4779-b500-acc90d1ee051]: (4, 'qcow2') {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 25 15:57:05 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-4a3f530f-8a32-4ef3-89c8-12eb9ef19923 tempest-VolumesExtendTest-1653409646 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-34381b60-f4b8-486f-8113-334db7880364 {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 25 15:57:05 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-e35882f3-31c3-4918-893e-ab7c97dc150a tempest-VolumesTransfersV357Test-597647101 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cbfd71c5-6f3c-4676-b6b7-d602233f8db4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-31294be1-662f-4856-a350-a689e69f4fb7', 'volume_size': 1}' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 25 15:57:05 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-e35882f3-31c3-4918-893e-ab7c97dc150a tempest-VolumesTransfersV357Test-597647101 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c49dd34d-32ba-4e3f-bcaf-cd18000922bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 25 15:57:05 devstack cinder-volume[83528]: INFO cinder.volume.flows.manager.create_volume [None req-e35882f3-31c3-4918-893e-ab7c97dc150a tempest-VolumesTransfersV357Test-597647101 None] Volume volume-31294be1-662f-4856-a350-a689e69f4fb7 (31294be1-662f-4856-a350-a689e69f4fb7): created successfully Feb 25 15:57:05 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-e35882f3-31c3-4918-893e-ab7c97dc150a tempest-VolumesTransfersV357Test-597647101 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c49dd34d-32ba-4e3f-bcaf-cd18000922bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 25 15:57:05 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-e35882f3-31c3-4918-893e-ab7c97dc150a tempest-VolumesTransfersV357Test-597647101 None] Flow 'volume_create_manager' (c7e9ba03-3dec-4864-9047-95aecafc01a9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83528) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 25 15:57:05 devstack cinder-volume[83528]: INFO cinder.volume.manager [None req-e35882f3-31c3-4918-893e-ab7c97dc150a tempest-VolumesTransfersV357Test-597647101 None] Created volume successfully. Feb 25 15:57:05 devstack sudo[88243]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-4d2cfc74-a216-4f6e-82e4-bfde82916aa2 Feb 25 15:57:05 devstack sudo[88243]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 25 15:57:05 devstack sudo[88244]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-34381b60-f4b8-486f-8113-334db7880364 Feb 25 15:57:05 devstack sudo[88244]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 25 15:57:06 devstack cinder-volume[83528]: DEBUG cinder.coordination [None req-8525a97a-9205-485a-bcca-fc9d0b1663a6 tempest-VolumesTransfersV357Test-1971368222 None] Acquiring lock "cinder-31294be1-662f-4856-a350-a689e69f4fb7-delete_volume" by "delete_volume" {{(pid=83528) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 25 15:57:06 devstack cinder-volume[83528]: DEBUG cinder.coordination [None req-8525a97a-9205-485a-bcca-fc9d0b1663a6 tempest-VolumesTransfersV357Test-1971368222 None] Lock "cinder-31294be1-662f-4856-a350-a689e69f4fb7-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=83528) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 25 15:57:06 devstack sudo[88243]: pam_unix(sudo:session): session closed for user root Feb 25 15:57:06 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-61040545-92a2-4a3a-a74b-0a0671d48292 tempest-VolumesImageMetadata-2061713185 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-4d2cfc74-a216-4f6e-82e4-bfde82916aa2" returned: 0 in 0.551s {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 25 15:57:06 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-61040545-92a2-4a3a-a74b-0a0671d48292 tempest-VolumesImageMetadata-2061713185 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-4d2cfc74-a216-4f6e-82e4-bfde82916aa2 {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 25 15:57:06 devstack cinder-volume[83528]: DEBUG cinder.coordination [None req-8525a97a-9205-485a-bcca-fc9d0b1663a6 tempest-VolumesTransfersV357Test-1971368222 None] Acquiring lock "cinder-quobyte-31294be1-662f-4856-a350-a689e69f4fb7" by "delete_volume" {{(pid=83528) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 25 15:57:06 devstack cinder-volume[83528]: DEBUG cinder.coordination [None req-8525a97a-9205-485a-bcca-fc9d0b1663a6 tempest-VolumesTransfersV357Test-1971368222 None] Lock "cinder-quobyte-31294be1-662f-4856-a350-a689e69f4fb7" acquired by "delete_volume" :: waited 0.009s {{(pid=83528) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 25 15:57:06 devstack sudo[88244]: pam_unix(sudo:session): session closed for user root Feb 25 15:57:06 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-4a3f530f-8a32-4ef3-89c8-12eb9ef19923 tempest-VolumesExtendTest-1653409646 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-34381b60-f4b8-486f-8113-334db7880364" returned: 0 in 0.597s {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 25 15:57:06 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-4a3f530f-8a32-4ef3-89c8-12eb9ef19923 tempest-VolumesExtendTest-1653409646 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-34381b60-f4b8-486f-8113-334db7880364.285d38d9-77da-40d4-a4ed-b27158659fc7 2G {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 25 15:57:06 devstack cinder-volume[83528]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b8ca83e-b0cd-42b5-86d7-53e1351dc2af]: (4, 'qcow2') {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 25 15:57:06 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-8525a97a-9205-485a-bcca-fc9d0b1663a6 tempest-VolumesTransfersV357Test-1971368222 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-31294be1-662f-4856-a350-a689e69f4fb7 {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 25 15:57:06 devstack sudo[88252]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-4d2cfc74-a216-4f6e-82e4-bfde82916aa2 Feb 25 15:57:06 devstack sudo[88252]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 25 15:57:06 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-4a3f530f-8a32-4ef3-89c8-12eb9ef19923 tempest-VolumesExtendTest-1653409646 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-34381b60-f4b8-486f-8113-334db7880364.285d38d9-77da-40d4-a4ed-b27158659fc7 2G" returned: 0 in 0.059s {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 25 15:57:06 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-4a3f530f-8a32-4ef3-89c8-12eb9ef19923 tempest-VolumesExtendTest-1653409646 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 0.681s {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 25 15:57:06 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-17b4bc04-4ef6-4dd9-8b6f-1a4c886c9d3c tempest-VolumesDeleteCascade-1036059898 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.957s {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 25 15:57:06 devstack sudo[88254]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-31294be1-662f-4856-a350-a689e69f4fb7 Feb 25 15:57:06 devstack sudo[88254]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 25 15:57:06 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.remotefs [None req-17b4bc04-4ef6-4dd9-8b6f-1a4c886c9d3c tempest-VolumesDeleteCascade-1036059898 None] Creating offline snapshot cddedbb9-d853-4e20-8db9-58a8e40b7c6b of volume 3c93b0b5-b14c-437d-969c-1ebf3dddc971 {{(pid=83528) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Feb 25 15:57:06 devstack cinder-volume[83528]: INFO cinder.volume.manager [None req-4a3f530f-8a32-4ef3-89c8-12eb9ef19923 tempest-VolumesExtendTest-1653409646 None] Extend volume completed successfully. Feb 25 15:57:06 devstack cinder-volume[83528]: DEBUG oslo.privsep.daemon [-] privsep: reply[227b1f9a-9d93-4df1-8fdc-667725852626]: (4, 'qcow2') {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 25 15:57:06 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-17b4bc04-4ef6-4dd9-8b6f-1a4c886c9d3c tempest-VolumesDeleteCascade-1036059898 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-3c93b0b5-b14c-437d-969c-1ebf3dddc971 {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 25 15:57:06 devstack sudo[88259]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-3c93b0b5-b14c-437d-969c-1ebf3dddc971 Feb 25 15:57:06 devstack sudo[88259]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 25 15:57:06 devstack sudo[88252]: pam_unix(sudo:session): session closed for user root Feb 25 15:57:06 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-61040545-92a2-4a3a-a74b-0a0671d48292 tempest-VolumesImageMetadata-2061713185 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-4d2cfc74-a216-4f6e-82e4-bfde82916aa2" returned: 1 in 0.528s {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 25 15:57:06 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-61040545-92a2-4a3a-a74b-0a0671d48292 tempest-VolumesImageMetadata-2061713185 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-4d2cfc74-a216-4f6e-82e4-bfde82916aa2' failed. Not Retrying. {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Feb 25 15:57:06 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-61040545-92a2-4a3a-a74b-0a0671d48292 tempest-VolumesImageMetadata-2061713185 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-4d2cfc74-a216-4f6e-82e4-bfde82916aa2 {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 25 15:57:06 devstack sudo[88266]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-4d2cfc74-a216-4f6e-82e4-bfde82916aa2 Feb 25 15:57:06 devstack sudo[88266]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 25 15:57:06 devstack sudo[88254]: pam_unix(sudo:session): session closed for user root Feb 25 15:57:06 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-8525a97a-9205-485a-bcca-fc9d0b1663a6 tempest-VolumesTransfersV357Test-1971368222 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-31294be1-662f-4856-a350-a689e69f4fb7" returned: 0 in 0.566s {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 25 15:57:06 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-8525a97a-9205-485a-bcca-fc9d0b1663a6 tempest-VolumesTransfersV357Test-1971368222 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-31294be1-662f-4856-a350-a689e69f4fb7 {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 25 15:57:06 devstack sudo[88272]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-31294be1-662f-4856-a350-a689e69f4fb7 Feb 25 15:57:06 devstack sudo[88272]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 25 15:57:06 devstack sudo[88259]: pam_unix(sudo:session): session closed for user root Feb 25 15:57:06 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-17b4bc04-4ef6-4dd9-8b6f-1a4c886c9d3c tempest-VolumesDeleteCascade-1036059898 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-3c93b0b5-b14c-437d-969c-1ebf3dddc971" returned: 0 in 0.529s {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 25 15:57:06 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-17b4bc04-4ef6-4dd9-8b6f-1a4c886c9d3c tempest-VolumesDeleteCascade-1036059898 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-3c93b0b5-b14c-437d-969c-1ebf3dddc971,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-3c93b0b5-b14c-437d-969c-1ebf3dddc971.cddedbb9-d853-4e20-8db9-58a8e40b7c6b 1G {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 25 15:57:06 devstack cinder-volume[83528]: DEBUG cinder.coordination [None req-62896677-789d-4de0-a06e-0c6b1e0b7ed9 tempest-VolumesExtendTest-1653409646 None] Acquiring lock "cinder-285d38d9-77da-40d4-a4ed-b27158659fc7-delete_snapshot" by "delete_snapshot" {{(pid=83528) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 25 15:57:06 devstack sudo[88274]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-3c93b0b5-b14c-437d-969c-1ebf3dddc971,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-3c93b0b5-b14c-437d-969c-1ebf3dddc971.cddedbb9-d853-4e20-8db9-58a8e40b7c6b 1G Feb 25 15:57:06 devstack sudo[88274]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 25 15:57:06 devstack cinder-volume[83528]: DEBUG cinder.coordination [None req-62896677-789d-4de0-a06e-0c6b1e0b7ed9 tempest-VolumesExtendTest-1653409646 None] Lock "cinder-285d38d9-77da-40d4-a4ed-b27158659fc7-delete_snapshot" acquired by "delete_snapshot" :: waited 0.014s {{(pid=83528) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 25 15:57:06 devstack cinder-volume[83528]: DEBUG cinder.coordination [None req-62896677-789d-4de0-a06e-0c6b1e0b7ed9 tempest-VolumesExtendTest-1653409646 None] Acquiring lock "cinder-quobyte-34381b60-f4b8-486f-8113-334db7880364" by "delete_snapshot" {{(pid=83528) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 25 15:57:06 devstack cinder-volume[83528]: DEBUG cinder.coordination [None req-62896677-789d-4de0-a06e-0c6b1e0b7ed9 tempest-VolumesExtendTest-1653409646 None] Lock "cinder-quobyte-34381b60-f4b8-486f-8113-334db7880364" acquired by "delete_snapshot" :: waited 0.017s {{(pid=83528) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 25 15:57:06 devstack cinder-volume[83528]: DEBUG cinder.coordination [None req-62896677-789d-4de0-a06e-0c6b1e0b7ed9 tempest-VolumesExtendTest-1653409646 None] Acquiring lock "cinder-quobyte-285d38d9-77da-40d4-a4ed-b27158659fc7" by "_delete_snapshot" {{(pid=83528) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 25 15:57:06 devstack cinder-volume[83528]: DEBUG cinder.coordination [None req-62896677-789d-4de0-a06e-0c6b1e0b7ed9 tempest-VolumesExtendTest-1653409646 None] Lock "cinder-quobyte-285d38d9-77da-40d4-a4ed-b27158659fc7" acquired by "_delete_snapshot" :: waited 0.008s {{(pid=83528) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 25 15:57:06 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.remotefs [None req-62896677-789d-4de0-a06e-0c6b1e0b7ed9 tempest-VolumesExtendTest-1653409646 None] Deleting offline snapshot 285d38d9-77da-40d4-a4ed-b27158659fc7 of volume 34381b60-f4b8-486f-8113-334db7880364 {{(pid=83528) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Feb 25 15:57:06 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.remotefs [None req-62896677-789d-4de0-a06e-0c6b1e0b7ed9 tempest-VolumesExtendTest-1653409646 None] snapshot_file for this snap is: volume-34381b60-f4b8-486f-8113-334db7880364.285d38d9-77da-40d4-a4ed-b27158659fc7 {{(pid=83528) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Feb 25 15:57:06 devstack cinder-volume[83528]: DEBUG oslo.privsep.daemon [-] privsep: reply[d46a5e9e-8f86-4585-b29d-fc5513441ca3]: (4, 'qcow2') {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 25 15:57:06 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-62896677-789d-4de0-a06e-0c6b1e0b7ed9 tempest-VolumesExtendTest-1653409646 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-34381b60-f4b8-486f-8113-334db7880364.285d38d9-77da-40d4-a4ed-b27158659fc7 {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 25 15:57:07 devstack sudo[88276]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-34381b60-f4b8-486f-8113-334db7880364.285d38d9-77da-40d4-a4ed-b27158659fc7 Feb 25 15:57:07 devstack sudo[88276]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 25 15:57:07 devstack sudo[88266]: pam_unix(sudo:session): session closed for user root Feb 25 15:57:07 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-61040545-92a2-4a3a-a74b-0a0671d48292 tempest-VolumesImageMetadata-2061713185 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-4d2cfc74-a216-4f6e-82e4-bfde82916aa2" returned: 0 in 0.504s {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 25 15:57:07 devstack cinder-volume[83528]: DEBUG cinder.coordination [None req-61040545-92a2-4a3a-a74b-0a0671d48292 tempest-VolumesImageMetadata-2061713185 None] Lock "cinder-quobyte-4d2cfc74-a216-4f6e-82e4-bfde82916aa2" released by "delete_volume" :: held 1.639s {{(pid=83528) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 25 15:57:07 devstack sudo[88272]: pam_unix(sudo:session): session closed for user root Feb 25 15:57:07 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-8525a97a-9205-485a-bcca-fc9d0b1663a6 tempest-VolumesTransfersV357Test-1971368222 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-31294be1-662f-4856-a350-a689e69f4fb7" returned: 0 in 0.463s {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 25 15:57:07 devstack cinder-volume[83528]: DEBUG cinder.quota [None req-61040545-92a2-4a3a-a74b-0a0671d48292 tempest-VolumesImageMetadata-2061713185 None] Created reservations ['8eefe887-1225-4ef0-89f3-073bd2813576', '108eb707-5e01-498c-9753-cbbde8759f37', '6c043bfc-8ac2-4569-870b-05ce0fbcba33', 'fe494a80-77da-4dae-b77f-63b33dbd3439'] {{(pid=83528) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 25 15:57:07 devstack cinder-volume[83528]: DEBUG cinder.coordination [None req-8525a97a-9205-485a-bcca-fc9d0b1663a6 tempest-VolumesTransfersV357Test-1971368222 None] Lock "cinder-quobyte-31294be1-662f-4856-a350-a689e69f4fb7" released by "delete_volume" :: held 1.096s {{(pid=83528) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 25 15:57:07 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-61040545-92a2-4a3a-a74b-0a0671d48292 tempest-VolumesImageMetadata-2061713185 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 25 15:57:07 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-61040545-92a2-4a3a-a74b-0a0671d48292 tempest-VolumesImageMetadata-2061713185 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 25 15:57:07 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.quobyte [None req-61040545-92a2-4a3a-a74b-0a0671d48292 tempest-VolumesImageMetadata-2061713185 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23e9d725-3e04-4cd9-bfe0-c8ef43305589': None} {{(pid=83528) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 25 15:57:07 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.quobyte [None req-61040545-92a2-4a3a-a74b-0a0671d48292 tempest-VolumesImageMetadata-2061713185 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23e9d725-3e04-4cd9-bfe0-c8ef43305589'] {{(pid=83528) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 25 15:57:07 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-61040545-92a2-4a3a-a74b-0a0671d48292 tempest-VolumesImageMetadata-2061713185 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 25 15:57:07 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-61040545-92a2-4a3a-a74b-0a0671d48292 tempest-VolumesImageMetadata-2061713185 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85 {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 25 15:57:07 devstack cinder-volume[83528]: DEBUG cinder.quota [None req-8525a97a-9205-485a-bcca-fc9d0b1663a6 tempest-VolumesTransfersV357Test-1971368222 None] Created reservations ['3e4240e1-6974-42d9-9bc0-8faade75f3d7', 'e820bfa9-1dae-433e-8374-34f3604bdf00', 'bab5373f-c283-4034-8565-94e1e89d9dda', '59ba76cc-d8c5-468f-9302-376e91cf7137'] {{(pid=83528) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 25 15:57:07 devstack sudo[88283]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85 Feb 25 15:57:07 devstack sudo[88283]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 25 15:57:07 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-8525a97a-9205-485a-bcca-fc9d0b1663a6 tempest-VolumesTransfersV357Test-1971368222 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 25 15:57:07 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-8525a97a-9205-485a-bcca-fc9d0b1663a6 tempest-VolumesTransfersV357Test-1971368222 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 25 15:57:07 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.quobyte [None req-8525a97a-9205-485a-bcca-fc9d0b1663a6 tempest-VolumesTransfersV357Test-1971368222 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23e9d725-3e04-4cd9-bfe0-c8ef43305589': None} {{(pid=83528) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 25 15:57:07 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.quobyte [None req-8525a97a-9205-485a-bcca-fc9d0b1663a6 tempest-VolumesTransfersV357Test-1971368222 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23e9d725-3e04-4cd9-bfe0-c8ef43305589'] {{(pid=83528) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 25 15:57:07 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-8525a97a-9205-485a-bcca-fc9d0b1663a6 tempest-VolumesTransfersV357Test-1971368222 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 25 15:57:07 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-8525a97a-9205-485a-bcca-fc9d0b1663a6 tempest-VolumesTransfersV357Test-1971368222 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85 {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 25 15:57:07 devstack sudo[88274]: pam_unix(sudo:session): session closed for user root Feb 25 15:57:07 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-17b4bc04-4ef6-4dd9-8b6f-1a4c886c9d3c tempest-VolumesDeleteCascade-1036059898 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-3c93b0b5-b14c-437d-969c-1ebf3dddc971,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-3c93b0b5-b14c-437d-969c-1ebf3dddc971.cddedbb9-d853-4e20-8db9-58a8e40b7c6b 1G" returned: 0 in 0.600s {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 25 15:57:07 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-17b4bc04-4ef6-4dd9-8b6f-1a4c886c9d3c tempest-VolumesDeleteCascade-1036059898 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3c93b0b5-b14c-437d-969c-1ebf3dddc971 -F qcow2 /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-3c93b0b5-b14c-437d-969c-1ebf3dddc971.cddedbb9-d853-4e20-8db9-58a8e40b7c6b {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 25 15:57:07 devstack sudo[88288]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85 Feb 25 15:57:07 devstack sudo[88288]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 25 15:57:07 devstack sudo[88289]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3c93b0b5-b14c-437d-969c-1ebf3dddc971 -F qcow2 /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-3c93b0b5-b14c-437d-969c-1ebf3dddc971.cddedbb9-d853-4e20-8db9-58a8e40b7c6b Feb 25 15:57:07 devstack sudo[88289]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 25 15:57:07 devstack sudo[88276]: pam_unix(sudo:session): session closed for user root Feb 25 15:57:07 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-62896677-789d-4de0-a06e-0c6b1e0b7ed9 tempest-VolumesExtendTest-1653409646 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-34381b60-f4b8-486f-8113-334db7880364.285d38d9-77da-40d4-a4ed-b27158659fc7" returned: 0 in 0.588s {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 25 15:57:07 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.remotefs [None req-62896677-789d-4de0-a06e-0c6b1e0b7ed9 tempest-VolumesExtendTest-1653409646 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-34381b60-f4b8-486f-8113-334db7880364(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83528) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Feb 25 15:57:07 devstack cinder-volume[83528]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4e7b3fa-8b72-467f-aa19-06cd8f7b47af]: (4, 'qcow2') {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 25 15:57:07 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-62896677-789d-4de0-a06e-0c6b1e0b7ed9 tempest-VolumesExtendTest-1653409646 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-34381b60-f4b8-486f-8113-334db7880364 {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 25 15:57:07 devstack sudo[88292]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-34381b60-f4b8-486f-8113-334db7880364 Feb 25 15:57:07 devstack sudo[88292]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 25 15:57:07 devstack sudo[88288]: pam_unix(sudo:session): session closed for user root Feb 25 15:57:07 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-8525a97a-9205-485a-bcca-fc9d0b1663a6 tempest-VolumesTransfersV357Test-1971368222 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85" returned: 0 in 0.461s {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 25 15:57:07 devstack cinder-volume[83528]: DEBUG cinder.manager [None req-8525a97a-9205-485a-bcca-fc9d0b1663a6 tempest-VolumesTransfersV357Test-1971368222 None] Notifying Schedulers of capabilities ... {{(pid=83528) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 25 15:57:07 devstack cinder-volume[83528]: INFO cinder.volume.manager [None req-8525a97a-9205-485a-bcca-fc9d0b1663a6 tempest-VolumesTransfersV357Test-1971368222 None] Deleted volume successfully. Feb 25 15:57:07 devstack cinder-volume[83528]: DEBUG cinder.coordination [None req-8525a97a-9205-485a-bcca-fc9d0b1663a6 tempest-VolumesTransfersV357Test-1971368222 None] Lock "cinder-31294be1-662f-4856-a350-a689e69f4fb7-delete_volume" released by "delete_volume" :: held 1.803s {{(pid=83528) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 25 15:57:07 devstack sudo[88283]: pam_unix(sudo:session): session closed for user root Feb 25 15:57:07 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-61040545-92a2-4a3a-a74b-0a0671d48292 tempest-VolumesImageMetadata-2061713185 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85" returned: 0 in 0.591s {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 25 15:57:07 devstack cinder-volume[83528]: DEBUG cinder.manager [None req-61040545-92a2-4a3a-a74b-0a0671d48292 tempest-VolumesImageMetadata-2061713185 None] Notifying Schedulers of capabilities ... {{(pid=83528) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 25 15:57:07 devstack cinder-volume[83528]: INFO cinder.volume.manager [None req-61040545-92a2-4a3a-a74b-0a0671d48292 tempest-VolumesImageMetadata-2061713185 None] Deleted volume successfully. Feb 25 15:57:08 devstack cinder-volume[83528]: DEBUG cinder.coordination [None req-61040545-92a2-4a3a-a74b-0a0671d48292 tempest-VolumesImageMetadata-2061713185 None] Lock "cinder-4d2cfc74-a216-4f6e-82e4-bfde82916aa2-delete_volume" released by "delete_volume" :: held 2.449s {{(pid=83528) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 25 15:57:08 devstack sudo[88289]: pam_unix(sudo:session): session closed for user root Feb 25 15:57:08 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-17b4bc04-4ef6-4dd9-8b6f-1a4c886c9d3c tempest-VolumesDeleteCascade-1036059898 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3c93b0b5-b14c-437d-969c-1ebf3dddc971 -F qcow2 /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-3c93b0b5-b14c-437d-969c-1ebf3dddc971.cddedbb9-d853-4e20-8db9-58a8e40b7c6b" returned: 0 in 0.550s {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 25 15:57:08 devstack cinder-volume[83528]: WARNING cinder.volume.drivers.remotefs [None req-17b4bc04-4ef6-4dd9-8b6f-1a4c886c9d3c tempest-VolumesDeleteCascade-1036059898 None] /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-3c93b0b5-b14c-437d-969c-1ebf3dddc971.cddedbb9-d853-4e20-8db9-58a8e40b7c6b is being set with open permissions: ugo+rw Feb 25 15:57:08 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-17b4bc04-4ef6-4dd9-8b6f-1a4c886c9d3c tempest-VolumesDeleteCascade-1036059898 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-3c93b0b5-b14c-437d-969c-1ebf3dddc971.cddedbb9-d853-4e20-8db9-58a8e40b7c6b {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 25 15:57:08 devstack sudo[88299]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-3c93b0b5-b14c-437d-969c-1ebf3dddc971.cddedbb9-d853-4e20-8db9-58a8e40b7c6b Feb 25 15:57:08 devstack sudo[88299]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 25 15:57:08 devstack sudo[88292]: pam_unix(sudo:session): session closed for user root Feb 25 15:57:08 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-62896677-789d-4de0-a06e-0c6b1e0b7ed9 tempest-VolumesExtendTest-1653409646 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-34381b60-f4b8-486f-8113-334db7880364" returned: 0 in 0.586s {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 25 15:57:08 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-62896677-789d-4de0-a06e-0c6b1e0b7ed9 tempest-VolumesExtendTest-1653409646 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-34381b60-f4b8-486f-8113-334db7880364.285d38d9-77da-40d4-a4ed-b27158659fc7 {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 25 15:57:08 devstack sudo[88304]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-34381b60-f4b8-486f-8113-334db7880364.285d38d9-77da-40d4-a4ed-b27158659fc7 Feb 25 15:57:08 devstack sudo[88304]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 25 15:57:08 devstack sudo[88299]: pam_unix(sudo:session): session closed for user root Feb 25 15:57:08 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-17b4bc04-4ef6-4dd9-8b6f-1a4c886c9d3c tempest-VolumesDeleteCascade-1036059898 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-3c93b0b5-b14c-437d-969c-1ebf3dddc971.cddedbb9-d853-4e20-8db9-58a8e40b7c6b" returned: 0 in 0.557s {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 25 15:57:08 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-17b4bc04-4ef6-4dd9-8b6f-1a4c886c9d3c tempest-VolumesDeleteCascade-1036059898 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-3c93b0b5-b14c-437d-969c-1ebf3dddc971.info {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 25 15:57:08 devstack sudo[88308]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-3c93b0b5-b14c-437d-969c-1ebf3dddc971.info Feb 25 15:57:08 devstack sudo[88308]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 25 15:57:08 devstack sudo[88304]: pam_unix(sudo:session): session closed for user root Feb 25 15:57:08 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-62896677-789d-4de0-a06e-0c6b1e0b7ed9 tempest-VolumesExtendTest-1653409646 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-34381b60-f4b8-486f-8113-334db7880364.285d38d9-77da-40d4-a4ed-b27158659fc7" returned: 0 in 0.642s {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 25 15:57:08 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-62896677-789d-4de0-a06e-0c6b1e0b7ed9 tempest-VolumesExtendTest-1653409646 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-34381b60-f4b8-486f-8113-334db7880364.285d38d9-77da-40d4-a4ed-b27158659fc7 {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 25 15:57:08 devstack sudo[88312]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-34381b60-f4b8-486f-8113-334db7880364.285d38d9-77da-40d4-a4ed-b27158659fc7 Feb 25 15:57:08 devstack sudo[88312]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 25 15:57:09 devstack sudo[88308]: pam_unix(sudo:session): session closed for user root Feb 25 15:57:09 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-17b4bc04-4ef6-4dd9-8b6f-1a4c886c9d3c tempest-VolumesDeleteCascade-1036059898 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-3c93b0b5-b14c-437d-969c-1ebf3dddc971.info" returned: 0 in 0.557s {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 25 15:57:09 devstack cinder-volume[83528]: WARNING cinder.volume.drivers.remotefs [None req-17b4bc04-4ef6-4dd9-8b6f-1a4c886c9d3c tempest-VolumesDeleteCascade-1036059898 None] /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-3c93b0b5-b14c-437d-969c-1ebf3dddc971.info is being set with open permissions: ugo+rw Feb 25 15:57:09 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-17b4bc04-4ef6-4dd9-8b6f-1a4c886c9d3c tempest-VolumesDeleteCascade-1036059898 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-3c93b0b5-b14c-437d-969c-1ebf3dddc971.info {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 25 15:57:09 devstack sudo[88315]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-3c93b0b5-b14c-437d-969c-1ebf3dddc971.info Feb 25 15:57:09 devstack sudo[88315]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 25 15:57:09 devstack sudo[88312]: pam_unix(sudo:session): session closed for user root Feb 25 15:57:09 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-62896677-789d-4de0-a06e-0c6b1e0b7ed9 tempest-VolumesExtendTest-1653409646 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-34381b60-f4b8-486f-8113-334db7880364.285d38d9-77da-40d4-a4ed-b27158659fc7" returned: 0 in 0.584s {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 25 15:57:09 devstack cinder-volume[83528]: DEBUG cinder.coordination [None req-62896677-789d-4de0-a06e-0c6b1e0b7ed9 tempest-VolumesExtendTest-1653409646 None] Lock "cinder-quobyte-285d38d9-77da-40d4-a4ed-b27158659fc7" released by "_delete_snapshot" :: held 2.481s {{(pid=83528) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 25 15:57:09 devstack cinder-volume[83528]: DEBUG cinder.coordination [None req-62896677-789d-4de0-a06e-0c6b1e0b7ed9 tempest-VolumesExtendTest-1653409646 None] Lock "cinder-quobyte-34381b60-f4b8-486f-8113-334db7880364" released by "delete_snapshot" :: held 2.495s {{(pid=83528) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 25 15:57:09 devstack cinder-volume[83528]: DEBUG cinder.quota [None req-62896677-789d-4de0-a06e-0c6b1e0b7ed9 tempest-VolumesExtendTest-1653409646 None] Created reservations ['17290c05-6098-404b-a411-390c203cebb5', '52d40f40-1b89-453a-9d85-0c0afb95a364', 'f0c1925f-1f02-4afd-8367-0df34482741a', '4dea387e-5b14-4874-bb3b-f346aa307cba'] {{(pid=83528) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 25 15:57:09 devstack cinder-volume[83528]: INFO cinder.volume.manager [None req-62896677-789d-4de0-a06e-0c6b1e0b7ed9 tempest-VolumesExtendTest-1653409646 None] Delete snapshot completed successfully. Feb 25 15:57:09 devstack cinder-volume[83528]: DEBUG cinder.coordination [None req-62896677-789d-4de0-a06e-0c6b1e0b7ed9 tempest-VolumesExtendTest-1653409646 None] Lock "cinder-285d38d9-77da-40d4-a4ed-b27158659fc7-delete_snapshot" released by "delete_snapshot" :: held 2.631s {{(pid=83528) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 25 15:57:09 devstack sudo[88315]: pam_unix(sudo:session): session closed for user root Feb 25 15:57:09 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-17b4bc04-4ef6-4dd9-8b6f-1a4c886c9d3c tempest-VolumesDeleteCascade-1036059898 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-3c93b0b5-b14c-437d-969c-1ebf3dddc971.info" returned: 0 in 0.593s {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 25 15:57:09 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-17b4bc04-4ef6-4dd9-8b6f-1a4c886c9d3c tempest-VolumesDeleteCascade-1036059898 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.466s {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 25 15:57:09 devstack cinder-volume[83528]: INFO cinder.volume.manager [None req-17b4bc04-4ef6-4dd9-8b6f-1a4c886c9d3c tempest-VolumesDeleteCascade-1036059898 None] Create snapshot completed successfully Feb 25 15:57:10 devstack cinder-volume[83528]: DEBUG cinder.coordination [None req-090eb46c-2dd7-4903-bada-792f312578a0 tempest-VolumesExtendTest-1653409646 None] Acquiring lock "cinder-34381b60-f4b8-486f-8113-334db7880364-delete_volume" by "delete_volume" {{(pid=83528) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 25 15:57:10 devstack cinder-volume[83528]: DEBUG cinder.coordination [None req-090eb46c-2dd7-4903-bada-792f312578a0 tempest-VolumesExtendTest-1653409646 None] Lock "cinder-34381b60-f4b8-486f-8113-334db7880364-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=83528) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 25 15:57:10 devstack cinder-volume[83528]: DEBUG cinder.volume.flows.manager.create_volume [None req-de645544-6c01-4fc1-9b58-82d7564d1779 tempest-SnapshotMetadataTestJSON-1314612421 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83528) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 25 15:57:10 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-de645544-6c01-4fc1-9b58-82d7564d1779 tempest-SnapshotMetadataTestJSON-1314612421 None] Flow 'volume_create_manager' (972747c1-12a0-4084-829c-911c30faf0c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83528) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 25 15:57:10 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-de645544-6c01-4fc1-9b58-82d7564d1779 tempest-SnapshotMetadataTestJSON-1314612421 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (49b995b1-6676-45ed-b9d2-6f4236205702) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 25 15:57:10 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-de645544-6c01-4fc1-9b58-82d7564d1779 tempest-SnapshotMetadataTestJSON-1314612421 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (49b995b1-6676-45ed-b9d2-6f4236205702) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-25T14:57:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-457895256',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=21c8dfc2-8a66-4148-92c8-be83789f2e01,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='573319c3e8934785ae004b7d4f96db79',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-25T14:57:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-25T14:57:10Z,use_quota=True,user_id='ec993d6d78c8478b83ef4866c7a1bae7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ce71c2f9-6543-4165-9653-a1529b2ea243),volume_type_id=ce71c2f9-6543-4165-9653-a1529b2ea243)' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 25 15:57:10 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-de645544-6c01-4fc1-9b58-82d7564d1779 tempest-SnapshotMetadataTestJSON-1314612421 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6290744d-2eb4-4925-82bf-c3fc2f6b2647) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 25 15:57:10 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-de645544-6c01-4fc1-9b58-82d7564d1779 tempest-SnapshotMetadataTestJSON-1314612421 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6290744d-2eb4-4925-82bf-c3fc2f6b2647) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 25 15:57:10 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-de645544-6c01-4fc1-9b58-82d7564d1779 tempest-SnapshotMetadataTestJSON-1314612421 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ef69cbfc-9cfd-458b-b45f-2bfb4c30a356) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 25 15:57:10 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-de645544-6c01-4fc1-9b58-82d7564d1779 tempest-SnapshotMetadataTestJSON-1314612421 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ef69cbfc-9cfd-458b-b45f-2bfb4c30a356) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '21c8dfc2-8a66-4148-92c8-be83789f2e01', 'volume_name': 'volume-21c8dfc2-8a66-4148-92c8-be83789f2e01', 'volume_size': 1}' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 25 15:57:10 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-de645544-6c01-4fc1-9b58-82d7564d1779 tempest-SnapshotMetadataTestJSON-1314612421 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (73cfe801-d84b-402b-8872-d0afeb7dc4c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 25 15:57:10 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-de645544-6c01-4fc1-9b58-82d7564d1779 tempest-SnapshotMetadataTestJSON-1314612421 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (73cfe801-d84b-402b-8872-d0afeb7dc4c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 25 15:57:10 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-de645544-6c01-4fc1-9b58-82d7564d1779 tempest-SnapshotMetadataTestJSON-1314612421 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (65d8fda0-7a2d-4cee-a53c-a0cb422aa8e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 25 15:57:10 devstack cinder-volume[83528]: INFO cinder.volume.flows.manager.create_volume [None req-de645544-6c01-4fc1-9b58-82d7564d1779 tempest-SnapshotMetadataTestJSON-1314612421 None] Volume 21c8dfc2-8a66-4148-92c8-be83789f2e01: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-21c8dfc2-8a66-4148-92c8-be83789f2e01', 'volume_size': 1} Feb 25 15:57:10 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-de645544-6c01-4fc1-9b58-82d7564d1779 tempest-SnapshotMetadataTestJSON-1314612421 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 25 15:57:10 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-de645544-6c01-4fc1-9b58-82d7564d1779 tempest-SnapshotMetadataTestJSON-1314612421 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 25 15:57:10 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.quobyte [None req-de645544-6c01-4fc1-9b58-82d7564d1779 tempest-SnapshotMetadataTestJSON-1314612421 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-25T14:57:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-457895256',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=21c8dfc2-8a66-4148-92c8-be83789f2e01,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='573319c3e8934785ae004b7d4f96db79',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-25T14:57:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-25T14:57:10Z,use_quota=True,user_id='ec993d6d78c8478b83ef4866c7a1bae7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ce71c2f9-6543-4165-9653-a1529b2ea243),volume_type_id=ce71c2f9-6543-4165-9653-a1529b2ea243)}" {{(pid=83528) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 25 15:57:10 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.remotefs [None req-de645544-6c01-4fc1-9b58-82d7564d1779 tempest-SnapshotMetadataTestJSON-1314612421 None] Creating volume 21c8dfc2-8a66-4148-92c8-be83789f2e01 {{(pid=83528) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 25 15:57:10 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-de645544-6c01-4fc1-9b58-82d7564d1779 tempest-SnapshotMetadataTestJSON-1314612421 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 25 15:57:10 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-de645544-6c01-4fc1-9b58-82d7564d1779 tempest-SnapshotMetadataTestJSON-1314612421 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 25 15:57:10 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.quobyte [None req-de645544-6c01-4fc1-9b58-82d7564d1779 tempest-SnapshotMetadataTestJSON-1314612421 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23e9d725-3e04-4cd9-bfe0-c8ef43305589': None} {{(pid=83528) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 25 15:57:10 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.quobyte [None req-de645544-6c01-4fc1-9b58-82d7564d1779 tempest-SnapshotMetadataTestJSON-1314612421 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23e9d725-3e04-4cd9-bfe0-c8ef43305589'] {{(pid=83528) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 25 15:57:10 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-de645544-6c01-4fc1-9b58-82d7564d1779 tempest-SnapshotMetadataTestJSON-1314612421 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 25 15:57:10 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.quobyte [None req-de645544-6c01-4fc1-9b58-82d7564d1779 tempest-SnapshotMetadataTestJSON-1314612421 None] Selected osci02.corp.quobyte.com/cinder-vol-23e9d725-3e04-4cd9-bfe0-c8ef43305589 as target Quobyte volume. {{(pid=83528) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 25 15:57:10 devstack cinder-volume[83528]: INFO cinder.volume.drivers.remotefs [None req-de645544-6c01-4fc1-9b58-82d7564d1779 tempest-SnapshotMetadataTestJSON-1314612421 None] casted to osci02.corp.quobyte.com/cinder-vol-23e9d725-3e04-4cd9-bfe0-c8ef43305589 Feb 25 15:57:10 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-de645544-6c01-4fc1-9b58-82d7564d1779 tempest-SnapshotMetadataTestJSON-1314612421 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-21c8dfc2-8a66-4148-92c8-be83789f2e01 1073741824 {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 25 15:57:10 devstack cinder-volume[83528]: DEBUG cinder.coordination [None req-090eb46c-2dd7-4903-bada-792f312578a0 tempest-VolumesExtendTest-1653409646 None] Acquiring lock "cinder-quobyte-34381b60-f4b8-486f-8113-334db7880364" by "delete_volume" {{(pid=83528) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 25 15:57:10 devstack cinder-volume[83528]: DEBUG cinder.coordination [None req-090eb46c-2dd7-4903-bada-792f312578a0 tempest-VolumesExtendTest-1653409646 None] Lock "cinder-quobyte-34381b60-f4b8-486f-8113-334db7880364" acquired by "delete_volume" :: waited 0.012s {{(pid=83528) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 25 15:57:10 devstack sudo[88319]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-21c8dfc2-8a66-4148-92c8-be83789f2e01 1073741824 Feb 25 15:57:10 devstack sudo[88319]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 25 15:57:10 devstack cinder-volume[83528]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba77db82-a3bd-416a-bfd6-b76d1fe86838]: (4, 'qcow2') {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 25 15:57:10 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-090eb46c-2dd7-4903-bada-792f312578a0 tempest-VolumesExtendTest-1653409646 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-34381b60-f4b8-486f-8113-334db7880364 {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 25 15:57:10 devstack sudo[88321]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-34381b60-f4b8-486f-8113-334db7880364 Feb 25 15:57:10 devstack sudo[88321]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 25 15:57:10 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-18a97d19-30cd-4691-b0f6-c07501a881cc tempest-VolumesDeleteCascade-1036059898 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 25 15:57:10 devstack sudo[88319]: pam_unix(sudo:session): session closed for user root Feb 25 15:57:10 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-de645544-6c01-4fc1-9b58-82d7564d1779 tempest-SnapshotMetadataTestJSON-1314612421 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-21c8dfc2-8a66-4148-92c8-be83789f2e01 1073741824" returned: 0 in 0.617s {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 25 15:57:10 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-de645544-6c01-4fc1-9b58-82d7564d1779 tempest-SnapshotMetadataTestJSON-1314612421 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-21c8dfc2-8a66-4148-92c8-be83789f2e01 {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 25 15:57:11 devstack sudo[88327]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-21c8dfc2-8a66-4148-92c8-be83789f2e01 Feb 25 15:57:11 devstack sudo[88327]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 25 15:57:11 devstack sudo[88321]: pam_unix(sudo:session): session closed for user root Feb 25 15:57:11 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-090eb46c-2dd7-4903-bada-792f312578a0 tempest-VolumesExtendTest-1653409646 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-34381b60-f4b8-486f-8113-334db7880364" returned: 0 in 0.705s {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 25 15:57:11 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-090eb46c-2dd7-4903-bada-792f312578a0 tempest-VolumesExtendTest-1653409646 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-34381b60-f4b8-486f-8113-334db7880364 {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 25 15:57:11 devstack sudo[88332]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-34381b60-f4b8-486f-8113-334db7880364 Feb 25 15:57:11 devstack sudo[88332]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 25 15:57:11 devstack sudo[88327]: pam_unix(sudo:session): session closed for user root Feb 25 15:57:11 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-de645544-6c01-4fc1-9b58-82d7564d1779 tempest-SnapshotMetadataTestJSON-1314612421 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-21c8dfc2-8a66-4148-92c8-be83789f2e01" returned: 0 in 0.472s {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 25 15:57:11 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.quobyte [None req-de645544-6c01-4fc1-9b58-82d7564d1779 tempest-SnapshotMetadataTestJSON-1314612421 None] <== create_volume: return (1118ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-23e9d725-3e04-4cd9-bfe0-c8ef43305589'} {{(pid=83528) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 25 15:57:11 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-de645544-6c01-4fc1-9b58-82d7564d1779 tempest-SnapshotMetadataTestJSON-1314612421 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.120s {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 25 15:57:11 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-18a97d19-30cd-4691-b0f6-c07501a881cc tempest-VolumesDeleteCascade-1036059898 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.647s {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 25 15:57:11 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-de645544-6c01-4fc1-9b58-82d7564d1779 tempest-SnapshotMetadataTestJSON-1314612421 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (65d8fda0-7a2d-4cee-a53c-a0cb422aa8e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-21c8dfc2-8a66-4148-92c8-be83789f2e01', 'volume_size': 1}' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 25 15:57:11 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-de645544-6c01-4fc1-9b58-82d7564d1779 tempest-SnapshotMetadataTestJSON-1314612421 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8b95a2c6-da5b-4d6b-9bf2-02fa85da41c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 25 15:57:11 devstack cinder-volume[83528]: INFO cinder.volume.flows.manager.create_volume [None req-de645544-6c01-4fc1-9b58-82d7564d1779 tempest-SnapshotMetadataTestJSON-1314612421 None] Volume volume-21c8dfc2-8a66-4148-92c8-be83789f2e01 (21c8dfc2-8a66-4148-92c8-be83789f2e01): created successfully Feb 25 15:57:11 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-de645544-6c01-4fc1-9b58-82d7564d1779 tempest-SnapshotMetadataTestJSON-1314612421 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8b95a2c6-da5b-4d6b-9bf2-02fa85da41c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 25 15:57:11 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-de645544-6c01-4fc1-9b58-82d7564d1779 tempest-SnapshotMetadataTestJSON-1314612421 None] Flow 'volume_create_manager' (972747c1-12a0-4084-829c-911c30faf0c2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83528) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 25 15:57:11 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.remotefs [None req-18a97d19-30cd-4691-b0f6-c07501a881cc tempest-VolumesDeleteCascade-1036059898 None] Creating offline snapshot b570daaa-b909-4b5a-91fc-109d41dccac6 of volume 3c93b0b5-b14c-437d-969c-1ebf3dddc971 {{(pid=83528) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Feb 25 15:57:11 devstack cinder-volume[83528]: INFO cinder.volume.manager [None req-de645544-6c01-4fc1-9b58-82d7564d1779 tempest-SnapshotMetadataTestJSON-1314612421 None] Created volume successfully. Feb 25 15:57:11 devstack cinder-volume[83528]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f3634c9-acea-4bdd-ab4f-00b9284936e1]: (4, 'qcow2') {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 25 15:57:11 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-18a97d19-30cd-4691-b0f6-c07501a881cc tempest-VolumesDeleteCascade-1036059898 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-3c93b0b5-b14c-437d-969c-1ebf3dddc971.cddedbb9-d853-4e20-8db9-58a8e40b7c6b {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 25 15:57:11 devstack sudo[88332]: pam_unix(sudo:session): session closed for user root Feb 25 15:57:11 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-090eb46c-2dd7-4903-bada-792f312578a0 tempest-VolumesExtendTest-1653409646 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-34381b60-f4b8-486f-8113-334db7880364" returned: 0 in 0.497s {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 25 15:57:11 devstack cinder-volume[83528]: DEBUG cinder.coordination [None req-090eb46c-2dd7-4903-bada-792f312578a0 tempest-VolumesExtendTest-1653409646 None] Lock "cinder-quobyte-34381b60-f4b8-486f-8113-334db7880364" released by "delete_volume" :: held 1.244s {{(pid=83528) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 25 15:57:11 devstack cinder-volume[83528]: DEBUG cinder.quota [None req-090eb46c-2dd7-4903-bada-792f312578a0 tempest-VolumesExtendTest-1653409646 None] Created reservations ['b80e39e1-e8eb-45eb-8b61-d54e6686f9b9', '65f37a1f-50bf-4cc5-827e-7e6eda578a94', '31229547-78bd-4e11-a1f6-0a9d3fd9caca', 'd1170052-2570-46a7-9905-756c1e98b4e2'] {{(pid=83528) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 25 15:57:11 devstack sudo[88336]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-3c93b0b5-b14c-437d-969c-1ebf3dddc971.cddedbb9-d853-4e20-8db9-58a8e40b7c6b Feb 25 15:57:11 devstack sudo[88336]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 25 15:57:11 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-090eb46c-2dd7-4903-bada-792f312578a0 tempest-VolumesExtendTest-1653409646 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 25 15:57:11 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-090eb46c-2dd7-4903-bada-792f312578a0 tempest-VolumesExtendTest-1653409646 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 25 15:57:11 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.quobyte [None req-090eb46c-2dd7-4903-bada-792f312578a0 tempest-VolumesExtendTest-1653409646 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23e9d725-3e04-4cd9-bfe0-c8ef43305589': None} {{(pid=83528) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 25 15:57:11 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.quobyte [None req-090eb46c-2dd7-4903-bada-792f312578a0 tempest-VolumesExtendTest-1653409646 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23e9d725-3e04-4cd9-bfe0-c8ef43305589'] {{(pid=83528) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 25 15:57:11 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-090eb46c-2dd7-4903-bada-792f312578a0 tempest-VolumesExtendTest-1653409646 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 25 15:57:11 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-090eb46c-2dd7-4903-bada-792f312578a0 tempest-VolumesExtendTest-1653409646 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85 {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 25 15:57:11 devstack sudo[88350]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85 Feb 25 15:57:11 devstack sudo[88350]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 25 15:57:12 devstack sudo[88350]: pam_unix(sudo:session): session closed for user root Feb 25 15:57:12 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-090eb46c-2dd7-4903-bada-792f312578a0 tempest-VolumesExtendTest-1653409646 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85" returned: 0 in 0.456s {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 25 15:57:12 devstack cinder-volume[83528]: DEBUG cinder.manager [None req-090eb46c-2dd7-4903-bada-792f312578a0 tempest-VolumesExtendTest-1653409646 None] Notifying Schedulers of capabilities ... {{(pid=83528) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 25 15:57:12 devstack cinder-volume[83528]: INFO cinder.volume.manager [None req-090eb46c-2dd7-4903-bada-792f312578a0 tempest-VolumesExtendTest-1653409646 None] Deleted volume successfully. Feb 25 15:57:12 devstack cinder-volume[83528]: DEBUG cinder.coordination [None req-090eb46c-2dd7-4903-bada-792f312578a0 tempest-VolumesExtendTest-1653409646 None] Lock "cinder-34381b60-f4b8-486f-8113-334db7880364-delete_volume" released by "delete_volume" :: held 1.973s {{(pid=83528) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 25 15:57:12 devstack sudo[88336]: pam_unix(sudo:session): session closed for user root Feb 25 15:57:12 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-18a97d19-30cd-4691-b0f6-c07501a881cc tempest-VolumesDeleteCascade-1036059898 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-3c93b0b5-b14c-437d-969c-1ebf3dddc971.cddedbb9-d853-4e20-8db9-58a8e40b7c6b" returned: 0 in 0.684s {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 25 15:57:12 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.remotefs [None req-18a97d19-30cd-4691-b0f6-c07501a881cc tempest-VolumesDeleteCascade-1036059898 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3c93b0b5-b14c-437d-969c-1ebf3dddc971(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83528) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Feb 25 15:57:12 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-18a97d19-30cd-4691-b0f6-c07501a881cc tempest-VolumesDeleteCascade-1036059898 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-3c93b0b5-b14c-437d-969c-1ebf3dddc971.cddedbb9-d853-4e20-8db9-58a8e40b7c6b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-3c93b0b5-b14c-437d-969c-1ebf3dddc971.b570daaa-b909-4b5a-91fc-109d41dccac6 1G {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 25 15:57:12 devstack sudo[88378]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-3c93b0b5-b14c-437d-969c-1ebf3dddc971.cddedbb9-d853-4e20-8db9-58a8e40b7c6b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-3c93b0b5-b14c-437d-969c-1ebf3dddc971.b570daaa-b909-4b5a-91fc-109d41dccac6 1G Feb 25 15:57:12 devstack sudo[88378]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 25 15:57:12 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-1734686a-1f0b-4928-80a4-5abd7c9cce39 tempest-SnapshotMetadataTestJSON-1314612421 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 25 15:57:12 devstack sudo[88378]: pam_unix(sudo:session): session closed for user root Feb 25 15:57:12 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-18a97d19-30cd-4691-b0f6-c07501a881cc tempest-VolumesDeleteCascade-1036059898 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-3c93b0b5-b14c-437d-969c-1ebf3dddc971.cddedbb9-d853-4e20-8db9-58a8e40b7c6b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-3c93b0b5-b14c-437d-969c-1ebf3dddc971.b570daaa-b909-4b5a-91fc-109d41dccac6 1G" returned: 0 in 0.651s {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 25 15:57:12 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-18a97d19-30cd-4691-b0f6-c07501a881cc tempest-VolumesDeleteCascade-1036059898 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3c93b0b5-b14c-437d-969c-1ebf3dddc971.cddedbb9-d853-4e20-8db9-58a8e40b7c6b -F qcow2 /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-3c93b0b5-b14c-437d-969c-1ebf3dddc971.b570daaa-b909-4b5a-91fc-109d41dccac6 {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 25 15:57:12 devstack sudo[88383]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3c93b0b5-b14c-437d-969c-1ebf3dddc971.cddedbb9-d853-4e20-8db9-58a8e40b7c6b -F qcow2 /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-3c93b0b5-b14c-437d-969c-1ebf3dddc971.b570daaa-b909-4b5a-91fc-109d41dccac6 Feb 25 15:57:12 devstack sudo[88383]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 25 15:57:13 devstack sudo[88383]: pam_unix(sudo:session): session closed for user root Feb 25 15:57:13 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-18a97d19-30cd-4691-b0f6-c07501a881cc tempest-VolumesDeleteCascade-1036059898 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3c93b0b5-b14c-437d-969c-1ebf3dddc971.cddedbb9-d853-4e20-8db9-58a8e40b7c6b -F qcow2 /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-3c93b0b5-b14c-437d-969c-1ebf3dddc971.b570daaa-b909-4b5a-91fc-109d41dccac6" returned: 0 in 0.575s {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 25 15:57:13 devstack cinder-volume[83528]: WARNING cinder.volume.drivers.remotefs [None req-18a97d19-30cd-4691-b0f6-c07501a881cc tempest-VolumesDeleteCascade-1036059898 None] /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-3c93b0b5-b14c-437d-969c-1ebf3dddc971.b570daaa-b909-4b5a-91fc-109d41dccac6 is being set with open permissions: ugo+rw Feb 25 15:57:13 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-18a97d19-30cd-4691-b0f6-c07501a881cc tempest-VolumesDeleteCascade-1036059898 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-3c93b0b5-b14c-437d-969c-1ebf3dddc971.b570daaa-b909-4b5a-91fc-109d41dccac6 {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 25 15:57:13 devstack sudo[88394]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-3c93b0b5-b14c-437d-969c-1ebf3dddc971.b570daaa-b909-4b5a-91fc-109d41dccac6 Feb 25 15:57:13 devstack sudo[88394]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 25 15:57:14 devstack sudo[88394]: pam_unix(sudo:session): session closed for user root Feb 25 15:57:14 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-18a97d19-30cd-4691-b0f6-c07501a881cc tempest-VolumesDeleteCascade-1036059898 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-3c93b0b5-b14c-437d-969c-1ebf3dddc971.b570daaa-b909-4b5a-91fc-109d41dccac6" returned: 0 in 0.579s {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 25 15:57:14 devstack cinder-volume[83528]: DEBUG dbcounter [-] [83528] Writing DB stats cinder:SELECT=177,cinder:UPDATE=201,cinder:INSERT=61,cinder:DELETE=14 {{(pid=83528) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Feb 25 15:57:14 devstack cinder-volume[83528]: DEBUG dbcounter [-] [83528] Writing DB stats cinder:SELECT=137,cinder:INSERT=59,cinder:UPDATE=216,cinder:DELETE=23 {{(pid=83528) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Feb 25 15:57:14 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-18a97d19-30cd-4691-b0f6-c07501a881cc tempest-VolumesDeleteCascade-1036059898 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.644s {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 25 15:57:14 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-1734686a-1f0b-4928-80a4-5abd7c9cce39 tempest-SnapshotMetadataTestJSON-1314612421 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.586s {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 25 15:57:14 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.remotefs [None req-1734686a-1f0b-4928-80a4-5abd7c9cce39 tempest-SnapshotMetadataTestJSON-1314612421 None] Creating offline snapshot 996f8dc7-be53-4ed3-a78a-4da34567fb04 of volume 21c8dfc2-8a66-4148-92c8-be83789f2e01 {{(pid=83528) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Feb 25 15:57:14 devstack cinder-volume[83528]: INFO cinder.volume.manager [None req-18a97d19-30cd-4691-b0f6-c07501a881cc tempest-VolumesDeleteCascade-1036059898 None] Create snapshot completed successfully Feb 25 15:57:14 devstack cinder-volume[83528]: DEBUG oslo.privsep.daemon [-] privsep: reply[2fe8113c-07fa-4054-9420-f008b5c682c7]: (4, 'qcow2') {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 25 15:57:14 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-1734686a-1f0b-4928-80a4-5abd7c9cce39 tempest-SnapshotMetadataTestJSON-1314612421 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-21c8dfc2-8a66-4148-92c8-be83789f2e01 {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 25 15:57:14 devstack sudo[88397]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-21c8dfc2-8a66-4148-92c8-be83789f2e01 Feb 25 15:57:14 devstack sudo[88397]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 25 15:57:14 devstack sudo[88397]: pam_unix(sudo:session): session closed for user root Feb 25 15:57:14 devstack cinder-volume[83528]: DEBUG cinder.volume.flows.manager.create_volume [None req-32b9b80d-10b6-4252-874f-0323e606629f tempest-VolumesListTestJSON-11611395 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83528) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 25 15:57:14 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-32b9b80d-10b6-4252-874f-0323e606629f tempest-VolumesListTestJSON-11611395 None] Flow 'volume_create_manager' (301c610e-152a-4582-b459-d946a1d72635) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83528) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 25 15:57:14 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-32b9b80d-10b6-4252-874f-0323e606629f tempest-VolumesListTestJSON-11611395 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dbf965a8-d6aa-4d7d-a858-9eec9289d0ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 25 15:57:14 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-1734686a-1f0b-4928-80a4-5abd7c9cce39 tempest-SnapshotMetadataTestJSON-1314612421 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-21c8dfc2-8a66-4148-92c8-be83789f2e01" returned: 0 in 0.663s {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 25 15:57:14 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-1734686a-1f0b-4928-80a4-5abd7c9cce39 tempest-SnapshotMetadataTestJSON-1314612421 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-21c8dfc2-8a66-4148-92c8-be83789f2e01,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-21c8dfc2-8a66-4148-92c8-be83789f2e01.996f8dc7-be53-4ed3-a78a-4da34567fb04 1G {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 25 15:57:14 devstack sudo[88403]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-21c8dfc2-8a66-4148-92c8-be83789f2e01,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-21c8dfc2-8a66-4148-92c8-be83789f2e01.996f8dc7-be53-4ed3-a78a-4da34567fb04 1G Feb 25 15:57:14 devstack sudo[88403]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 25 15:57:14 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-32b9b80d-10b6-4252-874f-0323e606629f tempest-VolumesListTestJSON-11611395 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dbf965a8-d6aa-4d7d-a858-9eec9289d0ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-25T14:57:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-2107200928',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=44207fcf-7270-401d-8e4d-8cc9708458b1,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='09e01ab9bc494682ab1ec11fc5fec56f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-25T14:57:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-25T14:57:15Z,use_quota=True,user_id='85ffe75d4a064eab9c2691d918c06e71',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ce71c2f9-6543-4165-9653-a1529b2ea243),volume_type_id=ce71c2f9-6543-4165-9653-a1529b2ea243)' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 25 15:57:14 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-32b9b80d-10b6-4252-874f-0323e606629f tempest-VolumesListTestJSON-11611395 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0701c0bb-c28e-4cf1-a645-ec314fc58048) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 25 15:57:14 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-32b9b80d-10b6-4252-874f-0323e606629f tempest-VolumesListTestJSON-11611395 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0701c0bb-c28e-4cf1-a645-ec314fc58048) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 25 15:57:14 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-32b9b80d-10b6-4252-874f-0323e606629f tempest-VolumesListTestJSON-11611395 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6501faa7-103b-4181-a937-0b6772d22db7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 25 15:57:14 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-32b9b80d-10b6-4252-874f-0323e606629f tempest-VolumesListTestJSON-11611395 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6501faa7-103b-4181-a937-0b6772d22db7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '44207fcf-7270-401d-8e4d-8cc9708458b1', 'volume_name': 'volume-44207fcf-7270-401d-8e4d-8cc9708458b1', 'volume_size': 1}' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 25 15:57:14 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-32b9b80d-10b6-4252-874f-0323e606629f tempest-VolumesListTestJSON-11611395 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ad5547e6-bbbe-4286-9d14-5ced01ead643) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 25 15:57:14 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-32b9b80d-10b6-4252-874f-0323e606629f tempest-VolumesListTestJSON-11611395 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ad5547e6-bbbe-4286-9d14-5ced01ead643) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 25 15:57:14 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-32b9b80d-10b6-4252-874f-0323e606629f tempest-VolumesListTestJSON-11611395 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (856b5ecf-f0e6-4e9a-806f-cf7ddb622eb7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 25 15:57:14 devstack cinder-volume[83528]: INFO cinder.volume.flows.manager.create_volume [None req-32b9b80d-10b6-4252-874f-0323e606629f tempest-VolumesListTestJSON-11611395 None] Volume 44207fcf-7270-401d-8e4d-8cc9708458b1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-44207fcf-7270-401d-8e4d-8cc9708458b1', 'volume_size': 1} Feb 25 15:57:14 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-32b9b80d-10b6-4252-874f-0323e606629f tempest-VolumesListTestJSON-11611395 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 25 15:57:15 devstack cinder-volume[83528]: DEBUG cinder.coordination [None req-99f89b0b-99df-460a-8faa-a4c016ad1a5d tempest-VolumesDeleteCascade-1036059898 None] Acquiring lock "cinder-3c93b0b5-b14c-437d-969c-1ebf3dddc971-delete_volume" by "delete_volume" {{(pid=83528) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 25 15:57:15 devstack cinder-volume[83528]: DEBUG cinder.coordination [None req-99f89b0b-99df-460a-8faa-a4c016ad1a5d tempest-VolumesDeleteCascade-1036059898 None] Lock "cinder-3c93b0b5-b14c-437d-969c-1ebf3dddc971-delete_volume" acquired by "delete_volume" :: waited 0.013s {{(pid=83528) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 25 15:57:15 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-99f89b0b-99df-460a-8faa-a4c016ad1a5d tempest-VolumesDeleteCascade-1036059898 None] Performing cascade delete. {{(pid=83528) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}} Feb 25 15:57:15 devstack cinder-volume[83528]: DEBUG cinder.coordination [None req-99f89b0b-99df-460a-8faa-a4c016ad1a5d tempest-VolumesDeleteCascade-1036059898 None] Acquiring lock "cinder-b570daaa-b909-4b5a-91fc-109d41dccac6-delete_snapshot" by "delete_snapshot" {{(pid=83528) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 25 15:57:15 devstack cinder-volume[83528]: DEBUG cinder.coordination [None req-99f89b0b-99df-460a-8faa-a4c016ad1a5d tempest-VolumesDeleteCascade-1036059898 None] Lock "cinder-b570daaa-b909-4b5a-91fc-109d41dccac6-delete_snapshot" acquired by "delete_snapshot" :: waited 0.013s {{(pid=83528) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 25 15:57:15 devstack cinder-volume[83528]: DEBUG cinder.coordination [None req-99f89b0b-99df-460a-8faa-a4c016ad1a5d tempest-VolumesDeleteCascade-1036059898 None] Acquiring lock "cinder-quobyte-3c93b0b5-b14c-437d-969c-1ebf3dddc971" by "delete_snapshot" {{(pid=83528) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 25 15:57:15 devstack cinder-volume[83528]: DEBUG cinder.coordination [None req-99f89b0b-99df-460a-8faa-a4c016ad1a5d tempest-VolumesDeleteCascade-1036059898 None] Lock "cinder-quobyte-3c93b0b5-b14c-437d-969c-1ebf3dddc971" acquired by "delete_snapshot" :: waited 0.013s {{(pid=83528) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 25 15:57:15 devstack cinder-volume[83528]: DEBUG cinder.coordination [None req-99f89b0b-99df-460a-8faa-a4c016ad1a5d tempest-VolumesDeleteCascade-1036059898 None] Acquiring lock "cinder-quobyte-b570daaa-b909-4b5a-91fc-109d41dccac6" by "_delete_snapshot" {{(pid=83528) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 25 15:57:15 devstack cinder-volume[83528]: DEBUG cinder.coordination [None req-99f89b0b-99df-460a-8faa-a4c016ad1a5d tempest-VolumesDeleteCascade-1036059898 None] Lock "cinder-quobyte-b570daaa-b909-4b5a-91fc-109d41dccac6" acquired by "_delete_snapshot" :: waited 0.009s {{(pid=83528) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 25 15:57:15 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.remotefs [None req-99f89b0b-99df-460a-8faa-a4c016ad1a5d tempest-VolumesDeleteCascade-1036059898 None] Deleting offline snapshot b570daaa-b909-4b5a-91fc-109d41dccac6 of volume 3c93b0b5-b14c-437d-969c-1ebf3dddc971 {{(pid=83528) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Feb 25 15:57:15 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.remotefs [None req-99f89b0b-99df-460a-8faa-a4c016ad1a5d tempest-VolumesDeleteCascade-1036059898 None] snapshot_file for this snap is: volume-3c93b0b5-b14c-437d-969c-1ebf3dddc971.b570daaa-b909-4b5a-91fc-109d41dccac6 {{(pid=83528) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Feb 25 15:57:15 devstack cinder-volume[83528]: DEBUG oslo.privsep.daemon [-] privsep: reply[98f777e6-4289-4a95-8b4a-51ab861eedf9]: (4, 'qcow2') {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 25 15:57:15 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-99f89b0b-99df-460a-8faa-a4c016ad1a5d tempest-VolumesDeleteCascade-1036059898 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-3c93b0b5-b14c-437d-969c-1ebf3dddc971.b570daaa-b909-4b5a-91fc-109d41dccac6 {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 25 15:57:15 devstack sudo[88405]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-3c93b0b5-b14c-437d-969c-1ebf3dddc971.b570daaa-b909-4b5a-91fc-109d41dccac6 Feb 25 15:57:15 devstack sudo[88405]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 25 15:57:15 devstack sudo[88403]: pam_unix(sudo:session): session closed for user root Feb 25 15:57:15 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-1734686a-1f0b-4928-80a4-5abd7c9cce39 tempest-SnapshotMetadataTestJSON-1314612421 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-21c8dfc2-8a66-4148-92c8-be83789f2e01,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-21c8dfc2-8a66-4148-92c8-be83789f2e01.996f8dc7-be53-4ed3-a78a-4da34567fb04 1G" returned: 0 in 0.548s {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 25 15:57:15 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-1734686a-1f0b-4928-80a4-5abd7c9cce39 tempest-SnapshotMetadataTestJSON-1314612421 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-21c8dfc2-8a66-4148-92c8-be83789f2e01 -F qcow2 /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-21c8dfc2-8a66-4148-92c8-be83789f2e01.996f8dc7-be53-4ed3-a78a-4da34567fb04 {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 25 15:57:15 devstack sudo[88410]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-21c8dfc2-8a66-4148-92c8-be83789f2e01 -F qcow2 /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-21c8dfc2-8a66-4148-92c8-be83789f2e01.996f8dc7-be53-4ed3-a78a-4da34567fb04 Feb 25 15:57:15 devstack sudo[88410]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 25 15:57:15 devstack sudo[88405]: pam_unix(sudo:session): session closed for user root Feb 25 15:57:15 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-99f89b0b-99df-460a-8faa-a4c016ad1a5d tempest-VolumesDeleteCascade-1036059898 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-3c93b0b5-b14c-437d-969c-1ebf3dddc971.b570daaa-b909-4b5a-91fc-109d41dccac6" returned: 0 in 0.617s {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 25 15:57:15 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.remotefs [None req-99f89b0b-99df-460a-8faa-a4c016ad1a5d tempest-VolumesDeleteCascade-1036059898 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3c93b0b5-b14c-437d-969c-1ebf3dddc971(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83528) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Feb 25 15:57:15 devstack cinder-volume[83528]: DEBUG oslo.privsep.daemon [-] privsep: reply[a68b5cf3-61da-47e5-8372-4f292f76ce6e]: (4, 'qcow2') {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 25 15:57:15 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-99f89b0b-99df-460a-8faa-a4c016ad1a5d tempest-VolumesDeleteCascade-1036059898 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-3c93b0b5-b14c-437d-969c-1ebf3dddc971.cddedbb9-d853-4e20-8db9-58a8e40b7c6b {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 25 15:57:15 devstack sudo[88415]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-3c93b0b5-b14c-437d-969c-1ebf3dddc971.cddedbb9-d853-4e20-8db9-58a8e40b7c6b Feb 25 15:57:15 devstack sudo[88415]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 25 15:57:15 devstack sudo[88410]: pam_unix(sudo:session): session closed for user root Feb 25 15:57:15 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-1734686a-1f0b-4928-80a4-5abd7c9cce39 tempest-SnapshotMetadataTestJSON-1314612421 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-21c8dfc2-8a66-4148-92c8-be83789f2e01 -F qcow2 /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-21c8dfc2-8a66-4148-92c8-be83789f2e01.996f8dc7-be53-4ed3-a78a-4da34567fb04" returned: 0 in 0.584s {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 25 15:57:15 devstack cinder-volume[83528]: WARNING cinder.volume.drivers.remotefs [None req-1734686a-1f0b-4928-80a4-5abd7c9cce39 tempest-SnapshotMetadataTestJSON-1314612421 None] /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-21c8dfc2-8a66-4148-92c8-be83789f2e01.996f8dc7-be53-4ed3-a78a-4da34567fb04 is being set with open permissions: ugo+rw Feb 25 15:57:15 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-1734686a-1f0b-4928-80a4-5abd7c9cce39 tempest-SnapshotMetadataTestJSON-1314612421 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-21c8dfc2-8a66-4148-92c8-be83789f2e01.996f8dc7-be53-4ed3-a78a-4da34567fb04 {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 25 15:57:16 devstack sudo[88420]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-21c8dfc2-8a66-4148-92c8-be83789f2e01.996f8dc7-be53-4ed3-a78a-4da34567fb04 Feb 25 15:57:16 devstack sudo[88420]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 25 15:57:16 devstack sudo[88415]: pam_unix(sudo:session): session closed for user root Feb 25 15:57:16 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-99f89b0b-99df-460a-8faa-a4c016ad1a5d tempest-VolumesDeleteCascade-1036059898 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-3c93b0b5-b14c-437d-969c-1ebf3dddc971.cddedbb9-d853-4e20-8db9-58a8e40b7c6b" returned: 0 in 0.545s {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 25 15:57:16 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.remotefs [None req-99f89b0b-99df-460a-8faa-a4c016ad1a5d tempest-VolumesDeleteCascade-1036059898 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3c93b0b5-b14c-437d-969c-1ebf3dddc971(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83528) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Feb 25 15:57:16 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-99f89b0b-99df-460a-8faa-a4c016ad1a5d tempest-VolumesDeleteCascade-1036059898 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-3c93b0b5-b14c-437d-969c-1ebf3dddc971.b570daaa-b909-4b5a-91fc-109d41dccac6 {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 25 15:57:16 devstack sudo[88425]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-3c93b0b5-b14c-437d-969c-1ebf3dddc971.b570daaa-b909-4b5a-91fc-109d41dccac6 Feb 25 15:57:16 devstack sudo[88425]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 25 15:57:16 devstack sudo[88420]: pam_unix(sudo:session): session closed for user root Feb 25 15:57:16 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-1734686a-1f0b-4928-80a4-5abd7c9cce39 tempest-SnapshotMetadataTestJSON-1314612421 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-21c8dfc2-8a66-4148-92c8-be83789f2e01.996f8dc7-be53-4ed3-a78a-4da34567fb04" returned: 0 in 0.471s {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 25 15:57:16 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-1734686a-1f0b-4928-80a4-5abd7c9cce39 tempest-SnapshotMetadataTestJSON-1314612421 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-21c8dfc2-8a66-4148-92c8-be83789f2e01.info {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 25 15:57:16 devstack sudo[88428]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-21c8dfc2-8a66-4148-92c8-be83789f2e01.info Feb 25 15:57:16 devstack sudo[88428]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 25 15:57:16 devstack sudo[88425]: pam_unix(sudo:session): session closed for user root Feb 25 15:57:16 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-99f89b0b-99df-460a-8faa-a4c016ad1a5d tempest-VolumesDeleteCascade-1036059898 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-3c93b0b5-b14c-437d-969c-1ebf3dddc971.b570daaa-b909-4b5a-91fc-109d41dccac6" returned: 0 in 0.604s {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 25 15:57:16 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-99f89b0b-99df-460a-8faa-a4c016ad1a5d tempest-VolumesDeleteCascade-1036059898 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-3c93b0b5-b14c-437d-969c-1ebf3dddc971.b570daaa-b909-4b5a-91fc-109d41dccac6 {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 25 15:57:16 devstack sudo[88434]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-3c93b0b5-b14c-437d-969c-1ebf3dddc971.b570daaa-b909-4b5a-91fc-109d41dccac6 Feb 25 15:57:16 devstack sudo[88434]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 25 15:57:17 devstack sudo[88428]: pam_unix(sudo:session): session closed for user root Feb 25 15:57:17 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-1734686a-1f0b-4928-80a4-5abd7c9cce39 tempest-SnapshotMetadataTestJSON-1314612421 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-21c8dfc2-8a66-4148-92c8-be83789f2e01.info" returned: 0 in 0.545s {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 25 15:57:17 devstack cinder-volume[83528]: WARNING cinder.volume.drivers.remotefs [None req-1734686a-1f0b-4928-80a4-5abd7c9cce39 tempest-SnapshotMetadataTestJSON-1314612421 None] /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-21c8dfc2-8a66-4148-92c8-be83789f2e01.info is being set with open permissions: ugo+rw Feb 25 15:57:17 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-1734686a-1f0b-4928-80a4-5abd7c9cce39 tempest-SnapshotMetadataTestJSON-1314612421 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-21c8dfc2-8a66-4148-92c8-be83789f2e01.info {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 25 15:57:17 devstack sudo[88436]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-21c8dfc2-8a66-4148-92c8-be83789f2e01.info Feb 25 15:57:17 devstack sudo[88436]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 25 15:57:17 devstack sudo[88434]: pam_unix(sudo:session): session closed for user root Feb 25 15:57:17 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-99f89b0b-99df-460a-8faa-a4c016ad1a5d tempest-VolumesDeleteCascade-1036059898 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-3c93b0b5-b14c-437d-969c-1ebf3dddc971.b570daaa-b909-4b5a-91fc-109d41dccac6" returned: 0 in 0.494s {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 25 15:57:17 devstack cinder-volume[83528]: DEBUG cinder.coordination [None req-99f89b0b-99df-460a-8faa-a4c016ad1a5d tempest-VolumesDeleteCascade-1036059898 None] Lock "cinder-quobyte-b570daaa-b909-4b5a-91fc-109d41dccac6" released by "_delete_snapshot" :: held 2.323s {{(pid=83528) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 25 15:57:17 devstack cinder-volume[83528]: DEBUG cinder.coordination [None req-99f89b0b-99df-460a-8faa-a4c016ad1a5d tempest-VolumesDeleteCascade-1036059898 None] Lock "cinder-quobyte-3c93b0b5-b14c-437d-969c-1ebf3dddc971" released by "delete_snapshot" :: held 2.336s {{(pid=83528) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 25 15:57:17 devstack cinder-volume[83528]: DEBUG cinder.quota [None req-99f89b0b-99df-460a-8faa-a4c016ad1a5d tempest-VolumesDeleteCascade-1036059898 None] Created reservations ['ecf7b37e-e857-4241-b193-b3eef924a344', 'b27d9419-7513-4555-9d17-7135064b8384', 'a50220c7-ea05-40e1-9f70-960140302049', '6a9ebf03-a59a-4eee-8ac0-5b4453ecd960'] {{(pid=83528) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 25 15:57:17 devstack sudo[88436]: pam_unix(sudo:session): session closed for user root Feb 25 15:57:17 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-1734686a-1f0b-4928-80a4-5abd7c9cce39 tempest-SnapshotMetadataTestJSON-1314612421 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-21c8dfc2-8a66-4148-92c8-be83789f2e01.info" returned: 0 in 0.532s {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 25 15:57:17 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-1734686a-1f0b-4928-80a4-5abd7c9cce39 tempest-SnapshotMetadataTestJSON-1314612421 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.443s {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 25 15:57:17 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-32b9b80d-10b6-4252-874f-0323e606629f tempest-VolumesListTestJSON-11611395 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.663s {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 25 15:57:17 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.quobyte [None req-32b9b80d-10b6-4252-874f-0323e606629f tempest-VolumesListTestJSON-11611395 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-25T14:57:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-2107200928',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=44207fcf-7270-401d-8e4d-8cc9708458b1,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='09e01ab9bc494682ab1ec11fc5fec56f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-25T14:57:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-25T14:57:15Z,use_quota=True,user_id='85ffe75d4a064eab9c2691d918c06e71',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ce71c2f9-6543-4165-9653-a1529b2ea243),volume_type_id=ce71c2f9-6543-4165-9653-a1529b2ea243)}" {{(pid=83528) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 25 15:57:17 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.remotefs [None req-32b9b80d-10b6-4252-874f-0323e606629f tempest-VolumesListTestJSON-11611395 None] Creating volume 44207fcf-7270-401d-8e4d-8cc9708458b1 {{(pid=83528) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 25 15:57:17 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-32b9b80d-10b6-4252-874f-0323e606629f tempest-VolumesListTestJSON-11611395 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 25 15:57:17 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-32b9b80d-10b6-4252-874f-0323e606629f tempest-VolumesListTestJSON-11611395 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 25 15:57:17 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.quobyte [None req-32b9b80d-10b6-4252-874f-0323e606629f tempest-VolumesListTestJSON-11611395 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23e9d725-3e04-4cd9-bfe0-c8ef43305589': None} {{(pid=83528) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 25 15:57:17 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.quobyte [None req-32b9b80d-10b6-4252-874f-0323e606629f tempest-VolumesListTestJSON-11611395 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23e9d725-3e04-4cd9-bfe0-c8ef43305589'] {{(pid=83528) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 25 15:57:17 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-32b9b80d-10b6-4252-874f-0323e606629f tempest-VolumesListTestJSON-11611395 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 25 15:57:17 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.quobyte [None req-32b9b80d-10b6-4252-874f-0323e606629f tempest-VolumesListTestJSON-11611395 None] Selected osci02.corp.quobyte.com/cinder-vol-23e9d725-3e04-4cd9-bfe0-c8ef43305589 as target Quobyte volume. {{(pid=83528) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 25 15:57:17 devstack cinder-volume[83528]: INFO cinder.volume.drivers.remotefs [None req-32b9b80d-10b6-4252-874f-0323e606629f tempest-VolumesListTestJSON-11611395 None] casted to osci02.corp.quobyte.com/cinder-vol-23e9d725-3e04-4cd9-bfe0-c8ef43305589 Feb 25 15:57:17 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-32b9b80d-10b6-4252-874f-0323e606629f tempest-VolumesListTestJSON-11611395 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-44207fcf-7270-401d-8e4d-8cc9708458b1 1073741824 {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 25 15:57:17 devstack sudo[88440]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-44207fcf-7270-401d-8e4d-8cc9708458b1 1073741824 Feb 25 15:57:17 devstack sudo[88440]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 25 15:57:17 devstack cinder-volume[83528]: INFO cinder.volume.manager [None req-1734686a-1f0b-4928-80a4-5abd7c9cce39 tempest-SnapshotMetadataTestJSON-1314612421 None] Create snapshot completed successfully Feb 25 15:57:17 devstack cinder-volume[83528]: INFO cinder.volume.manager [None req-99f89b0b-99df-460a-8faa-a4c016ad1a5d tempest-VolumesDeleteCascade-1036059898 None] Delete snapshot completed successfully. Feb 25 15:57:17 devstack cinder-volume[83528]: DEBUG cinder.coordination [None req-99f89b0b-99df-460a-8faa-a4c016ad1a5d tempest-VolumesDeleteCascade-1036059898 None] Lock "cinder-b570daaa-b909-4b5a-91fc-109d41dccac6-delete_snapshot" released by "delete_snapshot" :: held 2.538s {{(pid=83528) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 25 15:57:17 devstack cinder-volume[83528]: DEBUG cinder.coordination [None req-99f89b0b-99df-460a-8faa-a4c016ad1a5d tempest-VolumesDeleteCascade-1036059898 None] Acquiring lock "cinder-cddedbb9-d853-4e20-8db9-58a8e40b7c6b-delete_snapshot" by "delete_snapshot" {{(pid=83528) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 25 15:57:17 devstack cinder-volume[83528]: DEBUG cinder.coordination [None req-99f89b0b-99df-460a-8faa-a4c016ad1a5d tempest-VolumesDeleteCascade-1036059898 None] Lock "cinder-cddedbb9-d853-4e20-8db9-58a8e40b7c6b-delete_snapshot" acquired by "delete_snapshot" :: waited 0.009s {{(pid=83528) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 25 15:57:17 devstack cinder-volume[83528]: DEBUG cinder.coordination [None req-99f89b0b-99df-460a-8faa-a4c016ad1a5d tempest-VolumesDeleteCascade-1036059898 None] Acquiring lock "cinder-quobyte-3c93b0b5-b14c-437d-969c-1ebf3dddc971" by "delete_snapshot" {{(pid=83528) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 25 15:57:17 devstack cinder-volume[83528]: DEBUG cinder.coordination [None req-99f89b0b-99df-460a-8faa-a4c016ad1a5d tempest-VolumesDeleteCascade-1036059898 None] Lock "cinder-quobyte-3c93b0b5-b14c-437d-969c-1ebf3dddc971" acquired by "delete_snapshot" :: waited 0.011s {{(pid=83528) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 25 15:57:17 devstack cinder-volume[83528]: DEBUG cinder.coordination [None req-99f89b0b-99df-460a-8faa-a4c016ad1a5d tempest-VolumesDeleteCascade-1036059898 None] Acquiring lock "cinder-quobyte-cddedbb9-d853-4e20-8db9-58a8e40b7c6b" by "_delete_snapshot" {{(pid=83528) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 25 15:57:17 devstack cinder-volume[83528]: DEBUG cinder.coordination [None req-99f89b0b-99df-460a-8faa-a4c016ad1a5d tempest-VolumesDeleteCascade-1036059898 None] Lock "cinder-quobyte-cddedbb9-d853-4e20-8db9-58a8e40b7c6b" acquired by "_delete_snapshot" :: waited 0.010s {{(pid=83528) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 25 15:57:17 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.remotefs [None req-99f89b0b-99df-460a-8faa-a4c016ad1a5d tempest-VolumesDeleteCascade-1036059898 None] Deleting offline snapshot cddedbb9-d853-4e20-8db9-58a8e40b7c6b of volume 3c93b0b5-b14c-437d-969c-1ebf3dddc971 {{(pid=83528) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Feb 25 15:57:17 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.remotefs [None req-99f89b0b-99df-460a-8faa-a4c016ad1a5d tempest-VolumesDeleteCascade-1036059898 None] snapshot_file for this snap is: volume-3c93b0b5-b14c-437d-969c-1ebf3dddc971.cddedbb9-d853-4e20-8db9-58a8e40b7c6b {{(pid=83528) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Feb 25 15:57:17 devstack cinder-volume[83528]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6d7cb13-001a-4023-8f99-f6a29078c0a2]: (4, 'qcow2') {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 25 15:57:17 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-99f89b0b-99df-460a-8faa-a4c016ad1a5d tempest-VolumesDeleteCascade-1036059898 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-3c93b0b5-b14c-437d-969c-1ebf3dddc971.cddedbb9-d853-4e20-8db9-58a8e40b7c6b {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 25 15:57:17 devstack sudo[88442]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-3c93b0b5-b14c-437d-969c-1ebf3dddc971.cddedbb9-d853-4e20-8db9-58a8e40b7c6b Feb 25 15:57:17 devstack sudo[88442]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 25 15:57:18 devstack sudo[88440]: pam_unix(sudo:session): session closed for user root Feb 25 15:57:18 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-32b9b80d-10b6-4252-874f-0323e606629f tempest-VolumesListTestJSON-11611395 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-44207fcf-7270-401d-8e4d-8cc9708458b1 1073741824" returned: 0 in 0.640s {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 25 15:57:18 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-32b9b80d-10b6-4252-874f-0323e606629f tempest-VolumesListTestJSON-11611395 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-44207fcf-7270-401d-8e4d-8cc9708458b1 {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 25 15:57:18 devstack sudo[88450]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-44207fcf-7270-401d-8e4d-8cc9708458b1 Feb 25 15:57:18 devstack sudo[88450]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 25 15:57:18 devstack cinder-volume[83528]: DEBUG cinder.coordination [None req-a5c682c9-e68d-4346-a7ab-71aec0892a55 tempest-SnapshotMetadataTestJSON-1314612421 None] Acquiring lock "cinder-996f8dc7-be53-4ed3-a78a-4da34567fb04-delete_snapshot" by "delete_snapshot" {{(pid=83528) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 25 15:57:18 devstack cinder-volume[83528]: DEBUG cinder.coordination [None req-a5c682c9-e68d-4346-a7ab-71aec0892a55 tempest-SnapshotMetadataTestJSON-1314612421 None] Lock "cinder-996f8dc7-be53-4ed3-a78a-4da34567fb04-delete_snapshot" acquired by "delete_snapshot" :: waited 0.014s {{(pid=83528) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 25 15:57:18 devstack cinder-volume[83528]: DEBUG cinder.coordination [None req-a5c682c9-e68d-4346-a7ab-71aec0892a55 tempest-SnapshotMetadataTestJSON-1314612421 None] Acquiring lock "cinder-quobyte-21c8dfc2-8a66-4148-92c8-be83789f2e01" by "delete_snapshot" {{(pid=83528) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 25 15:57:18 devstack cinder-volume[83528]: DEBUG cinder.coordination [None req-a5c682c9-e68d-4346-a7ab-71aec0892a55 tempest-SnapshotMetadataTestJSON-1314612421 None] Lock "cinder-quobyte-21c8dfc2-8a66-4148-92c8-be83789f2e01" acquired by "delete_snapshot" :: waited 0.018s {{(pid=83528) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 25 15:57:18 devstack cinder-volume[83528]: DEBUG cinder.coordination [None req-a5c682c9-e68d-4346-a7ab-71aec0892a55 tempest-SnapshotMetadataTestJSON-1314612421 None] Acquiring lock "cinder-quobyte-996f8dc7-be53-4ed3-a78a-4da34567fb04" by "_delete_snapshot" {{(pid=83528) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 25 15:57:18 devstack sudo[88442]: pam_unix(sudo:session): session closed for user root Feb 25 15:57:18 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-99f89b0b-99df-460a-8faa-a4c016ad1a5d tempest-VolumesDeleteCascade-1036059898 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-3c93b0b5-b14c-437d-969c-1ebf3dddc971.cddedbb9-d853-4e20-8db9-58a8e40b7c6b" returned: 0 in 0.694s {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 25 15:57:18 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.remotefs [None req-99f89b0b-99df-460a-8faa-a4c016ad1a5d tempest-VolumesDeleteCascade-1036059898 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3c93b0b5-b14c-437d-969c-1ebf3dddc971(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83528) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Feb 25 15:57:18 devstack cinder-volume[83528]: DEBUG cinder.coordination [None req-a5c682c9-e68d-4346-a7ab-71aec0892a55 tempest-SnapshotMetadataTestJSON-1314612421 None] Lock "cinder-quobyte-996f8dc7-be53-4ed3-a78a-4da34567fb04" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=83528) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 25 15:57:18 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.remotefs [None req-a5c682c9-e68d-4346-a7ab-71aec0892a55 tempest-SnapshotMetadataTestJSON-1314612421 None] Deleting offline snapshot 996f8dc7-be53-4ed3-a78a-4da34567fb04 of volume 21c8dfc2-8a66-4148-92c8-be83789f2e01 {{(pid=83528) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Feb 25 15:57:18 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.remotefs [None req-a5c682c9-e68d-4346-a7ab-71aec0892a55 tempest-SnapshotMetadataTestJSON-1314612421 None] snapshot_file for this snap is: volume-21c8dfc2-8a66-4148-92c8-be83789f2e01.996f8dc7-be53-4ed3-a78a-4da34567fb04 {{(pid=83528) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Feb 25 15:57:18 devstack cinder-volume[83528]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7ec20cd-0ecb-4df6-bba4-dac80f769974]: (4, 'qcow2') {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 25 15:57:18 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-99f89b0b-99df-460a-8faa-a4c016ad1a5d tempest-VolumesDeleteCascade-1036059898 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-3c93b0b5-b14c-437d-969c-1ebf3dddc971 {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 25 15:57:18 devstack cinder-volume[83528]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d52ce59-2bb9-4a6b-80ac-020334a36771]: (4, 'qcow2') {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 25 15:57:18 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-a5c682c9-e68d-4346-a7ab-71aec0892a55 tempest-SnapshotMetadataTestJSON-1314612421 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-21c8dfc2-8a66-4148-92c8-be83789f2e01.996f8dc7-be53-4ed3-a78a-4da34567fb04 {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 25 15:57:18 devstack sudo[88452]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-3c93b0b5-b14c-437d-969c-1ebf3dddc971 Feb 25 15:57:18 devstack sudo[88452]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 25 15:57:18 devstack sudo[88453]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-21c8dfc2-8a66-4148-92c8-be83789f2e01.996f8dc7-be53-4ed3-a78a-4da34567fb04 Feb 25 15:57:18 devstack sudo[88453]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 25 15:57:18 devstack sudo[88450]: pam_unix(sudo:session): session closed for user root Feb 25 15:57:18 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-32b9b80d-10b6-4252-874f-0323e606629f tempest-VolumesListTestJSON-11611395 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-44207fcf-7270-401d-8e4d-8cc9708458b1" returned: 0 in 0.653s {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 25 15:57:18 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.quobyte [None req-32b9b80d-10b6-4252-874f-0323e606629f tempest-VolumesListTestJSON-11611395 None] <== create_volume: return (1345ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-23e9d725-3e04-4cd9-bfe0-c8ef43305589'} {{(pid=83528) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 25 15:57:18 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-32b9b80d-10b6-4252-874f-0323e606629f tempest-VolumesListTestJSON-11611395 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.348s {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 25 15:57:18 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-32b9b80d-10b6-4252-874f-0323e606629f tempest-VolumesListTestJSON-11611395 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (856b5ecf-f0e6-4e9a-806f-cf7ddb622eb7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-44207fcf-7270-401d-8e4d-8cc9708458b1', 'volume_size': 1}' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 25 15:57:18 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-32b9b80d-10b6-4252-874f-0323e606629f tempest-VolumesListTestJSON-11611395 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f230f6e2-e495-447a-a449-81e8afffcc2e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 25 15:57:18 devstack cinder-volume[83528]: INFO cinder.volume.flows.manager.create_volume [None req-32b9b80d-10b6-4252-874f-0323e606629f tempest-VolumesListTestJSON-11611395 None] Volume volume-44207fcf-7270-401d-8e4d-8cc9708458b1 (44207fcf-7270-401d-8e4d-8cc9708458b1): created successfully Feb 25 15:57:18 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-32b9b80d-10b6-4252-874f-0323e606629f tempest-VolumesListTestJSON-11611395 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f230f6e2-e495-447a-a449-81e8afffcc2e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 25 15:57:18 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-32b9b80d-10b6-4252-874f-0323e606629f tempest-VolumesListTestJSON-11611395 None] Flow 'volume_create_manager' (301c610e-152a-4582-b459-d946a1d72635) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83528) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 25 15:57:19 devstack cinder-volume[83528]: INFO cinder.volume.manager [None req-32b9b80d-10b6-4252-874f-0323e606629f tempest-VolumesListTestJSON-11611395 None] Created volume successfully. Feb 25 15:57:19 devstack sudo[88453]: pam_unix(sudo:session): session closed for user root Feb 25 15:57:19 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-a5c682c9-e68d-4346-a7ab-71aec0892a55 tempest-SnapshotMetadataTestJSON-1314612421 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-21c8dfc2-8a66-4148-92c8-be83789f2e01.996f8dc7-be53-4ed3-a78a-4da34567fb04" returned: 0 in 0.618s {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 25 15:57:19 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.remotefs [None req-a5c682c9-e68d-4346-a7ab-71aec0892a55 tempest-SnapshotMetadataTestJSON-1314612421 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-21c8dfc2-8a66-4148-92c8-be83789f2e01(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83528) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Feb 25 15:57:19 devstack sudo[88452]: pam_unix(sudo:session): session closed for user root Feb 25 15:57:19 devstack cinder-volume[83528]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f6ad5e2-4f61-40b9-a407-89ef4f38731c]: (4, 'qcow2') {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 25 15:57:19 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-a5c682c9-e68d-4346-a7ab-71aec0892a55 tempest-SnapshotMetadataTestJSON-1314612421 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-21c8dfc2-8a66-4148-92c8-be83789f2e01 {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 25 15:57:19 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-99f89b0b-99df-460a-8faa-a4c016ad1a5d tempest-VolumesDeleteCascade-1036059898 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-3c93b0b5-b14c-437d-969c-1ebf3dddc971" returned: 0 in 0.661s {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 25 15:57:19 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-99f89b0b-99df-460a-8faa-a4c016ad1a5d tempest-VolumesDeleteCascade-1036059898 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-3c93b0b5-b14c-437d-969c-1ebf3dddc971.cddedbb9-d853-4e20-8db9-58a8e40b7c6b {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 25 15:57:19 devstack sudo[88464]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-3c93b0b5-b14c-437d-969c-1ebf3dddc971.cddedbb9-d853-4e20-8db9-58a8e40b7c6b Feb 25 15:57:19 devstack sudo[88464]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 25 15:57:19 devstack sudo[88463]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-21c8dfc2-8a66-4148-92c8-be83789f2e01 Feb 25 15:57:19 devstack sudo[88463]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 25 15:57:19 devstack cinder-volume[83528]: DEBUG cinder.volume.flows.manager.create_volume [None req-a63e3809-3639-46cd-8754-fb606b29b807 tempest-VolumesListTestJSON-11611395 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83528) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 25 15:57:19 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-a63e3809-3639-46cd-8754-fb606b29b807 tempest-VolumesListTestJSON-11611395 None] Flow 'volume_create_manager' (ff6946fa-3d29-4994-8bf5-9da9b08de352) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83528) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 25 15:57:19 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-a63e3809-3639-46cd-8754-fb606b29b807 tempest-VolumesListTestJSON-11611395 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a7b16573-4533-432e-8cb4-b4b9cd7d7357) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 25 15:57:19 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-a63e3809-3639-46cd-8754-fb606b29b807 tempest-VolumesListTestJSON-11611395 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a7b16573-4533-432e-8cb4-b4b9cd7d7357) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-25T14:57:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1660902198',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b27df5ed-9c92-47b0-a8d8-da37ea1f5667,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='09e01ab9bc494682ab1ec11fc5fec56f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-25T14:57:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-25T14:57:20Z,use_quota=True,user_id='85ffe75d4a064eab9c2691d918c06e71',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ce71c2f9-6543-4165-9653-a1529b2ea243),volume_type_id=ce71c2f9-6543-4165-9653-a1529b2ea243)' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 25 15:57:19 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-a63e3809-3639-46cd-8754-fb606b29b807 tempest-VolumesListTestJSON-11611395 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (809e7abd-dfac-4a5b-b9a8-910b94be4081) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 25 15:57:19 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-a63e3809-3639-46cd-8754-fb606b29b807 tempest-VolumesListTestJSON-11611395 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (809e7abd-dfac-4a5b-b9a8-910b94be4081) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 25 15:57:19 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-a63e3809-3639-46cd-8754-fb606b29b807 tempest-VolumesListTestJSON-11611395 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ce7f0675-6cf8-490c-b171-f8c528b18316) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 25 15:57:19 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-a63e3809-3639-46cd-8754-fb606b29b807 tempest-VolumesListTestJSON-11611395 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ce7f0675-6cf8-490c-b171-f8c528b18316) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b27df5ed-9c92-47b0-a8d8-da37ea1f5667', 'volume_name': 'volume-b27df5ed-9c92-47b0-a8d8-da37ea1f5667', 'volume_size': 1}' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 25 15:57:19 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-a63e3809-3639-46cd-8754-fb606b29b807 tempest-VolumesListTestJSON-11611395 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (87151600-8be5-45c1-9e62-624713300b50) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 25 15:57:19 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-a63e3809-3639-46cd-8754-fb606b29b807 tempest-VolumesListTestJSON-11611395 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (87151600-8be5-45c1-9e62-624713300b50) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 25 15:57:19 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-a63e3809-3639-46cd-8754-fb606b29b807 tempest-VolumesListTestJSON-11611395 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (16f6fc91-d851-4927-8f97-434c7c045271) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 25 15:57:19 devstack cinder-volume[83528]: INFO cinder.volume.flows.manager.create_volume [None req-a63e3809-3639-46cd-8754-fb606b29b807 tempest-VolumesListTestJSON-11611395 None] Volume b27df5ed-9c92-47b0-a8d8-da37ea1f5667: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b27df5ed-9c92-47b0-a8d8-da37ea1f5667', 'volume_size': 1} Feb 25 15:57:19 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-a63e3809-3639-46cd-8754-fb606b29b807 tempest-VolumesListTestJSON-11611395 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 25 15:57:19 devstack sudo[88463]: pam_unix(sudo:session): session closed for user root Feb 25 15:57:19 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-a63e3809-3639-46cd-8754-fb606b29b807 tempest-VolumesListTestJSON-11611395 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 25 15:57:19 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.quobyte [None req-a63e3809-3639-46cd-8754-fb606b29b807 tempest-VolumesListTestJSON-11611395 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-25T14:57:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1660902198',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b27df5ed-9c92-47b0-a8d8-da37ea1f5667,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='09e01ab9bc494682ab1ec11fc5fec56f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-25T14:57:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-25T14:57:20Z,use_quota=True,user_id='85ffe75d4a064eab9c2691d918c06e71',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ce71c2f9-6543-4165-9653-a1529b2ea243),volume_type_id=ce71c2f9-6543-4165-9653-a1529b2ea243)}" {{(pid=83528) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 25 15:57:19 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.remotefs [None req-a63e3809-3639-46cd-8754-fb606b29b807 tempest-VolumesListTestJSON-11611395 None] Creating volume b27df5ed-9c92-47b0-a8d8-da37ea1f5667 {{(pid=83528) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 25 15:57:19 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-a63e3809-3639-46cd-8754-fb606b29b807 tempest-VolumesListTestJSON-11611395 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 25 15:57:19 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-a63e3809-3639-46cd-8754-fb606b29b807 tempest-VolumesListTestJSON-11611395 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 25 15:57:19 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.quobyte [None req-a63e3809-3639-46cd-8754-fb606b29b807 tempest-VolumesListTestJSON-11611395 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23e9d725-3e04-4cd9-bfe0-c8ef43305589': None} {{(pid=83528) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 25 15:57:19 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.quobyte [None req-a63e3809-3639-46cd-8754-fb606b29b807 tempest-VolumesListTestJSON-11611395 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23e9d725-3e04-4cd9-bfe0-c8ef43305589'] {{(pid=83528) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 25 15:57:19 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-a63e3809-3639-46cd-8754-fb606b29b807 tempest-VolumesListTestJSON-11611395 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 25 15:57:19 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.quobyte [None req-a63e3809-3639-46cd-8754-fb606b29b807 tempest-VolumesListTestJSON-11611395 None] Selected osci02.corp.quobyte.com/cinder-vol-23e9d725-3e04-4cd9-bfe0-c8ef43305589 as target Quobyte volume. {{(pid=83528) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 25 15:57:19 devstack cinder-volume[83528]: INFO cinder.volume.drivers.remotefs [None req-a63e3809-3639-46cd-8754-fb606b29b807 tempest-VolumesListTestJSON-11611395 None] casted to osci02.corp.quobyte.com/cinder-vol-23e9d725-3e04-4cd9-bfe0-c8ef43305589 Feb 25 15:57:19 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-a63e3809-3639-46cd-8754-fb606b29b807 tempest-VolumesListTestJSON-11611395 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-b27df5ed-9c92-47b0-a8d8-da37ea1f5667 1073741824 {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 25 15:57:19 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-a5c682c9-e68d-4346-a7ab-71aec0892a55 tempest-SnapshotMetadataTestJSON-1314612421 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-21c8dfc2-8a66-4148-92c8-be83789f2e01" returned: 0 in 0.680s {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 25 15:57:19 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-a5c682c9-e68d-4346-a7ab-71aec0892a55 tempest-SnapshotMetadataTestJSON-1314612421 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-21c8dfc2-8a66-4148-92c8-be83789f2e01.996f8dc7-be53-4ed3-a78a-4da34567fb04 {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 25 15:57:19 devstack sudo[88474]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-21c8dfc2-8a66-4148-92c8-be83789f2e01.996f8dc7-be53-4ed3-a78a-4da34567fb04 Feb 25 15:57:19 devstack sudo[88474]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 25 15:57:19 devstack sudo[88473]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-b27df5ed-9c92-47b0-a8d8-da37ea1f5667 1073741824 Feb 25 15:57:19 devstack sudo[88473]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 25 15:57:19 devstack sudo[88464]: pam_unix(sudo:session): session closed for user root Feb 25 15:57:19 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-99f89b0b-99df-460a-8faa-a4c016ad1a5d tempest-VolumesDeleteCascade-1036059898 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-3c93b0b5-b14c-437d-969c-1ebf3dddc971.cddedbb9-d853-4e20-8db9-58a8e40b7c6b" returned: 0 in 0.733s {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 25 15:57:19 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-99f89b0b-99df-460a-8faa-a4c016ad1a5d tempest-VolumesDeleteCascade-1036059898 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-3c93b0b5-b14c-437d-969c-1ebf3dddc971.cddedbb9-d853-4e20-8db9-58a8e40b7c6b {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 25 15:57:19 devstack sudo[88477]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-3c93b0b5-b14c-437d-969c-1ebf3dddc971.cddedbb9-d853-4e20-8db9-58a8e40b7c6b Feb 25 15:57:19 devstack sudo[88477]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 25 15:57:20 devstack sudo[88474]: pam_unix(sudo:session): session closed for user root Feb 25 15:57:20 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-a5c682c9-e68d-4346-a7ab-71aec0892a55 tempest-SnapshotMetadataTestJSON-1314612421 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-21c8dfc2-8a66-4148-92c8-be83789f2e01.996f8dc7-be53-4ed3-a78a-4da34567fb04" returned: 0 in 0.677s {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 25 15:57:20 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-a5c682c9-e68d-4346-a7ab-71aec0892a55 tempest-SnapshotMetadataTestJSON-1314612421 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-21c8dfc2-8a66-4148-92c8-be83789f2e01.996f8dc7-be53-4ed3-a78a-4da34567fb04 {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 25 15:57:20 devstack sudo[88486]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-21c8dfc2-8a66-4148-92c8-be83789f2e01.996f8dc7-be53-4ed3-a78a-4da34567fb04 Feb 25 15:57:20 devstack sudo[88486]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 25 15:57:20 devstack sudo[88477]: pam_unix(sudo:session): session closed for user root Feb 25 15:57:20 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-99f89b0b-99df-460a-8faa-a4c016ad1a5d tempest-VolumesDeleteCascade-1036059898 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-3c93b0b5-b14c-437d-969c-1ebf3dddc971.cddedbb9-d853-4e20-8db9-58a8e40b7c6b" returned: 0 in 0.680s {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 25 15:57:20 devstack sudo[88473]: pam_unix(sudo:session): session closed for user root Feb 25 15:57:20 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-a63e3809-3639-46cd-8754-fb606b29b807 tempest-VolumesListTestJSON-11611395 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-b27df5ed-9c92-47b0-a8d8-da37ea1f5667 1073741824" returned: 0 in 0.778s {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 25 15:57:20 devstack cinder-volume[83528]: DEBUG cinder.coordination [None req-99f89b0b-99df-460a-8faa-a4c016ad1a5d tempest-VolumesDeleteCascade-1036059898 None] Lock "cinder-quobyte-cddedbb9-d853-4e20-8db9-58a8e40b7c6b" released by "_delete_snapshot" :: held 2.855s {{(pid=83528) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 25 15:57:20 devstack cinder-volume[83528]: DEBUG cinder.coordination [None req-99f89b0b-99df-460a-8faa-a4c016ad1a5d tempest-VolumesDeleteCascade-1036059898 None] Lock "cinder-quobyte-3c93b0b5-b14c-437d-969c-1ebf3dddc971" released by "delete_snapshot" :: held 2.873s {{(pid=83528) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 25 15:57:20 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-a63e3809-3639-46cd-8754-fb606b29b807 tempest-VolumesListTestJSON-11611395 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-b27df5ed-9c92-47b0-a8d8-da37ea1f5667 {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 25 15:57:20 devstack sudo[88488]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-b27df5ed-9c92-47b0-a8d8-da37ea1f5667 Feb 25 15:57:20 devstack sudo[88488]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 25 15:57:20 devstack cinder-volume[83528]: DEBUG cinder.quota [None req-99f89b0b-99df-460a-8faa-a4c016ad1a5d tempest-VolumesDeleteCascade-1036059898 None] Created reservations ['3184961e-d813-4c56-ab0e-601ec1fbade3', 'be6cf34a-3fc0-4a51-bee0-13819f8bce80', 'cbbdcee6-8b27-4917-841e-dbac4318871b', 'ed4a2dc5-0c16-416e-9adf-9f2d9559b00a'] {{(pid=83528) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 25 15:57:20 devstack cinder-volume[83528]: INFO cinder.volume.manager [None req-99f89b0b-99df-460a-8faa-a4c016ad1a5d tempest-VolumesDeleteCascade-1036059898 None] Delete snapshot completed successfully. Feb 25 15:57:20 devstack cinder-volume[83528]: DEBUG cinder.coordination [None req-99f89b0b-99df-460a-8faa-a4c016ad1a5d tempest-VolumesDeleteCascade-1036059898 None] Lock "cinder-cddedbb9-d853-4e20-8db9-58a8e40b7c6b-delete_snapshot" released by "delete_snapshot" :: held 3.073s {{(pid=83528) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 25 15:57:20 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-99f89b0b-99df-460a-8faa-a4c016ad1a5d tempest-VolumesDeleteCascade-1036059898 None] Snapshots deleted, issuing volume delete {{(pid=83528) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}} Feb 25 15:57:20 devstack cinder-volume[83528]: DEBUG cinder.coordination [None req-99f89b0b-99df-460a-8faa-a4c016ad1a5d tempest-VolumesDeleteCascade-1036059898 None] Acquiring lock "cinder-quobyte-3c93b0b5-b14c-437d-969c-1ebf3dddc971" by "delete_volume" {{(pid=83528) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 25 15:57:20 devstack cinder-volume[83528]: DEBUG cinder.coordination [None req-99f89b0b-99df-460a-8faa-a4c016ad1a5d tempest-VolumesDeleteCascade-1036059898 None] Lock "cinder-quobyte-3c93b0b5-b14c-437d-969c-1ebf3dddc971" acquired by "delete_volume" :: waited 0.010s {{(pid=83528) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 25 15:57:20 devstack cinder-volume[83528]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac159a63-cdd2-4251-a650-f95968cd7606]: (4, 'qcow2') {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 25 15:57:20 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-99f89b0b-99df-460a-8faa-a4c016ad1a5d tempest-VolumesDeleteCascade-1036059898 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-3c93b0b5-b14c-437d-969c-1ebf3dddc971 {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 25 15:57:20 devstack sudo[88490]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-3c93b0b5-b14c-437d-969c-1ebf3dddc971 Feb 25 15:57:20 devstack sudo[88490]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 25 15:57:21 devstack sudo[88488]: pam_unix(sudo:session): session closed for user root Feb 25 15:57:21 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-a63e3809-3639-46cd-8754-fb606b29b807 tempest-VolumesListTestJSON-11611395 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-b27df5ed-9c92-47b0-a8d8-da37ea1f5667" returned: 0 in 0.588s {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 25 15:57:21 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.quobyte [None req-a63e3809-3639-46cd-8754-fb606b29b807 tempest-VolumesListTestJSON-11611395 None] <== create_volume: return (1416ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-23e9d725-3e04-4cd9-bfe0-c8ef43305589'} {{(pid=83528) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 25 15:57:21 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-a63e3809-3639-46cd-8754-fb606b29b807 tempest-VolumesListTestJSON-11611395 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.419s {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 25 15:57:21 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-a63e3809-3639-46cd-8754-fb606b29b807 tempest-VolumesListTestJSON-11611395 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (16f6fc91-d851-4927-8f97-434c7c045271) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b27df5ed-9c92-47b0-a8d8-da37ea1f5667', 'volume_size': 1}' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 25 15:57:21 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-a63e3809-3639-46cd-8754-fb606b29b807 tempest-VolumesListTestJSON-11611395 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5f955c0d-be91-457d-9c21-58b84f29fbd5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 25 15:57:21 devstack cinder-volume[83528]: INFO cinder.volume.flows.manager.create_volume [None req-a63e3809-3639-46cd-8754-fb606b29b807 tempest-VolumesListTestJSON-11611395 None] Volume volume-b27df5ed-9c92-47b0-a8d8-da37ea1f5667 (b27df5ed-9c92-47b0-a8d8-da37ea1f5667): created successfully Feb 25 15:57:21 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-a63e3809-3639-46cd-8754-fb606b29b807 tempest-VolumesListTestJSON-11611395 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5f955c0d-be91-457d-9c21-58b84f29fbd5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 25 15:57:21 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-a63e3809-3639-46cd-8754-fb606b29b807 tempest-VolumesListTestJSON-11611395 None] Flow 'volume_create_manager' (ff6946fa-3d29-4994-8bf5-9da9b08de352) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83528) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 25 15:57:21 devstack sudo[88486]: pam_unix(sudo:session): session closed for user root Feb 25 15:57:21 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-a5c682c9-e68d-4346-a7ab-71aec0892a55 tempest-SnapshotMetadataTestJSON-1314612421 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-21c8dfc2-8a66-4148-92c8-be83789f2e01.996f8dc7-be53-4ed3-a78a-4da34567fb04" returned: 0 in 0.795s {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 25 15:57:21 devstack cinder-volume[83528]: INFO cinder.volume.manager [None req-a63e3809-3639-46cd-8754-fb606b29b807 tempest-VolumesListTestJSON-11611395 None] Created volume successfully. Feb 25 15:57:21 devstack cinder-volume[83528]: DEBUG cinder.coordination [None req-a5c682c9-e68d-4346-a7ab-71aec0892a55 tempest-SnapshotMetadataTestJSON-1314612421 None] Lock "cinder-quobyte-996f8dc7-be53-4ed3-a78a-4da34567fb04" released by "_delete_snapshot" :: held 2.849s {{(pid=83528) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 25 15:57:21 devstack cinder-volume[83528]: DEBUG cinder.coordination [None req-a5c682c9-e68d-4346-a7ab-71aec0892a55 tempest-SnapshotMetadataTestJSON-1314612421 None] Lock "cinder-quobyte-21c8dfc2-8a66-4148-92c8-be83789f2e01" released by "delete_snapshot" :: held 2.872s {{(pid=83528) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 25 15:57:21 devstack cinder-volume[83528]: DEBUG cinder.quota [None req-a5c682c9-e68d-4346-a7ab-71aec0892a55 tempest-SnapshotMetadataTestJSON-1314612421 None] Created reservations ['a9bbe54d-0030-4944-948b-cb2de713bbf4', 'f435bbe0-e025-46d8-94b3-e402d684103e', 'fcdd96a1-0161-4eb8-a9ee-29ae2021f607', 'e9b7c4f6-9544-44ec-9812-fe6f4f248a99'] {{(pid=83528) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 25 15:57:21 devstack cinder-volume[83528]: INFO cinder.volume.manager [None req-a5c682c9-e68d-4346-a7ab-71aec0892a55 tempest-SnapshotMetadataTestJSON-1314612421 None] Delete snapshot completed successfully. Feb 25 15:57:21 devstack cinder-volume[83528]: DEBUG cinder.coordination [None req-a5c682c9-e68d-4346-a7ab-71aec0892a55 tempest-SnapshotMetadataTestJSON-1314612421 None] Lock "cinder-996f8dc7-be53-4ed3-a78a-4da34567fb04-delete_snapshot" released by "delete_snapshot" :: held 2.997s {{(pid=83528) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 25 15:57:21 devstack sudo[88490]: pam_unix(sudo:session): session closed for user root Feb 25 15:57:21 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-99f89b0b-99df-460a-8faa-a4c016ad1a5d tempest-VolumesDeleteCascade-1036059898 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-3c93b0b5-b14c-437d-969c-1ebf3dddc971" returned: 0 in 0.751s {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 25 15:57:21 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-99f89b0b-99df-460a-8faa-a4c016ad1a5d tempest-VolumesDeleteCascade-1036059898 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-3c93b0b5-b14c-437d-969c-1ebf3dddc971 {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 25 15:57:21 devstack sudo[88498]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-3c93b0b5-b14c-437d-969c-1ebf3dddc971 Feb 25 15:57:21 devstack sudo[88498]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 25 15:57:21 devstack cinder-volume[83528]: DEBUG cinder.coordination [None req-8e87701e-a538-49dd-92b2-a2c163cf6d4c tempest-SnapshotMetadataTestJSON-1314612421 None] Acquiring lock "cinder-21c8dfc2-8a66-4148-92c8-be83789f2e01-delete_volume" by "delete_volume" {{(pid=83528) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 25 15:57:21 devstack cinder-volume[83528]: DEBUG cinder.coordination [None req-8e87701e-a538-49dd-92b2-a2c163cf6d4c tempest-SnapshotMetadataTestJSON-1314612421 None] Lock "cinder-21c8dfc2-8a66-4148-92c8-be83789f2e01-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=83528) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 25 15:57:21 devstack cinder-volume[83528]: DEBUG cinder.coordination [None req-8e87701e-a538-49dd-92b2-a2c163cf6d4c tempest-SnapshotMetadataTestJSON-1314612421 None] Acquiring lock "cinder-quobyte-21c8dfc2-8a66-4148-92c8-be83789f2e01" by "delete_volume" {{(pid=83528) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 25 15:57:21 devstack cinder-volume[83528]: DEBUG cinder.coordination [None req-8e87701e-a538-49dd-92b2-a2c163cf6d4c tempest-SnapshotMetadataTestJSON-1314612421 None] Lock "cinder-quobyte-21c8dfc2-8a66-4148-92c8-be83789f2e01" acquired by "delete_volume" :: waited 0.020s {{(pid=83528) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 25 15:57:21 devstack cinder-volume[83528]: DEBUG oslo.privsep.daemon [-] privsep: reply[2fe7732e-c497-40d2-bb63-802c80d53850]: (4, 'qcow2') {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 25 15:57:21 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-8e87701e-a538-49dd-92b2-a2c163cf6d4c tempest-SnapshotMetadataTestJSON-1314612421 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-21c8dfc2-8a66-4148-92c8-be83789f2e01 {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 25 15:57:21 devstack sudo[88500]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-21c8dfc2-8a66-4148-92c8-be83789f2e01 Feb 25 15:57:21 devstack sudo[88500]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 25 15:57:22 devstack sudo[88498]: pam_unix(sudo:session): session closed for user root Feb 25 15:57:22 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-99f89b0b-99df-460a-8faa-a4c016ad1a5d tempest-VolumesDeleteCascade-1036059898 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-3c93b0b5-b14c-437d-969c-1ebf3dddc971" returned: 0 in 0.639s {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 25 15:57:22 devstack cinder-volume[83528]: DEBUG cinder.coordination [None req-99f89b0b-99df-460a-8faa-a4c016ad1a5d tempest-VolumesDeleteCascade-1036059898 None] Lock "cinder-quobyte-3c93b0b5-b14c-437d-969c-1ebf3dddc971" released by "delete_volume" :: held 1.450s {{(pid=83528) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 25 15:57:22 devstack cinder-volume[83528]: DEBUG cinder.volume.flows.manager.create_volume [None req-be83f24b-8d42-4858-9846-92c6fdaf5917 tempest-VolumesListTestJSON-11611395 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83528) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 25 15:57:22 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-be83f24b-8d42-4858-9846-92c6fdaf5917 tempest-VolumesListTestJSON-11611395 None] Flow 'volume_create_manager' (3b1716ef-0aba-4d7b-908e-bd5dca29f59f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83528) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 25 15:57:22 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-be83f24b-8d42-4858-9846-92c6fdaf5917 tempest-VolumesListTestJSON-11611395 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d2e178cb-a9f7-4387-85f7-60f5c65e6146) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 25 15:57:22 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-be83f24b-8d42-4858-9846-92c6fdaf5917 tempest-VolumesListTestJSON-11611395 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d2e178cb-a9f7-4387-85f7-60f5c65e6146) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-25T14:57:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-43441146',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1d8c9606-cc67-42a2-a12d-02c657647074,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='09e01ab9bc494682ab1ec11fc5fec56f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-25T14:57:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-25T14:57:22Z,use_quota=True,user_id='85ffe75d4a064eab9c2691d918c06e71',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ce71c2f9-6543-4165-9653-a1529b2ea243),volume_type_id=ce71c2f9-6543-4165-9653-a1529b2ea243)' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 25 15:57:22 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-be83f24b-8d42-4858-9846-92c6fdaf5917 tempest-VolumesListTestJSON-11611395 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d96a50b5-e8cb-434d-88f8-4db5e2c5b993) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 25 15:57:22 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-be83f24b-8d42-4858-9846-92c6fdaf5917 tempest-VolumesListTestJSON-11611395 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d96a50b5-e8cb-434d-88f8-4db5e2c5b993) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 25 15:57:22 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-be83f24b-8d42-4858-9846-92c6fdaf5917 tempest-VolumesListTestJSON-11611395 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5bb7bb45-c6bb-4f3b-bf3a-e39dedbba728) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 25 15:57:22 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-be83f24b-8d42-4858-9846-92c6fdaf5917 tempest-VolumesListTestJSON-11611395 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5bb7bb45-c6bb-4f3b-bf3a-e39dedbba728) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1d8c9606-cc67-42a2-a12d-02c657647074', 'volume_name': 'volume-1d8c9606-cc67-42a2-a12d-02c657647074', 'volume_size': 1}' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 25 15:57:22 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-be83f24b-8d42-4858-9846-92c6fdaf5917 tempest-VolumesListTestJSON-11611395 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (abcde2dd-8842-4313-9ed3-cb68a874133d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 25 15:57:22 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-be83f24b-8d42-4858-9846-92c6fdaf5917 tempest-VolumesListTestJSON-11611395 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (abcde2dd-8842-4313-9ed3-cb68a874133d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 25 15:57:22 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-be83f24b-8d42-4858-9846-92c6fdaf5917 tempest-VolumesListTestJSON-11611395 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1e21916d-bb00-4937-bdeb-733b0854d23b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 25 15:57:22 devstack cinder-volume[83528]: INFO cinder.volume.flows.manager.create_volume [None req-be83f24b-8d42-4858-9846-92c6fdaf5917 tempest-VolumesListTestJSON-11611395 None] Volume 1d8c9606-cc67-42a2-a12d-02c657647074: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1d8c9606-cc67-42a2-a12d-02c657647074', 'volume_size': 1} Feb 25 15:57:22 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-be83f24b-8d42-4858-9846-92c6fdaf5917 tempest-VolumesListTestJSON-11611395 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 25 15:57:22 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-be83f24b-8d42-4858-9846-92c6fdaf5917 tempest-VolumesListTestJSON-11611395 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 25 15:57:22 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.quobyte [None req-be83f24b-8d42-4858-9846-92c6fdaf5917 tempest-VolumesListTestJSON-11611395 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-25T14:57:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-43441146',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1d8c9606-cc67-42a2-a12d-02c657647074,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='09e01ab9bc494682ab1ec11fc5fec56f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-25T14:57:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-25T14:57:22Z,use_quota=True,user_id='85ffe75d4a064eab9c2691d918c06e71',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ce71c2f9-6543-4165-9653-a1529b2ea243),volume_type_id=ce71c2f9-6543-4165-9653-a1529b2ea243)}" {{(pid=83528) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 25 15:57:22 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.remotefs [None req-be83f24b-8d42-4858-9846-92c6fdaf5917 tempest-VolumesListTestJSON-11611395 None] Creating volume 1d8c9606-cc67-42a2-a12d-02c657647074 {{(pid=83528) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 25 15:57:22 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-be83f24b-8d42-4858-9846-92c6fdaf5917 tempest-VolumesListTestJSON-11611395 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 25 15:57:22 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-be83f24b-8d42-4858-9846-92c6fdaf5917 tempest-VolumesListTestJSON-11611395 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 25 15:57:22 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.quobyte [None req-be83f24b-8d42-4858-9846-92c6fdaf5917 tempest-VolumesListTestJSON-11611395 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23e9d725-3e04-4cd9-bfe0-c8ef43305589': None} {{(pid=83528) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 25 15:57:22 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.quobyte [None req-be83f24b-8d42-4858-9846-92c6fdaf5917 tempest-VolumesListTestJSON-11611395 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23e9d725-3e04-4cd9-bfe0-c8ef43305589'] {{(pid=83528) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 25 15:57:22 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-be83f24b-8d42-4858-9846-92c6fdaf5917 tempest-VolumesListTestJSON-11611395 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 25 15:57:22 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.quobyte [None req-be83f24b-8d42-4858-9846-92c6fdaf5917 tempest-VolumesListTestJSON-11611395 None] Selected osci02.corp.quobyte.com/cinder-vol-23e9d725-3e04-4cd9-bfe0-c8ef43305589 as target Quobyte volume. {{(pid=83528) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 25 15:57:22 devstack cinder-volume[83528]: INFO cinder.volume.drivers.remotefs [None req-be83f24b-8d42-4858-9846-92c6fdaf5917 tempest-VolumesListTestJSON-11611395 None] casted to osci02.corp.quobyte.com/cinder-vol-23e9d725-3e04-4cd9-bfe0-c8ef43305589 Feb 25 15:57:22 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-be83f24b-8d42-4858-9846-92c6fdaf5917 tempest-VolumesListTestJSON-11611395 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-1d8c9606-cc67-42a2-a12d-02c657647074 1073741824 {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 25 15:57:22 devstack cinder-volume[83528]: DEBUG cinder.quota [None req-99f89b0b-99df-460a-8faa-a4c016ad1a5d tempest-VolumesDeleteCascade-1036059898 None] Created reservations ['7c2f00cd-f668-4f32-b157-dc1e7ff18ae7', '52edfd36-c5da-4d6c-b4f0-0b9d50fdef6a', 'a60dd6ad-d291-4147-9b6e-727b53a3c33a', 'efabd51d-b974-47e3-b903-4386fc5e85b9'] {{(pid=83528) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 25 15:57:22 devstack sudo[88503]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-1d8c9606-cc67-42a2-a12d-02c657647074 1073741824 Feb 25 15:57:22 devstack sudo[88503]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 25 15:57:22 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-99f89b0b-99df-460a-8faa-a4c016ad1a5d tempest-VolumesDeleteCascade-1036059898 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 25 15:57:22 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-99f89b0b-99df-460a-8faa-a4c016ad1a5d tempest-VolumesDeleteCascade-1036059898 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 25 15:57:22 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.quobyte [None req-99f89b0b-99df-460a-8faa-a4c016ad1a5d tempest-VolumesDeleteCascade-1036059898 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23e9d725-3e04-4cd9-bfe0-c8ef43305589': None} {{(pid=83528) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 25 15:57:22 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.quobyte [None req-99f89b0b-99df-460a-8faa-a4c016ad1a5d tempest-VolumesDeleteCascade-1036059898 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23e9d725-3e04-4cd9-bfe0-c8ef43305589'] {{(pid=83528) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 25 15:57:22 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-99f89b0b-99df-460a-8faa-a4c016ad1a5d tempest-VolumesDeleteCascade-1036059898 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 25 15:57:22 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-99f89b0b-99df-460a-8faa-a4c016ad1a5d tempest-VolumesDeleteCascade-1036059898 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85 {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 25 15:57:22 devstack sudo[88508]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85 Feb 25 15:57:22 devstack sudo[88508]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 25 15:57:22 devstack sudo[88500]: pam_unix(sudo:session): session closed for user root Feb 25 15:57:22 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-8e87701e-a538-49dd-92b2-a2c163cf6d4c tempest-SnapshotMetadataTestJSON-1314612421 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-21c8dfc2-8a66-4148-92c8-be83789f2e01" returned: 0 in 0.769s {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 25 15:57:22 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-8e87701e-a538-49dd-92b2-a2c163cf6d4c tempest-SnapshotMetadataTestJSON-1314612421 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-21c8dfc2-8a66-4148-92c8-be83789f2e01 {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 25 15:57:22 devstack sudo[88510]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-21c8dfc2-8a66-4148-92c8-be83789f2e01 Feb 25 15:57:22 devstack sudo[88510]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 25 15:57:23 devstack cinder-volume[83528]: DEBUG cinder.volume.flows.manager.create_volume [None req-1ba4e8c9-492d-4176-8378-029cb4ceeefb tempest-VolumesDeleteCascade-1036059898 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83528) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 25 15:57:23 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-1ba4e8c9-492d-4176-8378-029cb4ceeefb tempest-VolumesDeleteCascade-1036059898 None] Flow 'volume_create_manager' (94a0b3c5-b27a-4726-b6ae-7f9d0abdec13) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83528) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 25 15:57:23 devstack sudo[88503]: pam_unix(sudo:session): session closed for user root Feb 25 15:57:23 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-1ba4e8c9-492d-4176-8378-029cb4ceeefb tempest-VolumesDeleteCascade-1036059898 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a3fd491b-a3b9-40d4-8614-9452d2e2a192) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 25 15:57:23 devstack sudo[88508]: pam_unix(sudo:session): session closed for user root Feb 25 15:57:23 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-1ba4e8c9-492d-4176-8378-029cb4ceeefb tempest-VolumesDeleteCascade-1036059898 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a3fd491b-a3b9-40d4-8614-9452d2e2a192) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-25T14:57:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-715644766',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7b3ec993-062b-49bc-8f15-f2e125115130,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f8464253780144d49cfe3aa5fc80be50',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-25T14:57:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-25T14:57:23Z,use_quota=True,user_id='a4405dce3ee9409e92ab33348e52bb5c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ce71c2f9-6543-4165-9653-a1529b2ea243),volume_type_id=ce71c2f9-6543-4165-9653-a1529b2ea243)' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 25 15:57:23 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-1ba4e8c9-492d-4176-8378-029cb4ceeefb tempest-VolumesDeleteCascade-1036059898 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (914214d3-9bb3-4e4f-996b-faad90efc252) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 25 15:57:23 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-1ba4e8c9-492d-4176-8378-029cb4ceeefb tempest-VolumesDeleteCascade-1036059898 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (914214d3-9bb3-4e4f-996b-faad90efc252) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 25 15:57:23 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-1ba4e8c9-492d-4176-8378-029cb4ceeefb tempest-VolumesDeleteCascade-1036059898 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4e1ec5fe-96a0-4f83-91a4-08c655c4f0ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 25 15:57:23 devstack sudo[88510]: pam_unix(sudo:session): session closed for user root Feb 25 15:57:23 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-1ba4e8c9-492d-4176-8378-029cb4ceeefb tempest-VolumesDeleteCascade-1036059898 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4e1ec5fe-96a0-4f83-91a4-08c655c4f0ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7b3ec993-062b-49bc-8f15-f2e125115130', 'volume_name': 'volume-7b3ec993-062b-49bc-8f15-f2e125115130', 'volume_size': 1}' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 25 15:57:23 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-1ba4e8c9-492d-4176-8378-029cb4ceeefb tempest-VolumesDeleteCascade-1036059898 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e89e1c05-786a-4c0e-bbf6-bd90b1713a13) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 25 15:57:23 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-1ba4e8c9-492d-4176-8378-029cb4ceeefb tempest-VolumesDeleteCascade-1036059898 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e89e1c05-786a-4c0e-bbf6-bd90b1713a13) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 25 15:57:23 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-1ba4e8c9-492d-4176-8378-029cb4ceeefb tempest-VolumesDeleteCascade-1036059898 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8ec71518-c049-48c2-b552-2cb36fa4f5ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 25 15:57:23 devstack cinder-volume[83528]: INFO cinder.volume.flows.manager.create_volume [None req-1ba4e8c9-492d-4176-8378-029cb4ceeefb tempest-VolumesDeleteCascade-1036059898 None] Volume 7b3ec993-062b-49bc-8f15-f2e125115130: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7b3ec993-062b-49bc-8f15-f2e125115130', 'volume_size': 1} Feb 25 15:57:23 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-1ba4e8c9-492d-4176-8378-029cb4ceeefb tempest-VolumesDeleteCascade-1036059898 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 25 15:57:23 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-be83f24b-8d42-4858-9846-92c6fdaf5917 tempest-VolumesListTestJSON-11611395 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-1d8c9606-cc67-42a2-a12d-02c657647074 1073741824" returned: 0 in 0.930s {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 25 15:57:23 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-99f89b0b-99df-460a-8faa-a4c016ad1a5d tempest-VolumesDeleteCascade-1036059898 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85" returned: 0 in 0.844s {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 25 15:57:23 devstack cinder-volume[83528]: DEBUG cinder.manager [None req-99f89b0b-99df-460a-8faa-a4c016ad1a5d tempest-VolumesDeleteCascade-1036059898 None] Notifying Schedulers of capabilities ... {{(pid=83528) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 25 15:57:23 devstack cinder-volume[83528]: INFO cinder.volume.manager [None req-99f89b0b-99df-460a-8faa-a4c016ad1a5d tempest-VolumesDeleteCascade-1036059898 None] Deleted volume successfully. Feb 25 15:57:23 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-8e87701e-a538-49dd-92b2-a2c163cf6d4c tempest-SnapshotMetadataTestJSON-1314612421 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-21c8dfc2-8a66-4148-92c8-be83789f2e01" returned: 0 in 0.741s {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 25 15:57:23 devstack cinder-volume[83528]: DEBUG cinder.coordination [None req-8e87701e-a538-49dd-92b2-a2c163cf6d4c tempest-SnapshotMetadataTestJSON-1314612421 None] Lock "cinder-quobyte-21c8dfc2-8a66-4148-92c8-be83789f2e01" released by "delete_volume" :: held 1.591s {{(pid=83528) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 25 15:57:23 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-be83f24b-8d42-4858-9846-92c6fdaf5917 tempest-VolumesListTestJSON-11611395 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-1d8c9606-cc67-42a2-a12d-02c657647074 {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 25 15:57:23 devstack cinder-volume[83528]: DEBUG cinder.coordination [None req-99f89b0b-99df-460a-8faa-a4c016ad1a5d tempest-VolumesDeleteCascade-1036059898 None] Lock "cinder-3c93b0b5-b14c-437d-969c-1ebf3dddc971-delete_volume" released by "delete_volume" :: held 8.359s {{(pid=83528) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 25 15:57:23 devstack sudo[88517]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-1d8c9606-cc67-42a2-a12d-02c657647074 Feb 25 15:57:23 devstack sudo[88517]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 25 15:57:23 devstack cinder-volume[83528]: DEBUG cinder.quota [None req-8e87701e-a538-49dd-92b2-a2c163cf6d4c tempest-SnapshotMetadataTestJSON-1314612421 None] Created reservations ['2d1cbddd-cd64-4969-a565-b457812b1e62', '5bdb3515-6841-40dc-bc99-e35d6f89fadc', '8ef7b62a-6860-4842-b510-a4ef741360ac', '96a7ca95-1bd1-40ba-bad7-23252e48f0e5'] {{(pid=83528) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 25 15:57:23 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-8e87701e-a538-49dd-92b2-a2c163cf6d4c tempest-SnapshotMetadataTestJSON-1314612421 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 25 15:57:23 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-8e87701e-a538-49dd-92b2-a2c163cf6d4c tempest-SnapshotMetadataTestJSON-1314612421 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 25 15:57:23 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.quobyte [None req-8e87701e-a538-49dd-92b2-a2c163cf6d4c tempest-SnapshotMetadataTestJSON-1314612421 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23e9d725-3e04-4cd9-bfe0-c8ef43305589': None} {{(pid=83528) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 25 15:57:23 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.quobyte [None req-8e87701e-a538-49dd-92b2-a2c163cf6d4c tempest-SnapshotMetadataTestJSON-1314612421 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23e9d725-3e04-4cd9-bfe0-c8ef43305589'] {{(pid=83528) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 25 15:57:23 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-8e87701e-a538-49dd-92b2-a2c163cf6d4c tempest-SnapshotMetadataTestJSON-1314612421 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 25 15:57:23 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-8e87701e-a538-49dd-92b2-a2c163cf6d4c tempest-SnapshotMetadataTestJSON-1314612421 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85 {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 25 15:57:23 devstack sudo[88519]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85 Feb 25 15:57:23 devstack sudo[88519]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 25 15:57:23 devstack sudo[88517]: pam_unix(sudo:session): session closed for user root Feb 25 15:57:23 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-be83f24b-8d42-4858-9846-92c6fdaf5917 tempest-VolumesListTestJSON-11611395 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-1d8c9606-cc67-42a2-a12d-02c657647074" returned: 0 in 0.534s {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 25 15:57:23 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.quobyte [None req-be83f24b-8d42-4858-9846-92c6fdaf5917 tempest-VolumesListTestJSON-11611395 None] <== create_volume: return (1526ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-23e9d725-3e04-4cd9-bfe0-c8ef43305589'} {{(pid=83528) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 25 15:57:23 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-be83f24b-8d42-4858-9846-92c6fdaf5917 tempest-VolumesListTestJSON-11611395 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.528s {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 25 15:57:23 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-1ba4e8c9-492d-4176-8378-029cb4ceeefb tempest-VolumesDeleteCascade-1036059898 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.596s {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 25 15:57:23 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.quobyte [None req-1ba4e8c9-492d-4176-8378-029cb4ceeefb tempest-VolumesDeleteCascade-1036059898 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-25T14:57:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-715644766',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7b3ec993-062b-49bc-8f15-f2e125115130,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f8464253780144d49cfe3aa5fc80be50',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-25T14:57:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-25T14:57:23Z,use_quota=True,user_id='a4405dce3ee9409e92ab33348e52bb5c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ce71c2f9-6543-4165-9653-a1529b2ea243),volume_type_id=ce71c2f9-6543-4165-9653-a1529b2ea243)}" {{(pid=83528) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 25 15:57:23 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.remotefs [None req-1ba4e8c9-492d-4176-8378-029cb4ceeefb tempest-VolumesDeleteCascade-1036059898 None] Creating volume 7b3ec993-062b-49bc-8f15-f2e125115130 {{(pid=83528) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 25 15:57:23 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-1ba4e8c9-492d-4176-8378-029cb4ceeefb tempest-VolumesDeleteCascade-1036059898 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 25 15:57:23 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-1ba4e8c9-492d-4176-8378-029cb4ceeefb tempest-VolumesDeleteCascade-1036059898 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 25 15:57:23 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.quobyte [None req-1ba4e8c9-492d-4176-8378-029cb4ceeefb tempest-VolumesDeleteCascade-1036059898 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23e9d725-3e04-4cd9-bfe0-c8ef43305589': None} {{(pid=83528) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 25 15:57:23 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.quobyte [None req-1ba4e8c9-492d-4176-8378-029cb4ceeefb tempest-VolumesDeleteCascade-1036059898 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23e9d725-3e04-4cd9-bfe0-c8ef43305589'] {{(pid=83528) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 25 15:57:23 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-1ba4e8c9-492d-4176-8378-029cb4ceeefb tempest-VolumesDeleteCascade-1036059898 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 25 15:57:23 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.quobyte [None req-1ba4e8c9-492d-4176-8378-029cb4ceeefb tempest-VolumesDeleteCascade-1036059898 None] Selected osci02.corp.quobyte.com/cinder-vol-23e9d725-3e04-4cd9-bfe0-c8ef43305589 as target Quobyte volume. {{(pid=83528) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 25 15:57:23 devstack cinder-volume[83528]: INFO cinder.volume.drivers.remotefs [None req-1ba4e8c9-492d-4176-8378-029cb4ceeefb tempest-VolumesDeleteCascade-1036059898 None] casted to osci02.corp.quobyte.com/cinder-vol-23e9d725-3e04-4cd9-bfe0-c8ef43305589 Feb 25 15:57:23 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-1ba4e8c9-492d-4176-8378-029cb4ceeefb tempest-VolumesDeleteCascade-1036059898 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-7b3ec993-062b-49bc-8f15-f2e125115130 1073741824 {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 25 15:57:23 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-be83f24b-8d42-4858-9846-92c6fdaf5917 tempest-VolumesListTestJSON-11611395 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1e21916d-bb00-4937-bdeb-733b0854d23b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1d8c9606-cc67-42a2-a12d-02c657647074', 'volume_size': 1}' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 25 15:57:23 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-be83f24b-8d42-4858-9846-92c6fdaf5917 tempest-VolumesListTestJSON-11611395 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (af6e17bf-71ba-448c-adb0-8bec2f7403a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 25 15:57:23 devstack cinder-volume[83528]: INFO cinder.volume.flows.manager.create_volume [None req-be83f24b-8d42-4858-9846-92c6fdaf5917 tempest-VolumesListTestJSON-11611395 None] Volume volume-1d8c9606-cc67-42a2-a12d-02c657647074 (1d8c9606-cc67-42a2-a12d-02c657647074): created successfully Feb 25 15:57:23 devstack sudo[88523]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-7b3ec993-062b-49bc-8f15-f2e125115130 1073741824 Feb 25 15:57:23 devstack sudo[88523]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 25 15:57:23 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-be83f24b-8d42-4858-9846-92c6fdaf5917 tempest-VolumesListTestJSON-11611395 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (af6e17bf-71ba-448c-adb0-8bec2f7403a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 25 15:57:23 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-be83f24b-8d42-4858-9846-92c6fdaf5917 tempest-VolumesListTestJSON-11611395 None] Flow 'volume_create_manager' (3b1716ef-0aba-4d7b-908e-bd5dca29f59f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83528) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 25 15:57:24 devstack cinder-volume[83528]: INFO cinder.volume.manager [None req-be83f24b-8d42-4858-9846-92c6fdaf5917 tempest-VolumesListTestJSON-11611395 None] Created volume successfully. Feb 25 15:57:24 devstack sudo[88519]: pam_unix(sudo:session): session closed for user root Feb 25 15:57:24 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-8e87701e-a538-49dd-92b2-a2c163cf6d4c tempest-SnapshotMetadataTestJSON-1314612421 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85" returned: 0 in 0.565s {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 25 15:57:24 devstack cinder-volume[83528]: DEBUG cinder.manager [None req-8e87701e-a538-49dd-92b2-a2c163cf6d4c tempest-SnapshotMetadataTestJSON-1314612421 None] Notifying Schedulers of capabilities ... {{(pid=83528) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 25 15:57:24 devstack cinder-volume[83528]: INFO cinder.volume.manager [None req-8e87701e-a538-49dd-92b2-a2c163cf6d4c tempest-SnapshotMetadataTestJSON-1314612421 None] Deleted volume successfully. Feb 25 15:57:24 devstack cinder-volume[83528]: DEBUG cinder.coordination [None req-8e87701e-a538-49dd-92b2-a2c163cf6d4c tempest-SnapshotMetadataTestJSON-1314612421 None] Lock "cinder-21c8dfc2-8a66-4148-92c8-be83789f2e01-delete_volume" released by "delete_volume" :: held 2.395s {{(pid=83528) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 25 15:57:24 devstack sudo[88523]: pam_unix(sudo:session): session closed for user root Feb 25 15:57:24 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-1ba4e8c9-492d-4176-8378-029cb4ceeefb tempest-VolumesDeleteCascade-1036059898 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-7b3ec993-062b-49bc-8f15-f2e125115130 1073741824" returned: 0 in 0.747s {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 25 15:57:24 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-1ba4e8c9-492d-4176-8378-029cb4ceeefb tempest-VolumesDeleteCascade-1036059898 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-7b3ec993-062b-49bc-8f15-f2e125115130 {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 25 15:57:24 devstack sudo[88529]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-7b3ec993-062b-49bc-8f15-f2e125115130 Feb 25 15:57:24 devstack sudo[88529]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 25 15:57:25 devstack sudo[88529]: pam_unix(sudo:session): session closed for user root Feb 25 15:57:25 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-1ba4e8c9-492d-4176-8378-029cb4ceeefb tempest-VolumesDeleteCascade-1036059898 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-7b3ec993-062b-49bc-8f15-f2e125115130" returned: 0 in 0.556s {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 25 15:57:25 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.quobyte [None req-1ba4e8c9-492d-4176-8378-029cb4ceeefb tempest-VolumesDeleteCascade-1036059898 None] <== create_volume: return (1337ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-23e9d725-3e04-4cd9-bfe0-c8ef43305589'} {{(pid=83528) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 25 15:57:25 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-1ba4e8c9-492d-4176-8378-029cb4ceeefb tempest-VolumesDeleteCascade-1036059898 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.342s {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 25 15:57:25 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-1ba4e8c9-492d-4176-8378-029cb4ceeefb tempest-VolumesDeleteCascade-1036059898 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8ec71518-c049-48c2-b552-2cb36fa4f5ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7b3ec993-062b-49bc-8f15-f2e125115130', 'volume_size': 1}' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 25 15:57:25 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-1ba4e8c9-492d-4176-8378-029cb4ceeefb tempest-VolumesDeleteCascade-1036059898 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (36c0fbef-4ddd-4a96-818b-d05cd61ecd11) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 25 15:57:25 devstack cinder-volume[83528]: INFO cinder.volume.flows.manager.create_volume [None req-1ba4e8c9-492d-4176-8378-029cb4ceeefb tempest-VolumesDeleteCascade-1036059898 None] Volume volume-7b3ec993-062b-49bc-8f15-f2e125115130 (7b3ec993-062b-49bc-8f15-f2e125115130): created successfully Feb 25 15:57:25 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-1ba4e8c9-492d-4176-8378-029cb4ceeefb tempest-VolumesDeleteCascade-1036059898 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (36c0fbef-4ddd-4a96-818b-d05cd61ecd11) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 25 15:57:25 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-1ba4e8c9-492d-4176-8378-029cb4ceeefb tempest-VolumesDeleteCascade-1036059898 None] Flow 'volume_create_manager' (94a0b3c5-b27a-4726-b6ae-7f9d0abdec13) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83528) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 25 15:57:25 devstack cinder-volume[83528]: INFO cinder.volume.manager [None req-1ba4e8c9-492d-4176-8378-029cb4ceeefb tempest-VolumesDeleteCascade-1036059898 None] Created volume successfully. Feb 25 15:57:25 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-5c810954-cd14-4127-abb4-3322a1210e68 tempest-VolumesDeleteCascade-1036059898 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 25 15:57:25 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-5c810954-cd14-4127-abb4-3322a1210e68 tempest-VolumesDeleteCascade-1036059898 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 25 15:57:25 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.remotefs [None req-5c810954-cd14-4127-abb4-3322a1210e68 tempest-VolumesDeleteCascade-1036059898 None] Creating offline snapshot d40a2f08-5338-4bb3-bd39-8d875d45c585 of volume 7b3ec993-062b-49bc-8f15-f2e125115130 {{(pid=83528) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Feb 25 15:57:25 devstack cinder-volume[83528]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0162e0e-9e62-4084-a977-70c1b1ba49e3]: (4, 'qcow2') {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 25 15:57:25 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-5c810954-cd14-4127-abb4-3322a1210e68 tempest-VolumesDeleteCascade-1036059898 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-7b3ec993-062b-49bc-8f15-f2e125115130 {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 25 15:57:25 devstack sudo[88532]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-7b3ec993-062b-49bc-8f15-f2e125115130 Feb 25 15:57:25 devstack sudo[88532]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 25 15:57:26 devstack cinder-volume[83528]: DEBUG cinder.volume.flows.manager.create_volume [None req-532f42ec-8978-4441-989a-6d9df5090256 tempest-VolumesGetTest-958147190 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83528) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 25 15:57:26 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-532f42ec-8978-4441-989a-6d9df5090256 tempest-VolumesGetTest-958147190 None] Flow 'volume_create_manager' (ee1bce2b-5911-499a-a59b-a86daee0f621) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83528) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 25 15:57:26 devstack sudo[88532]: pam_unix(sudo:session): session closed for user root Feb 25 15:57:26 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-532f42ec-8978-4441-989a-6d9df5090256 tempest-VolumesGetTest-958147190 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4c7e1c83-52ec-4c35-beee-e32c36bbc7c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 25 15:57:26 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-5c810954-cd14-4127-abb4-3322a1210e68 tempest-VolumesDeleteCascade-1036059898 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-7b3ec993-062b-49bc-8f15-f2e125115130" returned: 0 in 0.668s {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 25 15:57:26 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-5c810954-cd14-4127-abb4-3322a1210e68 tempest-VolumesDeleteCascade-1036059898 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-7b3ec993-062b-49bc-8f15-f2e125115130,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-7b3ec993-062b-49bc-8f15-f2e125115130.d40a2f08-5338-4bb3-bd39-8d875d45c585 1G {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 25 15:57:26 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-532f42ec-8978-4441-989a-6d9df5090256 tempest-VolumesGetTest-958147190 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4c7e1c83-52ec-4c35-beee-e32c36bbc7c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-25T14:57:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1343514951',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cc95ece6-e94f-470e-bf90-21b6c707a9d4,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='30b56c3cb9b44b44bc932bfa91495865',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-25T14:57:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-25T14:57:26Z,use_quota=True,user_id='e09e6f803ddf47f09c166c46461b2f9a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ce71c2f9-6543-4165-9653-a1529b2ea243),volume_type_id=ce71c2f9-6543-4165-9653-a1529b2ea243)' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 25 15:57:26 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-532f42ec-8978-4441-989a-6d9df5090256 tempest-VolumesGetTest-958147190 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a53c6657-d888-4f38-b4db-45eab36ce0c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 25 15:57:26 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-532f42ec-8978-4441-989a-6d9df5090256 tempest-VolumesGetTest-958147190 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a53c6657-d888-4f38-b4db-45eab36ce0c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 25 15:57:26 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-532f42ec-8978-4441-989a-6d9df5090256 tempest-VolumesGetTest-958147190 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (052ba751-b528-44c9-a926-280fdd024a0e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 25 15:57:26 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-532f42ec-8978-4441-989a-6d9df5090256 tempest-VolumesGetTest-958147190 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (052ba751-b528-44c9-a926-280fdd024a0e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cc95ece6-e94f-470e-bf90-21b6c707a9d4', 'volume_name': 'volume-cc95ece6-e94f-470e-bf90-21b6c707a9d4', 'volume_size': 1}' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 25 15:57:26 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-532f42ec-8978-4441-989a-6d9df5090256 tempest-VolumesGetTest-958147190 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (279f2512-20c5-40e6-96f2-8ca2bb80af09) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 25 15:57:26 devstack sudo[88537]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-7b3ec993-062b-49bc-8f15-f2e125115130,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-7b3ec993-062b-49bc-8f15-f2e125115130.d40a2f08-5338-4bb3-bd39-8d875d45c585 1G Feb 25 15:57:26 devstack sudo[88537]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 25 15:57:26 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-532f42ec-8978-4441-989a-6d9df5090256 tempest-VolumesGetTest-958147190 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (279f2512-20c5-40e6-96f2-8ca2bb80af09) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 25 15:57:26 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-532f42ec-8978-4441-989a-6d9df5090256 tempest-VolumesGetTest-958147190 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ce6d9e87-c917-46d1-84d0-3af0f0d0e4d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 25 15:57:26 devstack cinder-volume[83528]: INFO cinder.volume.flows.manager.create_volume [None req-532f42ec-8978-4441-989a-6d9df5090256 tempest-VolumesGetTest-958147190 None] Volume cc95ece6-e94f-470e-bf90-21b6c707a9d4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cc95ece6-e94f-470e-bf90-21b6c707a9d4', 'volume_size': 1} Feb 25 15:57:26 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-532f42ec-8978-4441-989a-6d9df5090256 tempest-VolumesGetTest-958147190 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 25 15:57:26 devstack cinder-volume[83528]: DEBUG cinder.coordination [None req-999a4434-73f4-4333-9def-44acc5936ec9 tempest-VolumesListTestJSON-11611395 None] Acquiring lock "cinder-1d8c9606-cc67-42a2-a12d-02c657647074-delete_volume" by "delete_volume" {{(pid=83528) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 25 15:57:26 devstack cinder-volume[83528]: DEBUG cinder.coordination [None req-999a4434-73f4-4333-9def-44acc5936ec9 tempest-VolumesListTestJSON-11611395 None] Lock "cinder-1d8c9606-cc67-42a2-a12d-02c657647074-delete_volume" acquired by "delete_volume" :: waited 0.012s {{(pid=83528) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 25 15:57:26 devstack cinder-volume[83528]: DEBUG cinder.coordination [None req-999a4434-73f4-4333-9def-44acc5936ec9 tempest-VolumesListTestJSON-11611395 None] Acquiring lock "cinder-quobyte-1d8c9606-cc67-42a2-a12d-02c657647074" by "delete_volume" {{(pid=83528) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 25 15:57:26 devstack cinder-volume[83528]: DEBUG cinder.coordination [None req-999a4434-73f4-4333-9def-44acc5936ec9 tempest-VolumesListTestJSON-11611395 None] Lock "cinder-quobyte-1d8c9606-cc67-42a2-a12d-02c657647074" acquired by "delete_volume" :: waited 0.020s {{(pid=83528) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 25 15:57:26 devstack cinder-volume[83528]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ff9f88f-91b3-4243-a755-55d2cc5ffd32]: (4, 'qcow2') {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 25 15:57:26 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-999a4434-73f4-4333-9def-44acc5936ec9 tempest-VolumesListTestJSON-11611395 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-1d8c9606-cc67-42a2-a12d-02c657647074 {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 25 15:57:26 devstack sudo[88539]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-1d8c9606-cc67-42a2-a12d-02c657647074 Feb 25 15:57:26 devstack sudo[88539]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 25 15:57:27 devstack sudo[88537]: pam_unix(sudo:session): session closed for user root Feb 25 15:57:27 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-5c810954-cd14-4127-abb4-3322a1210e68 tempest-VolumesDeleteCascade-1036059898 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-7b3ec993-062b-49bc-8f15-f2e125115130,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-7b3ec993-062b-49bc-8f15-f2e125115130.d40a2f08-5338-4bb3-bd39-8d875d45c585 1G" returned: 0 in 0.675s {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 25 15:57:27 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-5c810954-cd14-4127-abb4-3322a1210e68 tempest-VolumesDeleteCascade-1036059898 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7b3ec993-062b-49bc-8f15-f2e125115130 -F qcow2 /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-7b3ec993-062b-49bc-8f15-f2e125115130.d40a2f08-5338-4bb3-bd39-8d875d45c585 {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 25 15:57:27 devstack sudo[88544]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7b3ec993-062b-49bc-8f15-f2e125115130 -F qcow2 /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-7b3ec993-062b-49bc-8f15-f2e125115130.d40a2f08-5338-4bb3-bd39-8d875d45c585 Feb 25 15:57:27 devstack sudo[88544]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 25 15:57:27 devstack sudo[88539]: pam_unix(sudo:session): session closed for user root Feb 25 15:57:27 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-999a4434-73f4-4333-9def-44acc5936ec9 tempest-VolumesListTestJSON-11611395 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-1d8c9606-cc67-42a2-a12d-02c657647074" returned: 0 in 0.609s {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 25 15:57:27 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-999a4434-73f4-4333-9def-44acc5936ec9 tempest-VolumesListTestJSON-11611395 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-1d8c9606-cc67-42a2-a12d-02c657647074 {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 25 15:57:27 devstack sudo[88549]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-1d8c9606-cc67-42a2-a12d-02c657647074 Feb 25 15:57:27 devstack sudo[88549]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 25 15:57:27 devstack sudo[88544]: pam_unix(sudo:session): session closed for user root Feb 25 15:57:27 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-5c810954-cd14-4127-abb4-3322a1210e68 tempest-VolumesDeleteCascade-1036059898 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7b3ec993-062b-49bc-8f15-f2e125115130 -F qcow2 /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-7b3ec993-062b-49bc-8f15-f2e125115130.d40a2f08-5338-4bb3-bd39-8d875d45c585" returned: 0 in 0.524s {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 25 15:57:27 devstack cinder-volume[83528]: WARNING cinder.volume.drivers.remotefs [None req-5c810954-cd14-4127-abb4-3322a1210e68 tempest-VolumesDeleteCascade-1036059898 None] /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-7b3ec993-062b-49bc-8f15-f2e125115130.d40a2f08-5338-4bb3-bd39-8d875d45c585 is being set with open permissions: ugo+rw Feb 25 15:57:27 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-5c810954-cd14-4127-abb4-3322a1210e68 tempest-VolumesDeleteCascade-1036059898 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-7b3ec993-062b-49bc-8f15-f2e125115130.d40a2f08-5338-4bb3-bd39-8d875d45c585 {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 25 15:57:27 devstack sudo[88554]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-7b3ec993-062b-49bc-8f15-f2e125115130.d40a2f08-5338-4bb3-bd39-8d875d45c585 Feb 25 15:57:27 devstack sudo[88554]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 25 15:57:27 devstack sudo[88549]: pam_unix(sudo:session): session closed for user root Feb 25 15:57:27 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-999a4434-73f4-4333-9def-44acc5936ec9 tempest-VolumesListTestJSON-11611395 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-1d8c9606-cc67-42a2-a12d-02c657647074" returned: 0 in 0.506s {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 25 15:57:27 devstack cinder-volume[83528]: DEBUG cinder.coordination [None req-999a4434-73f4-4333-9def-44acc5936ec9 tempest-VolumesListTestJSON-11611395 None] Lock "cinder-quobyte-1d8c9606-cc67-42a2-a12d-02c657647074" released by "delete_volume" :: held 1.146s {{(pid=83528) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 25 15:57:27 devstack cinder-volume[83528]: DEBUG cinder.quota [None req-999a4434-73f4-4333-9def-44acc5936ec9 tempest-VolumesListTestJSON-11611395 None] Created reservations ['6b889009-7cfb-4e42-9bba-19257554b231', 'ffad0597-efbf-4052-9cc3-454f3a3f3449', 'a20fbf3c-b19c-4e3c-98a8-49d02152e78a', '8530c033-712c-4c7e-8608-1810147a14ba'] {{(pid=83528) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 25 15:57:27 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-999a4434-73f4-4333-9def-44acc5936ec9 tempest-VolumesListTestJSON-11611395 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 25 15:57:27 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-999a4434-73f4-4333-9def-44acc5936ec9 tempest-VolumesListTestJSON-11611395 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 25 15:57:27 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.quobyte [None req-999a4434-73f4-4333-9def-44acc5936ec9 tempest-VolumesListTestJSON-11611395 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23e9d725-3e04-4cd9-bfe0-c8ef43305589': None} {{(pid=83528) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 25 15:57:27 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.quobyte [None req-999a4434-73f4-4333-9def-44acc5936ec9 tempest-VolumesListTestJSON-11611395 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23e9d725-3e04-4cd9-bfe0-c8ef43305589'] {{(pid=83528) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 25 15:57:27 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-999a4434-73f4-4333-9def-44acc5936ec9 tempest-VolumesListTestJSON-11611395 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 25 15:57:27 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-999a4434-73f4-4333-9def-44acc5936ec9 tempest-VolumesListTestJSON-11611395 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85 {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 25 15:57:27 devstack sudo[88557]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85 Feb 25 15:57:27 devstack sudo[88557]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 25 15:57:28 devstack sudo[88554]: pam_unix(sudo:session): session closed for user root Feb 25 15:57:28 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-5c810954-cd14-4127-abb4-3322a1210e68 tempest-VolumesDeleteCascade-1036059898 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-7b3ec993-062b-49bc-8f15-f2e125115130.d40a2f08-5338-4bb3-bd39-8d875d45c585" returned: 0 in 0.511s {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 25 15:57:28 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-5c810954-cd14-4127-abb4-3322a1210e68 tempest-VolumesDeleteCascade-1036059898 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-7b3ec993-062b-49bc-8f15-f2e125115130.info {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 25 15:57:28 devstack sudo[88561]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-7b3ec993-062b-49bc-8f15-f2e125115130.info Feb 25 15:57:28 devstack sudo[88561]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 25 15:57:28 devstack sudo[88557]: pam_unix(sudo:session): session closed for user root Feb 25 15:57:28 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-999a4434-73f4-4333-9def-44acc5936ec9 tempest-VolumesListTestJSON-11611395 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85" returned: 0 in 0.504s {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 25 15:57:28 devstack cinder-volume[83528]: DEBUG cinder.manager [None req-999a4434-73f4-4333-9def-44acc5936ec9 tempest-VolumesListTestJSON-11611395 None] Notifying Schedulers of capabilities ... {{(pid=83528) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 25 15:57:28 devstack cinder-volume[83528]: INFO cinder.volume.manager [None req-999a4434-73f4-4333-9def-44acc5936ec9 tempest-VolumesListTestJSON-11611395 None] Deleted volume successfully. Feb 25 15:57:28 devstack cinder-volume[83528]: DEBUG cinder.coordination [None req-999a4434-73f4-4333-9def-44acc5936ec9 tempest-VolumesListTestJSON-11611395 None] Lock "cinder-1d8c9606-cc67-42a2-a12d-02c657647074-delete_volume" released by "delete_volume" :: held 1.818s {{(pid=83528) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 25 15:57:28 devstack sudo[88561]: pam_unix(sudo:session): session closed for user root Feb 25 15:57:28 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-5c810954-cd14-4127-abb4-3322a1210e68 tempest-VolumesDeleteCascade-1036059898 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-7b3ec993-062b-49bc-8f15-f2e125115130.info" returned: 0 in 0.673s {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 25 15:57:28 devstack cinder-volume[83528]: WARNING cinder.volume.drivers.remotefs [None req-5c810954-cd14-4127-abb4-3322a1210e68 tempest-VolumesDeleteCascade-1036059898 None] /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-7b3ec993-062b-49bc-8f15-f2e125115130.info is being set with open permissions: ugo+rw Feb 25 15:57:28 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-5c810954-cd14-4127-abb4-3322a1210e68 tempest-VolumesDeleteCascade-1036059898 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-7b3ec993-062b-49bc-8f15-f2e125115130.info {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 25 15:57:28 devstack sudo[88565]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-7b3ec993-062b-49bc-8f15-f2e125115130.info Feb 25 15:57:28 devstack sudo[88565]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 25 15:57:28 devstack cinder-volume[83528]: DEBUG cinder.coordination [None req-0f430d53-fe29-4ed4-b7df-51f8f5a59732 tempest-VolumesListTestJSON-11611395 None] Acquiring lock "cinder-b27df5ed-9c92-47b0-a8d8-da37ea1f5667-delete_volume" by "delete_volume" {{(pid=83528) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 25 15:57:28 devstack cinder-volume[83528]: DEBUG cinder.coordination [None req-0f430d53-fe29-4ed4-b7df-51f8f5a59732 tempest-VolumesListTestJSON-11611395 None] Lock "cinder-b27df5ed-9c92-47b0-a8d8-da37ea1f5667-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=83528) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 25 15:57:28 devstack cinder-volume[83528]: DEBUG cinder.coordination [None req-0f430d53-fe29-4ed4-b7df-51f8f5a59732 tempest-VolumesListTestJSON-11611395 None] Acquiring lock "cinder-quobyte-b27df5ed-9c92-47b0-a8d8-da37ea1f5667" by "delete_volume" {{(pid=83528) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 25 15:57:28 devstack cinder-volume[83528]: DEBUG cinder.coordination [None req-0f430d53-fe29-4ed4-b7df-51f8f5a59732 tempest-VolumesListTestJSON-11611395 None] Lock "cinder-quobyte-b27df5ed-9c92-47b0-a8d8-da37ea1f5667" acquired by "delete_volume" :: waited 0.011s {{(pid=83528) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 25 15:57:28 devstack cinder-volume[83528]: DEBUG oslo.privsep.daemon [-] privsep: reply[88860738-be12-4975-8b77-0729699f6b6c]: (4, 'qcow2') {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 25 15:57:28 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-0f430d53-fe29-4ed4-b7df-51f8f5a59732 tempest-VolumesListTestJSON-11611395 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-b27df5ed-9c92-47b0-a8d8-da37ea1f5667 {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 25 15:57:29 devstack sudo[88567]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-b27df5ed-9c92-47b0-a8d8-da37ea1f5667 Feb 25 15:57:29 devstack sudo[88567]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 25 15:57:29 devstack sudo[88565]: pam_unix(sudo:session): session closed for user root Feb 25 15:57:29 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-5c810954-cd14-4127-abb4-3322a1210e68 tempest-VolumesDeleteCascade-1036059898 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-7b3ec993-062b-49bc-8f15-f2e125115130.info" returned: 0 in 0.534s {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 25 15:57:29 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-5c810954-cd14-4127-abb4-3322a1210e68 tempest-VolumesDeleteCascade-1036059898 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.666s {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 25 15:57:29 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-532f42ec-8978-4441-989a-6d9df5090256 tempest-VolumesGetTest-958147190 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.903s {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 25 15:57:29 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.quobyte [None req-532f42ec-8978-4441-989a-6d9df5090256 tempest-VolumesGetTest-958147190 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-25T14:57:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1343514951',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cc95ece6-e94f-470e-bf90-21b6c707a9d4,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='30b56c3cb9b44b44bc932bfa91495865',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-25T14:57:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-25T14:57:26Z,use_quota=True,user_id='e09e6f803ddf47f09c166c46461b2f9a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ce71c2f9-6543-4165-9653-a1529b2ea243),volume_type_id=ce71c2f9-6543-4165-9653-a1529b2ea243)}" {{(pid=83528) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 25 15:57:29 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.remotefs [None req-532f42ec-8978-4441-989a-6d9df5090256 tempest-VolumesGetTest-958147190 None] Creating volume cc95ece6-e94f-470e-bf90-21b6c707a9d4 {{(pid=83528) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 25 15:57:29 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-532f42ec-8978-4441-989a-6d9df5090256 tempest-VolumesGetTest-958147190 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 25 15:57:29 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-532f42ec-8978-4441-989a-6d9df5090256 tempest-VolumesGetTest-958147190 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 25 15:57:29 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.quobyte [None req-532f42ec-8978-4441-989a-6d9df5090256 tempest-VolumesGetTest-958147190 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23e9d725-3e04-4cd9-bfe0-c8ef43305589': None} {{(pid=83528) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 25 15:57:29 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.quobyte [None req-532f42ec-8978-4441-989a-6d9df5090256 tempest-VolumesGetTest-958147190 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23e9d725-3e04-4cd9-bfe0-c8ef43305589'] {{(pid=83528) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 25 15:57:29 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-532f42ec-8978-4441-989a-6d9df5090256 tempest-VolumesGetTest-958147190 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 25 15:57:29 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.quobyte [None req-532f42ec-8978-4441-989a-6d9df5090256 tempest-VolumesGetTest-958147190 None] Selected osci02.corp.quobyte.com/cinder-vol-23e9d725-3e04-4cd9-bfe0-c8ef43305589 as target Quobyte volume. {{(pid=83528) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 25 15:57:29 devstack cinder-volume[83528]: INFO cinder.volume.drivers.remotefs [None req-532f42ec-8978-4441-989a-6d9df5090256 tempest-VolumesGetTest-958147190 None] casted to osci02.corp.quobyte.com/cinder-vol-23e9d725-3e04-4cd9-bfe0-c8ef43305589 Feb 25 15:57:29 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-532f42ec-8978-4441-989a-6d9df5090256 tempest-VolumesGetTest-958147190 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-cc95ece6-e94f-470e-bf90-21b6c707a9d4 1073741824 {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 25 15:57:29 devstack sudo[88570]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-cc95ece6-e94f-470e-bf90-21b6c707a9d4 1073741824 Feb 25 15:57:29 devstack sudo[88570]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 25 15:57:29 devstack cinder-volume[83528]: INFO cinder.volume.manager [None req-5c810954-cd14-4127-abb4-3322a1210e68 tempest-VolumesDeleteCascade-1036059898 None] Create snapshot completed successfully Feb 25 15:57:29 devstack sudo[88567]: pam_unix(sudo:session): session closed for user root Feb 25 15:57:29 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-0f430d53-fe29-4ed4-b7df-51f8f5a59732 tempest-VolumesListTestJSON-11611395 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-b27df5ed-9c92-47b0-a8d8-da37ea1f5667" returned: 0 in 0.649s {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 25 15:57:29 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-0f430d53-fe29-4ed4-b7df-51f8f5a59732 tempest-VolumesListTestJSON-11611395 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-b27df5ed-9c92-47b0-a8d8-da37ea1f5667 {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 25 15:57:29 devstack sudo[88575]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-b27df5ed-9c92-47b0-a8d8-da37ea1f5667 Feb 25 15:57:29 devstack sudo[88575]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 25 15:57:30 devstack sudo[88570]: pam_unix(sudo:session): session closed for user root Feb 25 15:57:30 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-532f42ec-8978-4441-989a-6d9df5090256 tempest-VolumesGetTest-958147190 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-cc95ece6-e94f-470e-bf90-21b6c707a9d4 1073741824" returned: 0 in 0.808s {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 25 15:57:30 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-532f42ec-8978-4441-989a-6d9df5090256 tempest-VolumesGetTest-958147190 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-cc95ece6-e94f-470e-bf90-21b6c707a9d4 {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 25 15:57:30 devstack sudo[88581]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-cc95ece6-e94f-470e-bf90-21b6c707a9d4 Feb 25 15:57:30 devstack sudo[88581]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 25 15:57:30 devstack cinder-volume[83528]: DEBUG cinder.volume.flows.manager.create_volume [None req-b8760f25-c386-4d4e-9e9c-0ba038c2a88e tempest-VolumesDeleteCascade-1036059898 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83528) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 25 15:57:30 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-b8760f25-c386-4d4e-9e9c-0ba038c2a88e tempest-VolumesDeleteCascade-1036059898 None] Flow 'volume_create_manager' (93c27f82-6db1-43ab-8761-f0bd846443a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83528) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 25 15:57:30 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-b8760f25-c386-4d4e-9e9c-0ba038c2a88e tempest-VolumesDeleteCascade-1036059898 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0d0deae3-970e-470c-872b-c56475fd557c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 25 15:57:30 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-b8760f25-c386-4d4e-9e9c-0ba038c2a88e tempest-VolumesDeleteCascade-1036059898 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0d0deae3-970e-470c-872b-c56475fd557c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-25T14:57:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1922813393',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2afba5cf-b7fe-41bf-b8aa-4d761bee261a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f8464253780144d49cfe3aa5fc80be50',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-25T14:57:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=d40a2f08-5338-4bb3-bd39-8d875d45c585,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-25T14:57:30Z,use_quota=True,user_id='a4405dce3ee9409e92ab33348e52bb5c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ce71c2f9-6543-4165-9653-a1529b2ea243),volume_type_id=ce71c2f9-6543-4165-9653-a1529b2ea243)' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 25 15:57:30 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-b8760f25-c386-4d4e-9e9c-0ba038c2a88e tempest-VolumesDeleteCascade-1036059898 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eb927a10-2c12-4593-b4ec-adcd4f33b00c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 25 15:57:30 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-b8760f25-c386-4d4e-9e9c-0ba038c2a88e tempest-VolumesDeleteCascade-1036059898 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eb927a10-2c12-4593-b4ec-adcd4f33b00c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 25 15:57:30 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-b8760f25-c386-4d4e-9e9c-0ba038c2a88e tempest-VolumesDeleteCascade-1036059898 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (04ef495a-da14-4af9-9245-672322013cf6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 25 15:57:30 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-b8760f25-c386-4d4e-9e9c-0ba038c2a88e tempest-VolumesDeleteCascade-1036059898 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (04ef495a-da14-4af9-9245-672322013cf6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '2afba5cf-b7fe-41bf-b8aa-4d761bee261a', 'volume_name': 'volume-2afba5cf-b7fe-41bf-b8aa-4d761bee261a', 'volume_size': 1, 'snapshot_id': 'd40a2f08-5338-4bb3-bd39-8d875d45c585'}' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 25 15:57:30 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-b8760f25-c386-4d4e-9e9c-0ba038c2a88e tempest-VolumesDeleteCascade-1036059898 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dc737c63-d552-496c-be40-506ee2177c14) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 25 15:57:30 devstack sudo[88575]: pam_unix(sudo:session): session closed for user root Feb 25 15:57:30 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-b8760f25-c386-4d4e-9e9c-0ba038c2a88e tempest-VolumesDeleteCascade-1036059898 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dc737c63-d552-496c-be40-506ee2177c14) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 25 15:57:30 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-b8760f25-c386-4d4e-9e9c-0ba038c2a88e tempest-VolumesDeleteCascade-1036059898 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8224aa3f-8dae-4464-b306-a5acbb4b2428) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 25 15:57:30 devstack cinder-volume[83528]: INFO cinder.volume.flows.manager.create_volume [None req-b8760f25-c386-4d4e-9e9c-0ba038c2a88e tempest-VolumesDeleteCascade-1036059898 None] Volume 2afba5cf-b7fe-41bf-b8aa-4d761bee261a: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-2afba5cf-b7fe-41bf-b8aa-4d761bee261a', 'volume_size': 1, 'snapshot_id': 'd40a2f08-5338-4bb3-bd39-8d875d45c585'} Feb 25 15:57:30 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-0f430d53-fe29-4ed4-b7df-51f8f5a59732 tempest-VolumesListTestJSON-11611395 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-b27df5ed-9c92-47b0-a8d8-da37ea1f5667" returned: 0 in 0.739s {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 25 15:57:30 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-b8760f25-c386-4d4e-9e9c-0ba038c2a88e tempest-VolumesDeleteCascade-1036059898 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 25 15:57:30 devstack cinder-volume[83528]: DEBUG cinder.coordination [None req-0f430d53-fe29-4ed4-b7df-51f8f5a59732 tempest-VolumesListTestJSON-11611395 None] Lock "cinder-quobyte-b27df5ed-9c92-47b0-a8d8-da37ea1f5667" released by "delete_volume" :: held 1.416s {{(pid=83528) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 25 15:57:30 devstack cinder-volume[83528]: DEBUG cinder.quota [None req-0f430d53-fe29-4ed4-b7df-51f8f5a59732 tempest-VolumesListTestJSON-11611395 None] Created reservations ['c6af248f-1b86-4e49-b970-819c4c9b3686', 'b9cb40b8-ed45-45c5-a552-6f3113da03b8', '66cd66ff-7c3e-4ece-ad4d-9ae7714a11b1', '57b7b8ae-b637-409e-888c-baa2088543cd'] {{(pid=83528) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 25 15:57:30 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-0f430d53-fe29-4ed4-b7df-51f8f5a59732 tempest-VolumesListTestJSON-11611395 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 25 15:57:30 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-0f430d53-fe29-4ed4-b7df-51f8f5a59732 tempest-VolumesListTestJSON-11611395 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 25 15:57:30 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.quobyte [None req-0f430d53-fe29-4ed4-b7df-51f8f5a59732 tempest-VolumesListTestJSON-11611395 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23e9d725-3e04-4cd9-bfe0-c8ef43305589': None} {{(pid=83528) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 25 15:57:30 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.quobyte [None req-0f430d53-fe29-4ed4-b7df-51f8f5a59732 tempest-VolumesListTestJSON-11611395 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23e9d725-3e04-4cd9-bfe0-c8ef43305589'] {{(pid=83528) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 25 15:57:30 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-0f430d53-fe29-4ed4-b7df-51f8f5a59732 tempest-VolumesListTestJSON-11611395 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 25 15:57:30 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-0f430d53-fe29-4ed4-b7df-51f8f5a59732 tempest-VolumesListTestJSON-11611395 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85 {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 25 15:57:30 devstack sudo[88583]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85 Feb 25 15:57:30 devstack sudo[88583]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 25 15:57:30 devstack sudo[88581]: pam_unix(sudo:session): session closed for user root Feb 25 15:57:30 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-532f42ec-8978-4441-989a-6d9df5090256 tempest-VolumesGetTest-958147190 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-cc95ece6-e94f-470e-bf90-21b6c707a9d4" returned: 0 in 0.663s {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 25 15:57:30 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.quobyte [None req-532f42ec-8978-4441-989a-6d9df5090256 tempest-VolumesGetTest-958147190 None] <== create_volume: return (1526ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-23e9d725-3e04-4cd9-bfe0-c8ef43305589'} {{(pid=83528) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 25 15:57:30 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-532f42ec-8978-4441-989a-6d9df5090256 tempest-VolumesGetTest-958147190 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.529s {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 25 15:57:30 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-b8760f25-c386-4d4e-9e9c-0ba038c2a88e tempest-VolumesDeleteCascade-1036059898 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.482s {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 25 15:57:30 devstack cinder-volume[83528]: DEBUG cinder.coordination [None req-b8760f25-c386-4d4e-9e9c-0ba038c2a88e tempest-VolumesDeleteCascade-1036059898 None] Acquiring lock "cinder-quobyte-d40a2f08-5338-4bb3-bd39-8d875d45c585-2afba5cf-b7fe-41bf-b8aa-4d761bee261a" by "_create_volume_from_snapshot" {{(pid=83528) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 25 15:57:30 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-532f42ec-8978-4441-989a-6d9df5090256 tempest-VolumesGetTest-958147190 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ce6d9e87-c917-46d1-84d0-3af0f0d0e4d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cc95ece6-e94f-470e-bf90-21b6c707a9d4', 'volume_size': 1}' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 25 15:57:30 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-532f42ec-8978-4441-989a-6d9df5090256 tempest-VolumesGetTest-958147190 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (66b2f682-786f-494f-9532-c79777995957) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 25 15:57:30 devstack cinder-volume[83528]: DEBUG cinder.coordination [None req-b8760f25-c386-4d4e-9e9c-0ba038c2a88e tempest-VolumesDeleteCascade-1036059898 None] Lock "cinder-quobyte-d40a2f08-5338-4bb3-bd39-8d875d45c585-2afba5cf-b7fe-41bf-b8aa-4d761bee261a" acquired by "_create_volume_from_snapshot" :: waited 0.025s {{(pid=83528) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 25 15:57:30 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.quobyte [None req-b8760f25-c386-4d4e-9e9c-0ba038c2a88e tempest-VolumesDeleteCascade-1036059898 None] Creating volume 2afba5cf-b7fe-41bf-b8aa-4d761bee261a from snapshot d40a2f08-5338-4bb3-bd39-8d875d45c585 {{(pid=83528) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Feb 25 15:57:30 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-b8760f25-c386-4d4e-9e9c-0ba038c2a88e tempest-VolumesDeleteCascade-1036059898 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 25 15:57:30 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-b8760f25-c386-4d4e-9e9c-0ba038c2a88e tempest-VolumesDeleteCascade-1036059898 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 25 15:57:30 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.quobyte [None req-b8760f25-c386-4d4e-9e9c-0ba038c2a88e tempest-VolumesDeleteCascade-1036059898 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23e9d725-3e04-4cd9-bfe0-c8ef43305589': None} {{(pid=83528) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 25 15:57:30 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.quobyte [None req-b8760f25-c386-4d4e-9e9c-0ba038c2a88e tempest-VolumesDeleteCascade-1036059898 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23e9d725-3e04-4cd9-bfe0-c8ef43305589'] {{(pid=83528) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 25 15:57:30 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-b8760f25-c386-4d4e-9e9c-0ba038c2a88e tempest-VolumesDeleteCascade-1036059898 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 25 15:57:30 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.quobyte [None req-b8760f25-c386-4d4e-9e9c-0ba038c2a88e tempest-VolumesDeleteCascade-1036059898 None] Selected osci02.corp.quobyte.com/cinder-vol-23e9d725-3e04-4cd9-bfe0-c8ef43305589 as target Quobyte volume. {{(pid=83528) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 25 15:57:30 devstack cinder-volume[83528]: DEBUG cinder.coordination [None req-b8760f25-c386-4d4e-9e9c-0ba038c2a88e tempest-VolumesDeleteCascade-1036059898 None] Acquiring lock "cinder-quobyte-2afba5cf-b7fe-41bf-b8aa-4d761bee261a" by "_copy_volume_from_snapshot" {{(pid=83528) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 25 15:57:30 devstack cinder-volume[83528]: INFO cinder.volume.flows.manager.create_volume [None req-532f42ec-8978-4441-989a-6d9df5090256 tempest-VolumesGetTest-958147190 None] Volume volume-cc95ece6-e94f-470e-bf90-21b6c707a9d4 (cc95ece6-e94f-470e-bf90-21b6c707a9d4): created successfully Feb 25 15:57:30 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-532f42ec-8978-4441-989a-6d9df5090256 tempest-VolumesGetTest-958147190 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (66b2f682-786f-494f-9532-c79777995957) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 25 15:57:30 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-532f42ec-8978-4441-989a-6d9df5090256 tempest-VolumesGetTest-958147190 None] Flow 'volume_create_manager' (ee1bce2b-5911-499a-a59b-a86daee0f621) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83528) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 25 15:57:30 devstack cinder-volume[83528]: DEBUG cinder.coordination [None req-b8760f25-c386-4d4e-9e9c-0ba038c2a88e tempest-VolumesDeleteCascade-1036059898 None] Lock "cinder-quobyte-2afba5cf-b7fe-41bf-b8aa-4d761bee261a" acquired by "_copy_volume_from_snapshot" :: waited 0.023s {{(pid=83528) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 25 15:57:30 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.quobyte [None req-b8760f25-c386-4d4e-9e9c-0ba038c2a88e tempest-VolumesDeleteCascade-1036059898 None] snapshot: d40a2f08-5338-4bb3-bd39-8d875d45c585, volume: 2afba5cf-b7fe-41bf-b8aa-4d761bee261a, {{(pid=83528) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Feb 25 15:57:30 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-b8760f25-c386-4d4e-9e9c-0ba038c2a88e tempest-VolumesDeleteCascade-1036059898 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 25 15:57:30 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-b8760f25-c386-4d4e-9e9c-0ba038c2a88e tempest-VolumesDeleteCascade-1036059898 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 25 15:57:30 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.quobyte [None req-b8760f25-c386-4d4e-9e9c-0ba038c2a88e tempest-VolumesDeleteCascade-1036059898 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23e9d725-3e04-4cd9-bfe0-c8ef43305589': None} {{(pid=83528) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 25 15:57:30 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.quobyte [None req-b8760f25-c386-4d4e-9e9c-0ba038c2a88e tempest-VolumesDeleteCascade-1036059898 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23e9d725-3e04-4cd9-bfe0-c8ef43305589'] {{(pid=83528) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 25 15:57:30 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-b8760f25-c386-4d4e-9e9c-0ba038c2a88e tempest-VolumesDeleteCascade-1036059898 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 25 15:57:30 devstack cinder-volume[83528]: INFO cinder.volume.manager [None req-532f42ec-8978-4441-989a-6d9df5090256 tempest-VolumesGetTest-958147190 None] Created volume successfully. Feb 25 15:57:30 devstack cinder-volume[83528]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d783975-d055-44ae-b097-9f7ad9591870]: (4, 'qcow2') {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 25 15:57:30 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-b8760f25-c386-4d4e-9e9c-0ba038c2a88e tempest-VolumesDeleteCascade-1036059898 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-7b3ec993-062b-49bc-8f15-f2e125115130.d40a2f08-5338-4bb3-bd39-8d875d45c585 {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 25 15:57:31 devstack sudo[88583]: pam_unix(sudo:session): session closed for user root Feb 25 15:57:31 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-0f430d53-fe29-4ed4-b7df-51f8f5a59732 tempest-VolumesListTestJSON-11611395 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85" returned: 0 in 0.569s {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 25 15:57:31 devstack cinder-volume[83528]: DEBUG cinder.manager [None req-0f430d53-fe29-4ed4-b7df-51f8f5a59732 tempest-VolumesListTestJSON-11611395 None] Notifying Schedulers of capabilities ... {{(pid=83528) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 25 15:57:31 devstack cinder-volume[83528]: INFO cinder.volume.manager [None req-0f430d53-fe29-4ed4-b7df-51f8f5a59732 tempest-VolumesListTestJSON-11611395 None] Deleted volume successfully. Feb 25 15:57:31 devstack sudo[88586]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-7b3ec993-062b-49bc-8f15-f2e125115130.d40a2f08-5338-4bb3-bd39-8d875d45c585 Feb 25 15:57:31 devstack sudo[88586]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 25 15:57:31 devstack cinder-volume[83528]: DEBUG cinder.coordination [None req-0f430d53-fe29-4ed4-b7df-51f8f5a59732 tempest-VolumesListTestJSON-11611395 None] Lock "cinder-b27df5ed-9c92-47b0-a8d8-da37ea1f5667-delete_volume" released by "delete_volume" :: held 2.184s {{(pid=83528) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 25 15:57:31 devstack cinder-volume[83528]: DEBUG cinder.coordination [None req-3882d836-c6be-4efd-9584-4fc3ea7a9d46 tempest-VolumesListTestJSON-11611395 None] Acquiring lock "cinder-44207fcf-7270-401d-8e4d-8cc9708458b1-delete_volume" by "delete_volume" {{(pid=83528) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 25 15:57:31 devstack cinder-volume[83528]: DEBUG cinder.coordination [None req-3882d836-c6be-4efd-9584-4fc3ea7a9d46 tempest-VolumesListTestJSON-11611395 None] Lock "cinder-44207fcf-7270-401d-8e4d-8cc9708458b1-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=83528) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 25 15:57:31 devstack cinder-volume[83528]: DEBUG cinder.coordination [None req-3882d836-c6be-4efd-9584-4fc3ea7a9d46 tempest-VolumesListTestJSON-11611395 None] Acquiring lock "cinder-quobyte-44207fcf-7270-401d-8e4d-8cc9708458b1" by "delete_volume" {{(pid=83528) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 25 15:57:31 devstack cinder-volume[83528]: DEBUG cinder.coordination [None req-3882d836-c6be-4efd-9584-4fc3ea7a9d46 tempest-VolumesListTestJSON-11611395 None] Lock "cinder-quobyte-44207fcf-7270-401d-8e4d-8cc9708458b1" acquired by "delete_volume" :: waited 0.012s {{(pid=83528) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 25 15:57:31 devstack cinder-volume[83528]: DEBUG oslo.privsep.daemon [-] privsep: reply[42e8a1f4-a2b6-4eb3-b842-bb4375b9cbc1]: (4, 'qcow2') {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 25 15:57:31 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-3882d836-c6be-4efd-9584-4fc3ea7a9d46 tempest-VolumesListTestJSON-11611395 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-44207fcf-7270-401d-8e4d-8cc9708458b1 {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 25 15:57:31 devstack sudo[88589]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-44207fcf-7270-401d-8e4d-8cc9708458b1 Feb 25 15:57:31 devstack sudo[88589]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 25 15:57:31 devstack cinder-volume[83528]: DEBUG cinder.volume.flows.manager.create_volume [None req-7c7478fd-408e-4997-8145-12295682893d tempest-TestVolumeBootPattern-1339247704 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83528) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 25 15:57:31 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-7c7478fd-408e-4997-8145-12295682893d tempest-TestVolumeBootPattern-1339247704 None] Flow 'volume_create_manager' (34454895-930c-40cd-8734-3d7c925e1cbc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83528) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 25 15:57:31 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-7c7478fd-408e-4997-8145-12295682893d tempest-TestVolumeBootPattern-1339247704 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c974a710-8303-428c-8e8d-207e9fd3c4b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 25 15:57:31 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-7c7478fd-408e-4997-8145-12295682893d tempest-TestVolumeBootPattern-1339247704 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c974a710-8303-428c-8e8d-207e9fd3c4b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-25T14:57:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestVolumeBootPattern-volume-origin-1142137312',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=603ceb8f-999e-4bdd-a2b4-3010a4fd6af5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3d007cfa64f547159cc538caccca8f48',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-25T14:57:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-25T14:57:31Z,use_quota=True,user_id='a1dcddd485dd48ae82df66efa0ae0b80',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ce71c2f9-6543-4165-9653-a1529b2ea243),volume_type_id=ce71c2f9-6543-4165-9653-a1529b2ea243)' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 25 15:57:31 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-7c7478fd-408e-4997-8145-12295682893d tempest-TestVolumeBootPattern-1339247704 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b8c36254-f318-43a9-a84e-632171a8fa12) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 25 15:57:31 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-7c7478fd-408e-4997-8145-12295682893d tempest-TestVolumeBootPattern-1339247704 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b8c36254-f318-43a9-a84e-632171a8fa12) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 25 15:57:31 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-7c7478fd-408e-4997-8145-12295682893d tempest-TestVolumeBootPattern-1339247704 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (559ec900-d119-48e0-aaba-19ed72673b94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 25 15:57:31 devstack cinder-volume[83528]: DEBUG cinder.image.glance [None req-7c7478fd-408e-4997-8145-12295682893d tempest-TestVolumeBootPattern-1339247704 None] Creating Keystone auth plugin from conf {{(pid=83528) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Feb 25 15:57:31 devstack sudo[88586]: pam_unix(sudo:session): session closed for user root Feb 25 15:57:31 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-b8760f25-c386-4d4e-9e9c-0ba038c2a88e tempest-VolumesDeleteCascade-1036059898 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-7b3ec993-062b-49bc-8f15-f2e125115130.d40a2f08-5338-4bb3-bd39-8d875d45c585" returned: 0 in 0.619s {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 25 15:57:31 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.remotefs [None req-b8760f25-c386-4d4e-9e9c-0ba038c2a88e tempest-VolumesDeleteCascade-1036059898 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7b3ec993-062b-49bc-8f15-f2e125115130(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83528) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Feb 25 15:57:31 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.quobyte [None req-b8760f25-c386-4d4e-9e9c-0ba038c2a88e tempest-VolumesDeleteCascade-1036059898 None] will copy from snapshot at /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-7b3ec993-062b-49bc-8f15-f2e125115130 {{(pid=83528) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Feb 25 15:57:31 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.quobyte [None req-b8760f25-c386-4d4e-9e9c-0ba038c2a88e tempest-VolumesDeleteCascade-1036059898 None] Creating direct copy from snapshot {{(pid=83528) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Feb 25 15:57:31 devstack cinder-volume[83528]: DEBUG oslo.privsep.daemon [-] privsep: reply[b85c4815-d5bb-487a-82de-a3b1331ed505]: (4, 'qcow2') {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 25 15:57:31 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-b8760f25-c386-4d4e-9e9c-0ba038c2a88e tempest-VolumesDeleteCascade-1036059898 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-7b3ec993-062b-49bc-8f15-f2e125115130 {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 25 15:57:31 devstack sudo[88594]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-7b3ec993-062b-49bc-8f15-f2e125115130 Feb 25 15:57:31 devstack sudo[88594]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 25 15:57:31 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-7c7478fd-408e-4997-8145-12295682893d tempest-TestVolumeBootPattern-1339247704 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (559ec900-d119-48e0-aaba-19ed72673b94) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '603ceb8f-999e-4bdd-a2b4-3010a4fd6af5', 'volume_name': 'volume-603ceb8f-999e-4bdd-a2b4-3010a4fd6af5', 'volume_size': 1, 'image_id': 'c50f3ecd-5e88-4737-aa36-6e073ce70c60', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/c50f3ecd-5e88-4737-aa36-6e073ce70c60', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '75f8571da0ad46ec8e734ab2a4fa231d', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'c50f3ecd-5e88-4737-aa36-6e073ce70c60', 'created_at': datetime.datetime(2026, 2, 25, 14, 47, 16, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 2, 25, 14, 47, 18, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/c50f3ecd-5e88-4737-aa36-6e073ce70c60/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 25 15:57:31 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-7c7478fd-408e-4997-8145-12295682893d tempest-TestVolumeBootPattern-1339247704 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8b482624-2af7-4283-b520-aae412538ca2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 25 15:57:31 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-7c7478fd-408e-4997-8145-12295682893d tempest-TestVolumeBootPattern-1339247704 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8b482624-2af7-4283-b520-aae412538ca2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 25 15:57:31 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-7c7478fd-408e-4997-8145-12295682893d tempest-TestVolumeBootPattern-1339247704 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7e0053a1-733e-4cf0-ab69-6ca3188cb2ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 25 15:57:31 devstack cinder-volume[83528]: INFO cinder.volume.flows.manager.create_volume [None req-7c7478fd-408e-4997-8145-12295682893d tempest-TestVolumeBootPattern-1339247704 None] Volume 603ceb8f-999e-4bdd-a2b4-3010a4fd6af5: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-603ceb8f-999e-4bdd-a2b4-3010a4fd6af5', 'volume_size': 1, 'image_id': 'c50f3ecd-5e88-4737-aa36-6e073ce70c60', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/c50f3ecd-5e88-4737-aa36-6e073ce70c60', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '75f8571da0ad46ec8e734ab2a4fa231d', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'c50f3ecd-5e88-4737-aa36-6e073ce70c60', 'created_at': datetime.datetime(2026, 2, 25, 14, 47, 16, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 2, 25, 14, 47, 18, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/c50f3ecd-5e88-4737-aa36-6e073ce70c60/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Feb 25 15:57:31 devstack cinder-volume[83528]: DEBUG cinder.volume.flows.manager.create_volume [None req-7c7478fd-408e-4997-8145-12295682893d tempest-TestVolumeBootPattern-1339247704 None] Trying to clone 603ceb8f-999e-4bdd-a2b4-3010a4fd6af5 from image c50f3ecd-5e88-4737-aa36-6e073ce70c60 at location (None, [{'url': 'file:///opt/stack/data/glance/images/c50f3ecd-5e88-4737-aa36-6e073ce70c60', 'metadata': {}}]). {{(pid=83528) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1082}} Feb 25 15:57:31 devstack sudo[88589]: pam_unix(sudo:session): session closed for user root Feb 25 15:57:31 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-3882d836-c6be-4efd-9584-4fc3ea7a9d46 tempest-VolumesListTestJSON-11611395 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-44207fcf-7270-401d-8e4d-8cc9708458b1" returned: 0 in 0.703s {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 25 15:57:31 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-3882d836-c6be-4efd-9584-4fc3ea7a9d46 tempest-VolumesListTestJSON-11611395 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-44207fcf-7270-401d-8e4d-8cc9708458b1 {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 25 15:57:31 devstack sudo[88599]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-44207fcf-7270-401d-8e4d-8cc9708458b1 Feb 25 15:57:31 devstack sudo[88599]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 25 15:57:32 devstack cinder-volume[83528]: DEBUG cinder.image.image_utils [None req-7c7478fd-408e-4997-8145-12295682893d tempest-TestVolumeBootPattern-1339247704 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_c50f3ecd-5e88-4737-aa36-6e073ce70c60_dbkw48m1devstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=83528) fetch /opt/stack/cinder/cinder/image/image_utils.py:732}} Feb 25 15:57:32 devstack cinder-volume[83528]: INFO cinder.image.image_utils [None req-7c7478fd-408e-4997-8145-12295682893d tempest-TestVolumeBootPattern-1339247704 None] Image download 20.69 MB at 20.69 MB/s Feb 25 15:57:32 devstack sudo[88594]: pam_unix(sudo:session): session closed for user root Feb 25 15:57:32 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-b8760f25-c386-4d4e-9e9c-0ba038c2a88e tempest-VolumesDeleteCascade-1036059898 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-7b3ec993-062b-49bc-8f15-f2e125115130" returned: 0 in 0.620s {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 25 15:57:32 devstack cinder-volume[83528]: DEBUG cinder.utils [None req-b8760f25-c386-4d4e-9e9c-0ba038c2a88e tempest-VolumesDeleteCascade-1036059898 None] Path /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-2afba5cf-b7fe-41bf-b8aa-4d761bee261a not found in is_blk_device check {{(pid=83528) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Feb 25 15:57:32 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-b8760f25-c386-4d4e-9e9c-0ba038c2a88e tempest-VolumesDeleteCascade-1036059898 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-7b3ec993-062b-49bc-8f15-f2e125115130 /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-2afba5cf-b7fe-41bf-b8aa-4d761bee261a {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 25 15:57:32 devstack sudo[88605]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-7b3ec993-062b-49bc-8f15-f2e125115130 /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-2afba5cf-b7fe-41bf-b8aa-4d761bee261a Feb 25 15:57:32 devstack sudo[88605]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 25 15:57:32 devstack cinder-volume[83528]: DEBUG oslo.privsep.daemon [-] privsep: reply[f716270b-757d-4cb6-a43d-58c909f0c0c1]: (4, 'qcow2') {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 25 15:57:32 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-7c7478fd-408e-4997-8145-12295682893d tempest-TestVolumeBootPattern-1339247704 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c50f3ecd-5e88-4737-aa36-6e073ce70c60_dbkw48m1devstack@QuobyteHD {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 25 15:57:32 devstack cinder-volume[83528]: DEBUG cinder.volume.flows.manager.create_volume [None req-069ffc25-4d1b-4e75-aa9b-201cf5aa46a5 tempest-VolumesGetTest-958147190 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83528) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 25 15:57:32 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-069ffc25-4d1b-4e75-aa9b-201cf5aa46a5 tempest-VolumesGetTest-958147190 None] Flow 'volume_create_manager' (528498e4-c98d-47ae-be5c-ae5b922a50ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83528) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 25 15:57:32 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-069ffc25-4d1b-4e75-aa9b-201cf5aa46a5 tempest-VolumesGetTest-958147190 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (70e92c09-c566-46c5-9828-dc8b8ac84f43) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 25 15:57:32 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-069ffc25-4d1b-4e75-aa9b-201cf5aa46a5 tempest-VolumesGetTest-958147190 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (70e92c09-c566-46c5-9828-dc8b8ac84f43) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-25T14:57:32Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-71019502',display_name='tempest-VolumesGetTest-Volume-1698464959',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=487088ea-8912-4347-9ca0-6ffce3ff8471,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='30b56c3cb9b44b44bc932bfa91495865',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-25T14:57:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-25T14:57:32Z,use_quota=True,user_id='e09e6f803ddf47f09c166c46461b2f9a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ce71c2f9-6543-4165-9653-a1529b2ea243),volume_type_id=ce71c2f9-6543-4165-9653-a1529b2ea243)' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 25 15:57:32 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-069ffc25-4d1b-4e75-aa9b-201cf5aa46a5 tempest-VolumesGetTest-958147190 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (efa2fd09-31fc-4095-adea-bd0c43d78798) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 25 15:57:32 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-069ffc25-4d1b-4e75-aa9b-201cf5aa46a5 tempest-VolumesGetTest-958147190 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (efa2fd09-31fc-4095-adea-bd0c43d78798) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 25 15:57:32 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-069ffc25-4d1b-4e75-aa9b-201cf5aa46a5 tempest-VolumesGetTest-958147190 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6305fd66-b12a-496b-8eba-a2f1eb89766b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 25 15:57:32 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-069ffc25-4d1b-4e75-aa9b-201cf5aa46a5 tempest-VolumesGetTest-958147190 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6305fd66-b12a-496b-8eba-a2f1eb89766b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '487088ea-8912-4347-9ca0-6ffce3ff8471', 'volume_name': 'volume-487088ea-8912-4347-9ca0-6ffce3ff8471', 'volume_size': 1}' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 25 15:57:32 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-069ffc25-4d1b-4e75-aa9b-201cf5aa46a5 tempest-VolumesGetTest-958147190 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (533814c2-4f68-4b88-ab71-c532a0a8b172) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 25 15:57:32 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-069ffc25-4d1b-4e75-aa9b-201cf5aa46a5 tempest-VolumesGetTest-958147190 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (533814c2-4f68-4b88-ab71-c532a0a8b172) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 25 15:57:32 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-069ffc25-4d1b-4e75-aa9b-201cf5aa46a5 tempest-VolumesGetTest-958147190 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (74b4bf2e-3f16-40a1-af0f-5d7648a2fecc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 25 15:57:32 devstack cinder-volume[83528]: INFO cinder.volume.flows.manager.create_volume [None req-069ffc25-4d1b-4e75-aa9b-201cf5aa46a5 tempest-VolumesGetTest-958147190 None] Volume 487088ea-8912-4347-9ca0-6ffce3ff8471: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-487088ea-8912-4347-9ca0-6ffce3ff8471', 'volume_size': 1} Feb 25 15:57:32 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-069ffc25-4d1b-4e75-aa9b-201cf5aa46a5 tempest-VolumesGetTest-958147190 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 25 15:57:32 devstack sudo[88607]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c50f3ecd-5e88-4737-aa36-6e073ce70c60_dbkw48m1devstack@QuobyteHD Feb 25 15:57:32 devstack sudo[88607]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 25 15:57:32 devstack sudo[88599]: pam_unix(sudo:session): session closed for user root Feb 25 15:57:32 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-3882d836-c6be-4efd-9584-4fc3ea7a9d46 tempest-VolumesListTestJSON-11611395 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-44207fcf-7270-401d-8e4d-8cc9708458b1" returned: 0 in 0.618s {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 25 15:57:32 devstack cinder-volume[83528]: DEBUG cinder.coordination [None req-3882d836-c6be-4efd-9584-4fc3ea7a9d46 tempest-VolumesListTestJSON-11611395 None] Lock "cinder-quobyte-44207fcf-7270-401d-8e4d-8cc9708458b1" released by "delete_volume" :: held 1.363s {{(pid=83528) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 25 15:57:32 devstack cinder-volume[83528]: DEBUG cinder.quota [None req-3882d836-c6be-4efd-9584-4fc3ea7a9d46 tempest-VolumesListTestJSON-11611395 None] Created reservations ['c4fd3806-7458-452c-b878-ca96ae1b49c2', 'f6808ba0-cd2a-4a35-883b-a27bab442d5f', '1b9565cf-a0f7-43af-a88a-a68f1805151b', 'bd7f4394-5ab1-4ef4-805e-044adc1f9adc'] {{(pid=83528) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 25 15:57:32 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-3882d836-c6be-4efd-9584-4fc3ea7a9d46 tempest-VolumesListTestJSON-11611395 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 25 15:57:32 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-3882d836-c6be-4efd-9584-4fc3ea7a9d46 tempest-VolumesListTestJSON-11611395 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 25 15:57:32 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.quobyte [None req-3882d836-c6be-4efd-9584-4fc3ea7a9d46 tempest-VolumesListTestJSON-11611395 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23e9d725-3e04-4cd9-bfe0-c8ef43305589': None} {{(pid=83528) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 25 15:57:32 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.quobyte [None req-3882d836-c6be-4efd-9584-4fc3ea7a9d46 tempest-VolumesListTestJSON-11611395 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23e9d725-3e04-4cd9-bfe0-c8ef43305589'] {{(pid=83528) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 25 15:57:32 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-3882d836-c6be-4efd-9584-4fc3ea7a9d46 tempest-VolumesListTestJSON-11611395 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 25 15:57:32 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-3882d836-c6be-4efd-9584-4fc3ea7a9d46 tempest-VolumesListTestJSON-11611395 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85 {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 25 15:57:32 devstack sudo[88618]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85 Feb 25 15:57:32 devstack sudo[88618]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 25 15:57:32 devstack sudo[88607]: pam_unix(sudo:session): session closed for user root Feb 25 15:57:32 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-7c7478fd-408e-4997-8145-12295682893d tempest-TestVolumeBootPattern-1339247704 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c50f3ecd-5e88-4737-aa36-6e073ce70c60_dbkw48m1devstack@QuobyteHD" returned: 0 in 0.569s {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 25 15:57:32 devstack cinder-volume[83528]: DEBUG cinder.image.image_utils [None req-7c7478fd-408e-4997-8145-12295682893d tempest-TestVolumeBootPattern-1339247704 None] Temporary image c50f3ecd-5e88-4737-aa36-6e073ce70c60 is fetched for user a1dcddd485dd48ae82df66efa0ae0b80. {{(pid=83528) fetch /opt/stack/cinder/cinder/image/image_utils.py:1431}} Feb 25 15:57:32 devstack cinder-volume[83528]: DEBUG oslo.privsep.daemon [-] privsep: reply[1137a014-d0dc-46b3-b4d7-62ee9f79a8b2]: (4, 'qcow2') {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 25 15:57:32 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-7c7478fd-408e-4997-8145-12295682893d tempest-TestVolumeBootPattern-1339247704 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c50f3ecd-5e88-4737-aa36-6e073ce70c60_dbkw48m1devstack@QuobyteHD {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 25 15:57:33 devstack sudo[88627]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c50f3ecd-5e88-4737-aa36-6e073ce70c60_dbkw48m1devstack@QuobyteHD Feb 25 15:57:33 devstack sudo[88627]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 25 15:57:34 devstack sudo[88618]: pam_unix(sudo:session): session closed for user root Feb 25 15:57:34 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-3882d836-c6be-4efd-9584-4fc3ea7a9d46 tempest-VolumesListTestJSON-11611395 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85" returned: 0 in 1.754s {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 25 15:57:34 devstack cinder-volume[83528]: DEBUG cinder.manager [None req-3882d836-c6be-4efd-9584-4fc3ea7a9d46 tempest-VolumesListTestJSON-11611395 None] Notifying Schedulers of capabilities ... {{(pid=83528) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 25 15:57:34 devstack cinder-volume[83528]: INFO cinder.volume.manager [None req-3882d836-c6be-4efd-9584-4fc3ea7a9d46 tempest-VolumesListTestJSON-11611395 None] Deleted volume successfully. Feb 25 15:57:34 devstack cinder-volume[83528]: DEBUG cinder.coordination [None req-3882d836-c6be-4efd-9584-4fc3ea7a9d46 tempest-VolumesListTestJSON-11611395 None] Lock "cinder-44207fcf-7270-401d-8e4d-8cc9708458b1-delete_volume" released by "delete_volume" :: held 3.369s {{(pid=83528) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 25 15:57:34 devstack sudo[88627]: pam_unix(sudo:session): session closed for user root Feb 25 15:57:34 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-7c7478fd-408e-4997-8145-12295682893d tempest-TestVolumeBootPattern-1339247704 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c50f3ecd-5e88-4737-aa36-6e073ce70c60_dbkw48m1devstack@QuobyteHD" returned: 0 in 1.840s {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 25 15:57:34 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-7c7478fd-408e-4997-8145-12295682893d tempest-TestVolumeBootPattern-1339247704 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 25 15:57:34 devstack sudo[88605]: pam_unix(sudo:session): session closed for user root Feb 25 15:57:34 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-b8760f25-c386-4d4e-9e9c-0ba038c2a88e tempest-VolumesDeleteCascade-1036059898 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-7b3ec993-062b-49bc-8f15-f2e125115130 /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-2afba5cf-b7fe-41bf-b8aa-4d761bee261a" returned: 0 in 2.551s {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 25 15:57:34 devstack cinder-volume[83528]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b2d3b55-3519-47a0-93e2-0f5aa362d394]: (4, 'qcow2') {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 25 15:57:34 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-b8760f25-c386-4d4e-9e9c-0ba038c2a88e tempest-VolumesDeleteCascade-1036059898 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-7b3ec993-062b-49bc-8f15-f2e125115130 {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 25 15:57:34 devstack sudo[88634]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-7b3ec993-062b-49bc-8f15-f2e125115130 Feb 25 15:57:34 devstack sudo[88634]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 25 15:57:35 devstack sudo[88634]: pam_unix(sudo:session): session closed for user root Feb 25 15:57:35 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-b8760f25-c386-4d4e-9e9c-0ba038c2a88e tempest-VolumesDeleteCascade-1036059898 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-7b3ec993-062b-49bc-8f15-f2e125115130" returned: 0 in 0.676s {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 25 15:57:35 devstack cinder-volume[83528]: DEBUG cinder.image.image_utils [None req-b8760f25-c386-4d4e-9e9c-0ba038c2a88e tempest-VolumesDeleteCascade-1036059898 None] Image conversion details: src /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-7b3ec993-062b-49bc-8f15-f2e125115130, size 1024.00 MB, duration 2.55 sec, destination /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-2afba5cf-b7fe-41bf-b8aa-4d761bee261a {{(pid=83528) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Feb 25 15:57:35 devstack cinder-volume[83528]: INFO cinder.image.image_utils [None req-b8760f25-c386-4d4e-9e9c-0ba038c2a88e tempest-VolumesDeleteCascade-1036059898 None] Converted 1024.00 MB image at 401.19 MB/s Feb 25 15:57:35 devstack cinder-volume[83528]: WARNING cinder.volume.drivers.remotefs [None req-b8760f25-c386-4d4e-9e9c-0ba038c2a88e tempest-VolumesDeleteCascade-1036059898 None] /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-2afba5cf-b7fe-41bf-b8aa-4d761bee261a is being set with open permissions: ugo+rw Feb 25 15:57:35 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-b8760f25-c386-4d4e-9e9c-0ba038c2a88e tempest-VolumesDeleteCascade-1036059898 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-2afba5cf-b7fe-41bf-b8aa-4d761bee261a {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 25 15:57:35 devstack sudo[88639]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-2afba5cf-b7fe-41bf-b8aa-4d761bee261a Feb 25 15:57:35 devstack sudo[88639]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 25 15:57:35 devstack sudo[88639]: pam_unix(sudo:session): session closed for user root Feb 25 15:57:35 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-b8760f25-c386-4d4e-9e9c-0ba038c2a88e tempest-VolumesDeleteCascade-1036059898 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-2afba5cf-b7fe-41bf-b8aa-4d761bee261a" returned: 0 in 0.534s {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 25 15:57:35 devstack cinder-volume[83528]: DEBUG cinder.coordination [None req-b8760f25-c386-4d4e-9e9c-0ba038c2a88e tempest-VolumesDeleteCascade-1036059898 None] Lock "cinder-quobyte-2afba5cf-b7fe-41bf-b8aa-4d761bee261a" released by "_copy_volume_from_snapshot" :: held 5.069s {{(pid=83528) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 25 15:57:35 devstack cinder-volume[83528]: DEBUG cinder.coordination [None req-b8760f25-c386-4d4e-9e9c-0ba038c2a88e tempest-VolumesDeleteCascade-1036059898 None] Lock "cinder-quobyte-d40a2f08-5338-4bb3-bd39-8d875d45c585-2afba5cf-b7fe-41bf-b8aa-4d761bee261a" released by "_create_volume_from_snapshot" :: held 5.104s {{(pid=83528) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 25 15:57:35 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-b8760f25-c386-4d4e-9e9c-0ba038c2a88e tempest-VolumesDeleteCascade-1036059898 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 5.130s {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 25 15:57:35 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-069ffc25-4d1b-4e75-aa9b-201cf5aa46a5 tempest-VolumesGetTest-958147190 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.643s {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 25 15:57:35 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.quobyte [None req-069ffc25-4d1b-4e75-aa9b-201cf5aa46a5 tempest-VolumesGetTest-958147190 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-25T14:57:32Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-71019502',display_name='tempest-VolumesGetTest-Volume-1698464959',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=487088ea-8912-4347-9ca0-6ffce3ff8471,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='30b56c3cb9b44b44bc932bfa91495865',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-25T14:57:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-25T14:57:32Z,use_quota=True,user_id='e09e6f803ddf47f09c166c46461b2f9a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ce71c2f9-6543-4165-9653-a1529b2ea243),volume_type_id=ce71c2f9-6543-4165-9653-a1529b2ea243)}" {{(pid=83528) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 25 15:57:35 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.remotefs [None req-069ffc25-4d1b-4e75-aa9b-201cf5aa46a5 tempest-VolumesGetTest-958147190 None] Creating volume 487088ea-8912-4347-9ca0-6ffce3ff8471 {{(pid=83528) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 25 15:57:35 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-069ffc25-4d1b-4e75-aa9b-201cf5aa46a5 tempest-VolumesGetTest-958147190 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 25 15:57:35 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-069ffc25-4d1b-4e75-aa9b-201cf5aa46a5 tempest-VolumesGetTest-958147190 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 25 15:57:35 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.quobyte [None req-069ffc25-4d1b-4e75-aa9b-201cf5aa46a5 tempest-VolumesGetTest-958147190 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23e9d725-3e04-4cd9-bfe0-c8ef43305589': None} {{(pid=83528) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 25 15:57:35 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.quobyte [None req-069ffc25-4d1b-4e75-aa9b-201cf5aa46a5 tempest-VolumesGetTest-958147190 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23e9d725-3e04-4cd9-bfe0-c8ef43305589'] {{(pid=83528) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 25 15:57:35 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-069ffc25-4d1b-4e75-aa9b-201cf5aa46a5 tempest-VolumesGetTest-958147190 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 25 15:57:35 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.quobyte [None req-069ffc25-4d1b-4e75-aa9b-201cf5aa46a5 tempest-VolumesGetTest-958147190 None] Selected osci02.corp.quobyte.com/cinder-vol-23e9d725-3e04-4cd9-bfe0-c8ef43305589 as target Quobyte volume. {{(pid=83528) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 25 15:57:35 devstack cinder-volume[83528]: INFO cinder.volume.drivers.remotefs [None req-069ffc25-4d1b-4e75-aa9b-201cf5aa46a5 tempest-VolumesGetTest-958147190 None] casted to osci02.corp.quobyte.com/cinder-vol-23e9d725-3e04-4cd9-bfe0-c8ef43305589 Feb 25 15:57:35 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-069ffc25-4d1b-4e75-aa9b-201cf5aa46a5 tempest-VolumesGetTest-958147190 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-487088ea-8912-4347-9ca0-6ffce3ff8471 1073741824 {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 25 15:57:36 devstack sudo[88642]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-487088ea-8912-4347-9ca0-6ffce3ff8471 1073741824 Feb 25 15:57:36 devstack sudo[88642]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 25 15:57:36 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-b8760f25-c386-4d4e-9e9c-0ba038c2a88e tempest-VolumesDeleteCascade-1036059898 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8224aa3f-8dae-4464-b306-a5acbb4b2428) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2afba5cf-b7fe-41bf-b8aa-4d761bee261a', 'volume_size': 1, 'snapshot_id': 'd40a2f08-5338-4bb3-bd39-8d875d45c585'}' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 25 15:57:36 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-b8760f25-c386-4d4e-9e9c-0ba038c2a88e tempest-VolumesDeleteCascade-1036059898 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (48069b23-fc8a-4259-a8ac-79df9f8e3844) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 25 15:57:36 devstack cinder-volume[83528]: INFO cinder.volume.flows.manager.create_volume [None req-b8760f25-c386-4d4e-9e9c-0ba038c2a88e tempest-VolumesDeleteCascade-1036059898 None] Volume volume-2afba5cf-b7fe-41bf-b8aa-4d761bee261a (2afba5cf-b7fe-41bf-b8aa-4d761bee261a): created successfully Feb 25 15:57:36 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-b8760f25-c386-4d4e-9e9c-0ba038c2a88e tempest-VolumesDeleteCascade-1036059898 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (48069b23-fc8a-4259-a8ac-79df9f8e3844) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 25 15:57:36 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-b8760f25-c386-4d4e-9e9c-0ba038c2a88e tempest-VolumesDeleteCascade-1036059898 None] Flow 'volume_create_manager' (93c27f82-6db1-43ab-8761-f0bd846443a1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83528) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 25 15:57:36 devstack cinder-volume[83528]: INFO cinder.volume.manager [None req-b8760f25-c386-4d4e-9e9c-0ba038c2a88e tempest-VolumesDeleteCascade-1036059898 None] Created volume successfully. Feb 25 15:57:36 devstack sudo[88642]: pam_unix(sudo:session): session closed for user root Feb 25 15:57:36 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-069ffc25-4d1b-4e75-aa9b-201cf5aa46a5 tempest-VolumesGetTest-958147190 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-487088ea-8912-4347-9ca0-6ffce3ff8471 1073741824" returned: 0 in 0.583s {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 25 15:57:36 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-069ffc25-4d1b-4e75-aa9b-201cf5aa46a5 tempest-VolumesGetTest-958147190 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-487088ea-8912-4347-9ca0-6ffce3ff8471 {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 25 15:57:36 devstack sudo[88647]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-487088ea-8912-4347-9ca0-6ffce3ff8471 Feb 25 15:57:36 devstack sudo[88647]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 25 15:57:36 devstack cinder-volume[83528]: DEBUG cinder.volume.flows.manager.create_volume [None req-95f971be-7196-4a8c-96e2-8d32b4f8c397 tempest-VolumesSnapshotNegativeTestJSON-221576189 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83528) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 25 15:57:36 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-95f971be-7196-4a8c-96e2-8d32b4f8c397 tempest-VolumesSnapshotNegativeTestJSON-221576189 None] Flow 'volume_create_manager' (b8c46747-de0d-4063-98ae-bb704bb74e5f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83528) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 25 15:57:36 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-95f971be-7196-4a8c-96e2-8d32b4f8c397 tempest-VolumesSnapshotNegativeTestJSON-221576189 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dc99e5ce-e115-4145-a4f1-803b8f7fbdeb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 25 15:57:36 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-95f971be-7196-4a8c-96e2-8d32b4f8c397 tempest-VolumesSnapshotNegativeTestJSON-221576189 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dc99e5ce-e115-4145-a4f1-803b8f7fbdeb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-25T14:57:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-603803158',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=66cc9438-f1f5-4c07-8d43-9b6af58f1291,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fd05ae3a568f48c985241d9485747c05',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-25T14:57:37Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-25T14:57:37Z,use_quota=True,user_id='47c47c5ad6664668ac63aef91e542cf6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ce71c2f9-6543-4165-9653-a1529b2ea243),volume_type_id=ce71c2f9-6543-4165-9653-a1529b2ea243)' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 25 15:57:36 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-95f971be-7196-4a8c-96e2-8d32b4f8c397 tempest-VolumesSnapshotNegativeTestJSON-221576189 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b4947302-8285-47e5-ac67-eb152cdd4070) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 25 15:57:36 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-95f971be-7196-4a8c-96e2-8d32b4f8c397 tempest-VolumesSnapshotNegativeTestJSON-221576189 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b4947302-8285-47e5-ac67-eb152cdd4070) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 25 15:57:36 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-95f971be-7196-4a8c-96e2-8d32b4f8c397 tempest-VolumesSnapshotNegativeTestJSON-221576189 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8954f422-f424-4271-982c-a40c14063959) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 25 15:57:36 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-95f971be-7196-4a8c-96e2-8d32b4f8c397 tempest-VolumesSnapshotNegativeTestJSON-221576189 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8954f422-f424-4271-982c-a40c14063959) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '66cc9438-f1f5-4c07-8d43-9b6af58f1291', 'volume_name': 'volume-66cc9438-f1f5-4c07-8d43-9b6af58f1291', 'volume_size': 2}' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 25 15:57:36 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-95f971be-7196-4a8c-96e2-8d32b4f8c397 tempest-VolumesSnapshotNegativeTestJSON-221576189 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (84effea2-6b61-42fe-bcd9-32e6ea2aada6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 25 15:57:36 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-95f971be-7196-4a8c-96e2-8d32b4f8c397 tempest-VolumesSnapshotNegativeTestJSON-221576189 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (84effea2-6b61-42fe-bcd9-32e6ea2aada6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 25 15:57:36 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-95f971be-7196-4a8c-96e2-8d32b4f8c397 tempest-VolumesSnapshotNegativeTestJSON-221576189 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (11e4b391-f98d-4355-b820-3641504e689e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 25 15:57:36 devstack cinder-volume[83528]: INFO cinder.volume.flows.manager.create_volume [None req-95f971be-7196-4a8c-96e2-8d32b4f8c397 tempest-VolumesSnapshotNegativeTestJSON-221576189 None] Volume 66cc9438-f1f5-4c07-8d43-9b6af58f1291: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-66cc9438-f1f5-4c07-8d43-9b6af58f1291', 'volume_size': 2} Feb 25 15:57:36 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-95f971be-7196-4a8c-96e2-8d32b4f8c397 tempest-VolumesSnapshotNegativeTestJSON-221576189 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 25 15:57:36 devstack cinder-volume[83528]: DEBUG cinder.coordination [None req-9ca7b7c1-16a8-4d29-bc49-1ca2499232f8 tempest-VolumesDeleteCascade-1036059898 None] Acquiring lock "cinder-7b3ec993-062b-49bc-8f15-f2e125115130-delete_volume" by "delete_volume" {{(pid=83528) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 25 15:57:37 devstack cinder-volume[83528]: DEBUG cinder.coordination [None req-9ca7b7c1-16a8-4d29-bc49-1ca2499232f8 tempest-VolumesDeleteCascade-1036059898 None] Lock "cinder-7b3ec993-062b-49bc-8f15-f2e125115130-delete_volume" acquired by "delete_volume" :: waited 0.013s {{(pid=83528) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 25 15:57:37 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-9ca7b7c1-16a8-4d29-bc49-1ca2499232f8 tempest-VolumesDeleteCascade-1036059898 None] Performing cascade delete. {{(pid=83528) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}} Feb 25 15:57:37 devstack cinder-volume[83528]: DEBUG cinder.coordination [None req-9ca7b7c1-16a8-4d29-bc49-1ca2499232f8 tempest-VolumesDeleteCascade-1036059898 None] Acquiring lock "cinder-d40a2f08-5338-4bb3-bd39-8d875d45c585-delete_snapshot" by "delete_snapshot" {{(pid=83528) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 25 15:57:37 devstack cinder-volume[83528]: DEBUG cinder.coordination [None req-9ca7b7c1-16a8-4d29-bc49-1ca2499232f8 tempest-VolumesDeleteCascade-1036059898 None] Lock "cinder-d40a2f08-5338-4bb3-bd39-8d875d45c585-delete_snapshot" acquired by "delete_snapshot" :: waited 0.008s {{(pid=83528) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 25 15:57:37 devstack cinder-volume[83528]: DEBUG cinder.coordination [None req-9ca7b7c1-16a8-4d29-bc49-1ca2499232f8 tempest-VolumesDeleteCascade-1036059898 None] Acquiring lock "cinder-quobyte-7b3ec993-062b-49bc-8f15-f2e125115130" by "delete_snapshot" {{(pid=83528) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 25 15:57:37 devstack cinder-volume[83528]: DEBUG cinder.coordination [None req-9ca7b7c1-16a8-4d29-bc49-1ca2499232f8 tempest-VolumesDeleteCascade-1036059898 None] Lock "cinder-quobyte-7b3ec993-062b-49bc-8f15-f2e125115130" acquired by "delete_snapshot" :: waited 0.009s {{(pid=83528) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 25 15:57:37 devstack cinder-volume[83528]: DEBUG cinder.coordination [None req-9ca7b7c1-16a8-4d29-bc49-1ca2499232f8 tempest-VolumesDeleteCascade-1036059898 None] Acquiring lock "cinder-quobyte-d40a2f08-5338-4bb3-bd39-8d875d45c585" by "_delete_snapshot" {{(pid=83528) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 25 15:57:37 devstack cinder-volume[83528]: DEBUG cinder.coordination [None req-9ca7b7c1-16a8-4d29-bc49-1ca2499232f8 tempest-VolumesDeleteCascade-1036059898 None] Lock "cinder-quobyte-d40a2f08-5338-4bb3-bd39-8d875d45c585" acquired by "_delete_snapshot" :: waited 0.009s {{(pid=83528) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 25 15:57:37 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.remotefs [None req-9ca7b7c1-16a8-4d29-bc49-1ca2499232f8 tempest-VolumesDeleteCascade-1036059898 None] Deleting offline snapshot d40a2f08-5338-4bb3-bd39-8d875d45c585 of volume 7b3ec993-062b-49bc-8f15-f2e125115130 {{(pid=83528) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Feb 25 15:57:37 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.remotefs [None req-9ca7b7c1-16a8-4d29-bc49-1ca2499232f8 tempest-VolumesDeleteCascade-1036059898 None] snapshot_file for this snap is: volume-7b3ec993-062b-49bc-8f15-f2e125115130.d40a2f08-5338-4bb3-bd39-8d875d45c585 {{(pid=83528) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Feb 25 15:57:37 devstack cinder-volume[83528]: DEBUG oslo.privsep.daemon [-] privsep: reply[24ed0896-fee9-4d92-9d05-68ddde9da462]: (4, 'qcow2') {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 25 15:57:37 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-9ca7b7c1-16a8-4d29-bc49-1ca2499232f8 tempest-VolumesDeleteCascade-1036059898 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-7b3ec993-062b-49bc-8f15-f2e125115130.d40a2f08-5338-4bb3-bd39-8d875d45c585 {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 25 15:57:37 devstack sudo[88647]: pam_unix(sudo:session): session closed for user root Feb 25 15:57:37 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-069ffc25-4d1b-4e75-aa9b-201cf5aa46a5 tempest-VolumesGetTest-958147190 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-487088ea-8912-4347-9ca0-6ffce3ff8471" returned: 0 in 0.565s {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 25 15:57:37 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.quobyte [None req-069ffc25-4d1b-4e75-aa9b-201cf5aa46a5 tempest-VolumesGetTest-958147190 None] <== create_volume: return (1179ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-23e9d725-3e04-4cd9-bfe0-c8ef43305589'} {{(pid=83528) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 25 15:57:37 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-069ffc25-4d1b-4e75-aa9b-201cf5aa46a5 tempest-VolumesGetTest-958147190 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.183s {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 25 15:57:37 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-7c7478fd-408e-4997-8145-12295682893d tempest-TestVolumeBootPattern-1339247704 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.431s {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 25 15:57:37 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.quobyte [None req-7c7478fd-408e-4997-8145-12295682893d tempest-TestVolumeBootPattern-1339247704 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-25T14:57:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestVolumeBootPattern-volume-origin-1142137312',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=603ceb8f-999e-4bdd-a2b4-3010a4fd6af5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3d007cfa64f547159cc538caccca8f48',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-25T14:57:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-25T14:57:31Z,use_quota=True,user_id='a1dcddd485dd48ae82df66efa0ae0b80',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ce71c2f9-6543-4165-9653-a1529b2ea243),volume_type_id=ce71c2f9-6543-4165-9653-a1529b2ea243)}" {{(pid=83528) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 25 15:57:37 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.remotefs [None req-7c7478fd-408e-4997-8145-12295682893d tempest-TestVolumeBootPattern-1339247704 None] Creating volume 603ceb8f-999e-4bdd-a2b4-3010a4fd6af5 {{(pid=83528) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 25 15:57:37 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-7c7478fd-408e-4997-8145-12295682893d tempest-TestVolumeBootPattern-1339247704 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 25 15:57:37 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-7c7478fd-408e-4997-8145-12295682893d tempest-TestVolumeBootPattern-1339247704 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 25 15:57:37 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.quobyte [None req-7c7478fd-408e-4997-8145-12295682893d tempest-TestVolumeBootPattern-1339247704 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23e9d725-3e04-4cd9-bfe0-c8ef43305589': None} {{(pid=83528) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 25 15:57:37 devstack sudo[88650]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-7b3ec993-062b-49bc-8f15-f2e125115130.d40a2f08-5338-4bb3-bd39-8d875d45c585 Feb 25 15:57:37 devstack sudo[88650]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 25 15:57:37 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.quobyte [None req-7c7478fd-408e-4997-8145-12295682893d tempest-TestVolumeBootPattern-1339247704 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23e9d725-3e04-4cd9-bfe0-c8ef43305589'] {{(pid=83528) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 25 15:57:37 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-7c7478fd-408e-4997-8145-12295682893d tempest-TestVolumeBootPattern-1339247704 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 25 15:57:37 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.quobyte [None req-7c7478fd-408e-4997-8145-12295682893d tempest-TestVolumeBootPattern-1339247704 None] Selected osci02.corp.quobyte.com/cinder-vol-23e9d725-3e04-4cd9-bfe0-c8ef43305589 as target Quobyte volume. {{(pid=83528) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 25 15:57:37 devstack cinder-volume[83528]: INFO cinder.volume.drivers.remotefs [None req-7c7478fd-408e-4997-8145-12295682893d tempest-TestVolumeBootPattern-1339247704 None] casted to osci02.corp.quobyte.com/cinder-vol-23e9d725-3e04-4cd9-bfe0-c8ef43305589 Feb 25 15:57:37 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-7c7478fd-408e-4997-8145-12295682893d tempest-TestVolumeBootPattern-1339247704 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-603ceb8f-999e-4bdd-a2b4-3010a4fd6af5 1073741824 {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 25 15:57:37 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-069ffc25-4d1b-4e75-aa9b-201cf5aa46a5 tempest-VolumesGetTest-958147190 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (74b4bf2e-3f16-40a1-af0f-5d7648a2fecc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-487088ea-8912-4347-9ca0-6ffce3ff8471', 'volume_size': 1}' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 25 15:57:37 devstack sudo[88652]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-603ceb8f-999e-4bdd-a2b4-3010a4fd6af5 1073741824 Feb 25 15:57:37 devstack sudo[88652]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 25 15:57:37 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-069ffc25-4d1b-4e75-aa9b-201cf5aa46a5 tempest-VolumesGetTest-958147190 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c0de82d8-b99e-4f0a-b536-cf073a281703) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 25 15:57:37 devstack cinder-volume[83528]: INFO cinder.volume.flows.manager.create_volume [None req-069ffc25-4d1b-4e75-aa9b-201cf5aa46a5 tempest-VolumesGetTest-958147190 None] Volume volume-487088ea-8912-4347-9ca0-6ffce3ff8471 (487088ea-8912-4347-9ca0-6ffce3ff8471): created successfully Feb 25 15:57:37 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-069ffc25-4d1b-4e75-aa9b-201cf5aa46a5 tempest-VolumesGetTest-958147190 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c0de82d8-b99e-4f0a-b536-cf073a281703) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 25 15:57:37 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-069ffc25-4d1b-4e75-aa9b-201cf5aa46a5 tempest-VolumesGetTest-958147190 None] Flow 'volume_create_manager' (528498e4-c98d-47ae-be5c-ae5b922a50ab) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83528) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 25 15:57:37 devstack cinder-volume[83528]: INFO cinder.volume.manager [None req-069ffc25-4d1b-4e75-aa9b-201cf5aa46a5 tempest-VolumesGetTest-958147190 None] Created volume successfully. Feb 25 15:57:37 devstack sudo[88650]: pam_unix(sudo:session): session closed for user root Feb 25 15:57:37 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-9ca7b7c1-16a8-4d29-bc49-1ca2499232f8 tempest-VolumesDeleteCascade-1036059898 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-7b3ec993-062b-49bc-8f15-f2e125115130.d40a2f08-5338-4bb3-bd39-8d875d45c585" returned: 0 in 0.508s {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 25 15:57:37 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.remotefs [None req-9ca7b7c1-16a8-4d29-bc49-1ca2499232f8 tempest-VolumesDeleteCascade-1036059898 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7b3ec993-062b-49bc-8f15-f2e125115130(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83528) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Feb 25 15:57:37 devstack cinder-volume[83528]: DEBUG oslo.privsep.daemon [-] privsep: reply[489e9944-03c9-4306-ab6a-5bc383017c3f]: (4, 'qcow2') {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 25 15:57:37 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-9ca7b7c1-16a8-4d29-bc49-1ca2499232f8 tempest-VolumesDeleteCascade-1036059898 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-7b3ec993-062b-49bc-8f15-f2e125115130 {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 25 15:57:37 devstack sudo[88660]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-7b3ec993-062b-49bc-8f15-f2e125115130 Feb 25 15:57:37 devstack sudo[88660]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 25 15:57:37 devstack sudo[88652]: pam_unix(sudo:session): session closed for user root Feb 25 15:57:37 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-7c7478fd-408e-4997-8145-12295682893d tempest-TestVolumeBootPattern-1339247704 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-603ceb8f-999e-4bdd-a2b4-3010a4fd6af5 1073741824" returned: 0 in 0.535s {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 25 15:57:37 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-7c7478fd-408e-4997-8145-12295682893d tempest-TestVolumeBootPattern-1339247704 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-603ceb8f-999e-4bdd-a2b4-3010a4fd6af5 {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 25 15:57:37 devstack sudo[88662]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-603ceb8f-999e-4bdd-a2b4-3010a4fd6af5 Feb 25 15:57:37 devstack sudo[88662]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 25 15:57:37 devstack cinder-volume[83528]: DEBUG cinder.coordination [None req-edb33711-aecb-46b4-8eec-e26b15a8033d tempest-VolumesGetTest-958147190 None] Acquiring lock "cinder-487088ea-8912-4347-9ca0-6ffce3ff8471-delete_volume" by "delete_volume" {{(pid=83528) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 25 15:57:37 devstack cinder-volume[83528]: DEBUG cinder.coordination [None req-edb33711-aecb-46b4-8eec-e26b15a8033d tempest-VolumesGetTest-958147190 None] Lock "cinder-487088ea-8912-4347-9ca0-6ffce3ff8471-delete_volume" acquired by "delete_volume" :: waited 0.014s {{(pid=83528) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 25 15:57:37 devstack cinder-volume[83528]: DEBUG cinder.coordination [None req-edb33711-aecb-46b4-8eec-e26b15a8033d tempest-VolumesGetTest-958147190 None] Acquiring lock "cinder-quobyte-487088ea-8912-4347-9ca0-6ffce3ff8471" by "delete_volume" {{(pid=83528) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 25 15:57:37 devstack cinder-volume[83528]: DEBUG cinder.coordination [None req-edb33711-aecb-46b4-8eec-e26b15a8033d tempest-VolumesGetTest-958147190 None] Lock "cinder-quobyte-487088ea-8912-4347-9ca0-6ffce3ff8471" acquired by "delete_volume" :: waited 0.010s {{(pid=83528) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 25 15:57:37 devstack cinder-volume[83528]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb7c415c-dabd-4f67-85da-13e4e95f285f]: (4, 'qcow2') {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 25 15:57:37 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-edb33711-aecb-46b4-8eec-e26b15a8033d tempest-VolumesGetTest-958147190 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-487088ea-8912-4347-9ca0-6ffce3ff8471 {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 25 15:57:37 devstack sudo[88664]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-487088ea-8912-4347-9ca0-6ffce3ff8471 Feb 25 15:57:37 devstack sudo[88664]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 25 15:57:38 devstack sudo[88660]: pam_unix(sudo:session): session closed for user root Feb 25 15:57:38 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-9ca7b7c1-16a8-4d29-bc49-1ca2499232f8 tempest-VolumesDeleteCascade-1036059898 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-7b3ec993-062b-49bc-8f15-f2e125115130" returned: 0 in 0.582s {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 25 15:57:38 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-9ca7b7c1-16a8-4d29-bc49-1ca2499232f8 tempest-VolumesDeleteCascade-1036059898 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-7b3ec993-062b-49bc-8f15-f2e125115130.d40a2f08-5338-4bb3-bd39-8d875d45c585 {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 25 15:57:38 devstack sudo[88662]: pam_unix(sudo:session): session closed for user root Feb 25 15:57:38 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-7c7478fd-408e-4997-8145-12295682893d tempest-TestVolumeBootPattern-1339247704 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-603ceb8f-999e-4bdd-a2b4-3010a4fd6af5" returned: 0 in 0.468s {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 25 15:57:38 devstack sudo[88670]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-7b3ec993-062b-49bc-8f15-f2e125115130.d40a2f08-5338-4bb3-bd39-8d875d45c585 Feb 25 15:57:38 devstack sudo[88670]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 25 15:57:38 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.quobyte [None req-7c7478fd-408e-4997-8145-12295682893d tempest-TestVolumeBootPattern-1339247704 None] <== create_volume: return (1059ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-23e9d725-3e04-4cd9-bfe0-c8ef43305589'} {{(pid=83528) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 25 15:57:38 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-7c7478fd-408e-4997-8145-12295682893d tempest-TestVolumeBootPattern-1339247704 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.062s {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 25 15:57:38 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-95f971be-7196-4a8c-96e2-8d32b4f8c397 tempest-VolumesSnapshotNegativeTestJSON-221576189 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.408s {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 25 15:57:38 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.quobyte [None req-95f971be-7196-4a8c-96e2-8d32b4f8c397 tempest-VolumesSnapshotNegativeTestJSON-221576189 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-25T14:57:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-603803158',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=66cc9438-f1f5-4c07-8d43-9b6af58f1291,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fd05ae3a568f48c985241d9485747c05',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-25T14:57:37Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-25T14:57:37Z,use_quota=True,user_id='47c47c5ad6664668ac63aef91e542cf6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ce71c2f9-6543-4165-9653-a1529b2ea243),volume_type_id=ce71c2f9-6543-4165-9653-a1529b2ea243)}" {{(pid=83528) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 25 15:57:38 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.remotefs [None req-95f971be-7196-4a8c-96e2-8d32b4f8c397 tempest-VolumesSnapshotNegativeTestJSON-221576189 None] Creating volume 66cc9438-f1f5-4c07-8d43-9b6af58f1291 {{(pid=83528) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 25 15:57:38 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-95f971be-7196-4a8c-96e2-8d32b4f8c397 tempest-VolumesSnapshotNegativeTestJSON-221576189 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 25 15:57:38 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-95f971be-7196-4a8c-96e2-8d32b4f8c397 tempest-VolumesSnapshotNegativeTestJSON-221576189 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 25 15:57:38 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.quobyte [None req-95f971be-7196-4a8c-96e2-8d32b4f8c397 tempest-VolumesSnapshotNegativeTestJSON-221576189 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23e9d725-3e04-4cd9-bfe0-c8ef43305589': None} {{(pid=83528) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 25 15:57:38 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.quobyte [None req-95f971be-7196-4a8c-96e2-8d32b4f8c397 tempest-VolumesSnapshotNegativeTestJSON-221576189 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23e9d725-3e04-4cd9-bfe0-c8ef43305589'] {{(pid=83528) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 25 15:57:38 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-95f971be-7196-4a8c-96e2-8d32b4f8c397 tempest-VolumesSnapshotNegativeTestJSON-221576189 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 25 15:57:38 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.quobyte [None req-95f971be-7196-4a8c-96e2-8d32b4f8c397 tempest-VolumesSnapshotNegativeTestJSON-221576189 None] Selected osci02.corp.quobyte.com/cinder-vol-23e9d725-3e04-4cd9-bfe0-c8ef43305589 as target Quobyte volume. {{(pid=83528) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 25 15:57:38 devstack cinder-volume[83528]: INFO cinder.volume.drivers.remotefs [None req-95f971be-7196-4a8c-96e2-8d32b4f8c397 tempest-VolumesSnapshotNegativeTestJSON-221576189 None] casted to osci02.corp.quobyte.com/cinder-vol-23e9d725-3e04-4cd9-bfe0-c8ef43305589 Feb 25 15:57:38 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-95f971be-7196-4a8c-96e2-8d32b4f8c397 tempest-VolumesSnapshotNegativeTestJSON-221576189 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-66cc9438-f1f5-4c07-8d43-9b6af58f1291 2147483648 {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 25 15:57:38 devstack cinder-volume[83528]: DEBUG cinder.volume.volume_utils [None req-7c7478fd-408e-4997-8145-12295682893d tempest-TestVolumeBootPattern-1339247704 None] Attempting download of c50f3ecd-5e88-4737-aa36-6e073ce70c60 ((None, [{'url': 'file:///opt/stack/data/glance/images/c50f3ecd-5e88-4737-aa36-6e073ce70c60', 'metadata': {}}])) to volume 603ceb8f-999e-4bdd-a2b4-3010a4fd6af5. {{(pid=83528) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1189}} Feb 25 15:57:38 devstack sudo[88672]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-66cc9438-f1f5-4c07-8d43-9b6af58f1291 2147483648 Feb 25 15:57:38 devstack sudo[88672]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 25 15:57:38 devstack cinder-volume[83528]: DEBUG oslo.privsep.daemon [-] privsep: reply[53a9b192-9e9a-4970-bb45-6ec5d41ce96d]: (4, 'raw') {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 25 15:57:38 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-7c7478fd-408e-4997-8145-12295682893d tempest-TestVolumeBootPattern-1339247704 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_c50f3ecd-5e88-4737-aa36-6e073ce70c60_2lf56967 {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 25 15:57:38 devstack sudo[88674]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_c50f3ecd-5e88-4737-aa36-6e073ce70c60_2lf56967 Feb 25 15:57:38 devstack sudo[88674]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 25 15:57:38 devstack sudo[88664]: pam_unix(sudo:session): session closed for user root Feb 25 15:57:38 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-edb33711-aecb-46b4-8eec-e26b15a8033d tempest-VolumesGetTest-958147190 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-487088ea-8912-4347-9ca0-6ffce3ff8471" returned: 0 in 0.591s {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 25 15:57:38 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-edb33711-aecb-46b4-8eec-e26b15a8033d tempest-VolumesGetTest-958147190 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-487088ea-8912-4347-9ca0-6ffce3ff8471 {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 25 15:57:38 devstack sudo[88679]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-487088ea-8912-4347-9ca0-6ffce3ff8471 Feb 25 15:57:38 devstack sudo[88679]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 25 15:57:38 devstack sudo[88670]: pam_unix(sudo:session): session closed for user root Feb 25 15:57:38 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-9ca7b7c1-16a8-4d29-bc49-1ca2499232f8 tempest-VolumesDeleteCascade-1036059898 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-7b3ec993-062b-49bc-8f15-f2e125115130.d40a2f08-5338-4bb3-bd39-8d875d45c585" returned: 0 in 0.467s {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 25 15:57:38 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-9ca7b7c1-16a8-4d29-bc49-1ca2499232f8 tempest-VolumesDeleteCascade-1036059898 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-7b3ec993-062b-49bc-8f15-f2e125115130.d40a2f08-5338-4bb3-bd39-8d875d45c585 {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 25 15:57:38 devstack sudo[88687]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-7b3ec993-062b-49bc-8f15-f2e125115130.d40a2f08-5338-4bb3-bd39-8d875d45c585 Feb 25 15:57:38 devstack sudo[88687]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 25 15:57:38 devstack cinder-volume[83528]: DEBUG oslo_service.periodic_task [None req-d4c764ec-0ebb-4b31-b534-c9a53c1ab0dd None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=83528) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Feb 25 15:57:38 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-d4c764ec-0ebb-4b31-b534-c9a53c1ab0dd None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 25 15:57:38 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-d4c764ec-0ebb-4b31-b534-c9a53c1ab0dd None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 25 15:57:38 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.quobyte [None req-d4c764ec-0ebb-4b31-b534-c9a53c1ab0dd None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23e9d725-3e04-4cd9-bfe0-c8ef43305589': None} {{(pid=83528) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 25 15:57:38 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.quobyte [None req-d4c764ec-0ebb-4b31-b534-c9a53c1ab0dd None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23e9d725-3e04-4cd9-bfe0-c8ef43305589'] {{(pid=83528) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 25 15:57:38 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-d4c764ec-0ebb-4b31-b534-c9a53c1ab0dd None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 25 15:57:38 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-d4c764ec-0ebb-4b31-b534-c9a53c1ab0dd None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85 {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 25 15:57:38 devstack sudo[88689]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85 Feb 25 15:57:38 devstack sudo[88689]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 25 15:57:38 devstack sudo[88672]: pam_unix(sudo:session): session closed for user root Feb 25 15:57:38 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-95f971be-7196-4a8c-96e2-8d32b4f8c397 tempest-VolumesSnapshotNegativeTestJSON-221576189 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-66cc9438-f1f5-4c07-8d43-9b6af58f1291 2147483648" returned: 0 in 0.634s {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 25 15:57:38 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-95f971be-7196-4a8c-96e2-8d32b4f8c397 tempest-VolumesSnapshotNegativeTestJSON-221576189 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-66cc9438-f1f5-4c07-8d43-9b6af58f1291 {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 25 15:57:38 devstack sudo[88694]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-66cc9438-f1f5-4c07-8d43-9b6af58f1291 Feb 25 15:57:38 devstack sudo[88694]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 25 15:57:38 devstack sudo[88674]: pam_unix(sudo:session): session closed for user root Feb 25 15:57:38 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-7c7478fd-408e-4997-8145-12295682893d tempest-TestVolumeBootPattern-1339247704 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_c50f3ecd-5e88-4737-aa36-6e073ce70c60_2lf56967" returned: 0 in 0.685s {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 25 15:57:38 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-7c7478fd-408e-4997-8145-12295682893d tempest-TestVolumeBootPattern-1339247704 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_c50f3ecd-5e88-4737-aa36-6e073ce70c60_2lf56967 {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 25 15:57:39 devstack sudo[88679]: pam_unix(sudo:session): session closed for user root Feb 25 15:57:39 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-edb33711-aecb-46b4-8eec-e26b15a8033d tempest-VolumesGetTest-958147190 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-487088ea-8912-4347-9ca0-6ffce3ff8471" returned: 0 in 0.511s {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 25 15:57:39 devstack cinder-volume[83528]: DEBUG cinder.coordination [None req-edb33711-aecb-46b4-8eec-e26b15a8033d tempest-VolumesGetTest-958147190 None] Lock "cinder-quobyte-487088ea-8912-4347-9ca0-6ffce3ff8471" released by "delete_volume" :: held 1.128s {{(pid=83528) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 25 15:57:39 devstack cinder-volume[83528]: DEBUG cinder.quota [None req-edb33711-aecb-46b4-8eec-e26b15a8033d tempest-VolumesGetTest-958147190 None] Created reservations ['2e8c32d9-8d66-4afd-8843-bdd20092ca6f', '3b03ceaf-515e-4168-952a-b64589dc6c07', '4ed038d9-69af-493a-8b88-fba61a200cce', 'b89d3e4e-e40b-406a-98fc-ff92d711a119'] {{(pid=83528) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 25 15:57:39 devstack sudo[88696]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_c50f3ecd-5e88-4737-aa36-6e073ce70c60_2lf56967 Feb 25 15:57:39 devstack sudo[88696]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 25 15:57:39 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-edb33711-aecb-46b4-8eec-e26b15a8033d tempest-VolumesGetTest-958147190 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 25 15:57:39 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-edb33711-aecb-46b4-8eec-e26b15a8033d tempest-VolumesGetTest-958147190 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 25 15:57:39 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.quobyte [None req-edb33711-aecb-46b4-8eec-e26b15a8033d tempest-VolumesGetTest-958147190 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23e9d725-3e04-4cd9-bfe0-c8ef43305589': None} {{(pid=83528) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 25 15:57:39 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.quobyte [None req-edb33711-aecb-46b4-8eec-e26b15a8033d tempest-VolumesGetTest-958147190 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23e9d725-3e04-4cd9-bfe0-c8ef43305589'] {{(pid=83528) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 25 15:57:39 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-edb33711-aecb-46b4-8eec-e26b15a8033d tempest-VolumesGetTest-958147190 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 25 15:57:39 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-edb33711-aecb-46b4-8eec-e26b15a8033d tempest-VolumesGetTest-958147190 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85 {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 25 15:57:39 devstack sudo[88700]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85 Feb 25 15:57:39 devstack sudo[88700]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 25 15:57:39 devstack sudo[88687]: pam_unix(sudo:session): session closed for user root Feb 25 15:57:39 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-9ca7b7c1-16a8-4d29-bc49-1ca2499232f8 tempest-VolumesDeleteCascade-1036059898 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-7b3ec993-062b-49bc-8f15-f2e125115130.d40a2f08-5338-4bb3-bd39-8d875d45c585" returned: 0 in 0.596s {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 25 15:57:39 devstack sudo[88689]: pam_unix(sudo:session): session closed for user root Feb 25 15:57:39 devstack cinder-volume[83528]: DEBUG cinder.coordination [None req-9ca7b7c1-16a8-4d29-bc49-1ca2499232f8 tempest-VolumesDeleteCascade-1036059898 None] Lock "cinder-quobyte-d40a2f08-5338-4bb3-bd39-8d875d45c585" released by "_delete_snapshot" :: held 2.202s {{(pid=83528) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 25 15:57:39 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-d4c764ec-0ebb-4b31-b534-c9a53c1ab0dd None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85" returned: 0 in 0.564s {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 25 15:57:39 devstack cinder-volume[83528]: DEBUG cinder.manager [None req-d4c764ec-0ebb-4b31-b534-c9a53c1ab0dd None None] Notifying Schedulers of capabilities ... {{(pid=83528) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 25 15:57:39 devstack cinder-volume[83528]: DEBUG cinder.coordination [None req-9ca7b7c1-16a8-4d29-bc49-1ca2499232f8 tempest-VolumesDeleteCascade-1036059898 None] Lock "cinder-quobyte-7b3ec993-062b-49bc-8f15-f2e125115130" released by "delete_snapshot" :: held 2.219s {{(pid=83528) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 25 15:57:39 devstack cinder-volume[83528]: DEBUG cinder.quota [None req-9ca7b7c1-16a8-4d29-bc49-1ca2499232f8 tempest-VolumesDeleteCascade-1036059898 None] Created reservations ['68156b3e-b68b-4696-8b33-cdc2a54d5e61', '88de5107-b4a4-482b-bbf5-6be69aedf9c3', '40e3c0cb-3d39-45e9-a957-53826b72223d', '31c2030e-0186-41a9-8bbf-dca2b2202950'] {{(pid=83528) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 25 15:57:39 devstack cinder-volume[83528]: INFO cinder.volume.manager [None req-9ca7b7c1-16a8-4d29-bc49-1ca2499232f8 tempest-VolumesDeleteCascade-1036059898 None] Delete snapshot completed successfully. Feb 25 15:57:39 devstack cinder-volume[83528]: DEBUG cinder.coordination [None req-9ca7b7c1-16a8-4d29-bc49-1ca2499232f8 tempest-VolumesDeleteCascade-1036059898 None] Lock "cinder-d40a2f08-5338-4bb3-bd39-8d875d45c585-delete_snapshot" released by "delete_snapshot" :: held 2.325s {{(pid=83528) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 25 15:57:39 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-9ca7b7c1-16a8-4d29-bc49-1ca2499232f8 tempest-VolumesDeleteCascade-1036059898 None] Snapshots deleted, issuing volume delete {{(pid=83528) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}} Feb 25 15:57:39 devstack cinder-volume[83528]: DEBUG cinder.coordination [None req-9ca7b7c1-16a8-4d29-bc49-1ca2499232f8 tempest-VolumesDeleteCascade-1036059898 None] Acquiring lock "cinder-quobyte-7b3ec993-062b-49bc-8f15-f2e125115130" by "delete_volume" {{(pid=83528) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 25 15:57:39 devstack cinder-volume[83528]: DEBUG cinder.coordination [None req-9ca7b7c1-16a8-4d29-bc49-1ca2499232f8 tempest-VolumesDeleteCascade-1036059898 None] Lock "cinder-quobyte-7b3ec993-062b-49bc-8f15-f2e125115130" acquired by "delete_volume" :: waited 0.010s {{(pid=83528) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 25 15:57:39 devstack cinder-volume[83528]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb56f9c7-28d2-4a48-8afb-bd6da21b325b]: (4, 'qcow2') {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 25 15:57:39 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-9ca7b7c1-16a8-4d29-bc49-1ca2499232f8 tempest-VolumesDeleteCascade-1036059898 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-7b3ec993-062b-49bc-8f15-f2e125115130 {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 25 15:57:39 devstack sudo[88694]: pam_unix(sudo:session): session closed for user root Feb 25 15:57:39 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-95f971be-7196-4a8c-96e2-8d32b4f8c397 tempest-VolumesSnapshotNegativeTestJSON-221576189 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-66cc9438-f1f5-4c07-8d43-9b6af58f1291" returned: 0 in 0.558s {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 25 15:57:39 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.quobyte [None req-95f971be-7196-4a8c-96e2-8d32b4f8c397 tempest-VolumesSnapshotNegativeTestJSON-221576189 None] <== create_volume: return (1231ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-23e9d725-3e04-4cd9-bfe0-c8ef43305589'} {{(pid=83528) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 25 15:57:39 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-95f971be-7196-4a8c-96e2-8d32b4f8c397 tempest-VolumesSnapshotNegativeTestJSON-221576189 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.235s {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 25 15:57:39 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-95f971be-7196-4a8c-96e2-8d32b4f8c397 tempest-VolumesSnapshotNegativeTestJSON-221576189 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (11e4b391-f98d-4355-b820-3641504e689e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-66cc9438-f1f5-4c07-8d43-9b6af58f1291', 'volume_size': 2}' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 25 15:57:39 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-95f971be-7196-4a8c-96e2-8d32b4f8c397 tempest-VolumesSnapshotNegativeTestJSON-221576189 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (085f4f59-7d0e-43ec-8c4d-b9cd838b3573) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 25 15:57:39 devstack sudo[88703]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-7b3ec993-062b-49bc-8f15-f2e125115130 Feb 25 15:57:39 devstack sudo[88703]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 25 15:57:39 devstack cinder-volume[83528]: INFO cinder.volume.flows.manager.create_volume [None req-95f971be-7196-4a8c-96e2-8d32b4f8c397 tempest-VolumesSnapshotNegativeTestJSON-221576189 None] Volume volume-66cc9438-f1f5-4c07-8d43-9b6af58f1291 (66cc9438-f1f5-4c07-8d43-9b6af58f1291): created successfully Feb 25 15:57:39 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-95f971be-7196-4a8c-96e2-8d32b4f8c397 tempest-VolumesSnapshotNegativeTestJSON-221576189 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (085f4f59-7d0e-43ec-8c4d-b9cd838b3573) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 25 15:57:39 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-95f971be-7196-4a8c-96e2-8d32b4f8c397 tempest-VolumesSnapshotNegativeTestJSON-221576189 None] Flow 'volume_create_manager' (b8c46747-de0d-4063-98ae-bb704bb74e5f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83528) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 25 15:57:39 devstack cinder-volume[83528]: INFO cinder.volume.manager [None req-95f971be-7196-4a8c-96e2-8d32b4f8c397 tempest-VolumesSnapshotNegativeTestJSON-221576189 None] Created volume successfully. Feb 25 15:57:39 devstack sudo[88696]: pam_unix(sudo:session): session closed for user root Feb 25 15:57:39 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-7c7478fd-408e-4997-8145-12295682893d tempest-TestVolumeBootPattern-1339247704 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_c50f3ecd-5e88-4737-aa36-6e073ce70c60_2lf56967" returned: 1 in 0.630s {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 25 15:57:39 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-7c7478fd-408e-4997-8145-12295682893d tempest-TestVolumeBootPattern-1339247704 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_c50f3ecd-5e88-4737-aa36-6e073ce70c60_2lf56967' failed. Not Retrying. {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Feb 25 15:57:39 devstack cinder-volume[83528]: DEBUG oslo.privsep.daemon [-] privsep: reply[724ff14f-610e-4105-bcab-115b3ab0b409]: (4, 'qcow2') {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 25 15:57:39 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-7c7478fd-408e-4997-8145-12295682893d tempest-TestVolumeBootPattern-1339247704 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c50f3ecd-5e88-4737-aa36-6e073ce70c60_dbkw48m1devstack@QuobyteHD {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 25 15:57:39 devstack sudo[88708]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c50f3ecd-5e88-4737-aa36-6e073ce70c60_dbkw48m1devstack@QuobyteHD Feb 25 15:57:39 devstack sudo[88708]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 25 15:57:39 devstack sudo[88700]: pam_unix(sudo:session): session closed for user root Feb 25 15:57:39 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-edb33711-aecb-46b4-8eec-e26b15a8033d tempest-VolumesGetTest-958147190 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85" returned: 0 in 0.535s {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 25 15:57:39 devstack cinder-volume[83528]: DEBUG cinder.manager [None req-edb33711-aecb-46b4-8eec-e26b15a8033d tempest-VolumesGetTest-958147190 None] Notifying Schedulers of capabilities ... {{(pid=83528) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 25 15:57:39 devstack cinder-volume[83528]: INFO cinder.volume.manager [None req-edb33711-aecb-46b4-8eec-e26b15a8033d tempest-VolumesGetTest-958147190 None] Deleted volume successfully. Feb 25 15:57:39 devstack cinder-volume[83528]: DEBUG cinder.coordination [None req-edb33711-aecb-46b4-8eec-e26b15a8033d tempest-VolumesGetTest-958147190 None] Lock "cinder-487088ea-8912-4347-9ca0-6ffce3ff8471-delete_volume" released by "delete_volume" :: held 1.883s {{(pid=83528) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 25 15:57:39 devstack sudo[88703]: pam_unix(sudo:session): session closed for user root Feb 25 15:57:39 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-9ca7b7c1-16a8-4d29-bc49-1ca2499232f8 tempest-VolumesDeleteCascade-1036059898 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-7b3ec993-062b-49bc-8f15-f2e125115130" returned: 0 in 0.500s {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 25 15:57:39 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-9ca7b7c1-16a8-4d29-bc49-1ca2499232f8 tempest-VolumesDeleteCascade-1036059898 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-7b3ec993-062b-49bc-8f15-f2e125115130 {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 25 15:57:39 devstack sudo[88713]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-7b3ec993-062b-49bc-8f15-f2e125115130 Feb 25 15:57:39 devstack sudo[88713]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 25 15:57:40 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-94865ed7-af8d-471a-ae32-2fd11a8a17b2 tempest-VolumesSnapshotNegativeTestJSON-221576189 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 25 15:57:40 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-94865ed7-af8d-471a-ae32-2fd11a8a17b2 tempest-VolumesSnapshotNegativeTestJSON-221576189 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 25 15:57:40 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.remotefs [None req-94865ed7-af8d-471a-ae32-2fd11a8a17b2 tempest-VolumesSnapshotNegativeTestJSON-221576189 None] Creating offline snapshot 9b025f5d-9beb-4908-a8ba-57073cf1853e of volume 66cc9438-f1f5-4c07-8d43-9b6af58f1291 {{(pid=83528) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Feb 25 15:57:40 devstack cinder-volume[83528]: DEBUG cinder.coordination [None req-3a4b27e4-dcd3-4337-bd34-7249b436eb86 tempest-VolumesGetTest-958147190 None] Acquiring lock "cinder-cc95ece6-e94f-470e-bf90-21b6c707a9d4-delete_volume" by "delete_volume" {{(pid=83528) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 25 15:57:40 devstack cinder-volume[83528]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd06f73a-2595-430f-bdd3-031f0cd25221]: (4, 'qcow2') {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 25 15:57:40 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-94865ed7-af8d-471a-ae32-2fd11a8a17b2 tempest-VolumesSnapshotNegativeTestJSON-221576189 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-66cc9438-f1f5-4c07-8d43-9b6af58f1291 {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 25 15:57:40 devstack cinder-volume[83528]: DEBUG cinder.coordination [None req-3a4b27e4-dcd3-4337-bd34-7249b436eb86 tempest-VolumesGetTest-958147190 None] Lock "cinder-cc95ece6-e94f-470e-bf90-21b6c707a9d4-delete_volume" acquired by "delete_volume" :: waited 0.053s {{(pid=83528) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 25 15:57:40 devstack sudo[88708]: pam_unix(sudo:session): session closed for user root Feb 25 15:57:40 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-7c7478fd-408e-4997-8145-12295682893d tempest-TestVolumeBootPattern-1339247704 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c50f3ecd-5e88-4737-aa36-6e073ce70c60_dbkw48m1devstack@QuobyteHD" returned: 0 in 0.600s {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 25 15:57:40 devstack cinder-volume[83528]: DEBUG cinder.image.image_utils [None req-7c7478fd-408e-4997-8145-12295682893d tempest-TestVolumeBootPattern-1339247704 None] c50f3ecd-5e88-4737-aa36-6e073ce70c60 was qcow2, converting to raw {{(pid=83528) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1120}} Feb 25 15:57:40 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-7c7478fd-408e-4997-8145-12295682893d tempest-TestVolumeBootPattern-1339247704 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_c50f3ecd-5e88-4737-aa36-6e073ce70c60_dbkw48m1devstack@QuobyteHD /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-603ceb8f-999e-4bdd-a2b4-3010a4fd6af5 {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 25 15:57:40 devstack sudo[88719]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_c50f3ecd-5e88-4737-aa36-6e073ce70c60_dbkw48m1devstack@QuobyteHD /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-603ceb8f-999e-4bdd-a2b4-3010a4fd6af5 Feb 25 15:57:40 devstack sudo[88719]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 25 15:57:40 devstack cinder-volume[83528]: DEBUG cinder.coordination [None req-3a4b27e4-dcd3-4337-bd34-7249b436eb86 tempest-VolumesGetTest-958147190 None] Acquiring lock "cinder-quobyte-cc95ece6-e94f-470e-bf90-21b6c707a9d4" by "delete_volume" {{(pid=83528) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 25 15:57:40 devstack cinder-volume[83528]: DEBUG cinder.coordination [None req-3a4b27e4-dcd3-4337-bd34-7249b436eb86 tempest-VolumesGetTest-958147190 None] Lock "cinder-quobyte-cc95ece6-e94f-470e-bf90-21b6c707a9d4" acquired by "delete_volume" :: waited 0.010s {{(pid=83528) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 25 15:57:40 devstack sudo[88718]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-66cc9438-f1f5-4c07-8d43-9b6af58f1291 Feb 25 15:57:40 devstack sudo[88718]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 25 15:57:40 devstack cinder-volume[83528]: DEBUG oslo.privsep.daemon [-] privsep: reply[f30c4bfb-609f-47c9-92cf-8ef96963729c]: (4, 'qcow2') {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 25 15:57:40 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-3a4b27e4-dcd3-4337-bd34-7249b436eb86 tempest-VolumesGetTest-958147190 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-cc95ece6-e94f-470e-bf90-21b6c707a9d4 {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 25 15:57:40 devstack sudo[88722]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-cc95ece6-e94f-470e-bf90-21b6c707a9d4 Feb 25 15:57:40 devstack sudo[88722]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 25 15:57:40 devstack sudo[88713]: pam_unix(sudo:session): session closed for user root Feb 25 15:57:40 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-9ca7b7c1-16a8-4d29-bc49-1ca2499232f8 tempest-VolumesDeleteCascade-1036059898 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-7b3ec993-062b-49bc-8f15-f2e125115130" returned: 0 in 0.500s {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 25 15:57:40 devstack cinder-volume[83528]: DEBUG cinder.coordination [None req-9ca7b7c1-16a8-4d29-bc49-1ca2499232f8 tempest-VolumesDeleteCascade-1036059898 None] Lock "cinder-quobyte-7b3ec993-062b-49bc-8f15-f2e125115130" released by "delete_volume" :: held 1.028s {{(pid=83528) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 25 15:57:40 devstack cinder-volume[83528]: DEBUG cinder.quota [None req-9ca7b7c1-16a8-4d29-bc49-1ca2499232f8 tempest-VolumesDeleteCascade-1036059898 None] Created reservations ['da2df5ae-2842-443f-adac-6c2d639623cf', 'ba895026-a1a9-411e-8467-cd3520894760', 'd23af665-a5d2-4467-95d3-6409725e261e', '3babe2a6-901a-4997-9056-ba4957ffe364'] {{(pid=83528) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 25 15:57:40 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-9ca7b7c1-16a8-4d29-bc49-1ca2499232f8 tempest-VolumesDeleteCascade-1036059898 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 25 15:57:40 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-9ca7b7c1-16a8-4d29-bc49-1ca2499232f8 tempest-VolumesDeleteCascade-1036059898 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 25 15:57:40 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.quobyte [None req-9ca7b7c1-16a8-4d29-bc49-1ca2499232f8 tempest-VolumesDeleteCascade-1036059898 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23e9d725-3e04-4cd9-bfe0-c8ef43305589': None} {{(pid=83528) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 25 15:57:40 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.quobyte [None req-9ca7b7c1-16a8-4d29-bc49-1ca2499232f8 tempest-VolumesDeleteCascade-1036059898 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23e9d725-3e04-4cd9-bfe0-c8ef43305589'] {{(pid=83528) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 25 15:57:40 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-9ca7b7c1-16a8-4d29-bc49-1ca2499232f8 tempest-VolumesDeleteCascade-1036059898 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 25 15:57:40 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-9ca7b7c1-16a8-4d29-bc49-1ca2499232f8 tempest-VolumesDeleteCascade-1036059898 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85 {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 25 15:57:40 devstack sudo[88725]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85 Feb 25 15:57:40 devstack sudo[88725]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 25 15:57:40 devstack sudo[88718]: pam_unix(sudo:session): session closed for user root Feb 25 15:57:40 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-94865ed7-af8d-471a-ae32-2fd11a8a17b2 tempest-VolumesSnapshotNegativeTestJSON-221576189 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-66cc9438-f1f5-4c07-8d43-9b6af58f1291" returned: 0 in 0.555s {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 25 15:57:40 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-94865ed7-af8d-471a-ae32-2fd11a8a17b2 tempest-VolumesSnapshotNegativeTestJSON-221576189 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-66cc9438-f1f5-4c07-8d43-9b6af58f1291,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-66cc9438-f1f5-4c07-8d43-9b6af58f1291.9b025f5d-9beb-4908-a8ba-57073cf1853e 2G {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 25 15:57:40 devstack sudo[88735]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-66cc9438-f1f5-4c07-8d43-9b6af58f1291,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-66cc9438-f1f5-4c07-8d43-9b6af58f1291.9b025f5d-9beb-4908-a8ba-57073cf1853e 2G Feb 25 15:57:40 devstack sudo[88735]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 25 15:57:40 devstack sudo[88722]: pam_unix(sudo:session): session closed for user root Feb 25 15:57:40 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-3a4b27e4-dcd3-4337-bd34-7249b436eb86 tempest-VolumesGetTest-958147190 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-cc95ece6-e94f-470e-bf90-21b6c707a9d4" returned: 0 in 0.565s {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 25 15:57:40 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-3a4b27e4-dcd3-4337-bd34-7249b436eb86 tempest-VolumesGetTest-958147190 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-cc95ece6-e94f-470e-bf90-21b6c707a9d4 {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 25 15:57:40 devstack sudo[88741]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-cc95ece6-e94f-470e-bf90-21b6c707a9d4 Feb 25 15:57:40 devstack sudo[88741]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 25 15:57:40 devstack sudo[88725]: pam_unix(sudo:session): session closed for user root Feb 25 15:57:40 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-9ca7b7c1-16a8-4d29-bc49-1ca2499232f8 tempest-VolumesDeleteCascade-1036059898 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85" returned: 0 in 0.476s {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 25 15:57:40 devstack cinder-volume[83528]: DEBUG cinder.manager [None req-9ca7b7c1-16a8-4d29-bc49-1ca2499232f8 tempest-VolumesDeleteCascade-1036059898 None] Notifying Schedulers of capabilities ... {{(pid=83528) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 25 15:57:40 devstack cinder-volume[83528]: INFO cinder.volume.manager [None req-9ca7b7c1-16a8-4d29-bc49-1ca2499232f8 tempest-VolumesDeleteCascade-1036059898 None] Deleted volume successfully. Feb 25 15:57:40 devstack cinder-volume[83528]: DEBUG cinder.coordination [None req-9ca7b7c1-16a8-4d29-bc49-1ca2499232f8 tempest-VolumesDeleteCascade-1036059898 None] Lock "cinder-7b3ec993-062b-49bc-8f15-f2e125115130-delete_volume" released by "delete_volume" :: held 3.984s {{(pid=83528) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 25 15:57:41 devstack sudo[88719]: pam_unix(sudo:session): session closed for user root Feb 25 15:57:41 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-7c7478fd-408e-4997-8145-12295682893d tempest-TestVolumeBootPattern-1339247704 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_c50f3ecd-5e88-4737-aa36-6e073ce70c60_dbkw48m1devstack@QuobyteHD /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-603ceb8f-999e-4bdd-a2b4-3010a4fd6af5" returned: 0 in 0.972s {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 25 15:57:41 devstack cinder-volume[83528]: DEBUG cinder.image.image_utils [None req-7c7478fd-408e-4997-8145-12295682893d tempest-TestVolumeBootPattern-1339247704 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_c50f3ecd-5e88-4737-aa36-6e073ce70c60_dbkw48m1devstack@QuobyteHD, size 112.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-603ceb8f-999e-4bdd-a2b4-3010a4fd6af5 {{(pid=83528) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Feb 25 15:57:41 devstack cinder-volume[83528]: INFO cinder.image.image_utils [None req-7c7478fd-408e-4997-8145-12295682893d tempest-TestVolumeBootPattern-1339247704 None] Converted 112.00 MB image at 112.00 MB/s Feb 25 15:57:41 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-7c7478fd-408e-4997-8145-12295682893d tempest-TestVolumeBootPattern-1339247704 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-603ceb8f-999e-4bdd-a2b4-3010a4fd6af5 1G {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 25 15:57:41 devstack sudo[88747]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-603ceb8f-999e-4bdd-a2b4-3010a4fd6af5 1G Feb 25 15:57:41 devstack sudo[88747]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 25 15:57:41 devstack sudo[88735]: pam_unix(sudo:session): session closed for user root Feb 25 15:57:41 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-94865ed7-af8d-471a-ae32-2fd11a8a17b2 tempest-VolumesSnapshotNegativeTestJSON-221576189 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-66cc9438-f1f5-4c07-8d43-9b6af58f1291,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-66cc9438-f1f5-4c07-8d43-9b6af58f1291.9b025f5d-9beb-4908-a8ba-57073cf1853e 2G" returned: 0 in 0.579s {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 25 15:57:41 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-94865ed7-af8d-471a-ae32-2fd11a8a17b2 tempest-VolumesSnapshotNegativeTestJSON-221576189 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-66cc9438-f1f5-4c07-8d43-9b6af58f1291 -F qcow2 /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-66cc9438-f1f5-4c07-8d43-9b6af58f1291.9b025f5d-9beb-4908-a8ba-57073cf1853e {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 25 15:57:41 devstack sudo[88750]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-66cc9438-f1f5-4c07-8d43-9b6af58f1291 -F qcow2 /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-66cc9438-f1f5-4c07-8d43-9b6af58f1291.9b025f5d-9beb-4908-a8ba-57073cf1853e Feb 25 15:57:41 devstack sudo[88750]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 25 15:57:41 devstack sudo[88741]: pam_unix(sudo:session): session closed for user root Feb 25 15:57:41 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-3a4b27e4-dcd3-4337-bd34-7249b436eb86 tempest-VolumesGetTest-958147190 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-cc95ece6-e94f-470e-bf90-21b6c707a9d4" returned: 0 in 0.542s {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 25 15:57:41 devstack cinder-volume[83528]: DEBUG cinder.coordination [None req-3a4b27e4-dcd3-4337-bd34-7249b436eb86 tempest-VolumesGetTest-958147190 None] Lock "cinder-quobyte-cc95ece6-e94f-470e-bf90-21b6c707a9d4" released by "delete_volume" :: held 1.130s {{(pid=83528) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 25 15:57:41 devstack cinder-volume[83528]: DEBUG cinder.coordination [None req-a94655a8-0ded-4a95-ab1a-fc01183de130 tempest-VolumesDeleteCascade-1036059898 None] Acquiring lock "cinder-2afba5cf-b7fe-41bf-b8aa-4d761bee261a-delete_volume" by "delete_volume" {{(pid=83528) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 25 15:57:41 devstack cinder-volume[83528]: DEBUG cinder.quota [None req-3a4b27e4-dcd3-4337-bd34-7249b436eb86 tempest-VolumesGetTest-958147190 None] Created reservations ['79eecbed-fe89-49d6-a324-53027f855452', 'c981f471-acfa-490b-b1e1-6e27035182e7', '59821e7e-b4b0-4fc8-b288-a4301988f410', '5e74668d-4bfa-4b7c-a747-f36e324fe949'] {{(pid=83528) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 25 15:57:41 devstack cinder-volume[83528]: DEBUG cinder.coordination [None req-a94655a8-0ded-4a95-ab1a-fc01183de130 tempest-VolumesDeleteCascade-1036059898 None] Lock "cinder-2afba5cf-b7fe-41bf-b8aa-4d761bee261a-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=83528) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 25 15:57:41 devstack cinder-volume[83528]: DEBUG cinder.coordination [None req-a94655a8-0ded-4a95-ab1a-fc01183de130 tempest-VolumesDeleteCascade-1036059898 None] Acquiring lock "cinder-quobyte-2afba5cf-b7fe-41bf-b8aa-4d761bee261a" by "delete_volume" {{(pid=83528) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 25 15:57:41 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-3a4b27e4-dcd3-4337-bd34-7249b436eb86 tempest-VolumesGetTest-958147190 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 25 15:57:41 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-3a4b27e4-dcd3-4337-bd34-7249b436eb86 tempest-VolumesGetTest-958147190 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 25 15:57:41 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.quobyte [None req-3a4b27e4-dcd3-4337-bd34-7249b436eb86 tempest-VolumesGetTest-958147190 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23e9d725-3e04-4cd9-bfe0-c8ef43305589': None} {{(pid=83528) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 25 15:57:41 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.quobyte [None req-3a4b27e4-dcd3-4337-bd34-7249b436eb86 tempest-VolumesGetTest-958147190 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23e9d725-3e04-4cd9-bfe0-c8ef43305589'] {{(pid=83528) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 25 15:57:41 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-3a4b27e4-dcd3-4337-bd34-7249b436eb86 tempest-VolumesGetTest-958147190 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 25 15:57:41 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-3a4b27e4-dcd3-4337-bd34-7249b436eb86 tempest-VolumesGetTest-958147190 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85 {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 25 15:57:41 devstack cinder-volume[83528]: DEBUG cinder.coordination [None req-a94655a8-0ded-4a95-ab1a-fc01183de130 tempest-VolumesDeleteCascade-1036059898 None] Lock "cinder-quobyte-2afba5cf-b7fe-41bf-b8aa-4d761bee261a" acquired by "delete_volume" :: waited 0.028s {{(pid=83528) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 25 15:57:41 devstack sudo[88752]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85 Feb 25 15:57:41 devstack sudo[88752]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 25 15:57:41 devstack cinder-volume[83528]: DEBUG oslo.privsep.daemon [-] privsep: reply[398bd3f4-ae2c-4298-a631-1396442c01cb]: (4, 'qcow2') {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 25 15:57:41 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-a94655a8-0ded-4a95-ab1a-fc01183de130 tempest-VolumesDeleteCascade-1036059898 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-2afba5cf-b7fe-41bf-b8aa-4d761bee261a {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 25 15:57:41 devstack sudo[88754]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-2afba5cf-b7fe-41bf-b8aa-4d761bee261a Feb 25 15:57:41 devstack sudo[88754]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 25 15:57:41 devstack sudo[88747]: pam_unix(sudo:session): session closed for user root Feb 25 15:57:41 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-7c7478fd-408e-4997-8145-12295682893d tempest-TestVolumeBootPattern-1339247704 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-603ceb8f-999e-4bdd-a2b4-3010a4fd6af5 1G" returned: 0 in 0.526s {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 25 15:57:41 devstack cinder-volume[83528]: DEBUG oslo.privsep.daemon [-] privsep: reply[80d3072a-a7fa-472e-8b24-c4b8281e3209]: (4, 'raw') {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 25 15:57:41 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-7c7478fd-408e-4997-8145-12295682893d tempest-TestVolumeBootPattern-1339247704 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-603ceb8f-999e-4bdd-a2b4-3010a4fd6af5 {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 25 15:57:41 devstack sudo[88750]: pam_unix(sudo:session): session closed for user root Feb 25 15:57:41 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-94865ed7-af8d-471a-ae32-2fd11a8a17b2 tempest-VolumesSnapshotNegativeTestJSON-221576189 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-66cc9438-f1f5-4c07-8d43-9b6af58f1291 -F qcow2 /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-66cc9438-f1f5-4c07-8d43-9b6af58f1291.9b025f5d-9beb-4908-a8ba-57073cf1853e" returned: 0 in 0.475s {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 25 15:57:41 devstack cinder-volume[83528]: WARNING cinder.volume.drivers.remotefs [None req-94865ed7-af8d-471a-ae32-2fd11a8a17b2 tempest-VolumesSnapshotNegativeTestJSON-221576189 None] /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-66cc9438-f1f5-4c07-8d43-9b6af58f1291.9b025f5d-9beb-4908-a8ba-57073cf1853e is being set with open permissions: ugo+rw Feb 25 15:57:41 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-94865ed7-af8d-471a-ae32-2fd11a8a17b2 tempest-VolumesSnapshotNegativeTestJSON-221576189 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-66cc9438-f1f5-4c07-8d43-9b6af58f1291.9b025f5d-9beb-4908-a8ba-57073cf1853e {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 25 15:57:41 devstack sudo[88763]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-66cc9438-f1f5-4c07-8d43-9b6af58f1291.9b025f5d-9beb-4908-a8ba-57073cf1853e Feb 25 15:57:41 devstack sudo[88763]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 25 15:57:41 devstack sudo[88762]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-603ceb8f-999e-4bdd-a2b4-3010a4fd6af5 Feb 25 15:57:41 devstack sudo[88762]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 25 15:57:41 devstack sudo[88752]: pam_unix(sudo:session): session closed for user root Feb 25 15:57:41 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-3a4b27e4-dcd3-4337-bd34-7249b436eb86 tempest-VolumesGetTest-958147190 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85" returned: 0 in 0.445s {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 25 15:57:41 devstack cinder-volume[83528]: DEBUG cinder.manager [None req-3a4b27e4-dcd3-4337-bd34-7249b436eb86 tempest-VolumesGetTest-958147190 None] Notifying Schedulers of capabilities ... {{(pid=83528) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 25 15:57:41 devstack cinder-volume[83528]: INFO cinder.volume.manager [None req-3a4b27e4-dcd3-4337-bd34-7249b436eb86 tempest-VolumesGetTest-958147190 None] Deleted volume successfully. Feb 25 15:57:41 devstack cinder-volume[83528]: DEBUG cinder.coordination [None req-3a4b27e4-dcd3-4337-bd34-7249b436eb86 tempest-VolumesGetTest-958147190 None] Lock "cinder-cc95ece6-e94f-470e-bf90-21b6c707a9d4-delete_volume" released by "delete_volume" :: held 1.793s {{(pid=83528) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 25 15:57:42 devstack sudo[88754]: pam_unix(sudo:session): session closed for user root Feb 25 15:57:42 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-a94655a8-0ded-4a95-ab1a-fc01183de130 tempest-VolumesDeleteCascade-1036059898 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-2afba5cf-b7fe-41bf-b8aa-4d761bee261a" returned: 0 in 0.504s {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 25 15:57:42 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-a94655a8-0ded-4a95-ab1a-fc01183de130 tempest-VolumesDeleteCascade-1036059898 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-2afba5cf-b7fe-41bf-b8aa-4d761bee261a {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 25 15:57:42 devstack sudo[88770]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-2afba5cf-b7fe-41bf-b8aa-4d761bee261a Feb 25 15:57:42 devstack sudo[88770]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 25 15:57:42 devstack sudo[88762]: pam_unix(sudo:session): session closed for user root Feb 25 15:57:42 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-7c7478fd-408e-4997-8145-12295682893d tempest-TestVolumeBootPattern-1339247704 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-603ceb8f-999e-4bdd-a2b4-3010a4fd6af5" returned: 0 in 0.495s {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 25 15:57:42 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-7c7478fd-408e-4997-8145-12295682893d tempest-TestVolumeBootPattern-1339247704 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-603ceb8f-999e-4bdd-a2b4-3010a4fd6af5 {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 25 15:57:42 devstack sudo[88763]: pam_unix(sudo:session): session closed for user root Feb 25 15:57:42 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-94865ed7-af8d-471a-ae32-2fd11a8a17b2 tempest-VolumesSnapshotNegativeTestJSON-221576189 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-66cc9438-f1f5-4c07-8d43-9b6af58f1291.9b025f5d-9beb-4908-a8ba-57073cf1853e" returned: 0 in 0.476s {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 25 15:57:42 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-94865ed7-af8d-471a-ae32-2fd11a8a17b2 tempest-VolumesSnapshotNegativeTestJSON-221576189 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-66cc9438-f1f5-4c07-8d43-9b6af58f1291.info {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 25 15:57:42 devstack sudo[88776]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-66cc9438-f1f5-4c07-8d43-9b6af58f1291.info Feb 25 15:57:42 devstack sudo[88776]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 25 15:57:42 devstack sudo[88775]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-603ceb8f-999e-4bdd-a2b4-3010a4fd6af5 Feb 25 15:57:42 devstack sudo[88775]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 25 15:57:42 devstack sudo[88770]: pam_unix(sudo:session): session closed for user root Feb 25 15:57:42 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-a94655a8-0ded-4a95-ab1a-fc01183de130 tempest-VolumesDeleteCascade-1036059898 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-2afba5cf-b7fe-41bf-b8aa-4d761bee261a" returned: 0 in 0.419s {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 25 15:57:42 devstack cinder-volume[83528]: DEBUG cinder.coordination [None req-a94655a8-0ded-4a95-ab1a-fc01183de130 tempest-VolumesDeleteCascade-1036059898 None] Lock "cinder-quobyte-2afba5cf-b7fe-41bf-b8aa-4d761bee261a" released by "delete_volume" :: held 0.950s {{(pid=83528) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 25 15:57:42 devstack cinder-volume[83528]: DEBUG cinder.quota [None req-a94655a8-0ded-4a95-ab1a-fc01183de130 tempest-VolumesDeleteCascade-1036059898 None] Created reservations ['52ac340c-2e8b-4fe0-8c6e-5bd6ff77b256', '13b795c5-7d80-498c-9667-7b699b2efa86', 'e6affa7d-2594-4499-bc20-411c7e3c933a', '4eacabc9-376c-45a8-a2ad-ea6efbef704d'] {{(pid=83528) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 25 15:57:42 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-a94655a8-0ded-4a95-ab1a-fc01183de130 tempest-VolumesDeleteCascade-1036059898 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 25 15:57:42 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-a94655a8-0ded-4a95-ab1a-fc01183de130 tempest-VolumesDeleteCascade-1036059898 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 25 15:57:42 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.quobyte [None req-a94655a8-0ded-4a95-ab1a-fc01183de130 tempest-VolumesDeleteCascade-1036059898 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23e9d725-3e04-4cd9-bfe0-c8ef43305589': None} {{(pid=83528) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 25 15:57:42 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.quobyte [None req-a94655a8-0ded-4a95-ab1a-fc01183de130 tempest-VolumesDeleteCascade-1036059898 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23e9d725-3e04-4cd9-bfe0-c8ef43305589'] {{(pid=83528) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 25 15:57:42 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-a94655a8-0ded-4a95-ab1a-fc01183de130 tempest-VolumesDeleteCascade-1036059898 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 25 15:57:42 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-a94655a8-0ded-4a95-ab1a-fc01183de130 tempest-VolumesDeleteCascade-1036059898 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85 {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 25 15:57:42 devstack sudo[88780]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85 Feb 25 15:57:42 devstack sudo[88780]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 25 15:57:42 devstack cinder-volume[83528]: DEBUG cinder.volume.flows.manager.create_volume [None req-26f0aab9-cf67-4bce-bf51-71e560817ddc tempest-VolumesGetTest-958147190 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83528) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 25 15:57:42 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-26f0aab9-cf67-4bce-bf51-71e560817ddc tempest-VolumesGetTest-958147190 None] Flow 'volume_create_manager' (e335a8c7-8371-4f40-bb6b-b1f2e159b754) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83528) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 25 15:57:42 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-26f0aab9-cf67-4bce-bf51-71e560817ddc tempest-VolumesGetTest-958147190 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5a5acbaf-af2e-49f5-a890-68ab60964e4b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 25 15:57:42 devstack sudo[88776]: pam_unix(sudo:session): session closed for user root Feb 25 15:57:42 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-94865ed7-af8d-471a-ae32-2fd11a8a17b2 tempest-VolumesSnapshotNegativeTestJSON-221576189 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-66cc9438-f1f5-4c07-8d43-9b6af58f1291.info" returned: 0 in 0.498s {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 25 15:57:42 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-26f0aab9-cf67-4bce-bf51-71e560817ddc tempest-VolumesGetTest-958147190 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5a5acbaf-af2e-49f5-a890-68ab60964e4b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-25T14:57:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1698804307',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b6a247fd-8187-4862-9f69-ba87bfe2e9ff,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='30b56c3cb9b44b44bc932bfa91495865',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-25T14:57:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-25T14:57:43Z,use_quota=True,user_id='e09e6f803ddf47f09c166c46461b2f9a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ce71c2f9-6543-4165-9653-a1529b2ea243),volume_type_id=ce71c2f9-6543-4165-9653-a1529b2ea243)' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 25 15:57:42 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-26f0aab9-cf67-4bce-bf51-71e560817ddc tempest-VolumesGetTest-958147190 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5cfa0f94-3c9f-4f45-94ba-a404ee48c2d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 25 15:57:42 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-26f0aab9-cf67-4bce-bf51-71e560817ddc tempest-VolumesGetTest-958147190 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5cfa0f94-3c9f-4f45-94ba-a404ee48c2d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 25 15:57:42 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-26f0aab9-cf67-4bce-bf51-71e560817ddc tempest-VolumesGetTest-958147190 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3c257186-57f0-454c-8bbc-7d55511f579e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 25 15:57:42 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-26f0aab9-cf67-4bce-bf51-71e560817ddc tempest-VolumesGetTest-958147190 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3c257186-57f0-454c-8bbc-7d55511f579e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b6a247fd-8187-4862-9f69-ba87bfe2e9ff', 'volume_name': 'volume-b6a247fd-8187-4862-9f69-ba87bfe2e9ff', 'volume_size': 1}' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 25 15:57:42 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-26f0aab9-cf67-4bce-bf51-71e560817ddc tempest-VolumesGetTest-958147190 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ca6e8d6f-994e-4c5e-9630-80fb5191a03b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 25 15:57:42 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-26f0aab9-cf67-4bce-bf51-71e560817ddc tempest-VolumesGetTest-958147190 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ca6e8d6f-994e-4c5e-9630-80fb5191a03b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 25 15:57:42 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-26f0aab9-cf67-4bce-bf51-71e560817ddc tempest-VolumesGetTest-958147190 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (83a9da33-1c56-4654-9ee6-91a1cee8098e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 25 15:57:42 devstack cinder-volume[83528]: INFO cinder.volume.flows.manager.create_volume [None req-26f0aab9-cf67-4bce-bf51-71e560817ddc tempest-VolumesGetTest-958147190 None] Volume b6a247fd-8187-4862-9f69-ba87bfe2e9ff: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b6a247fd-8187-4862-9f69-ba87bfe2e9ff', 'volume_size': 1} Feb 25 15:57:42 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-26f0aab9-cf67-4bce-bf51-71e560817ddc tempest-VolumesGetTest-958147190 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 25 15:57:42 devstack cinder-volume[83528]: WARNING cinder.volume.drivers.remotefs [None req-94865ed7-af8d-471a-ae32-2fd11a8a17b2 tempest-VolumesSnapshotNegativeTestJSON-221576189 None] /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-66cc9438-f1f5-4c07-8d43-9b6af58f1291.info is being set with open permissions: ugo+rw Feb 25 15:57:42 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-94865ed7-af8d-471a-ae32-2fd11a8a17b2 tempest-VolumesSnapshotNegativeTestJSON-221576189 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-66cc9438-f1f5-4c07-8d43-9b6af58f1291.info {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 25 15:57:42 devstack sudo[88786]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-66cc9438-f1f5-4c07-8d43-9b6af58f1291.info Feb 25 15:57:42 devstack sudo[88786]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 25 15:57:42 devstack sudo[88775]: pam_unix(sudo:session): session closed for user root Feb 25 15:57:42 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-7c7478fd-408e-4997-8145-12295682893d tempest-TestVolumeBootPattern-1339247704 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-603ceb8f-999e-4bdd-a2b4-3010a4fd6af5" returned: 1 in 0.606s {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 25 15:57:42 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-7c7478fd-408e-4997-8145-12295682893d tempest-TestVolumeBootPattern-1339247704 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-603ceb8f-999e-4bdd-a2b4-3010a4fd6af5' failed. Not Retrying. {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Feb 25 15:57:42 devstack cinder-volume[83528]: DEBUG cinder.volume.volume_utils [None req-7c7478fd-408e-4997-8145-12295682893d tempest-TestVolumeBootPattern-1339247704 None] Downloaded image c50f3ecd-5e88-4737-aa36-6e073ce70c60 ((None, [{'url': 'file:///opt/stack/data/glance/images/c50f3ecd-5e88-4737-aa36-6e073ce70c60', 'metadata': {}}])) to volume 603ceb8f-999e-4bdd-a2b4-3010a4fd6af5 successfully. {{(pid=83528) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1234}} Feb 25 15:57:42 devstack cinder-volume[83528]: DEBUG cinder.image.image_utils [None req-7c7478fd-408e-4997-8145-12295682893d tempest-TestVolumeBootPattern-1339247704 None] Temporary image c50f3ecd-5e88-4737-aa36-6e073ce70c60 for user a1dcddd485dd48ae82df66efa0ae0b80 is deleted. {{(pid=83528) fetch /opt/stack/cinder/cinder/image/image_utils.py:1435}} Feb 25 15:57:42 devstack cinder-volume[83528]: DEBUG cinder.volume.volume_utils [None req-7c7478fd-408e-4997-8145-12295682893d tempest-TestVolumeBootPattern-1339247704 None] Marking volume 603ceb8f-999e-4bdd-a2b4-3010a4fd6af5 as bootable. {{(pid=83528) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1138}} Feb 25 15:57:42 devstack cinder-volume[83528]: DEBUG cinder.volume.flows.manager.create_volume [None req-7c7478fd-408e-4997-8145-12295682893d tempest-TestVolumeBootPattern-1339247704 None] Copying metadata from image c50f3ecd-5e88-4737-aa36-6e073ce70c60 to 603ceb8f-999e-4bdd-a2b4-3010a4fd6af5. {{(pid=83528) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Feb 25 15:57:42 devstack cinder-volume[83528]: DEBUG cinder.volume.flows.manager.create_volume [None req-7c7478fd-408e-4997-8145-12295682893d tempest-TestVolumeBootPattern-1339247704 None] Creating volume glance metadata for volume 603ceb8f-999e-4bdd-a2b4-3010a4fd6af5 backed by image c50f3ecd-5e88-4737-aa36-6e073ce70c60 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': 'c50f3ecd-5e88-4737-aa36-6e073ce70c60', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=83528) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Feb 25 15:57:42 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-7c7478fd-408e-4997-8145-12295682893d tempest-TestVolumeBootPattern-1339247704 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7e0053a1-733e-4cf0-ab69-6ca3188cb2ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-603ceb8f-999e-4bdd-a2b4-3010a4fd6af5', 'volume_size': 1, 'image_id': 'c50f3ecd-5e88-4737-aa36-6e073ce70c60', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/c50f3ecd-5e88-4737-aa36-6e073ce70c60', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '75f8571da0ad46ec8e734ab2a4fa231d', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'c50f3ecd-5e88-4737-aa36-6e073ce70c60', 'created_at': datetime.datetime(2026, 2, 25, 14, 47, 16, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 2, 25, 14, 47, 18, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/c50f3ecd-5e88-4737-aa36-6e073ce70c60/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 25 15:57:42 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-7c7478fd-408e-4997-8145-12295682893d tempest-TestVolumeBootPattern-1339247704 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f9b59f42-550a-42e7-bdfb-1295dc483afb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 25 15:57:42 devstack cinder-volume[83528]: INFO cinder.volume.flows.manager.create_volume [None req-7c7478fd-408e-4997-8145-12295682893d tempest-TestVolumeBootPattern-1339247704 None] Volume volume-603ceb8f-999e-4bdd-a2b4-3010a4fd6af5 (603ceb8f-999e-4bdd-a2b4-3010a4fd6af5): created successfully Feb 25 15:57:42 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-7c7478fd-408e-4997-8145-12295682893d tempest-TestVolumeBootPattern-1339247704 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f9b59f42-550a-42e7-bdfb-1295dc483afb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 25 15:57:42 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-7c7478fd-408e-4997-8145-12295682893d tempest-TestVolumeBootPattern-1339247704 None] Flow 'volume_create_manager' (34454895-930c-40cd-8734-3d7c925e1cbc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83528) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 25 15:57:42 devstack cinder-volume[83528]: INFO cinder.volume.manager [None req-7c7478fd-408e-4997-8145-12295682893d tempest-TestVolumeBootPattern-1339247704 None] Created volume successfully. Feb 25 15:57:43 devstack sudo[88780]: pam_unix(sudo:session): session closed for user root Feb 25 15:57:43 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-a94655a8-0ded-4a95-ab1a-fc01183de130 tempest-VolumesDeleteCascade-1036059898 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85" returned: 0 in 0.453s {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 25 15:57:43 devstack cinder-volume[83528]: DEBUG cinder.manager [None req-a94655a8-0ded-4a95-ab1a-fc01183de130 tempest-VolumesDeleteCascade-1036059898 None] Notifying Schedulers of capabilities ... {{(pid=83528) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 25 15:57:43 devstack cinder-volume[83528]: INFO cinder.volume.manager [None req-a94655a8-0ded-4a95-ab1a-fc01183de130 tempest-VolumesDeleteCascade-1036059898 None] Deleted volume successfully. Feb 25 15:57:43 devstack cinder-volume[83528]: DEBUG cinder.coordination [None req-a94655a8-0ded-4a95-ab1a-fc01183de130 tempest-VolumesDeleteCascade-1036059898 None] Lock "cinder-2afba5cf-b7fe-41bf-b8aa-4d761bee261a-delete_volume" released by "delete_volume" :: held 1.646s {{(pid=83528) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 25 15:57:43 devstack sudo[88786]: pam_unix(sudo:session): session closed for user root Feb 25 15:57:43 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-94865ed7-af8d-471a-ae32-2fd11a8a17b2 tempest-VolumesSnapshotNegativeTestJSON-221576189 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-66cc9438-f1f5-4c07-8d43-9b6af58f1291.info" returned: 0 in 0.437s {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 25 15:57:43 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-94865ed7-af8d-471a-ae32-2fd11a8a17b2 tempest-VolumesSnapshotNegativeTestJSON-221576189 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.128s {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 25 15:57:43 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-26f0aab9-cf67-4bce-bf51-71e560817ddc tempest-VolumesGetTest-958147190 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.449s {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 25 15:57:43 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.quobyte [None req-26f0aab9-cf67-4bce-bf51-71e560817ddc tempest-VolumesGetTest-958147190 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-25T14:57:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1698804307',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b6a247fd-8187-4862-9f69-ba87bfe2e9ff,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='30b56c3cb9b44b44bc932bfa91495865',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-25T14:57:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-25T14:57:43Z,use_quota=True,user_id='e09e6f803ddf47f09c166c46461b2f9a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ce71c2f9-6543-4165-9653-a1529b2ea243),volume_type_id=ce71c2f9-6543-4165-9653-a1529b2ea243)}" {{(pid=83528) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 25 15:57:43 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.remotefs [None req-26f0aab9-cf67-4bce-bf51-71e560817ddc tempest-VolumesGetTest-958147190 None] Creating volume b6a247fd-8187-4862-9f69-ba87bfe2e9ff {{(pid=83528) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 25 15:57:43 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-26f0aab9-cf67-4bce-bf51-71e560817ddc tempest-VolumesGetTest-958147190 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 25 15:57:43 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-26f0aab9-cf67-4bce-bf51-71e560817ddc tempest-VolumesGetTest-958147190 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 25 15:57:43 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.quobyte [None req-26f0aab9-cf67-4bce-bf51-71e560817ddc tempest-VolumesGetTest-958147190 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23e9d725-3e04-4cd9-bfe0-c8ef43305589': None} {{(pid=83528) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 25 15:57:43 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.quobyte [None req-26f0aab9-cf67-4bce-bf51-71e560817ddc tempest-VolumesGetTest-958147190 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23e9d725-3e04-4cd9-bfe0-c8ef43305589'] {{(pid=83528) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 25 15:57:43 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-26f0aab9-cf67-4bce-bf51-71e560817ddc tempest-VolumesGetTest-958147190 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 25 15:57:43 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.quobyte [None req-26f0aab9-cf67-4bce-bf51-71e560817ddc tempest-VolumesGetTest-958147190 None] Selected osci02.corp.quobyte.com/cinder-vol-23e9d725-3e04-4cd9-bfe0-c8ef43305589 as target Quobyte volume. {{(pid=83528) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 25 15:57:43 devstack cinder-volume[83528]: INFO cinder.volume.drivers.remotefs [None req-26f0aab9-cf67-4bce-bf51-71e560817ddc tempest-VolumesGetTest-958147190 None] casted to osci02.corp.quobyte.com/cinder-vol-23e9d725-3e04-4cd9-bfe0-c8ef43305589 Feb 25 15:57:43 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-26f0aab9-cf67-4bce-bf51-71e560817ddc tempest-VolumesGetTest-958147190 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-b6a247fd-8187-4862-9f69-ba87bfe2e9ff 1073741824 {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 25 15:57:43 devstack sudo[88790]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-b6a247fd-8187-4862-9f69-ba87bfe2e9ff 1073741824 Feb 25 15:57:43 devstack sudo[88790]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 25 15:57:43 devstack cinder-volume[83528]: INFO cinder.volume.manager [None req-94865ed7-af8d-471a-ae32-2fd11a8a17b2 tempest-VolumesSnapshotNegativeTestJSON-221576189 None] Create snapshot completed successfully Feb 25 15:57:43 devstack sudo[88790]: pam_unix(sudo:session): session closed for user root Feb 25 15:57:43 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-26f0aab9-cf67-4bce-bf51-71e560817ddc tempest-VolumesGetTest-958147190 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-b6a247fd-8187-4862-9f69-ba87bfe2e9ff 1073741824" returned: 0 in 0.636s {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 25 15:57:43 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-26f0aab9-cf67-4bce-bf51-71e560817ddc tempest-VolumesGetTest-958147190 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-b6a247fd-8187-4862-9f69-ba87bfe2e9ff {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 25 15:57:43 devstack sudo[88796]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-b6a247fd-8187-4862-9f69-ba87bfe2e9ff Feb 25 15:57:43 devstack sudo[88796]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 25 15:57:44 devstack cinder-volume[83528]: DEBUG cinder.coordination [None req-a953d070-d812-405f-8606-c46a4ef530d5 tempest-VolumesSnapshotNegativeTestJSON-221576189 None] Acquiring lock "cinder-9b025f5d-9beb-4908-a8ba-57073cf1853e-delete_snapshot" by "delete_snapshot" {{(pid=83528) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 25 15:57:44 devstack cinder-volume[83528]: DEBUG cinder.coordination [None req-a953d070-d812-405f-8606-c46a4ef530d5 tempest-VolumesSnapshotNegativeTestJSON-221576189 None] Lock "cinder-9b025f5d-9beb-4908-a8ba-57073cf1853e-delete_snapshot" acquired by "delete_snapshot" :: waited 0.012s {{(pid=83528) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 25 15:57:44 devstack cinder-volume[83528]: DEBUG cinder.coordination [None req-a953d070-d812-405f-8606-c46a4ef530d5 tempest-VolumesSnapshotNegativeTestJSON-221576189 None] Acquiring lock "cinder-quobyte-66cc9438-f1f5-4c07-8d43-9b6af58f1291" by "delete_snapshot" {{(pid=83528) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 25 15:57:44 devstack cinder-volume[83528]: DEBUG cinder.coordination [None req-a953d070-d812-405f-8606-c46a4ef530d5 tempest-VolumesSnapshotNegativeTestJSON-221576189 None] Lock "cinder-quobyte-66cc9438-f1f5-4c07-8d43-9b6af58f1291" acquired by "delete_snapshot" :: waited 0.009s {{(pid=83528) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 25 15:57:44 devstack cinder-volume[83528]: DEBUG cinder.coordination [None req-a953d070-d812-405f-8606-c46a4ef530d5 tempest-VolumesSnapshotNegativeTestJSON-221576189 None] Acquiring lock "cinder-quobyte-9b025f5d-9beb-4908-a8ba-57073cf1853e" by "_delete_snapshot" {{(pid=83528) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 25 15:57:44 devstack cinder-volume[83528]: DEBUG cinder.coordination [None req-a953d070-d812-405f-8606-c46a4ef530d5 tempest-VolumesSnapshotNegativeTestJSON-221576189 None] Lock "cinder-quobyte-9b025f5d-9beb-4908-a8ba-57073cf1853e" acquired by "_delete_snapshot" :: waited 0.008s {{(pid=83528) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 25 15:57:44 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.remotefs [None req-a953d070-d812-405f-8606-c46a4ef530d5 tempest-VolumesSnapshotNegativeTestJSON-221576189 None] Deleting offline snapshot 9b025f5d-9beb-4908-a8ba-57073cf1853e of volume 66cc9438-f1f5-4c07-8d43-9b6af58f1291 {{(pid=83528) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Feb 25 15:57:44 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.remotefs [None req-a953d070-d812-405f-8606-c46a4ef530d5 tempest-VolumesSnapshotNegativeTestJSON-221576189 None] snapshot_file for this snap is: volume-66cc9438-f1f5-4c07-8d43-9b6af58f1291.9b025f5d-9beb-4908-a8ba-57073cf1853e {{(pid=83528) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Feb 25 15:57:44 devstack cinder-volume[83528]: DEBUG oslo.privsep.daemon [-] privsep: reply[70fa7adb-01be-4b97-a0eb-81ba46bdd325]: (4, 'qcow2') {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 25 15:57:44 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-a953d070-d812-405f-8606-c46a4ef530d5 tempest-VolumesSnapshotNegativeTestJSON-221576189 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-66cc9438-f1f5-4c07-8d43-9b6af58f1291.9b025f5d-9beb-4908-a8ba-57073cf1853e {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 25 15:57:44 devstack sudo[88796]: pam_unix(sudo:session): session closed for user root Feb 25 15:57:44 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-26f0aab9-cf67-4bce-bf51-71e560817ddc tempest-VolumesGetTest-958147190 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-b6a247fd-8187-4862-9f69-ba87bfe2e9ff" returned: 0 in 0.511s {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 25 15:57:44 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.quobyte [None req-26f0aab9-cf67-4bce-bf51-71e560817ddc tempest-VolumesGetTest-958147190 None] <== create_volume: return (1204ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-23e9d725-3e04-4cd9-bfe0-c8ef43305589'} {{(pid=83528) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 25 15:57:44 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-26f0aab9-cf67-4bce-bf51-71e560817ddc tempest-VolumesGetTest-958147190 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.206s {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 25 15:57:44 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-26f0aab9-cf67-4bce-bf51-71e560817ddc tempest-VolumesGetTest-958147190 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (83a9da33-1c56-4654-9ee6-91a1cee8098e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b6a247fd-8187-4862-9f69-ba87bfe2e9ff', 'volume_size': 1}' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 25 15:57:44 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-26f0aab9-cf67-4bce-bf51-71e560817ddc tempest-VolumesGetTest-958147190 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (35caf473-7c4e-43d0-99a9-dd21d24a2bce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 25 15:57:44 devstack cinder-volume[83528]: INFO cinder.volume.flows.manager.create_volume [None req-26f0aab9-cf67-4bce-bf51-71e560817ddc tempest-VolumesGetTest-958147190 None] Volume volume-b6a247fd-8187-4862-9f69-ba87bfe2e9ff (b6a247fd-8187-4862-9f69-ba87bfe2e9ff): created successfully Feb 25 15:57:44 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-26f0aab9-cf67-4bce-bf51-71e560817ddc tempest-VolumesGetTest-958147190 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (35caf473-7c4e-43d0-99a9-dd21d24a2bce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 25 15:57:44 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-26f0aab9-cf67-4bce-bf51-71e560817ddc tempest-VolumesGetTest-958147190 None] Flow 'volume_create_manager' (e335a8c7-8371-4f40-bb6b-b1f2e159b754) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83528) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 25 15:57:44 devstack cinder-volume[83528]: INFO cinder.volume.manager [None req-26f0aab9-cf67-4bce-bf51-71e560817ddc tempest-VolumesGetTest-958147190 None] Created volume successfully. Feb 25 15:57:44 devstack sudo[88799]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-66cc9438-f1f5-4c07-8d43-9b6af58f1291.9b025f5d-9beb-4908-a8ba-57073cf1853e Feb 25 15:57:44 devstack sudo[88799]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 25 15:57:45 devstack sudo[88799]: pam_unix(sudo:session): session closed for user root Feb 25 15:57:45 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-a953d070-d812-405f-8606-c46a4ef530d5 tempest-VolumesSnapshotNegativeTestJSON-221576189 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-66cc9438-f1f5-4c07-8d43-9b6af58f1291.9b025f5d-9beb-4908-a8ba-57073cf1853e" returned: 0 in 0.656s {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 25 15:57:45 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.remotefs [None req-a953d070-d812-405f-8606-c46a4ef530d5 tempest-VolumesSnapshotNegativeTestJSON-221576189 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-66cc9438-f1f5-4c07-8d43-9b6af58f1291(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83528) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Feb 25 15:57:45 devstack cinder-volume[83528]: DEBUG oslo.privsep.daemon [-] privsep: reply[77a15877-45c5-4885-9797-987cc5a6eb17]: (4, 'qcow2') {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 25 15:57:45 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-a953d070-d812-405f-8606-c46a4ef530d5 tempest-VolumesSnapshotNegativeTestJSON-221576189 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-66cc9438-f1f5-4c07-8d43-9b6af58f1291 {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 25 15:57:45 devstack cinder-volume[83528]: DEBUG cinder.volume.flows.manager.create_volume [None req-285baca3-2da8-4521-8c58-c5bc7946a14a tempest-VolumesGetTest-958147190 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83528) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 25 15:57:45 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-285baca3-2da8-4521-8c58-c5bc7946a14a tempest-VolumesGetTest-958147190 None] Flow 'volume_create_manager' (ccca18d4-547c-42e6-82d6-b60cc1a5a6b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83528) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 25 15:57:45 devstack sudo[88805]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-66cc9438-f1f5-4c07-8d43-9b6af58f1291 Feb 25 15:57:45 devstack sudo[88805]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 25 15:57:45 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-285baca3-2da8-4521-8c58-c5bc7946a14a tempest-VolumesGetTest-958147190 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c01662b5-1e72-416c-9c7c-9ac298ab88b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 25 15:57:45 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-285baca3-2da8-4521-8c58-c5bc7946a14a tempest-VolumesGetTest-958147190 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c01662b5-1e72-416c-9c7c-9ac298ab88b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-25T14:57:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1532713685',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3637a021-495a-44e1-a43f-deddcf72b5a2,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='30b56c3cb9b44b44bc932bfa91495865',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-25T14:57:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=b6a247fd-8187-4862-9f69-ba87bfe2e9ff,status='creating',terminated_at=None,updated_at=2026-02-25T14:57:45Z,use_quota=True,user_id='e09e6f803ddf47f09c166c46461b2f9a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ce71c2f9-6543-4165-9653-a1529b2ea243),volume_type_id=ce71c2f9-6543-4165-9653-a1529b2ea243)' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 25 15:57:45 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-285baca3-2da8-4521-8c58-c5bc7946a14a tempest-VolumesGetTest-958147190 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e7b358e9-c64d-44c0-8b41-0ad31fd79eef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 25 15:57:45 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-285baca3-2da8-4521-8c58-c5bc7946a14a tempest-VolumesGetTest-958147190 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e7b358e9-c64d-44c0-8b41-0ad31fd79eef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 25 15:57:45 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-285baca3-2da8-4521-8c58-c5bc7946a14a tempest-VolumesGetTest-958147190 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (25a1e00b-fe98-45ec-b5d3-acdb20979a5a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 25 15:57:45 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-285baca3-2da8-4521-8c58-c5bc7946a14a tempest-VolumesGetTest-958147190 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (25a1e00b-fe98-45ec-b5d3-acdb20979a5a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': '3637a021-495a-44e1-a43f-deddcf72b5a2', 'volume_name': 'volume-3637a021-495a-44e1-a43f-deddcf72b5a2', 'volume_size': 1, 'source_volid': 'b6a247fd-8187-4862-9f69-ba87bfe2e9ff', 'source_volstatus': 'available'}' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 25 15:57:45 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-285baca3-2da8-4521-8c58-c5bc7946a14a tempest-VolumesGetTest-958147190 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c5ea87dc-2f44-4c5e-8b1c-fc82bfb92f5f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 25 15:57:45 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-285baca3-2da8-4521-8c58-c5bc7946a14a tempest-VolumesGetTest-958147190 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c5ea87dc-2f44-4c5e-8b1c-fc82bfb92f5f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 25 15:57:45 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-285baca3-2da8-4521-8c58-c5bc7946a14a tempest-VolumesGetTest-958147190 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9129b99f-2e01-4a96-9144-e588d6b9ab70) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 25 15:57:45 devstack cinder-volume[83528]: INFO cinder.volume.flows.manager.create_volume [None req-285baca3-2da8-4521-8c58-c5bc7946a14a tempest-VolumesGetTest-958147190 None] Volume 3637a021-495a-44e1-a43f-deddcf72b5a2: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-3637a021-495a-44e1-a43f-deddcf72b5a2', 'volume_size': 1, 'source_volid': 'b6a247fd-8187-4862-9f69-ba87bfe2e9ff', 'source_volstatus': 'available'} Feb 25 15:57:45 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-285baca3-2da8-4521-8c58-c5bc7946a14a tempest-VolumesGetTest-958147190 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 25 15:57:45 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-285baca3-2da8-4521-8c58-c5bc7946a14a tempest-VolumesGetTest-958147190 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 25 15:57:45 devstack cinder-volume[83528]: INFO cinder.volume.drivers.remotefs [None req-285baca3-2da8-4521-8c58-c5bc7946a14a tempest-VolumesGetTest-958147190 None] Cloning volume b6a247fd-8187-4862-9f69-ba87bfe2e9ff to volume 3637a021-495a-44e1-a43f-deddcf72b5a2 Feb 25 15:57:45 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.remotefs [None req-285baca3-2da8-4521-8c58-c5bc7946a14a tempest-VolumesGetTest-958147190 None] Creating offline snapshot b6bb6ac2-d1f2-47dc-ba10-065b8fb51a24 of volume b6a247fd-8187-4862-9f69-ba87bfe2e9ff {{(pid=83528) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Feb 25 15:57:45 devstack cinder-volume[83528]: DEBUG oslo.privsep.daemon [-] privsep: reply[16e5b8da-2ec0-494d-a2bc-d708db148e9b]: (4, 'qcow2') {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 25 15:57:45 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-285baca3-2da8-4521-8c58-c5bc7946a14a tempest-VolumesGetTest-958147190 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-b6a247fd-8187-4862-9f69-ba87bfe2e9ff {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 25 15:57:45 devstack sudo[88807]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-b6a247fd-8187-4862-9f69-ba87bfe2e9ff Feb 25 15:57:45 devstack sudo[88807]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 25 15:57:45 devstack sudo[88805]: pam_unix(sudo:session): session closed for user root Feb 25 15:57:45 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-a953d070-d812-405f-8606-c46a4ef530d5 tempest-VolumesSnapshotNegativeTestJSON-221576189 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-66cc9438-f1f5-4c07-8d43-9b6af58f1291" returned: 0 in 0.606s {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 25 15:57:45 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-a953d070-d812-405f-8606-c46a4ef530d5 tempest-VolumesSnapshotNegativeTestJSON-221576189 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-66cc9438-f1f5-4c07-8d43-9b6af58f1291.9b025f5d-9beb-4908-a8ba-57073cf1853e {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 25 15:57:45 devstack sudo[88812]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-66cc9438-f1f5-4c07-8d43-9b6af58f1291.9b025f5d-9beb-4908-a8ba-57073cf1853e Feb 25 15:57:45 devstack sudo[88812]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 25 15:57:46 devstack sudo[88807]: pam_unix(sudo:session): session closed for user root Feb 25 15:57:46 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-285baca3-2da8-4521-8c58-c5bc7946a14a tempest-VolumesGetTest-958147190 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-b6a247fd-8187-4862-9f69-ba87bfe2e9ff" returned: 0 in 0.667s {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 25 15:57:46 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-285baca3-2da8-4521-8c58-c5bc7946a14a tempest-VolumesGetTest-958147190 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-b6a247fd-8187-4862-9f69-ba87bfe2e9ff,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-b6a247fd-8187-4862-9f69-ba87bfe2e9ff.b6bb6ac2-d1f2-47dc-ba10-065b8fb51a24 1G {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 25 15:57:46 devstack sudo[88817]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-b6a247fd-8187-4862-9f69-ba87bfe2e9ff,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-b6a247fd-8187-4862-9f69-ba87bfe2e9ff.b6bb6ac2-d1f2-47dc-ba10-065b8fb51a24 1G Feb 25 15:57:46 devstack sudo[88817]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 25 15:57:46 devstack sudo[88812]: pam_unix(sudo:session): session closed for user root Feb 25 15:57:46 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-a953d070-d812-405f-8606-c46a4ef530d5 tempest-VolumesSnapshotNegativeTestJSON-221576189 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-66cc9438-f1f5-4c07-8d43-9b6af58f1291.9b025f5d-9beb-4908-a8ba-57073cf1853e" returned: 0 in 0.583s {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 25 15:57:46 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-a953d070-d812-405f-8606-c46a4ef530d5 tempest-VolumesSnapshotNegativeTestJSON-221576189 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-66cc9438-f1f5-4c07-8d43-9b6af58f1291.9b025f5d-9beb-4908-a8ba-57073cf1853e {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 25 15:57:46 devstack sudo[88824]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-66cc9438-f1f5-4c07-8d43-9b6af58f1291.9b025f5d-9beb-4908-a8ba-57073cf1853e Feb 25 15:57:46 devstack sudo[88824]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 25 15:57:46 devstack sudo[88817]: pam_unix(sudo:session): session closed for user root Feb 25 15:57:46 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-285baca3-2da8-4521-8c58-c5bc7946a14a tempest-VolumesGetTest-958147190 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-b6a247fd-8187-4862-9f69-ba87bfe2e9ff,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-b6a247fd-8187-4862-9f69-ba87bfe2e9ff.b6bb6ac2-d1f2-47dc-ba10-065b8fb51a24 1G" returned: 0 in 0.645s {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 25 15:57:46 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-285baca3-2da8-4521-8c58-c5bc7946a14a tempest-VolumesGetTest-958147190 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b6a247fd-8187-4862-9f69-ba87bfe2e9ff -F qcow2 /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-b6a247fd-8187-4862-9f69-ba87bfe2e9ff.b6bb6ac2-d1f2-47dc-ba10-065b8fb51a24 {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 25 15:57:46 devstack sudo[88829]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b6a247fd-8187-4862-9f69-ba87bfe2e9ff -F qcow2 /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-b6a247fd-8187-4862-9f69-ba87bfe2e9ff.b6bb6ac2-d1f2-47dc-ba10-065b8fb51a24 Feb 25 15:57:46 devstack sudo[88829]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 25 15:57:46 devstack sudo[88824]: pam_unix(sudo:session): session closed for user root Feb 25 15:57:46 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-a953d070-d812-405f-8606-c46a4ef530d5 tempest-VolumesSnapshotNegativeTestJSON-221576189 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-66cc9438-f1f5-4c07-8d43-9b6af58f1291.9b025f5d-9beb-4908-a8ba-57073cf1853e" returned: 0 in 0.639s {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 25 15:57:46 devstack cinder-volume[83528]: DEBUG cinder.coordination [None req-a953d070-d812-405f-8606-c46a4ef530d5 tempest-VolumesSnapshotNegativeTestJSON-221576189 None] Lock "cinder-quobyte-9b025f5d-9beb-4908-a8ba-57073cf1853e" released by "_delete_snapshot" :: held 2.581s {{(pid=83528) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 25 15:57:46 devstack cinder-volume[83528]: DEBUG cinder.coordination [None req-a953d070-d812-405f-8606-c46a4ef530d5 tempest-VolumesSnapshotNegativeTestJSON-221576189 None] Lock "cinder-quobyte-66cc9438-f1f5-4c07-8d43-9b6af58f1291" released by "delete_snapshot" :: held 2.596s {{(pid=83528) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 25 15:57:47 devstack cinder-volume[83528]: DEBUG cinder.quota [None req-a953d070-d812-405f-8606-c46a4ef530d5 tempest-VolumesSnapshotNegativeTestJSON-221576189 None] Created reservations ['935043e6-152a-47e8-8be2-d8156e8ad42a', '1a78edbd-be68-4e96-b9f3-8052b7807cf0', 'f9d94856-759c-483d-a0a9-b13763261bf8', 'b98a4813-2037-426e-ae24-32bf5f66b82e'] {{(pid=83528) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 25 15:57:47 devstack cinder-volume[83528]: INFO cinder.volume.manager [None req-a953d070-d812-405f-8606-c46a4ef530d5 tempest-VolumesSnapshotNegativeTestJSON-221576189 None] Delete snapshot completed successfully. Feb 25 15:57:47 devstack cinder-volume[83528]: DEBUG cinder.coordination [None req-a953d070-d812-405f-8606-c46a4ef530d5 tempest-VolumesSnapshotNegativeTestJSON-221576189 None] Lock "cinder-9b025f5d-9beb-4908-a8ba-57073cf1853e-delete_snapshot" released by "delete_snapshot" :: held 2.722s {{(pid=83528) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 25 15:57:47 devstack cinder-volume[83528]: DEBUG cinder.volume.flows.manager.create_volume [None req-e851bbe3-b150-46c0-bfe8-2d8d088f3e20 tempest-VolumesTransfersTest-1392781004 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83528) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 25 15:57:47 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-e851bbe3-b150-46c0-bfe8-2d8d088f3e20 tempest-VolumesTransfersTest-1392781004 None] Flow 'volume_create_manager' (84ff1ab7-864b-474c-9651-192c1b6cbe3e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83528) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 25 15:57:47 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-e851bbe3-b150-46c0-bfe8-2d8d088f3e20 tempest-VolumesTransfersTest-1392781004 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (88c71f24-3e2c-430f-87d9-1e0e70e6622d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 25 15:57:47 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-e851bbe3-b150-46c0-bfe8-2d8d088f3e20 tempest-VolumesTransfersTest-1392781004 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (88c71f24-3e2c-430f-87d9-1e0e70e6622d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-25T14:57:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1650283468',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5ac863a1-634f-4047-9636-58da83a9716f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0e12a574405749e096644b5c1a979249',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-25T14:57:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-25T14:57:47Z,use_quota=True,user_id='d7e75c3a01b44ff4ab6d0f341d0cdf94',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ce71c2f9-6543-4165-9653-a1529b2ea243),volume_type_id=ce71c2f9-6543-4165-9653-a1529b2ea243)' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 25 15:57:47 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-e851bbe3-b150-46c0-bfe8-2d8d088f3e20 tempest-VolumesTransfersTest-1392781004 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3d87362a-8eb4-4361-a6e6-04b98777b748) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 25 15:57:47 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-e851bbe3-b150-46c0-bfe8-2d8d088f3e20 tempest-VolumesTransfersTest-1392781004 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3d87362a-8eb4-4361-a6e6-04b98777b748) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 25 15:57:47 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-e851bbe3-b150-46c0-bfe8-2d8d088f3e20 tempest-VolumesTransfersTest-1392781004 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d900ebbf-2c06-4ea0-82c9-9984a7606d72) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 25 15:57:47 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-e851bbe3-b150-46c0-bfe8-2d8d088f3e20 tempest-VolumesTransfersTest-1392781004 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d900ebbf-2c06-4ea0-82c9-9984a7606d72) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5ac863a1-634f-4047-9636-58da83a9716f', 'volume_name': 'volume-5ac863a1-634f-4047-9636-58da83a9716f', 'volume_size': 1}' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 25 15:57:47 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-e851bbe3-b150-46c0-bfe8-2d8d088f3e20 tempest-VolumesTransfersTest-1392781004 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a9a95cc7-3728-4768-9c48-22ca9588f68b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 25 15:57:47 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-e851bbe3-b150-46c0-bfe8-2d8d088f3e20 tempest-VolumesTransfersTest-1392781004 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a9a95cc7-3728-4768-9c48-22ca9588f68b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 25 15:57:47 devstack sudo[88829]: pam_unix(sudo:session): session closed for user root Feb 25 15:57:47 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-e851bbe3-b150-46c0-bfe8-2d8d088f3e20 tempest-VolumesTransfersTest-1392781004 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (124e9e44-3bf1-437e-be41-54bec0b120b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 25 15:57:47 devstack cinder-volume[83528]: INFO cinder.volume.flows.manager.create_volume [None req-e851bbe3-b150-46c0-bfe8-2d8d088f3e20 tempest-VolumesTransfersTest-1392781004 None] Volume 5ac863a1-634f-4047-9636-58da83a9716f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5ac863a1-634f-4047-9636-58da83a9716f', 'volume_size': 1} Feb 25 15:57:47 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-e851bbe3-b150-46c0-bfe8-2d8d088f3e20 tempest-VolumesTransfersTest-1392781004 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 25 15:57:47 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-285baca3-2da8-4521-8c58-c5bc7946a14a tempest-VolumesGetTest-958147190 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b6a247fd-8187-4862-9f69-ba87bfe2e9ff -F qcow2 /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-b6a247fd-8187-4862-9f69-ba87bfe2e9ff.b6bb6ac2-d1f2-47dc-ba10-065b8fb51a24" returned: 0 in 0.515s {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 25 15:57:47 devstack cinder-volume[83528]: WARNING cinder.volume.drivers.remotefs [None req-285baca3-2da8-4521-8c58-c5bc7946a14a tempest-VolumesGetTest-958147190 None] /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-b6a247fd-8187-4862-9f69-ba87bfe2e9ff.b6bb6ac2-d1f2-47dc-ba10-065b8fb51a24 is being set with open permissions: ugo+rw Feb 25 15:57:47 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-285baca3-2da8-4521-8c58-c5bc7946a14a tempest-VolumesGetTest-958147190 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-b6a247fd-8187-4862-9f69-ba87bfe2e9ff.b6bb6ac2-d1f2-47dc-ba10-065b8fb51a24 {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 25 15:57:47 devstack sudo[88835]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-b6a247fd-8187-4862-9f69-ba87bfe2e9ff.b6bb6ac2-d1f2-47dc-ba10-065b8fb51a24 Feb 25 15:57:47 devstack sudo[88835]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 25 15:57:47 devstack cinder-volume[83528]: DEBUG cinder.coordination [None req-b43373b6-ca84-46ce-bd9e-581d762a36b6 tempest-VolumesSnapshotNegativeTestJSON-221576189 None] Acquiring lock "cinder-66cc9438-f1f5-4c07-8d43-9b6af58f1291-delete_volume" by "delete_volume" {{(pid=83528) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 25 15:57:47 devstack cinder-volume[83528]: DEBUG cinder.coordination [None req-b43373b6-ca84-46ce-bd9e-581d762a36b6 tempest-VolumesSnapshotNegativeTestJSON-221576189 None] Lock "cinder-66cc9438-f1f5-4c07-8d43-9b6af58f1291-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=83528) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 25 15:57:47 devstack sudo[88835]: pam_unix(sudo:session): session closed for user root Feb 25 15:57:47 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-285baca3-2da8-4521-8c58-c5bc7946a14a tempest-VolumesGetTest-958147190 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-b6a247fd-8187-4862-9f69-ba87bfe2e9ff.b6bb6ac2-d1f2-47dc-ba10-065b8fb51a24" returned: 0 in 0.455s {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 25 15:57:47 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-285baca3-2da8-4521-8c58-c5bc7946a14a tempest-VolumesGetTest-958147190 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-b6a247fd-8187-4862-9f69-ba87bfe2e9ff.info {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 25 15:57:47 devstack cinder-volume[83528]: DEBUG cinder.coordination [None req-b43373b6-ca84-46ce-bd9e-581d762a36b6 tempest-VolumesSnapshotNegativeTestJSON-221576189 None] Acquiring lock "cinder-quobyte-66cc9438-f1f5-4c07-8d43-9b6af58f1291" by "delete_volume" {{(pid=83528) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 25 15:57:47 devstack sudo[88838]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-b6a247fd-8187-4862-9f69-ba87bfe2e9ff.info Feb 25 15:57:47 devstack sudo[88838]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 25 15:57:47 devstack cinder-volume[83528]: DEBUG cinder.coordination [None req-b43373b6-ca84-46ce-bd9e-581d762a36b6 tempest-VolumesSnapshotNegativeTestJSON-221576189 None] Lock "cinder-quobyte-66cc9438-f1f5-4c07-8d43-9b6af58f1291" acquired by "delete_volume" :: waited 0.009s {{(pid=83528) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 25 15:57:47 devstack cinder-volume[83528]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d13b181-4131-4169-a9e9-e7ccaf4415f7]: (4, 'qcow2') {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 25 15:57:47 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-b43373b6-ca84-46ce-bd9e-581d762a36b6 tempest-VolumesSnapshotNegativeTestJSON-221576189 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-66cc9438-f1f5-4c07-8d43-9b6af58f1291 {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 25 15:57:47 devstack sudo[88840]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-66cc9438-f1f5-4c07-8d43-9b6af58f1291 Feb 25 15:57:47 devstack sudo[88840]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 25 15:57:48 devstack sudo[88838]: pam_unix(sudo:session): session closed for user root Feb 25 15:57:48 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-285baca3-2da8-4521-8c58-c5bc7946a14a tempest-VolumesGetTest-958147190 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-b6a247fd-8187-4862-9f69-ba87bfe2e9ff.info" returned: 0 in 0.444s {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 25 15:57:48 devstack cinder-volume[83528]: WARNING cinder.volume.drivers.remotefs [None req-285baca3-2da8-4521-8c58-c5bc7946a14a tempest-VolumesGetTest-958147190 None] /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-b6a247fd-8187-4862-9f69-ba87bfe2e9ff.info is being set with open permissions: ugo+rw Feb 25 15:57:48 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-285baca3-2da8-4521-8c58-c5bc7946a14a tempest-VolumesGetTest-958147190 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-b6a247fd-8187-4862-9f69-ba87bfe2e9ff.info {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 25 15:57:48 devstack sudo[88843]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-b6a247fd-8187-4862-9f69-ba87bfe2e9ff.info Feb 25 15:57:48 devstack sudo[88843]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 25 15:57:48 devstack sudo[88840]: pam_unix(sudo:session): session closed for user root Feb 25 15:57:48 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-b43373b6-ca84-46ce-bd9e-581d762a36b6 tempest-VolumesSnapshotNegativeTestJSON-221576189 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-66cc9438-f1f5-4c07-8d43-9b6af58f1291" returned: 0 in 0.508s {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 25 15:57:48 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-b43373b6-ca84-46ce-bd9e-581d762a36b6 tempest-VolumesSnapshotNegativeTestJSON-221576189 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-66cc9438-f1f5-4c07-8d43-9b6af58f1291 {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 25 15:57:48 devstack sudo[88848]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-66cc9438-f1f5-4c07-8d43-9b6af58f1291 Feb 25 15:57:48 devstack sudo[88848]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 25 15:57:48 devstack sudo[88843]: pam_unix(sudo:session): session closed for user root Feb 25 15:57:48 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-285baca3-2da8-4521-8c58-c5bc7946a14a tempest-VolumesGetTest-958147190 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-b6a247fd-8187-4862-9f69-ba87bfe2e9ff.info" returned: 0 in 0.444s {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 25 15:57:48 devstack cinder-volume[83528]: DEBUG cinder.coordination [None req-285baca3-2da8-4521-8c58-c5bc7946a14a tempest-VolumesGetTest-958147190 None] Acquiring lock "cinder-quobyte-3637a021-495a-44e1-a43f-deddcf72b5a2" by "_copy_volume_from_snapshot" {{(pid=83528) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 25 15:57:48 devstack cinder-volume[83528]: DEBUG cinder.coordination [None req-285baca3-2da8-4521-8c58-c5bc7946a14a tempest-VolumesGetTest-958147190 None] Lock "cinder-quobyte-3637a021-495a-44e1-a43f-deddcf72b5a2" acquired by "_copy_volume_from_snapshot" :: waited 0.009s {{(pid=83528) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 25 15:57:48 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.quobyte [None req-285baca3-2da8-4521-8c58-c5bc7946a14a tempest-VolumesGetTest-958147190 None] snapshot: b6bb6ac2-d1f2-47dc-ba10-065b8fb51a24, volume: 3637a021-495a-44e1-a43f-deddcf72b5a2, {{(pid=83528) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Feb 25 15:57:48 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-285baca3-2da8-4521-8c58-c5bc7946a14a tempest-VolumesGetTest-958147190 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 25 15:57:48 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-285baca3-2da8-4521-8c58-c5bc7946a14a tempest-VolumesGetTest-958147190 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 25 15:57:48 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.quobyte [None req-285baca3-2da8-4521-8c58-c5bc7946a14a tempest-VolumesGetTest-958147190 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23e9d725-3e04-4cd9-bfe0-c8ef43305589': None} {{(pid=83528) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 25 15:57:48 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.quobyte [None req-285baca3-2da8-4521-8c58-c5bc7946a14a tempest-VolumesGetTest-958147190 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23e9d725-3e04-4cd9-bfe0-c8ef43305589'] {{(pid=83528) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 25 15:57:48 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-285baca3-2da8-4521-8c58-c5bc7946a14a tempest-VolumesGetTest-958147190 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 25 15:57:48 devstack cinder-volume[83528]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f113424-f20d-4b41-9547-10bf1c1190a5]: (4, 'qcow2') {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 25 15:57:48 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-285baca3-2da8-4521-8c58-c5bc7946a14a tempest-VolumesGetTest-958147190 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-b6a247fd-8187-4862-9f69-ba87bfe2e9ff.b6bb6ac2-d1f2-47dc-ba10-065b8fb51a24 {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 25 15:57:48 devstack sudo[88848]: pam_unix(sudo:session): session closed for user root Feb 25 15:57:48 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-b43373b6-ca84-46ce-bd9e-581d762a36b6 tempest-VolumesSnapshotNegativeTestJSON-221576189 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-66cc9438-f1f5-4c07-8d43-9b6af58f1291" returned: 0 in 0.431s {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 25 15:57:48 devstack cinder-volume[83528]: DEBUG cinder.coordination [None req-b43373b6-ca84-46ce-bd9e-581d762a36b6 tempest-VolumesSnapshotNegativeTestJSON-221576189 None] Lock "cinder-quobyte-66cc9438-f1f5-4c07-8d43-9b6af58f1291" released by "delete_volume" :: held 0.977s {{(pid=83528) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 25 15:57:48 devstack sudo[88852]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-b6a247fd-8187-4862-9f69-ba87bfe2e9ff.b6bb6ac2-d1f2-47dc-ba10-065b8fb51a24 Feb 25 15:57:48 devstack sudo[88852]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 25 15:57:48 devstack cinder-volume[83528]: DEBUG cinder.quota [None req-b43373b6-ca84-46ce-bd9e-581d762a36b6 tempest-VolumesSnapshotNegativeTestJSON-221576189 None] Created reservations ['5f9ea9ae-6762-41c8-8027-dbc94a25e782', '2e2c4bdd-7a0d-410d-8b19-d2ba3315fd53', '0a329972-e9af-4c0f-9fbb-05180f04a1e6', 'db88082a-b435-4d15-8773-9b7d1681bd5d'] {{(pid=83528) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 25 15:57:48 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-b43373b6-ca84-46ce-bd9e-581d762a36b6 tempest-VolumesSnapshotNegativeTestJSON-221576189 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 25 15:57:48 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-b43373b6-ca84-46ce-bd9e-581d762a36b6 tempest-VolumesSnapshotNegativeTestJSON-221576189 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 25 15:57:48 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.quobyte [None req-b43373b6-ca84-46ce-bd9e-581d762a36b6 tempest-VolumesSnapshotNegativeTestJSON-221576189 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23e9d725-3e04-4cd9-bfe0-c8ef43305589': None} {{(pid=83528) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 25 15:57:48 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.quobyte [None req-b43373b6-ca84-46ce-bd9e-581d762a36b6 tempest-VolumesSnapshotNegativeTestJSON-221576189 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23e9d725-3e04-4cd9-bfe0-c8ef43305589'] {{(pid=83528) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 25 15:57:48 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-b43373b6-ca84-46ce-bd9e-581d762a36b6 tempest-VolumesSnapshotNegativeTestJSON-221576189 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 25 15:57:48 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-b43373b6-ca84-46ce-bd9e-581d762a36b6 tempest-VolumesSnapshotNegativeTestJSON-221576189 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85 {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 25 15:57:48 devstack sudo[88854]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85 Feb 25 15:57:48 devstack sudo[88854]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 25 15:57:49 devstack sudo[88852]: pam_unix(sudo:session): session closed for user root Feb 25 15:57:49 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-285baca3-2da8-4521-8c58-c5bc7946a14a tempest-VolumesGetTest-958147190 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-b6a247fd-8187-4862-9f69-ba87bfe2e9ff.b6bb6ac2-d1f2-47dc-ba10-065b8fb51a24" returned: 0 in 0.495s {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 25 15:57:49 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.remotefs [None req-285baca3-2da8-4521-8c58-c5bc7946a14a tempest-VolumesGetTest-958147190 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b6a247fd-8187-4862-9f69-ba87bfe2e9ff(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83528) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Feb 25 15:57:49 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.quobyte [None req-285baca3-2da8-4521-8c58-c5bc7946a14a tempest-VolumesGetTest-958147190 None] will copy from snapshot at /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-b6a247fd-8187-4862-9f69-ba87bfe2e9ff {{(pid=83528) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Feb 25 15:57:49 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.quobyte [None req-285baca3-2da8-4521-8c58-c5bc7946a14a tempest-VolumesGetTest-958147190 None] Creating direct copy from snapshot {{(pid=83528) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Feb 25 15:57:49 devstack cinder-volume[83528]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0bceac8-980f-43c9-b68a-2d0870f2c3ec]: (4, 'qcow2') {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 25 15:57:49 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-285baca3-2da8-4521-8c58-c5bc7946a14a tempest-VolumesGetTest-958147190 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-b6a247fd-8187-4862-9f69-ba87bfe2e9ff {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 25 15:57:49 devstack sudo[88859]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-b6a247fd-8187-4862-9f69-ba87bfe2e9ff Feb 25 15:57:49 devstack sudo[88859]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 25 15:57:49 devstack sudo[88854]: pam_unix(sudo:session): session closed for user root Feb 25 15:57:49 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-b43373b6-ca84-46ce-bd9e-581d762a36b6 tempest-VolumesSnapshotNegativeTestJSON-221576189 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85" returned: 0 in 0.478s {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 25 15:57:49 devstack cinder-volume[83528]: DEBUG cinder.manager [None req-b43373b6-ca84-46ce-bd9e-581d762a36b6 tempest-VolumesSnapshotNegativeTestJSON-221576189 None] Notifying Schedulers of capabilities ... {{(pid=83528) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 25 15:57:49 devstack cinder-volume[83528]: INFO cinder.volume.manager [None req-b43373b6-ca84-46ce-bd9e-581d762a36b6 tempest-VolumesSnapshotNegativeTestJSON-221576189 None] Deleted volume successfully. Feb 25 15:57:49 devstack cinder-volume[83528]: DEBUG cinder.coordination [None req-b43373b6-ca84-46ce-bd9e-581d762a36b6 tempest-VolumesSnapshotNegativeTestJSON-221576189 None] Lock "cinder-66cc9438-f1f5-4c07-8d43-9b6af58f1291-delete_volume" released by "delete_volume" :: held 1.627s {{(pid=83528) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 25 15:57:49 devstack sudo[88859]: pam_unix(sudo:session): session closed for user root Feb 25 15:57:49 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-285baca3-2da8-4521-8c58-c5bc7946a14a tempest-VolumesGetTest-958147190 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-b6a247fd-8187-4862-9f69-ba87bfe2e9ff" returned: 0 in 0.529s {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 25 15:57:49 devstack cinder-volume[83528]: DEBUG cinder.utils [None req-285baca3-2da8-4521-8c58-c5bc7946a14a tempest-VolumesGetTest-958147190 None] Path /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-3637a021-495a-44e1-a43f-deddcf72b5a2 not found in is_blk_device check {{(pid=83528) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Feb 25 15:57:49 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-285baca3-2da8-4521-8c58-c5bc7946a14a tempest-VolumesGetTest-958147190 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-b6a247fd-8187-4862-9f69-ba87bfe2e9ff /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-3637a021-495a-44e1-a43f-deddcf72b5a2 {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 25 15:57:49 devstack sudo[88865]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-b6a247fd-8187-4862-9f69-ba87bfe2e9ff /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-3637a021-495a-44e1-a43f-deddcf72b5a2 Feb 25 15:57:49 devstack sudo[88865]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 25 15:57:52 devstack sudo[88865]: pam_unix(sudo:session): session closed for user root Feb 25 15:57:52 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-285baca3-2da8-4521-8c58-c5bc7946a14a tempest-VolumesGetTest-958147190 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-b6a247fd-8187-4862-9f69-ba87bfe2e9ff /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-3637a021-495a-44e1-a43f-deddcf72b5a2" returned: 0 in 2.473s {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 25 15:57:52 devstack cinder-volume[83528]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc35a247-c266-484c-b4ce-558f980a8d5c]: (4, 'qcow2') {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 25 15:57:52 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-285baca3-2da8-4521-8c58-c5bc7946a14a tempest-VolumesGetTest-958147190 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-b6a247fd-8187-4862-9f69-ba87bfe2e9ff {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 25 15:57:52 devstack sudo[88877]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-b6a247fd-8187-4862-9f69-ba87bfe2e9ff Feb 25 15:57:52 devstack sudo[88877]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 25 15:57:52 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [req-4fd71420-f95c-4ac0-8713-615ad0bf3565 req-7edb8bfa-d06a-4e5a-aae2-1a14594fa3ae tempest-TestVolumeBootPattern-1339247704 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 25 15:57:52 devstack sudo[88877]: pam_unix(sudo:session): session closed for user root Feb 25 15:57:52 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-285baca3-2da8-4521-8c58-c5bc7946a14a tempest-VolumesGetTest-958147190 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-b6a247fd-8187-4862-9f69-ba87bfe2e9ff" returned: 0 in 0.841s {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 25 15:57:52 devstack cinder-volume[83528]: DEBUG cinder.image.image_utils [None req-285baca3-2da8-4521-8c58-c5bc7946a14a tempest-VolumesGetTest-958147190 None] Image conversion details: src /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-b6a247fd-8187-4862-9f69-ba87bfe2e9ff, size 1024.00 MB, duration 2.47 sec, destination /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-3637a021-495a-44e1-a43f-deddcf72b5a2 {{(pid=83528) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Feb 25 15:57:52 devstack cinder-volume[83528]: INFO cinder.image.image_utils [None req-285baca3-2da8-4521-8c58-c5bc7946a14a tempest-VolumesGetTest-958147190 None] Converted 1024.00 MB image at 413.92 MB/s Feb 25 15:57:52 devstack cinder-volume[83528]: WARNING cinder.volume.drivers.remotefs [None req-285baca3-2da8-4521-8c58-c5bc7946a14a tempest-VolumesGetTest-958147190 None] /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-3637a021-495a-44e1-a43f-deddcf72b5a2 is being set with open permissions: ugo+rw Feb 25 15:57:52 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-285baca3-2da8-4521-8c58-c5bc7946a14a tempest-VolumesGetTest-958147190 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-3637a021-495a-44e1-a43f-deddcf72b5a2 {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 25 15:57:52 devstack sudo[88890]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-3637a021-495a-44e1-a43f-deddcf72b5a2 Feb 25 15:57:52 devstack sudo[88890]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 25 15:57:53 devstack sudo[88890]: pam_unix(sudo:session): session closed for user root Feb 25 15:57:53 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-285baca3-2da8-4521-8c58-c5bc7946a14a tempest-VolumesGetTest-958147190 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-3637a021-495a-44e1-a43f-deddcf72b5a2" returned: 0 in 0.567s {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 25 15:57:53 devstack cinder-volume[83528]: DEBUG cinder.coordination [None req-285baca3-2da8-4521-8c58-c5bc7946a14a tempest-VolumesGetTest-958147190 None] Lock "cinder-quobyte-3637a021-495a-44e1-a43f-deddcf72b5a2" released by "_copy_volume_from_snapshot" :: held 4.956s {{(pid=83528) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 25 15:57:53 devstack cinder-volume[83528]: DEBUG cinder.coordination [None req-285baca3-2da8-4521-8c58-c5bc7946a14a tempest-VolumesGetTest-958147190 None] Acquiring lock "cinder-quobyte-b6bb6ac2-d1f2-47dc-ba10-065b8fb51a24" by "_delete_snapshot" {{(pid=83528) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 25 15:57:53 devstack cinder-volume[83528]: DEBUG cinder.coordination [None req-285baca3-2da8-4521-8c58-c5bc7946a14a tempest-VolumesGetTest-958147190 None] Lock "cinder-quobyte-b6bb6ac2-d1f2-47dc-ba10-065b8fb51a24" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=83528) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 25 15:57:53 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.remotefs [None req-285baca3-2da8-4521-8c58-c5bc7946a14a tempest-VolumesGetTest-958147190 None] Deleting offline snapshot b6bb6ac2-d1f2-47dc-ba10-065b8fb51a24 of volume b6a247fd-8187-4862-9f69-ba87bfe2e9ff {{(pid=83528) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Feb 25 15:57:53 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.remotefs [None req-285baca3-2da8-4521-8c58-c5bc7946a14a tempest-VolumesGetTest-958147190 None] snapshot_file for this snap is: volume-b6a247fd-8187-4862-9f69-ba87bfe2e9ff.b6bb6ac2-d1f2-47dc-ba10-065b8fb51a24 {{(pid=83528) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Feb 25 15:57:53 devstack cinder-volume[83528]: DEBUG oslo.privsep.daemon [-] privsep: reply[d785811d-e218-4972-9f8e-8a2b143ebc5d]: (4, 'qcow2') {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 25 15:57:53 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-285baca3-2da8-4521-8c58-c5bc7946a14a tempest-VolumesGetTest-958147190 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-b6a247fd-8187-4862-9f69-ba87bfe2e9ff.b6bb6ac2-d1f2-47dc-ba10-065b8fb51a24 {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 25 15:57:53 devstack sudo[88893]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-b6a247fd-8187-4862-9f69-ba87bfe2e9ff.b6bb6ac2-d1f2-47dc-ba10-065b8fb51a24 Feb 25 15:57:53 devstack sudo[88893]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 25 15:57:54 devstack sudo[88893]: pam_unix(sudo:session): session closed for user root Feb 25 15:57:54 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-285baca3-2da8-4521-8c58-c5bc7946a14a tempest-VolumesGetTest-958147190 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-b6a247fd-8187-4862-9f69-ba87bfe2e9ff.b6bb6ac2-d1f2-47dc-ba10-065b8fb51a24" returned: 0 in 0.674s {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 25 15:57:54 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.remotefs [None req-285baca3-2da8-4521-8c58-c5bc7946a14a tempest-VolumesGetTest-958147190 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b6a247fd-8187-4862-9f69-ba87bfe2e9ff(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83528) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Feb 25 15:57:54 devstack cinder-volume[83528]: DEBUG oslo.privsep.daemon [-] privsep: reply[c342d873-28ec-4f8b-a6af-4ee9ed0c50b8]: (4, 'qcow2') {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 25 15:57:54 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-285baca3-2da8-4521-8c58-c5bc7946a14a tempest-VolumesGetTest-958147190 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-b6a247fd-8187-4862-9f69-ba87bfe2e9ff {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 25 15:57:54 devstack sudo[88901]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-b6a247fd-8187-4862-9f69-ba87bfe2e9ff Feb 25 15:57:54 devstack sudo[88901]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 25 15:57:54 devstack sudo[88901]: pam_unix(sudo:session): session closed for user root Feb 25 15:57:54 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-285baca3-2da8-4521-8c58-c5bc7946a14a tempest-VolumesGetTest-958147190 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-b6a247fd-8187-4862-9f69-ba87bfe2e9ff" returned: 0 in 0.549s {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 25 15:57:54 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-285baca3-2da8-4521-8c58-c5bc7946a14a tempest-VolumesGetTest-958147190 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-b6a247fd-8187-4862-9f69-ba87bfe2e9ff.b6bb6ac2-d1f2-47dc-ba10-065b8fb51a24 {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 25 15:57:54 devstack sudo[88907]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-b6a247fd-8187-4862-9f69-ba87bfe2e9ff.b6bb6ac2-d1f2-47dc-ba10-065b8fb51a24 Feb 25 15:57:54 devstack sudo[88907]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 25 15:57:55 devstack sudo[88907]: pam_unix(sudo:session): session closed for user root Feb 25 15:57:55 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-285baca3-2da8-4521-8c58-c5bc7946a14a tempest-VolumesGetTest-958147190 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-b6a247fd-8187-4862-9f69-ba87bfe2e9ff.b6bb6ac2-d1f2-47dc-ba10-065b8fb51a24" returned: 0 in 0.521s {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 25 15:57:55 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-285baca3-2da8-4521-8c58-c5bc7946a14a tempest-VolumesGetTest-958147190 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-b6a247fd-8187-4862-9f69-ba87bfe2e9ff.b6bb6ac2-d1f2-47dc-ba10-065b8fb51a24 {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 25 15:57:55 devstack sudo[88912]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-b6a247fd-8187-4862-9f69-ba87bfe2e9ff.b6bb6ac2-d1f2-47dc-ba10-065b8fb51a24 Feb 25 15:57:55 devstack sudo[88912]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 25 15:57:55 devstack sudo[88912]: pam_unix(sudo:session): session closed for user root Feb 25 15:57:55 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-285baca3-2da8-4521-8c58-c5bc7946a14a tempest-VolumesGetTest-958147190 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-b6a247fd-8187-4862-9f69-ba87bfe2e9ff.b6bb6ac2-d1f2-47dc-ba10-065b8fb51a24" returned: 0 in 0.467s {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 25 15:57:55 devstack cinder-volume[83528]: DEBUG cinder.coordination [None req-285baca3-2da8-4521-8c58-c5bc7946a14a tempest-VolumesGetTest-958147190 None] Lock "cinder-quobyte-b6bb6ac2-d1f2-47dc-ba10-065b8fb51a24" released by "_delete_snapshot" :: held 2.271s {{(pid=83528) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 25 15:57:55 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-285baca3-2da8-4521-8c58-c5bc7946a14a tempest-VolumesGetTest-958147190 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 10.547s {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 25 15:57:55 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-e851bbe3-b150-46c0-bfe8-2d8d088f3e20 tempest-VolumesTransfersTest-1392781004 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 8.689s {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 25 15:57:55 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.quobyte [None req-e851bbe3-b150-46c0-bfe8-2d8d088f3e20 tempest-VolumesTransfersTest-1392781004 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-25T14:57:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1650283468',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5ac863a1-634f-4047-9636-58da83a9716f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0e12a574405749e096644b5c1a979249',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-25T14:57:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-25T14:57:47Z,use_quota=True,user_id='d7e75c3a01b44ff4ab6d0f341d0cdf94',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ce71c2f9-6543-4165-9653-a1529b2ea243),volume_type_id=ce71c2f9-6543-4165-9653-a1529b2ea243)}" {{(pid=83528) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 25 15:57:55 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.remotefs [None req-e851bbe3-b150-46c0-bfe8-2d8d088f3e20 tempest-VolumesTransfersTest-1392781004 None] Creating volume 5ac863a1-634f-4047-9636-58da83a9716f {{(pid=83528) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 25 15:57:55 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-e851bbe3-b150-46c0-bfe8-2d8d088f3e20 tempest-VolumesTransfersTest-1392781004 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 25 15:57:55 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-e851bbe3-b150-46c0-bfe8-2d8d088f3e20 tempest-VolumesTransfersTest-1392781004 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 25 15:57:55 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.quobyte [None req-e851bbe3-b150-46c0-bfe8-2d8d088f3e20 tempest-VolumesTransfersTest-1392781004 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23e9d725-3e04-4cd9-bfe0-c8ef43305589': None} {{(pid=83528) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 25 15:57:55 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.quobyte [None req-e851bbe3-b150-46c0-bfe8-2d8d088f3e20 tempest-VolumesTransfersTest-1392781004 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23e9d725-3e04-4cd9-bfe0-c8ef43305589'] {{(pid=83528) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 25 15:57:55 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-e851bbe3-b150-46c0-bfe8-2d8d088f3e20 tempest-VolumesTransfersTest-1392781004 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 25 15:57:55 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.quobyte [None req-e851bbe3-b150-46c0-bfe8-2d8d088f3e20 tempest-VolumesTransfersTest-1392781004 None] Selected osci02.corp.quobyte.com/cinder-vol-23e9d725-3e04-4cd9-bfe0-c8ef43305589 as target Quobyte volume. {{(pid=83528) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 25 15:57:55 devstack cinder-volume[83528]: INFO cinder.volume.drivers.remotefs [None req-e851bbe3-b150-46c0-bfe8-2d8d088f3e20 tempest-VolumesTransfersTest-1392781004 None] casted to osci02.corp.quobyte.com/cinder-vol-23e9d725-3e04-4cd9-bfe0-c8ef43305589 Feb 25 15:57:55 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-e851bbe3-b150-46c0-bfe8-2d8d088f3e20 tempest-VolumesTransfersTest-1392781004 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-5ac863a1-634f-4047-9636-58da83a9716f 1073741824 {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 25 15:57:55 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-285baca3-2da8-4521-8c58-c5bc7946a14a tempest-VolumesGetTest-958147190 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9129b99f-2e01-4a96-9144-e588d6b9ab70) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3637a021-495a-44e1-a43f-deddcf72b5a2', 'volume_size': 1, 'source_volid': 'b6a247fd-8187-4862-9f69-ba87bfe2e9ff', 'source_volstatus': 'available'}' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 25 15:57:55 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-285baca3-2da8-4521-8c58-c5bc7946a14a tempest-VolumesGetTest-958147190 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9cb6fdf0-b856-4aae-9c4b-ba05a61da8ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 25 15:57:55 devstack cinder-volume[83528]: INFO cinder.volume.flows.manager.create_volume [None req-285baca3-2da8-4521-8c58-c5bc7946a14a tempest-VolumesGetTest-958147190 None] Volume volume-3637a021-495a-44e1-a43f-deddcf72b5a2 (3637a021-495a-44e1-a43f-deddcf72b5a2): created successfully Feb 25 15:57:55 devstack sudo[88915]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-5ac863a1-634f-4047-9636-58da83a9716f 1073741824 Feb 25 15:57:55 devstack sudo[88915]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 25 15:57:55 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-285baca3-2da8-4521-8c58-c5bc7946a14a tempest-VolumesGetTest-958147190 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9cb6fdf0-b856-4aae-9c4b-ba05a61da8ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 25 15:57:55 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-285baca3-2da8-4521-8c58-c5bc7946a14a tempest-VolumesGetTest-958147190 None] Flow 'volume_create_manager' (ccca18d4-547c-42e6-82d6-b60cc1a5a6b1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83528) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 25 15:57:55 devstack cinder-volume[83528]: INFO cinder.volume.manager [None req-285baca3-2da8-4521-8c58-c5bc7946a14a tempest-VolumesGetTest-958147190 None] Created volume successfully. Feb 25 15:57:56 devstack sudo[88915]: pam_unix(sudo:session): session closed for user root Feb 25 15:57:56 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-e851bbe3-b150-46c0-bfe8-2d8d088f3e20 tempest-VolumesTransfersTest-1392781004 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-5ac863a1-634f-4047-9636-58da83a9716f 1073741824" returned: 0 in 0.579s {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 25 15:57:56 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-e851bbe3-b150-46c0-bfe8-2d8d088f3e20 tempest-VolumesTransfersTest-1392781004 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-5ac863a1-634f-4047-9636-58da83a9716f {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 25 15:57:56 devstack sudo[88920]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-5ac863a1-634f-4047-9636-58da83a9716f Feb 25 15:57:56 devstack sudo[88920]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 25 15:57:57 devstack sudo[88920]: pam_unix(sudo:session): session closed for user root Feb 25 15:57:57 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-e851bbe3-b150-46c0-bfe8-2d8d088f3e20 tempest-VolumesTransfersTest-1392781004 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-5ac863a1-634f-4047-9636-58da83a9716f" returned: 0 in 0.596s {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 25 15:57:57 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.quobyte [None req-e851bbe3-b150-46c0-bfe8-2d8d088f3e20 tempest-VolumesTransfersTest-1392781004 None] <== create_volume: return (1200ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-23e9d725-3e04-4cd9-bfe0-c8ef43305589'} {{(pid=83528) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 25 15:57:57 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-e851bbe3-b150-46c0-bfe8-2d8d088f3e20 tempest-VolumesTransfersTest-1392781004 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.207s {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 25 15:57:57 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [req-4fd71420-f95c-4ac0-8713-615ad0bf3565 req-7edb8bfa-d06a-4e5a-aae2-1a14594fa3ae tempest-TestVolumeBootPattern-1339247704 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 4.656s {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 25 15:57:57 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-e851bbe3-b150-46c0-bfe8-2d8d088f3e20 tempest-VolumesTransfersTest-1392781004 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (124e9e44-3bf1-437e-be41-54bec0b120b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5ac863a1-634f-4047-9636-58da83a9716f', 'volume_size': 1}' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 25 15:57:57 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-e851bbe3-b150-46c0-bfe8-2d8d088f3e20 tempest-VolumesTransfersTest-1392781004 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dcce520b-280f-454d-b20a-4c9f9f8208c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 25 15:57:57 devstack cinder-volume[83528]: DEBUG oslo.privsep.daemon [-] privsep: reply[78b73ae2-aaba-4df0-80e7-33413ee8d24f]: (4, 'raw') {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 25 15:57:57 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [req-4fd71420-f95c-4ac0-8713-615ad0bf3565 req-7edb8bfa-d06a-4e5a-aae2-1a14594fa3ae tempest-TestVolumeBootPattern-1339247704 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-603ceb8f-999e-4bdd-a2b4-3010a4fd6af5 {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 25 15:57:57 devstack cinder-volume[83528]: INFO cinder.volume.flows.manager.create_volume [None req-e851bbe3-b150-46c0-bfe8-2d8d088f3e20 tempest-VolumesTransfersTest-1392781004 None] Volume volume-5ac863a1-634f-4047-9636-58da83a9716f (5ac863a1-634f-4047-9636-58da83a9716f): created successfully Feb 25 15:57:57 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-e851bbe3-b150-46c0-bfe8-2d8d088f3e20 tempest-VolumesTransfersTest-1392781004 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dcce520b-280f-454d-b20a-4c9f9f8208c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 25 15:57:57 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-e851bbe3-b150-46c0-bfe8-2d8d088f3e20 tempest-VolumesTransfersTest-1392781004 None] Flow 'volume_create_manager' (84ff1ab7-864b-474c-9651-192c1b6cbe3e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83528) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 25 15:57:57 devstack cinder-volume[83528]: INFO cinder.volume.manager [None req-e851bbe3-b150-46c0-bfe8-2d8d088f3e20 tempest-VolumesTransfersTest-1392781004 None] Created volume successfully. Feb 25 15:57:57 devstack sudo[88923]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-603ceb8f-999e-4bdd-a2b4-3010a4fd6af5 Feb 25 15:57:57 devstack sudo[88923]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 25 15:57:57 devstack cinder-volume[83528]: DEBUG cinder.volume.flows.manager.create_volume [None req-41bc2c0e-82c3-44c2-8fc4-94b489e03352 tempest-VolumesGetTest-958147190 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83528) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 25 15:57:57 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-41bc2c0e-82c3-44c2-8fc4-94b489e03352 tempest-VolumesGetTest-958147190 None] Flow 'volume_create_manager' (24ec68a9-cc31-4d65-871f-0461ea0ed3d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83528) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 25 15:57:57 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-41bc2c0e-82c3-44c2-8fc4-94b489e03352 tempest-VolumesGetTest-958147190 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e5c5b319-4383-4f48-ac83-a0f704234583) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 25 15:57:57 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-41bc2c0e-82c3-44c2-8fc4-94b489e03352 tempest-VolumesGetTest-958147190 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e5c5b319-4383-4f48-ac83-a0f704234583) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-25T14:57:57Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-500600898',display_name='tempest-VolumesGetTest-Volume-703828733',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e47769dd-1452-4993-91ee-f6cf95c9b00a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='30b56c3cb9b44b44bc932bfa91495865',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-25T14:57:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-25T14:57:58Z,use_quota=True,user_id='e09e6f803ddf47f09c166c46461b2f9a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ce71c2f9-6543-4165-9653-a1529b2ea243),volume_type_id=ce71c2f9-6543-4165-9653-a1529b2ea243)' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 25 15:57:57 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-41bc2c0e-82c3-44c2-8fc4-94b489e03352 tempest-VolumesGetTest-958147190 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3613b300-284d-4278-b7fd-322362704320) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 25 15:57:57 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-41bc2c0e-82c3-44c2-8fc4-94b489e03352 tempest-VolumesGetTest-958147190 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3613b300-284d-4278-b7fd-322362704320) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 25 15:57:57 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-41bc2c0e-82c3-44c2-8fc4-94b489e03352 tempest-VolumesGetTest-958147190 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0d8b9c22-c296-4f33-8e27-2b090003d64b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 25 15:57:57 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-41bc2c0e-82c3-44c2-8fc4-94b489e03352 tempest-VolumesGetTest-958147190 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0d8b9c22-c296-4f33-8e27-2b090003d64b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e47769dd-1452-4993-91ee-f6cf95c9b00a', 'volume_name': 'volume-e47769dd-1452-4993-91ee-f6cf95c9b00a', 'volume_size': 1}' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 25 15:57:57 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-41bc2c0e-82c3-44c2-8fc4-94b489e03352 tempest-VolumesGetTest-958147190 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bdd014ea-ff55-46d5-b44f-5af260b17370) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 25 15:57:57 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-41bc2c0e-82c3-44c2-8fc4-94b489e03352 tempest-VolumesGetTest-958147190 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bdd014ea-ff55-46d5-b44f-5af260b17370) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 25 15:57:57 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-41bc2c0e-82c3-44c2-8fc4-94b489e03352 tempest-VolumesGetTest-958147190 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9f8294a0-6107-4ef7-bd71-8b53a91b00b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 25 15:57:57 devstack cinder-volume[83528]: INFO cinder.volume.flows.manager.create_volume [None req-41bc2c0e-82c3-44c2-8fc4-94b489e03352 tempest-VolumesGetTest-958147190 None] Volume e47769dd-1452-4993-91ee-f6cf95c9b00a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e47769dd-1452-4993-91ee-f6cf95c9b00a', 'volume_size': 1} Feb 25 15:57:57 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-41bc2c0e-82c3-44c2-8fc4-94b489e03352 tempest-VolumesGetTest-958147190 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 25 15:57:57 devstack sudo[88923]: pam_unix(sudo:session): session closed for user root Feb 25 15:57:57 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [req-4fd71420-f95c-4ac0-8713-615ad0bf3565 req-7edb8bfa-d06a-4e5a-aae2-1a14594fa3ae tempest-TestVolumeBootPattern-1339247704 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-603ceb8f-999e-4bdd-a2b4-3010a4fd6af5" returned: 0 in 0.617s {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 25 15:57:57 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [req-4fd71420-f95c-4ac0-8713-615ad0bf3565 req-7edb8bfa-d06a-4e5a-aae2-1a14594fa3ae tempest-TestVolumeBootPattern-1339247704 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-603ceb8f-999e-4bdd-a2b4-3010a4fd6af5 {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 25 15:57:57 devstack sudo[88927]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-603ceb8f-999e-4bdd-a2b4-3010a4fd6af5 Feb 25 15:57:57 devstack sudo[88927]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 25 15:57:58 devstack sudo[88927]: pam_unix(sudo:session): session closed for user root Feb 25 15:57:58 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [req-4fd71420-f95c-4ac0-8713-615ad0bf3565 req-7edb8bfa-d06a-4e5a-aae2-1a14594fa3ae tempest-TestVolumeBootPattern-1339247704 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-603ceb8f-999e-4bdd-a2b4-3010a4fd6af5" returned: 1 in 0.602s {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 25 15:57:58 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [req-4fd71420-f95c-4ac0-8713-615ad0bf3565 req-7edb8bfa-d06a-4e5a-aae2-1a14594fa3ae tempest-TestVolumeBootPattern-1339247704 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-603ceb8f-999e-4bdd-a2b4-3010a4fd6af5' failed. Not Retrying. {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Feb 25 15:57:58 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [req-4fd71420-f95c-4ac0-8713-615ad0bf3565 req-7edb8bfa-d06a-4e5a-aae2-1a14594fa3ae tempest-TestVolumeBootPattern-1339247704 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.268s {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 25 15:57:58 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-41bc2c0e-82c3-44c2-8fc4-94b489e03352 tempest-VolumesGetTest-958147190 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.731s {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 25 15:57:58 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.quobyte [None req-41bc2c0e-82c3-44c2-8fc4-94b489e03352 tempest-VolumesGetTest-958147190 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-25T14:57:57Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-500600898',display_name='tempest-VolumesGetTest-Volume-703828733',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e47769dd-1452-4993-91ee-f6cf95c9b00a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='30b56c3cb9b44b44bc932bfa91495865',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-25T14:57:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-25T14:57:58Z,use_quota=True,user_id='e09e6f803ddf47f09c166c46461b2f9a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ce71c2f9-6543-4165-9653-a1529b2ea243),volume_type_id=ce71c2f9-6543-4165-9653-a1529b2ea243)}" {{(pid=83528) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 25 15:57:58 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.remotefs [None req-41bc2c0e-82c3-44c2-8fc4-94b489e03352 tempest-VolumesGetTest-958147190 None] Creating volume e47769dd-1452-4993-91ee-f6cf95c9b00a {{(pid=83528) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 25 15:57:58 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-41bc2c0e-82c3-44c2-8fc4-94b489e03352 tempest-VolumesGetTest-958147190 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 25 15:57:58 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-41bc2c0e-82c3-44c2-8fc4-94b489e03352 tempest-VolumesGetTest-958147190 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 25 15:57:58 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.quobyte [None req-41bc2c0e-82c3-44c2-8fc4-94b489e03352 tempest-VolumesGetTest-958147190 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23e9d725-3e04-4cd9-bfe0-c8ef43305589': None} {{(pid=83528) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 25 15:57:58 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.quobyte [None req-41bc2c0e-82c3-44c2-8fc4-94b489e03352 tempest-VolumesGetTest-958147190 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23e9d725-3e04-4cd9-bfe0-c8ef43305589'] {{(pid=83528) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 25 15:57:58 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-41bc2c0e-82c3-44c2-8fc4-94b489e03352 tempest-VolumesGetTest-958147190 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 25 15:57:58 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.quobyte [None req-41bc2c0e-82c3-44c2-8fc4-94b489e03352 tempest-VolumesGetTest-958147190 None] Selected osci02.corp.quobyte.com/cinder-vol-23e9d725-3e04-4cd9-bfe0-c8ef43305589 as target Quobyte volume. {{(pid=83528) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 25 15:57:58 devstack cinder-volume[83528]: INFO cinder.volume.drivers.remotefs [None req-41bc2c0e-82c3-44c2-8fc4-94b489e03352 tempest-VolumesGetTest-958147190 None] casted to osci02.corp.quobyte.com/cinder-vol-23e9d725-3e04-4cd9-bfe0-c8ef43305589 Feb 25 15:57:58 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-41bc2c0e-82c3-44c2-8fc4-94b489e03352 tempest-VolumesGetTest-958147190 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-e47769dd-1452-4993-91ee-f6cf95c9b00a 1073741824 {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 25 15:57:58 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [req-4fd71420-f95c-4ac0-8713-615ad0bf3565 req-7edb8bfa-d06a-4e5a-aae2-1a14594fa3ae tempest-TestVolumeBootPattern-1339247704 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-23e9d725-3e04-4cd9-bfe0-c8ef43305589', 'name': 'volume-603ceb8f-999e-4bdd-a2b4-3010a4fd6af5', 'options': None, 'format': 'raw', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '3bb87d3c-bd99-49e4-ab15-825c3d9de2c7', 'enforce_multipath': True} {{(pid=83528) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Feb 25 15:57:58 devstack sudo[88932]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-e47769dd-1452-4993-91ee-f6cf95c9b00a 1073741824 Feb 25 15:57:58 devstack sudo[88932]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 25 15:57:58 devstack cinder-volume[83528]: INFO cinder.volume.manager [req-4fd71420-f95c-4ac0-8713-615ad0bf3565 req-7edb8bfa-d06a-4e5a-aae2-1a14594fa3ae tempest-TestVolumeBootPattern-1339247704 None] attachment_update completed successfully. Feb 25 15:57:58 devstack cinder-volume[83528]: INFO cinder.volume.manager [None req-c7fe49ff-6e7e-47f7-9010-c016b8c636b3 tempest-VolumesTransfersTest-458128804 None] Transfer volume completed successfully. Feb 25 15:57:59 devstack sudo[88932]: pam_unix(sudo:session): session closed for user root Feb 25 15:57:59 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-41bc2c0e-82c3-44c2-8fc4-94b489e03352 tempest-VolumesGetTest-958147190 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-e47769dd-1452-4993-91ee-f6cf95c9b00a 1073741824" returned: 0 in 0.739s {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 25 15:57:59 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-41bc2c0e-82c3-44c2-8fc4-94b489e03352 tempest-VolumesGetTest-958147190 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-e47769dd-1452-4993-91ee-f6cf95c9b00a {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 25 15:57:59 devstack sudo[88937]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-e47769dd-1452-4993-91ee-f6cf95c9b00a Feb 25 15:57:59 devstack sudo[88937]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 25 15:57:59 devstack cinder-volume[83528]: DEBUG cinder.coordination [None req-9de137f4-7760-43b1-bffa-7280563d9417 tempest-VolumesTransfersTest-562072289 None] Acquiring lock "cinder-5ac863a1-634f-4047-9636-58da83a9716f-delete_volume" by "delete_volume" {{(pid=83528) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 25 15:57:59 devstack cinder-volume[83528]: DEBUG cinder.coordination [None req-9de137f4-7760-43b1-bffa-7280563d9417 tempest-VolumesTransfersTest-562072289 None] Lock "cinder-5ac863a1-634f-4047-9636-58da83a9716f-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=83528) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 25 15:57:59 devstack cinder-volume[83528]: DEBUG cinder.coordination [None req-9de137f4-7760-43b1-bffa-7280563d9417 tempest-VolumesTransfersTest-562072289 None] Acquiring lock "cinder-quobyte-5ac863a1-634f-4047-9636-58da83a9716f" by "delete_volume" {{(pid=83528) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 25 15:57:59 devstack cinder-volume[83528]: DEBUG cinder.coordination [None req-9de137f4-7760-43b1-bffa-7280563d9417 tempest-VolumesTransfersTest-562072289 None] Lock "cinder-quobyte-5ac863a1-634f-4047-9636-58da83a9716f" acquired by "delete_volume" :: waited 0.012s {{(pid=83528) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 25 15:57:59 devstack sudo[88937]: pam_unix(sudo:session): session closed for user root Feb 25 15:57:59 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-41bc2c0e-82c3-44c2-8fc4-94b489e03352 tempest-VolumesGetTest-958147190 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-e47769dd-1452-4993-91ee-f6cf95c9b00a" returned: 0 in 0.496s {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 25 15:57:59 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.quobyte [None req-41bc2c0e-82c3-44c2-8fc4-94b489e03352 tempest-VolumesGetTest-958147190 None] <== create_volume: return (1266ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-23e9d725-3e04-4cd9-bfe0-c8ef43305589'} {{(pid=83528) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 25 15:57:59 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-41bc2c0e-82c3-44c2-8fc4-94b489e03352 tempest-VolumesGetTest-958147190 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.274s {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 25 15:57:59 devstack cinder-volume[83528]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4f89930-88d2-4991-97f4-916f2dee899d]: (4, 'qcow2') {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 25 15:57:59 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-9de137f4-7760-43b1-bffa-7280563d9417 tempest-VolumesTransfersTest-562072289 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-5ac863a1-634f-4047-9636-58da83a9716f {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 25 15:57:59 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-41bc2c0e-82c3-44c2-8fc4-94b489e03352 tempest-VolumesGetTest-958147190 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9f8294a0-6107-4ef7-bd71-8b53a91b00b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e47769dd-1452-4993-91ee-f6cf95c9b00a', 'volume_size': 1}' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 25 15:57:59 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-41bc2c0e-82c3-44c2-8fc4-94b489e03352 tempest-VolumesGetTest-958147190 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (050da0af-5780-4e7f-94dc-a243f665b7ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 25 15:57:59 devstack cinder-volume[83528]: INFO cinder.volume.flows.manager.create_volume [None req-41bc2c0e-82c3-44c2-8fc4-94b489e03352 tempest-VolumesGetTest-958147190 None] Volume volume-e47769dd-1452-4993-91ee-f6cf95c9b00a (e47769dd-1452-4993-91ee-f6cf95c9b00a): created successfully Feb 25 15:57:59 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-41bc2c0e-82c3-44c2-8fc4-94b489e03352 tempest-VolumesGetTest-958147190 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (050da0af-5780-4e7f-94dc-a243f665b7ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 25 15:57:59 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-41bc2c0e-82c3-44c2-8fc4-94b489e03352 tempest-VolumesGetTest-958147190 None] Flow 'volume_create_manager' (24ec68a9-cc31-4d65-871f-0461ea0ed3d8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83528) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 25 15:57:59 devstack cinder-volume[83528]: INFO cinder.volume.manager [None req-41bc2c0e-82c3-44c2-8fc4-94b489e03352 tempest-VolumesGetTest-958147190 None] Created volume successfully. Feb 25 15:57:59 devstack sudo[88940]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-5ac863a1-634f-4047-9636-58da83a9716f Feb 25 15:57:59 devstack sudo[88940]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 25 15:58:00 devstack sudo[88940]: pam_unix(sudo:session): session closed for user root Feb 25 15:58:00 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-9de137f4-7760-43b1-bffa-7280563d9417 tempest-VolumesTransfersTest-562072289 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-5ac863a1-634f-4047-9636-58da83a9716f" returned: 0 in 0.633s {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 25 15:58:00 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-9de137f4-7760-43b1-bffa-7280563d9417 tempest-VolumesTransfersTest-562072289 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-5ac863a1-634f-4047-9636-58da83a9716f {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 25 15:58:00 devstack sudo[88945]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-5ac863a1-634f-4047-9636-58da83a9716f Feb 25 15:58:00 devstack sudo[88945]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 25 15:58:00 devstack cinder-volume[83528]: DEBUG cinder.coordination [None req-ab3335a8-1c9f-4b38-8aed-c149d10c1cf9 tempest-VolumesGetTest-958147190 None] Acquiring lock "cinder-e47769dd-1452-4993-91ee-f6cf95c9b00a-delete_volume" by "delete_volume" {{(pid=83528) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 25 15:58:00 devstack cinder-volume[83528]: DEBUG cinder.coordination [None req-ab3335a8-1c9f-4b38-8aed-c149d10c1cf9 tempest-VolumesGetTest-958147190 None] Lock "cinder-e47769dd-1452-4993-91ee-f6cf95c9b00a-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=83528) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 25 15:58:00 devstack cinder-volume[83528]: DEBUG cinder.coordination [None req-ab3335a8-1c9f-4b38-8aed-c149d10c1cf9 tempest-VolumesGetTest-958147190 None] Acquiring lock "cinder-quobyte-e47769dd-1452-4993-91ee-f6cf95c9b00a" by "delete_volume" {{(pid=83528) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 25 15:58:00 devstack cinder-volume[83528]: DEBUG cinder.coordination [None req-ab3335a8-1c9f-4b38-8aed-c149d10c1cf9 tempest-VolumesGetTest-958147190 None] Lock "cinder-quobyte-e47769dd-1452-4993-91ee-f6cf95c9b00a" acquired by "delete_volume" :: waited 0.012s {{(pid=83528) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 25 15:58:00 devstack cinder-volume[83528]: DEBUG oslo.privsep.daemon [-] privsep: reply[cecdfd7a-3f99-47dd-9cc7-ca854e4294a5]: (4, 'qcow2') {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 25 15:58:00 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-ab3335a8-1c9f-4b38-8aed-c149d10c1cf9 tempest-VolumesGetTest-958147190 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-e47769dd-1452-4993-91ee-f6cf95c9b00a {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 25 15:58:00 devstack sudo[88947]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-e47769dd-1452-4993-91ee-f6cf95c9b00a Feb 25 15:58:00 devstack sudo[88947]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 25 15:58:00 devstack sudo[88945]: pam_unix(sudo:session): session closed for user root Feb 25 15:58:00 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-9de137f4-7760-43b1-bffa-7280563d9417 tempest-VolumesTransfersTest-562072289 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-5ac863a1-634f-4047-9636-58da83a9716f" returned: 0 in 0.551s {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 25 15:58:00 devstack cinder-volume[83528]: DEBUG cinder.coordination [None req-9de137f4-7760-43b1-bffa-7280563d9417 tempest-VolumesTransfersTest-562072289 None] Lock "cinder-quobyte-5ac863a1-634f-4047-9636-58da83a9716f" released by "delete_volume" :: held 1.220s {{(pid=83528) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 25 15:58:00 devstack cinder-volume[83528]: DEBUG cinder.quota [None req-9de137f4-7760-43b1-bffa-7280563d9417 tempest-VolumesTransfersTest-562072289 None] Created reservations ['2fc28452-1c34-4f16-a886-8b664e3bb51c', '38377560-438d-4c4a-9dfc-b4231b5855e4', '38f9881d-8d87-4ede-9705-8d86e70491ab', 'b507fb35-bae9-4c8f-8656-691a29701ffc'] {{(pid=83528) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 25 15:58:00 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-9de137f4-7760-43b1-bffa-7280563d9417 tempest-VolumesTransfersTest-562072289 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 25 15:58:00 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-9de137f4-7760-43b1-bffa-7280563d9417 tempest-VolumesTransfersTest-562072289 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 25 15:58:00 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.quobyte [None req-9de137f4-7760-43b1-bffa-7280563d9417 tempest-VolumesTransfersTest-562072289 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23e9d725-3e04-4cd9-bfe0-c8ef43305589': None} {{(pid=83528) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 25 15:58:00 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.quobyte [None req-9de137f4-7760-43b1-bffa-7280563d9417 tempest-VolumesTransfersTest-562072289 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23e9d725-3e04-4cd9-bfe0-c8ef43305589'] {{(pid=83528) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 25 15:58:00 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-9de137f4-7760-43b1-bffa-7280563d9417 tempest-VolumesTransfersTest-562072289 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 25 15:58:00 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-9de137f4-7760-43b1-bffa-7280563d9417 tempest-VolumesTransfersTest-562072289 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85 {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 25 15:58:01 devstack sudo[89020]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85 Feb 25 15:58:01 devstack sudo[89020]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 25 15:58:01 devstack sudo[88947]: pam_unix(sudo:session): session closed for user root Feb 25 15:58:01 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-ab3335a8-1c9f-4b38-8aed-c149d10c1cf9 tempest-VolumesGetTest-958147190 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-e47769dd-1452-4993-91ee-f6cf95c9b00a" returned: 0 in 0.673s {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 25 15:58:01 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-ab3335a8-1c9f-4b38-8aed-c149d10c1cf9 tempest-VolumesGetTest-958147190 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-e47769dd-1452-4993-91ee-f6cf95c9b00a {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 25 15:58:01 devstack sudo[89022]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-e47769dd-1452-4993-91ee-f6cf95c9b00a Feb 25 15:58:01 devstack sudo[89022]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 25 15:58:01 devstack sudo[89020]: pam_unix(sudo:session): session closed for user root Feb 25 15:58:01 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-9de137f4-7760-43b1-bffa-7280563d9417 tempest-VolumesTransfersTest-562072289 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85" returned: 0 in 0.483s {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 25 15:58:01 devstack cinder-volume[83528]: DEBUG cinder.manager [None req-9de137f4-7760-43b1-bffa-7280563d9417 tempest-VolumesTransfersTest-562072289 None] Notifying Schedulers of capabilities ... {{(pid=83528) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 25 15:58:01 devstack cinder-volume[83528]: INFO cinder.volume.manager [None req-9de137f4-7760-43b1-bffa-7280563d9417 tempest-VolumesTransfersTest-562072289 None] Deleted volume successfully. Feb 25 15:58:01 devstack cinder-volume[83528]: DEBUG cinder.coordination [None req-9de137f4-7760-43b1-bffa-7280563d9417 tempest-VolumesTransfersTest-562072289 None] Lock "cinder-5ac863a1-634f-4047-9636-58da83a9716f-delete_volume" released by "delete_volume" :: held 1.921s {{(pid=83528) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 25 15:58:01 devstack sudo[89022]: pam_unix(sudo:session): session closed for user root Feb 25 15:58:01 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-ab3335a8-1c9f-4b38-8aed-c149d10c1cf9 tempest-VolumesGetTest-958147190 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-e47769dd-1452-4993-91ee-f6cf95c9b00a" returned: 0 in 0.588s {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 25 15:58:01 devstack cinder-volume[83528]: DEBUG cinder.coordination [None req-ab3335a8-1c9f-4b38-8aed-c149d10c1cf9 tempest-VolumesGetTest-958147190 None] Lock "cinder-quobyte-e47769dd-1452-4993-91ee-f6cf95c9b00a" released by "delete_volume" :: held 1.291s {{(pid=83528) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 25 15:58:01 devstack cinder-volume[83528]: DEBUG cinder.quota [None req-ab3335a8-1c9f-4b38-8aed-c149d10c1cf9 tempest-VolumesGetTest-958147190 None] Created reservations ['c95f5279-95e1-45d9-a958-283f90f49d0e', '9dadbc69-4a90-4835-9049-b03f685962c4', '355f71d4-896c-461d-b911-abe6a3e5495a', '27c7e4a4-9c7d-4b0d-b436-b035ef1dd722'] {{(pid=83528) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 25 15:58:01 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-ab3335a8-1c9f-4b38-8aed-c149d10c1cf9 tempest-VolumesGetTest-958147190 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 25 15:58:01 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-ab3335a8-1c9f-4b38-8aed-c149d10c1cf9 tempest-VolumesGetTest-958147190 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 25 15:58:01 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.quobyte [None req-ab3335a8-1c9f-4b38-8aed-c149d10c1cf9 tempest-VolumesGetTest-958147190 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23e9d725-3e04-4cd9-bfe0-c8ef43305589': None} {{(pid=83528) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 25 15:58:01 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.quobyte [None req-ab3335a8-1c9f-4b38-8aed-c149d10c1cf9 tempest-VolumesGetTest-958147190 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23e9d725-3e04-4cd9-bfe0-c8ef43305589'] {{(pid=83528) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 25 15:58:01 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-ab3335a8-1c9f-4b38-8aed-c149d10c1cf9 tempest-VolumesGetTest-958147190 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 25 15:58:01 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-ab3335a8-1c9f-4b38-8aed-c149d10c1cf9 tempest-VolumesGetTest-958147190 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85 {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 25 15:58:01 devstack sudo[89026]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85 Feb 25 15:58:01 devstack sudo[89026]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 25 15:58:02 devstack cinder-volume[83528]: DEBUG cinder.volume.flows.manager.create_volume [None req-924e636f-7bfe-4cc2-8be1-647fdb132166 tempest-VolumesTransfersTest-1392781004 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83528) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 25 15:58:02 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-924e636f-7bfe-4cc2-8be1-647fdb132166 tempest-VolumesTransfersTest-1392781004 None] Flow 'volume_create_manager' (8a5b8aef-8c2b-4809-805b-6fc071bc683c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83528) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 25 15:58:02 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-924e636f-7bfe-4cc2-8be1-647fdb132166 tempest-VolumesTransfersTest-1392781004 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e062b3d9-c6d2-43ba-9cef-817d193a4d1e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 25 15:58:02 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-924e636f-7bfe-4cc2-8be1-647fdb132166 tempest-VolumesTransfersTest-1392781004 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e062b3d9-c6d2-43ba-9cef-817d193a4d1e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-25T14:58:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1312461131',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=05ecd05b-da27-4ce0-8b97-039ad701665f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0e12a574405749e096644b5c1a979249',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-25T14:58:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-25T14:58:02Z,use_quota=True,user_id='d7e75c3a01b44ff4ab6d0f341d0cdf94',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ce71c2f9-6543-4165-9653-a1529b2ea243),volume_type_id=ce71c2f9-6543-4165-9653-a1529b2ea243)' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 25 15:58:02 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-924e636f-7bfe-4cc2-8be1-647fdb132166 tempest-VolumesTransfersTest-1392781004 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3494ab9d-a614-4d69-a3c5-ebbb911258fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 25 15:58:02 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-924e636f-7bfe-4cc2-8be1-647fdb132166 tempest-VolumesTransfersTest-1392781004 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3494ab9d-a614-4d69-a3c5-ebbb911258fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 25 15:58:02 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-924e636f-7bfe-4cc2-8be1-647fdb132166 tempest-VolumesTransfersTest-1392781004 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5ba64ead-d1ef-4ac3-be4f-2aaaa38c86cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 25 15:58:02 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-924e636f-7bfe-4cc2-8be1-647fdb132166 tempest-VolumesTransfersTest-1392781004 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5ba64ead-d1ef-4ac3-be4f-2aaaa38c86cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '05ecd05b-da27-4ce0-8b97-039ad701665f', 'volume_name': 'volume-05ecd05b-da27-4ce0-8b97-039ad701665f', 'volume_size': 1}' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 25 15:58:02 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-924e636f-7bfe-4cc2-8be1-647fdb132166 tempest-VolumesTransfersTest-1392781004 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1cec118a-b97e-4e0b-929c-a4c05da6f0fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 25 15:58:02 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-924e636f-7bfe-4cc2-8be1-647fdb132166 tempest-VolumesTransfersTest-1392781004 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1cec118a-b97e-4e0b-929c-a4c05da6f0fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 25 15:58:02 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-924e636f-7bfe-4cc2-8be1-647fdb132166 tempest-VolumesTransfersTest-1392781004 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ee837d0f-7485-438d-99b1-90b8126e4cbd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 25 15:58:02 devstack cinder-volume[83528]: INFO cinder.volume.flows.manager.create_volume [None req-924e636f-7bfe-4cc2-8be1-647fdb132166 tempest-VolumesTransfersTest-1392781004 None] Volume 05ecd05b-da27-4ce0-8b97-039ad701665f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-05ecd05b-da27-4ce0-8b97-039ad701665f', 'volume_size': 1} Feb 25 15:58:02 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-924e636f-7bfe-4cc2-8be1-647fdb132166 tempest-VolumesTransfersTest-1392781004 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 25 15:58:02 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-924e636f-7bfe-4cc2-8be1-647fdb132166 tempest-VolumesTransfersTest-1392781004 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.004s {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 25 15:58:02 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.quobyte [None req-924e636f-7bfe-4cc2-8be1-647fdb132166 tempest-VolumesTransfersTest-1392781004 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-25T14:58:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1312461131',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=05ecd05b-da27-4ce0-8b97-039ad701665f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0e12a574405749e096644b5c1a979249',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-25T14:58:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-25T14:58:02Z,use_quota=True,user_id='d7e75c3a01b44ff4ab6d0f341d0cdf94',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ce71c2f9-6543-4165-9653-a1529b2ea243),volume_type_id=ce71c2f9-6543-4165-9653-a1529b2ea243)}" {{(pid=83528) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 25 15:58:02 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.remotefs [None req-924e636f-7bfe-4cc2-8be1-647fdb132166 tempest-VolumesTransfersTest-1392781004 None] Creating volume 05ecd05b-da27-4ce0-8b97-039ad701665f {{(pid=83528) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 25 15:58:02 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-924e636f-7bfe-4cc2-8be1-647fdb132166 tempest-VolumesTransfersTest-1392781004 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 25 15:58:02 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-924e636f-7bfe-4cc2-8be1-647fdb132166 tempest-VolumesTransfersTest-1392781004 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 25 15:58:02 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.quobyte [None req-924e636f-7bfe-4cc2-8be1-647fdb132166 tempest-VolumesTransfersTest-1392781004 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23e9d725-3e04-4cd9-bfe0-c8ef43305589': None} {{(pid=83528) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 25 15:58:02 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.quobyte [None req-924e636f-7bfe-4cc2-8be1-647fdb132166 tempest-VolumesTransfersTest-1392781004 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23e9d725-3e04-4cd9-bfe0-c8ef43305589'] {{(pid=83528) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 25 15:58:02 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-924e636f-7bfe-4cc2-8be1-647fdb132166 tempest-VolumesTransfersTest-1392781004 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 25 15:58:02 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.quobyte [None req-924e636f-7bfe-4cc2-8be1-647fdb132166 tempest-VolumesTransfersTest-1392781004 None] Selected osci02.corp.quobyte.com/cinder-vol-23e9d725-3e04-4cd9-bfe0-c8ef43305589 as target Quobyte volume. {{(pid=83528) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 25 15:58:02 devstack cinder-volume[83528]: INFO cinder.volume.drivers.remotefs [None req-924e636f-7bfe-4cc2-8be1-647fdb132166 tempest-VolumesTransfersTest-1392781004 None] casted to osci02.corp.quobyte.com/cinder-vol-23e9d725-3e04-4cd9-bfe0-c8ef43305589 Feb 25 15:58:02 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-924e636f-7bfe-4cc2-8be1-647fdb132166 tempest-VolumesTransfersTest-1392781004 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-05ecd05b-da27-4ce0-8b97-039ad701665f 1073741824 {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 25 15:58:02 devstack sudo[89032]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-05ecd05b-da27-4ce0-8b97-039ad701665f 1073741824 Feb 25 15:58:02 devstack sudo[89032]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 25 15:58:02 devstack sudo[89026]: pam_unix(sudo:session): session closed for user root Feb 25 15:58:02 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-ab3335a8-1c9f-4b38-8aed-c149d10c1cf9 tempest-VolumesGetTest-958147190 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85" returned: 0 in 0.697s {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 25 15:58:02 devstack cinder-volume[83528]: DEBUG cinder.manager [None req-ab3335a8-1c9f-4b38-8aed-c149d10c1cf9 tempest-VolumesGetTest-958147190 None] Notifying Schedulers of capabilities ... {{(pid=83528) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 25 15:58:02 devstack cinder-volume[83528]: INFO cinder.volume.manager [None req-ab3335a8-1c9f-4b38-8aed-c149d10c1cf9 tempest-VolumesGetTest-958147190 None] Deleted volume successfully. Feb 25 15:58:02 devstack cinder-volume[83528]: DEBUG cinder.coordination [None req-ab3335a8-1c9f-4b38-8aed-c149d10c1cf9 tempest-VolumesGetTest-958147190 None] Lock "cinder-e47769dd-1452-4993-91ee-f6cf95c9b00a-delete_volume" released by "delete_volume" :: held 2.208s {{(pid=83528) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 25 15:58:02 devstack cinder-volume[83528]: DEBUG cinder.coordination [None req-b76718c9-2ce5-492c-aa99-4a03a564dba0 tempest-VolumesGetTest-958147190 None] Acquiring lock "cinder-3637a021-495a-44e1-a43f-deddcf72b5a2-delete_volume" by "delete_volume" {{(pid=83528) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 25 15:58:02 devstack cinder-volume[83528]: DEBUG cinder.coordination [None req-b76718c9-2ce5-492c-aa99-4a03a564dba0 tempest-VolumesGetTest-958147190 None] Lock "cinder-3637a021-495a-44e1-a43f-deddcf72b5a2-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=83528) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 25 15:58:02 devstack cinder-volume[83528]: DEBUG cinder.coordination [None req-b76718c9-2ce5-492c-aa99-4a03a564dba0 tempest-VolumesGetTest-958147190 None] Acquiring lock "cinder-quobyte-3637a021-495a-44e1-a43f-deddcf72b5a2" by "delete_volume" {{(pid=83528) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 25 15:58:02 devstack cinder-volume[83528]: DEBUG cinder.coordination [None req-b76718c9-2ce5-492c-aa99-4a03a564dba0 tempest-VolumesGetTest-958147190 None] Lock "cinder-quobyte-3637a021-495a-44e1-a43f-deddcf72b5a2" acquired by "delete_volume" :: waited 0.015s {{(pid=83528) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 25 15:58:02 devstack cinder-volume[83528]: DEBUG oslo.privsep.daemon [-] privsep: reply[3858a106-69f7-4e58-9b28-da5976d766e0]: (4, 'qcow2') {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 25 15:58:02 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-b76718c9-2ce5-492c-aa99-4a03a564dba0 tempest-VolumesGetTest-958147190 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-3637a021-495a-44e1-a43f-deddcf72b5a2 {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 25 15:58:02 devstack sudo[89034]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-3637a021-495a-44e1-a43f-deddcf72b5a2 Feb 25 15:58:02 devstack sudo[89034]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 25 15:58:02 devstack sudo[89032]: pam_unix(sudo:session): session closed for user root Feb 25 15:58:02 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-924e636f-7bfe-4cc2-8be1-647fdb132166 tempest-VolumesTransfersTest-1392781004 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-05ecd05b-da27-4ce0-8b97-039ad701665f 1073741824" returned: 0 in 0.611s {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 25 15:58:03 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-924e636f-7bfe-4cc2-8be1-647fdb132166 tempest-VolumesTransfersTest-1392781004 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-05ecd05b-da27-4ce0-8b97-039ad701665f {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 25 15:58:03 devstack sudo[89039]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-05ecd05b-da27-4ce0-8b97-039ad701665f Feb 25 15:58:03 devstack sudo[89039]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 25 15:58:03 devstack sudo[89034]: pam_unix(sudo:session): session closed for user root Feb 25 15:58:03 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-b76718c9-2ce5-492c-aa99-4a03a564dba0 tempest-VolumesGetTest-958147190 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-3637a021-495a-44e1-a43f-deddcf72b5a2" returned: 0 in 0.662s {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 25 15:58:03 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-b76718c9-2ce5-492c-aa99-4a03a564dba0 tempest-VolumesGetTest-958147190 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-3637a021-495a-44e1-a43f-deddcf72b5a2 {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 25 15:58:03 devstack sudo[89044]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-3637a021-495a-44e1-a43f-deddcf72b5a2 Feb 25 15:58:03 devstack sudo[89044]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 25 15:58:03 devstack sudo[89039]: pam_unix(sudo:session): session closed for user root Feb 25 15:58:03 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-924e636f-7bfe-4cc2-8be1-647fdb132166 tempest-VolumesTransfersTest-1392781004 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-05ecd05b-da27-4ce0-8b97-039ad701665f" returned: 0 in 0.597s {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 25 15:58:03 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.quobyte [None req-924e636f-7bfe-4cc2-8be1-647fdb132166 tempest-VolumesTransfersTest-1392781004 None] <== create_volume: return (1253ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-23e9d725-3e04-4cd9-bfe0-c8ef43305589'} {{(pid=83528) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 25 15:58:03 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-924e636f-7bfe-4cc2-8be1-647fdb132166 tempest-VolumesTransfersTest-1392781004 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.256s {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 25 15:58:03 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-924e636f-7bfe-4cc2-8be1-647fdb132166 tempest-VolumesTransfersTest-1392781004 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ee837d0f-7485-438d-99b1-90b8126e4cbd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-05ecd05b-da27-4ce0-8b97-039ad701665f', 'volume_size': 1}' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 25 15:58:03 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-924e636f-7bfe-4cc2-8be1-647fdb132166 tempest-VolumesTransfersTest-1392781004 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (39ffa37f-5395-4fb0-81ea-0b8f6cc4ddac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 25 15:58:03 devstack cinder-volume[83528]: INFO cinder.volume.flows.manager.create_volume [None req-924e636f-7bfe-4cc2-8be1-647fdb132166 tempest-VolumesTransfersTest-1392781004 None] Volume volume-05ecd05b-da27-4ce0-8b97-039ad701665f (05ecd05b-da27-4ce0-8b97-039ad701665f): created successfully Feb 25 15:58:03 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-924e636f-7bfe-4cc2-8be1-647fdb132166 tempest-VolumesTransfersTest-1392781004 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (39ffa37f-5395-4fb0-81ea-0b8f6cc4ddac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 25 15:58:03 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-924e636f-7bfe-4cc2-8be1-647fdb132166 tempest-VolumesTransfersTest-1392781004 None] Flow 'volume_create_manager' (8a5b8aef-8c2b-4809-805b-6fc071bc683c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83528) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 25 15:58:03 devstack cinder-volume[83528]: INFO cinder.volume.manager [None req-924e636f-7bfe-4cc2-8be1-647fdb132166 tempest-VolumesTransfersTest-1392781004 None] Created volume successfully. Feb 25 15:58:03 devstack sudo[89044]: pam_unix(sudo:session): session closed for user root Feb 25 15:58:03 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-b76718c9-2ce5-492c-aa99-4a03a564dba0 tempest-VolumesGetTest-958147190 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-3637a021-495a-44e1-a43f-deddcf72b5a2" returned: 0 in 0.538s {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 25 15:58:03 devstack cinder-volume[83528]: DEBUG cinder.coordination [None req-b76718c9-2ce5-492c-aa99-4a03a564dba0 tempest-VolumesGetTest-958147190 None] Lock "cinder-quobyte-3637a021-495a-44e1-a43f-deddcf72b5a2" released by "delete_volume" :: held 1.233s {{(pid=83528) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 25 15:58:03 devstack cinder-volume[83528]: DEBUG cinder.quota [None req-b76718c9-2ce5-492c-aa99-4a03a564dba0 tempest-VolumesGetTest-958147190 None] Created reservations ['048cbc85-7f18-4e68-9af8-c546a6f92553', 'f41a2b9a-aea0-4445-889a-d1de711c01ae', 'a2da9491-2551-4370-8e76-b846b853eca8', '8054c221-da8c-4a78-8b2b-ba9874bf2c9e'] {{(pid=83528) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 25 15:58:04 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-b76718c9-2ce5-492c-aa99-4a03a564dba0 tempest-VolumesGetTest-958147190 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 25 15:58:04 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-b76718c9-2ce5-492c-aa99-4a03a564dba0 tempest-VolumesGetTest-958147190 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 25 15:58:04 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.quobyte [None req-b76718c9-2ce5-492c-aa99-4a03a564dba0 tempest-VolumesGetTest-958147190 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23e9d725-3e04-4cd9-bfe0-c8ef43305589': None} {{(pid=83528) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 25 15:58:04 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.quobyte [None req-b76718c9-2ce5-492c-aa99-4a03a564dba0 tempest-VolumesGetTest-958147190 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23e9d725-3e04-4cd9-bfe0-c8ef43305589'] {{(pid=83528) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 25 15:58:04 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-b76718c9-2ce5-492c-aa99-4a03a564dba0 tempest-VolumesGetTest-958147190 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 25 15:58:04 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-b76718c9-2ce5-492c-aa99-4a03a564dba0 tempest-VolumesGetTest-958147190 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85 {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 25 15:58:04 devstack sudo[89383]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85 Feb 25 15:58:04 devstack sudo[89383]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 25 15:58:04 devstack sudo[89383]: pam_unix(sudo:session): session closed for user root Feb 25 15:58:04 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-b76718c9-2ce5-492c-aa99-4a03a564dba0 tempest-VolumesGetTest-958147190 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85" returned: 0 in 0.633s {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 25 15:58:04 devstack cinder-volume[83528]: DEBUG cinder.manager [None req-b76718c9-2ce5-492c-aa99-4a03a564dba0 tempest-VolumesGetTest-958147190 None] Notifying Schedulers of capabilities ... {{(pid=83528) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 25 15:58:04 devstack cinder-volume[83528]: INFO cinder.volume.manager [None req-b76718c9-2ce5-492c-aa99-4a03a564dba0 tempest-VolumesGetTest-958147190 None] Deleted volume successfully. Feb 25 15:58:04 devstack cinder-volume[83528]: DEBUG cinder.coordination [None req-b76718c9-2ce5-492c-aa99-4a03a564dba0 tempest-VolumesGetTest-958147190 None] Lock "cinder-3637a021-495a-44e1-a43f-deddcf72b5a2-delete_volume" released by "delete_volume" :: held 2.060s {{(pid=83528) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 25 15:58:04 devstack cinder-volume[83528]: DEBUG cinder.coordination [None req-86c4287c-abb3-490a-b5bd-687c216503d8 tempest-VolumesTransfersTest-562072289 None] Acquiring lock "cinder-05ecd05b-da27-4ce0-8b97-039ad701665f-delete_volume" by "delete_volume" {{(pid=83528) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 25 15:58:04 devstack cinder-volume[83528]: DEBUG cinder.coordination [None req-86c4287c-abb3-490a-b5bd-687c216503d8 tempest-VolumesTransfersTest-562072289 None] Lock "cinder-05ecd05b-da27-4ce0-8b97-039ad701665f-delete_volume" acquired by "delete_volume" :: waited 0.014s {{(pid=83528) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 25 15:58:04 devstack cinder-volume[83528]: DEBUG cinder.coordination [None req-86c4287c-abb3-490a-b5bd-687c216503d8 tempest-VolumesTransfersTest-562072289 None] Acquiring lock "cinder-quobyte-05ecd05b-da27-4ce0-8b97-039ad701665f" by "delete_volume" {{(pid=83528) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 25 15:58:04 devstack cinder-volume[83528]: DEBUG cinder.coordination [None req-86c4287c-abb3-490a-b5bd-687c216503d8 tempest-VolumesTransfersTest-562072289 None] Lock "cinder-quobyte-05ecd05b-da27-4ce0-8b97-039ad701665f" acquired by "delete_volume" :: waited 0.012s {{(pid=83528) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 25 15:58:04 devstack cinder-volume[83528]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f84d58a-acbb-4fb2-ab18-363c8bcb4070]: (4, 'qcow2') {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 25 15:58:04 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-86c4287c-abb3-490a-b5bd-687c216503d8 tempest-VolumesTransfersTest-562072289 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-05ecd05b-da27-4ce0-8b97-039ad701665f {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 25 15:58:04 devstack cinder-volume[83528]: DEBUG cinder.coordination [None req-8c4d86a2-c63f-4e2b-a3f8-1539f3b6050f tempest-VolumesGetTest-958147190 None] Acquiring lock "cinder-b6a247fd-8187-4862-9f69-ba87bfe2e9ff-delete_volume" by "delete_volume" {{(pid=83528) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 25 15:58:04 devstack sudo[89387]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-05ecd05b-da27-4ce0-8b97-039ad701665f Feb 25 15:58:04 devstack sudo[89387]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 25 15:58:04 devstack cinder-volume[83528]: DEBUG cinder.coordination [None req-8c4d86a2-c63f-4e2b-a3f8-1539f3b6050f tempest-VolumesGetTest-958147190 None] Lock "cinder-b6a247fd-8187-4862-9f69-ba87bfe2e9ff-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=83528) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 25 15:58:04 devstack cinder-volume[83528]: DEBUG cinder.coordination [None req-8c4d86a2-c63f-4e2b-a3f8-1539f3b6050f tempest-VolumesGetTest-958147190 None] Acquiring lock "cinder-quobyte-b6a247fd-8187-4862-9f69-ba87bfe2e9ff" by "delete_volume" {{(pid=83528) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 25 15:58:05 devstack cinder-volume[83528]: DEBUG cinder.coordination [None req-8c4d86a2-c63f-4e2b-a3f8-1539f3b6050f tempest-VolumesGetTest-958147190 None] Lock "cinder-quobyte-b6a247fd-8187-4862-9f69-ba87bfe2e9ff" acquired by "delete_volume" :: waited 0.013s {{(pid=83528) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 25 15:58:05 devstack cinder-volume[83528]: DEBUG oslo.privsep.daemon [-] privsep: reply[b306a496-b094-4a78-9a0f-53b1c613c8ba]: (4, 'qcow2') {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 25 15:58:05 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-8c4d86a2-c63f-4e2b-a3f8-1539f3b6050f tempest-VolumesGetTest-958147190 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-b6a247fd-8187-4862-9f69-ba87bfe2e9ff {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 25 15:58:05 devstack sudo[89389]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-b6a247fd-8187-4862-9f69-ba87bfe2e9ff Feb 25 15:58:05 devstack sudo[89389]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 25 15:58:05 devstack sudo[89387]: pam_unix(sudo:session): session closed for user root Feb 25 15:58:05 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-86c4287c-abb3-490a-b5bd-687c216503d8 tempest-VolumesTransfersTest-562072289 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-05ecd05b-da27-4ce0-8b97-039ad701665f" returned: 0 in 0.634s {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 25 15:58:05 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-86c4287c-abb3-490a-b5bd-687c216503d8 tempest-VolumesTransfersTest-562072289 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-05ecd05b-da27-4ce0-8b97-039ad701665f {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 25 15:58:05 devstack sudo[89394]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-05ecd05b-da27-4ce0-8b97-039ad701665f Feb 25 15:58:05 devstack sudo[89394]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 25 15:58:05 devstack sudo[89389]: pam_unix(sudo:session): session closed for user root Feb 25 15:58:05 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-8c4d86a2-c63f-4e2b-a3f8-1539f3b6050f tempest-VolumesGetTest-958147190 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-b6a247fd-8187-4862-9f69-ba87bfe2e9ff" returned: 0 in 0.641s {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 25 15:58:05 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-8c4d86a2-c63f-4e2b-a3f8-1539f3b6050f tempest-VolumesGetTest-958147190 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-b6a247fd-8187-4862-9f69-ba87bfe2e9ff {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 25 15:58:05 devstack sudo[89399]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-b6a247fd-8187-4862-9f69-ba87bfe2e9ff Feb 25 15:58:05 devstack sudo[89399]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 25 15:58:06 devstack sudo[89394]: pam_unix(sudo:session): session closed for user root Feb 25 15:58:06 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-86c4287c-abb3-490a-b5bd-687c216503d8 tempest-VolumesTransfersTest-562072289 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-05ecd05b-da27-4ce0-8b97-039ad701665f" returned: 0 in 0.576s {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 25 15:58:06 devstack cinder-volume[83528]: DEBUG cinder.coordination [None req-86c4287c-abb3-490a-b5bd-687c216503d8 tempest-VolumesTransfersTest-562072289 None] Lock "cinder-quobyte-05ecd05b-da27-4ce0-8b97-039ad701665f" released by "delete_volume" :: held 1.240s {{(pid=83528) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 25 15:58:06 devstack cinder-volume[83528]: DEBUG cinder.quota [None req-86c4287c-abb3-490a-b5bd-687c216503d8 tempest-VolumesTransfersTest-562072289 None] Created reservations ['415292b6-65bd-4ebe-a2fe-2fc01ad784a3', '20e483ed-77e4-4914-97eb-39b67b1ed348', 'b36d85aa-d140-48b5-a7d5-fd8be77d7b90', '2a5cae15-8880-41dc-80ec-5b6a1ed199a3'] {{(pid=83528) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 25 15:58:06 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-86c4287c-abb3-490a-b5bd-687c216503d8 tempest-VolumesTransfersTest-562072289 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 25 15:58:06 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-86c4287c-abb3-490a-b5bd-687c216503d8 tempest-VolumesTransfersTest-562072289 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 25 15:58:06 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.quobyte [None req-86c4287c-abb3-490a-b5bd-687c216503d8 tempest-VolumesTransfersTest-562072289 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23e9d725-3e04-4cd9-bfe0-c8ef43305589': None} {{(pid=83528) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 25 15:58:06 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.quobyte [None req-86c4287c-abb3-490a-b5bd-687c216503d8 tempest-VolumesTransfersTest-562072289 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23e9d725-3e04-4cd9-bfe0-c8ef43305589'] {{(pid=83528) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 25 15:58:06 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-86c4287c-abb3-490a-b5bd-687c216503d8 tempest-VolumesTransfersTest-562072289 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 25 15:58:06 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-86c4287c-abb3-490a-b5bd-687c216503d8 tempest-VolumesTransfersTest-562072289 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85 {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 25 15:58:06 devstack sudo[89403]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85 Feb 25 15:58:06 devstack sudo[89403]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 25 15:58:06 devstack sudo[89399]: pam_unix(sudo:session): session closed for user root Feb 25 15:58:06 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-8c4d86a2-c63f-4e2b-a3f8-1539f3b6050f tempest-VolumesGetTest-958147190 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-b6a247fd-8187-4862-9f69-ba87bfe2e9ff" returned: 0 in 0.592s {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 25 15:58:06 devstack cinder-volume[83528]: DEBUG cinder.coordination [None req-8c4d86a2-c63f-4e2b-a3f8-1539f3b6050f tempest-VolumesGetTest-958147190 None] Lock "cinder-quobyte-b6a247fd-8187-4862-9f69-ba87bfe2e9ff" released by "delete_volume" :: held 1.278s {{(pid=83528) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 25 15:58:06 devstack cinder-volume[83528]: DEBUG cinder.quota [None req-8c4d86a2-c63f-4e2b-a3f8-1539f3b6050f tempest-VolumesGetTest-958147190 None] Created reservations ['520884aa-fe0a-47a9-b8a8-d63b5b2b1186', '24b1c908-3004-4190-a070-13c7b743fb4e', '7fd50c55-a42e-4be7-a169-dddbf7d1d2d3', '20b9722d-c58e-445e-8086-2a2a26b24123'] {{(pid=83528) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 25 15:58:06 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-8c4d86a2-c63f-4e2b-a3f8-1539f3b6050f tempest-VolumesGetTest-958147190 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 25 15:58:06 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-8c4d86a2-c63f-4e2b-a3f8-1539f3b6050f tempest-VolumesGetTest-958147190 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 25 15:58:06 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.quobyte [None req-8c4d86a2-c63f-4e2b-a3f8-1539f3b6050f tempest-VolumesGetTest-958147190 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23e9d725-3e04-4cd9-bfe0-c8ef43305589': None} {{(pid=83528) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 25 15:58:06 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.quobyte [None req-8c4d86a2-c63f-4e2b-a3f8-1539f3b6050f tempest-VolumesGetTest-958147190 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23e9d725-3e04-4cd9-bfe0-c8ef43305589'] {{(pid=83528) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 25 15:58:06 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-8c4d86a2-c63f-4e2b-a3f8-1539f3b6050f tempest-VolumesGetTest-958147190 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 25 15:58:06 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-8c4d86a2-c63f-4e2b-a3f8-1539f3b6050f tempest-VolumesGetTest-958147190 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85 {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 25 15:58:06 devstack sudo[89405]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85 Feb 25 15:58:06 devstack sudo[89405]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 25 15:58:06 devstack sudo[89403]: pam_unix(sudo:session): session closed for user root Feb 25 15:58:06 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-86c4287c-abb3-490a-b5bd-687c216503d8 tempest-VolumesTransfersTest-562072289 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85" returned: 0 in 0.485s {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 25 15:58:06 devstack cinder-volume[83528]: DEBUG cinder.manager [None req-86c4287c-abb3-490a-b5bd-687c216503d8 tempest-VolumesTransfersTest-562072289 None] Notifying Schedulers of capabilities ... {{(pid=83528) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 25 15:58:06 devstack cinder-volume[83528]: INFO cinder.volume.manager [None req-86c4287c-abb3-490a-b5bd-687c216503d8 tempest-VolumesTransfersTest-562072289 None] Deleted volume successfully. Feb 25 15:58:06 devstack cinder-volume[83528]: DEBUG cinder.coordination [None req-86c4287c-abb3-490a-b5bd-687c216503d8 tempest-VolumesTransfersTest-562072289 None] Lock "cinder-05ecd05b-da27-4ce0-8b97-039ad701665f-delete_volume" released by "delete_volume" :: held 1.897s {{(pid=83528) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 25 15:58:06 devstack sudo[89405]: pam_unix(sudo:session): session closed for user root Feb 25 15:58:06 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-8c4d86a2-c63f-4e2b-a3f8-1539f3b6050f tempest-VolumesGetTest-958147190 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85" returned: 0 in 0.432s {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 25 15:58:06 devstack cinder-volume[83528]: DEBUG cinder.manager [None req-8c4d86a2-c63f-4e2b-a3f8-1539f3b6050f tempest-VolumesGetTest-958147190 None] Notifying Schedulers of capabilities ... {{(pid=83528) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 25 15:58:06 devstack cinder-volume[83528]: INFO cinder.volume.manager [None req-8c4d86a2-c63f-4e2b-a3f8-1539f3b6050f tempest-VolumesGetTest-958147190 None] Deleted volume successfully. Feb 25 15:58:06 devstack cinder-volume[83528]: DEBUG cinder.coordination [None req-8c4d86a2-c63f-4e2b-a3f8-1539f3b6050f tempest-VolumesGetTest-958147190 None] Lock "cinder-b6a247fd-8187-4862-9f69-ba87bfe2e9ff-delete_volume" released by "delete_volume" :: held 1.876s {{(pid=83528) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 25 15:58:07 devstack cinder-volume[83528]: DEBUG cinder.volume.flows.manager.create_volume [None req-57bb3f79-029e-4fc8-9d57-02775eb38d37 tempest-VolumesGetTest-958147190 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83528) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 25 15:58:07 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-57bb3f79-029e-4fc8-9d57-02775eb38d37 tempest-VolumesGetTest-958147190 None] Flow 'volume_create_manager' (103b8ae6-97fb-4b8b-9de0-aa029af89194) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83528) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 25 15:58:07 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-57bb3f79-029e-4fc8-9d57-02775eb38d37 tempest-VolumesGetTest-958147190 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (583457e0-6499-43b9-9d6e-4ee5cb91c4dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 25 15:58:07 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-57bb3f79-029e-4fc8-9d57-02775eb38d37 tempest-VolumesGetTest-958147190 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (583457e0-6499-43b9-9d6e-4ee5cb91c4dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-25T14:58:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1822748594',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=834d62f9-8f30-4975-a9d6-b33c44744794,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='30b56c3cb9b44b44bc932bfa91495865',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-25T14:58:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-25T14:58:08Z,use_quota=True,user_id='e09e6f803ddf47f09c166c46461b2f9a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ce71c2f9-6543-4165-9653-a1529b2ea243),volume_type_id=ce71c2f9-6543-4165-9653-a1529b2ea243)' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 25 15:58:07 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-57bb3f79-029e-4fc8-9d57-02775eb38d37 tempest-VolumesGetTest-958147190 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (12e98ec9-ef27-4661-916f-e9387d073b2b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 25 15:58:07 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-57bb3f79-029e-4fc8-9d57-02775eb38d37 tempest-VolumesGetTest-958147190 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (12e98ec9-ef27-4661-916f-e9387d073b2b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 25 15:58:07 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-57bb3f79-029e-4fc8-9d57-02775eb38d37 tempest-VolumesGetTest-958147190 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (24ae7df2-105b-4205-beee-612c2ba771f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 25 15:58:07 devstack cinder-volume[83528]: DEBUG cinder.image.glance [None req-57bb3f79-029e-4fc8-9d57-02775eb38d37 tempest-VolumesGetTest-958147190 None] Creating Keystone auth plugin from conf {{(pid=83528) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Feb 25 15:58:08 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-57bb3f79-029e-4fc8-9d57-02775eb38d37 tempest-VolumesGetTest-958147190 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (24ae7df2-105b-4205-beee-612c2ba771f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '834d62f9-8f30-4975-a9d6-b33c44744794', 'volume_name': 'volume-834d62f9-8f30-4975-a9d6-b33c44744794', 'volume_size': 1, 'image_id': 'c50f3ecd-5e88-4737-aa36-6e073ce70c60', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/c50f3ecd-5e88-4737-aa36-6e073ce70c60', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '75f8571da0ad46ec8e734ab2a4fa231d', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'c50f3ecd-5e88-4737-aa36-6e073ce70c60', 'created_at': datetime.datetime(2026, 2, 25, 14, 47, 16, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 2, 25, 14, 47, 18, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/c50f3ecd-5e88-4737-aa36-6e073ce70c60/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 25 15:58:08 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-57bb3f79-029e-4fc8-9d57-02775eb38d37 tempest-VolumesGetTest-958147190 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4f6279ea-8838-46fc-900d-662f615e8c08) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 25 15:58:08 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-57bb3f79-029e-4fc8-9d57-02775eb38d37 tempest-VolumesGetTest-958147190 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4f6279ea-8838-46fc-900d-662f615e8c08) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 25 15:58:08 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-57bb3f79-029e-4fc8-9d57-02775eb38d37 tempest-VolumesGetTest-958147190 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e93d7a6d-a136-4ad7-b584-6ef95873a4da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 25 15:58:08 devstack cinder-volume[83528]: INFO cinder.volume.flows.manager.create_volume [None req-57bb3f79-029e-4fc8-9d57-02775eb38d37 tempest-VolumesGetTest-958147190 None] Volume 834d62f9-8f30-4975-a9d6-b33c44744794: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-834d62f9-8f30-4975-a9d6-b33c44744794', 'volume_size': 1, 'image_id': 'c50f3ecd-5e88-4737-aa36-6e073ce70c60', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/c50f3ecd-5e88-4737-aa36-6e073ce70c60', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '75f8571da0ad46ec8e734ab2a4fa231d', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'c50f3ecd-5e88-4737-aa36-6e073ce70c60', 'created_at': datetime.datetime(2026, 2, 25, 14, 47, 16, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 2, 25, 14, 47, 18, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/c50f3ecd-5e88-4737-aa36-6e073ce70c60/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Feb 25 15:58:08 devstack cinder-volume[83528]: DEBUG cinder.volume.flows.manager.create_volume [None req-57bb3f79-029e-4fc8-9d57-02775eb38d37 tempest-VolumesGetTest-958147190 None] Trying to clone 834d62f9-8f30-4975-a9d6-b33c44744794 from image c50f3ecd-5e88-4737-aa36-6e073ce70c60 at location (None, [{'url': 'file:///opt/stack/data/glance/images/c50f3ecd-5e88-4737-aa36-6e073ce70c60', 'metadata': {}}]). {{(pid=83528) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1082}} Feb 25 15:58:08 devstack cinder-volume[83528]: DEBUG cinder.image.image_utils [None req-57bb3f79-029e-4fc8-9d57-02775eb38d37 tempest-VolumesGetTest-958147190 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_c50f3ecd-5e88-4737-aa36-6e073ce70c60_ge38gkirdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=83528) fetch /opt/stack/cinder/cinder/image/image_utils.py:732}} Feb 25 15:58:08 devstack cinder-volume[83528]: INFO cinder.image.image_utils [None req-57bb3f79-029e-4fc8-9d57-02775eb38d37 tempest-VolumesGetTest-958147190 None] Image download 20.69 MB at 20.69 MB/s Feb 25 15:58:08 devstack cinder-volume[83528]: DEBUG oslo.privsep.daemon [-] privsep: reply[1760d596-f67e-4eff-b4be-e7fabda1c0bc]: (4, 'qcow2') {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 25 15:58:08 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-57bb3f79-029e-4fc8-9d57-02775eb38d37 tempest-VolumesGetTest-958147190 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c50f3ecd-5e88-4737-aa36-6e073ce70c60_ge38gkirdevstack@QuobyteHD {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 25 15:58:08 devstack sudo[89411]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c50f3ecd-5e88-4737-aa36-6e073ce70c60_ge38gkirdevstack@QuobyteHD Feb 25 15:58:08 devstack sudo[89411]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 25 15:58:09 devstack sudo[89411]: pam_unix(sudo:session): session closed for user root Feb 25 15:58:09 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-57bb3f79-029e-4fc8-9d57-02775eb38d37 tempest-VolumesGetTest-958147190 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c50f3ecd-5e88-4737-aa36-6e073ce70c60_ge38gkirdevstack@QuobyteHD" returned: 0 in 1.149s {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 25 15:58:09 devstack cinder-volume[83528]: DEBUG cinder.image.image_utils [None req-57bb3f79-029e-4fc8-9d57-02775eb38d37 tempest-VolumesGetTest-958147190 None] Temporary image c50f3ecd-5e88-4737-aa36-6e073ce70c60 is fetched for user e09e6f803ddf47f09c166c46461b2f9a. {{(pid=83528) fetch /opt/stack/cinder/cinder/image/image_utils.py:1431}} Feb 25 15:58:09 devstack cinder-volume[83528]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed9840f6-0ab2-4ea6-a5c0-d745d55d54a5]: (4, 'qcow2') {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 25 15:58:09 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-57bb3f79-029e-4fc8-9d57-02775eb38d37 tempest-VolumesGetTest-958147190 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c50f3ecd-5e88-4737-aa36-6e073ce70c60_ge38gkirdevstack@QuobyteHD {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 25 15:58:09 devstack sudo[89417]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c50f3ecd-5e88-4737-aa36-6e073ce70c60_ge38gkirdevstack@QuobyteHD Feb 25 15:58:09 devstack sudo[89417]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 25 15:58:10 devstack sudo[89417]: pam_unix(sudo:session): session closed for user root Feb 25 15:58:10 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-57bb3f79-029e-4fc8-9d57-02775eb38d37 tempest-VolumesGetTest-958147190 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c50f3ecd-5e88-4737-aa36-6e073ce70c60_ge38gkirdevstack@QuobyteHD" returned: 0 in 0.724s {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 25 15:58:10 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-57bb3f79-029e-4fc8-9d57-02775eb38d37 tempest-VolumesGetTest-958147190 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 25 15:58:10 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-57bb3f79-029e-4fc8-9d57-02775eb38d37 tempest-VolumesGetTest-958147190 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 25 15:58:10 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.quobyte [None req-57bb3f79-029e-4fc8-9d57-02775eb38d37 tempest-VolumesGetTest-958147190 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-25T14:58:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1822748594',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=834d62f9-8f30-4975-a9d6-b33c44744794,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='30b56c3cb9b44b44bc932bfa91495865',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-25T14:58:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-25T14:58:08Z,use_quota=True,user_id='e09e6f803ddf47f09c166c46461b2f9a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ce71c2f9-6543-4165-9653-a1529b2ea243),volume_type_id=ce71c2f9-6543-4165-9653-a1529b2ea243)}" {{(pid=83528) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 25 15:58:10 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.remotefs [None req-57bb3f79-029e-4fc8-9d57-02775eb38d37 tempest-VolumesGetTest-958147190 None] Creating volume 834d62f9-8f30-4975-a9d6-b33c44744794 {{(pid=83528) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 25 15:58:10 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-57bb3f79-029e-4fc8-9d57-02775eb38d37 tempest-VolumesGetTest-958147190 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 25 15:58:10 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-57bb3f79-029e-4fc8-9d57-02775eb38d37 tempest-VolumesGetTest-958147190 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 25 15:58:10 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.quobyte [None req-57bb3f79-029e-4fc8-9d57-02775eb38d37 tempest-VolumesGetTest-958147190 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23e9d725-3e04-4cd9-bfe0-c8ef43305589': None} {{(pid=83528) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 25 15:58:10 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.quobyte [None req-57bb3f79-029e-4fc8-9d57-02775eb38d37 tempest-VolumesGetTest-958147190 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23e9d725-3e04-4cd9-bfe0-c8ef43305589'] {{(pid=83528) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 25 15:58:10 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-57bb3f79-029e-4fc8-9d57-02775eb38d37 tempest-VolumesGetTest-958147190 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 25 15:58:10 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.quobyte [None req-57bb3f79-029e-4fc8-9d57-02775eb38d37 tempest-VolumesGetTest-958147190 None] Selected osci02.corp.quobyte.com/cinder-vol-23e9d725-3e04-4cd9-bfe0-c8ef43305589 as target Quobyte volume. {{(pid=83528) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 25 15:58:10 devstack cinder-volume[83528]: INFO cinder.volume.drivers.remotefs [None req-57bb3f79-029e-4fc8-9d57-02775eb38d37 tempest-VolumesGetTest-958147190 None] casted to osci02.corp.quobyte.com/cinder-vol-23e9d725-3e04-4cd9-bfe0-c8ef43305589 Feb 25 15:58:10 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-57bb3f79-029e-4fc8-9d57-02775eb38d37 tempest-VolumesGetTest-958147190 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-834d62f9-8f30-4975-a9d6-b33c44744794 1073741824 {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 25 15:58:10 devstack sudo[89422]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-834d62f9-8f30-4975-a9d6-b33c44744794 1073741824 Feb 25 15:58:10 devstack sudo[89422]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 25 15:58:11 devstack sudo[89422]: pam_unix(sudo:session): session closed for user root Feb 25 15:58:11 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-57bb3f79-029e-4fc8-9d57-02775eb38d37 tempest-VolumesGetTest-958147190 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-834d62f9-8f30-4975-a9d6-b33c44744794 1073741824" returned: 0 in 0.835s {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 25 15:58:11 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-57bb3f79-029e-4fc8-9d57-02775eb38d37 tempest-VolumesGetTest-958147190 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-834d62f9-8f30-4975-a9d6-b33c44744794 {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 25 15:58:11 devstack sudo[89427]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-834d62f9-8f30-4975-a9d6-b33c44744794 Feb 25 15:58:11 devstack sudo[89427]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 25 15:58:12 devstack sudo[89427]: pam_unix(sudo:session): session closed for user root Feb 25 15:58:12 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-57bb3f79-029e-4fc8-9d57-02775eb38d37 tempest-VolumesGetTest-958147190 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-834d62f9-8f30-4975-a9d6-b33c44744794" returned: 0 in 0.646s {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 25 15:58:12 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.quobyte [None req-57bb3f79-029e-4fc8-9d57-02775eb38d37 tempest-VolumesGetTest-958147190 None] <== create_volume: return (1542ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-23e9d725-3e04-4cd9-bfe0-c8ef43305589'} {{(pid=83528) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 25 15:58:12 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-57bb3f79-029e-4fc8-9d57-02775eb38d37 tempest-VolumesGetTest-958147190 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.547s {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 25 15:58:12 devstack cinder-volume[83528]: DEBUG cinder.volume.volume_utils [None req-57bb3f79-029e-4fc8-9d57-02775eb38d37 tempest-VolumesGetTest-958147190 None] Attempting download of c50f3ecd-5e88-4737-aa36-6e073ce70c60 ((None, [{'url': 'file:///opt/stack/data/glance/images/c50f3ecd-5e88-4737-aa36-6e073ce70c60', 'metadata': {}}])) to volume 834d62f9-8f30-4975-a9d6-b33c44744794. {{(pid=83528) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1189}} Feb 25 15:58:12 devstack cinder-volume[83528]: DEBUG oslo.privsep.daemon [-] privsep: reply[93bf9a01-f634-4aea-80b2-8ac38c2d3309]: (4, 'raw') {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 25 15:58:12 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-57bb3f79-029e-4fc8-9d57-02775eb38d37 tempest-VolumesGetTest-958147190 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_c50f3ecd-5e88-4737-aa36-6e073ce70c60_jrkdlpnw {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 25 15:58:12 devstack sudo[89462]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_c50f3ecd-5e88-4737-aa36-6e073ce70c60_jrkdlpnw Feb 25 15:58:12 devstack sudo[89462]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 25 15:58:13 devstack sudo[89462]: pam_unix(sudo:session): session closed for user root Feb 25 15:58:13 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-57bb3f79-029e-4fc8-9d57-02775eb38d37 tempest-VolumesGetTest-958147190 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_c50f3ecd-5e88-4737-aa36-6e073ce70c60_jrkdlpnw" returned: 0 in 1.181s {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 25 15:58:13 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-57bb3f79-029e-4fc8-9d57-02775eb38d37 tempest-VolumesGetTest-958147190 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_c50f3ecd-5e88-4737-aa36-6e073ce70c60_jrkdlpnw {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 25 15:58:13 devstack sudo[89475]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_c50f3ecd-5e88-4737-aa36-6e073ce70c60_jrkdlpnw Feb 25 15:58:13 devstack sudo[89475]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 25 15:58:14 devstack sudo[89475]: pam_unix(sudo:session): session closed for user root Feb 25 15:58:14 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-57bb3f79-029e-4fc8-9d57-02775eb38d37 tempest-VolumesGetTest-958147190 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_c50f3ecd-5e88-4737-aa36-6e073ce70c60_jrkdlpnw" returned: 1 in 0.832s {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 25 15:58:14 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-57bb3f79-029e-4fc8-9d57-02775eb38d37 tempest-VolumesGetTest-958147190 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_c50f3ecd-5e88-4737-aa36-6e073ce70c60_jrkdlpnw' failed. Not Retrying. {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Feb 25 15:58:14 devstack cinder-volume[83528]: DEBUG oslo.privsep.daemon [-] privsep: reply[bebd23a5-5abd-414a-827d-cd074f6cabee]: (4, 'qcow2') {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 25 15:58:14 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-57bb3f79-029e-4fc8-9d57-02775eb38d37 tempest-VolumesGetTest-958147190 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c50f3ecd-5e88-4737-aa36-6e073ce70c60_ge38gkirdevstack@QuobyteHD {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 25 15:58:14 devstack sudo[89479]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c50f3ecd-5e88-4737-aa36-6e073ce70c60_ge38gkirdevstack@QuobyteHD Feb 25 15:58:14 devstack sudo[89479]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 25 15:58:15 devstack sudo[89479]: pam_unix(sudo:session): session closed for user root Feb 25 15:58:15 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-57bb3f79-029e-4fc8-9d57-02775eb38d37 tempest-VolumesGetTest-958147190 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c50f3ecd-5e88-4737-aa36-6e073ce70c60_ge38gkirdevstack@QuobyteHD" returned: 0 in 0.737s {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 25 15:58:15 devstack cinder-volume[83528]: DEBUG cinder.image.image_utils [None req-57bb3f79-029e-4fc8-9d57-02775eb38d37 tempest-VolumesGetTest-958147190 None] c50f3ecd-5e88-4737-aa36-6e073ce70c60 was qcow2, converting to raw {{(pid=83528) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1120}} Feb 25 15:58:15 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-57bb3f79-029e-4fc8-9d57-02775eb38d37 tempest-VolumesGetTest-958147190 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_c50f3ecd-5e88-4737-aa36-6e073ce70c60_ge38gkirdevstack@QuobyteHD /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-834d62f9-8f30-4975-a9d6-b33c44744794 {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 25 15:58:15 devstack sudo[89485]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_c50f3ecd-5e88-4737-aa36-6e073ce70c60_ge38gkirdevstack@QuobyteHD /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-834d62f9-8f30-4975-a9d6-b33c44744794 Feb 25 15:58:15 devstack sudo[89485]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 25 15:58:15 devstack cinder-volume[83528]: DEBUG dbcounter [-] [83528] Writing DB stats cinder:DELETE=16,cinder:SELECT=162,cinder:UPDATE=231,cinder:INSERT=66 {{(pid=83528) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Feb 25 15:58:15 devstack cinder-volume[83528]: DEBUG dbcounter [-] [83528] Writing DB stats cinder:SELECT=160,cinder:UPDATE=170,cinder:INSERT=47,cinder:DELETE=17 {{(pid=83528) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Feb 25 15:58:15 devstack cinder-volume[83528]: DEBUG cinder.volume.flows.manager.create_volume [None req-f3fc3f74-a71b-44a0-b8c3-00941fd5e2a5 tempest-SnapshotDependencyTests-95648043 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83528) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 25 15:58:15 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-f3fc3f74-a71b-44a0-b8c3-00941fd5e2a5 tempest-SnapshotDependencyTests-95648043 None] Flow 'volume_create_manager' (a08e0f53-1e39-41ef-80e3-8dd89a95a8fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83528) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 25 15:58:15 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-f3fc3f74-a71b-44a0-b8c3-00941fd5e2a5 tempest-SnapshotDependencyTests-95648043 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3ab199ec-f975-4cd3-9c92-531ead3ed9f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 25 15:58:16 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-f3fc3f74-a71b-44a0-b8c3-00941fd5e2a5 tempest-SnapshotDependencyTests-95648043 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3ab199ec-f975-4cd3-9c92-531ead3ed9f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-25T14:58:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-679547503',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=44279f1a-6ab4-4916-8fa2-ff542ca99031,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3738d22ad82846e788dff0e49ced945d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-25T14:58:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-25T14:58:16Z,use_quota=True,user_id='ade0df8e08a44dc9a2351c7e948d93bb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ce71c2f9-6543-4165-9653-a1529b2ea243),volume_type_id=ce71c2f9-6543-4165-9653-a1529b2ea243)' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 25 15:58:16 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-f3fc3f74-a71b-44a0-b8c3-00941fd5e2a5 tempest-SnapshotDependencyTests-95648043 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b09c6edc-b595-47f1-9cba-297390a5eed6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 25 15:58:16 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-f3fc3f74-a71b-44a0-b8c3-00941fd5e2a5 tempest-SnapshotDependencyTests-95648043 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b09c6edc-b595-47f1-9cba-297390a5eed6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 25 15:58:16 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-f3fc3f74-a71b-44a0-b8c3-00941fd5e2a5 tempest-SnapshotDependencyTests-95648043 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (206d0f06-ffcb-4ce5-b260-2cd2d3226fcb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 25 15:58:16 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-f3fc3f74-a71b-44a0-b8c3-00941fd5e2a5 tempest-SnapshotDependencyTests-95648043 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (206d0f06-ffcb-4ce5-b260-2cd2d3226fcb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '44279f1a-6ab4-4916-8fa2-ff542ca99031', 'volume_name': 'volume-44279f1a-6ab4-4916-8fa2-ff542ca99031', 'volume_size': 1}' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 25 15:58:16 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-f3fc3f74-a71b-44a0-b8c3-00941fd5e2a5 tempest-SnapshotDependencyTests-95648043 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5226df2e-f348-4853-9496-d1711bca237a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 25 15:58:16 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-f3fc3f74-a71b-44a0-b8c3-00941fd5e2a5 tempest-SnapshotDependencyTests-95648043 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5226df2e-f348-4853-9496-d1711bca237a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 25 15:58:16 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-f3fc3f74-a71b-44a0-b8c3-00941fd5e2a5 tempest-SnapshotDependencyTests-95648043 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9d9c95b2-f6a5-44b4-8a10-71a29622f958) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 25 15:58:16 devstack cinder-volume[83528]: INFO cinder.volume.flows.manager.create_volume [None req-f3fc3f74-a71b-44a0-b8c3-00941fd5e2a5 tempest-SnapshotDependencyTests-95648043 None] Volume 44279f1a-6ab4-4916-8fa2-ff542ca99031: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-44279f1a-6ab4-4916-8fa2-ff542ca99031', 'volume_size': 1} Feb 25 15:58:16 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-f3fc3f74-a71b-44a0-b8c3-00941fd5e2a5 tempest-SnapshotDependencyTests-95648043 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 25 15:58:16 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-f3fc3f74-a71b-44a0-b8c3-00941fd5e2a5 tempest-SnapshotDependencyTests-95648043 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 25 15:58:16 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.quobyte [None req-f3fc3f74-a71b-44a0-b8c3-00941fd5e2a5 tempest-SnapshotDependencyTests-95648043 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-25T14:58:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-679547503',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=44279f1a-6ab4-4916-8fa2-ff542ca99031,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3738d22ad82846e788dff0e49ced945d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-25T14:58:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-25T14:58:16Z,use_quota=True,user_id='ade0df8e08a44dc9a2351c7e948d93bb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ce71c2f9-6543-4165-9653-a1529b2ea243),volume_type_id=ce71c2f9-6543-4165-9653-a1529b2ea243)}" {{(pid=83528) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 25 15:58:16 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.remotefs [None req-f3fc3f74-a71b-44a0-b8c3-00941fd5e2a5 tempest-SnapshotDependencyTests-95648043 None] Creating volume 44279f1a-6ab4-4916-8fa2-ff542ca99031 {{(pid=83528) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 25 15:58:16 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-f3fc3f74-a71b-44a0-b8c3-00941fd5e2a5 tempest-SnapshotDependencyTests-95648043 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 25 15:58:16 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-f3fc3f74-a71b-44a0-b8c3-00941fd5e2a5 tempest-SnapshotDependencyTests-95648043 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 25 15:58:16 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.quobyte [None req-f3fc3f74-a71b-44a0-b8c3-00941fd5e2a5 tempest-SnapshotDependencyTests-95648043 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23e9d725-3e04-4cd9-bfe0-c8ef43305589': None} {{(pid=83528) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 25 15:58:16 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.quobyte [None req-f3fc3f74-a71b-44a0-b8c3-00941fd5e2a5 tempest-SnapshotDependencyTests-95648043 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23e9d725-3e04-4cd9-bfe0-c8ef43305589'] {{(pid=83528) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 25 15:58:16 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-f3fc3f74-a71b-44a0-b8c3-00941fd5e2a5 tempest-SnapshotDependencyTests-95648043 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 25 15:58:16 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.quobyte [None req-f3fc3f74-a71b-44a0-b8c3-00941fd5e2a5 tempest-SnapshotDependencyTests-95648043 None] Selected osci02.corp.quobyte.com/cinder-vol-23e9d725-3e04-4cd9-bfe0-c8ef43305589 as target Quobyte volume. {{(pid=83528) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 25 15:58:16 devstack cinder-volume[83528]: INFO cinder.volume.drivers.remotefs [None req-f3fc3f74-a71b-44a0-b8c3-00941fd5e2a5 tempest-SnapshotDependencyTests-95648043 None] casted to osci02.corp.quobyte.com/cinder-vol-23e9d725-3e04-4cd9-bfe0-c8ef43305589 Feb 25 15:58:16 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-f3fc3f74-a71b-44a0-b8c3-00941fd5e2a5 tempest-SnapshotDependencyTests-95648043 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-44279f1a-6ab4-4916-8fa2-ff542ca99031 1073741824 {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 25 15:58:16 devstack sudo[89503]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-44279f1a-6ab4-4916-8fa2-ff542ca99031 1073741824 Feb 25 15:58:16 devstack sudo[89503]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 25 15:58:16 devstack sudo[89485]: pam_unix(sudo:session): session closed for user root Feb 25 15:58:16 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-57bb3f79-029e-4fc8-9d57-02775eb38d37 tempest-VolumesGetTest-958147190 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_c50f3ecd-5e88-4737-aa36-6e073ce70c60_ge38gkirdevstack@QuobyteHD /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-834d62f9-8f30-4975-a9d6-b33c44744794" returned: 0 in 1.582s {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 25 15:58:16 devstack cinder-volume[83528]: DEBUG cinder.image.image_utils [None req-57bb3f79-029e-4fc8-9d57-02775eb38d37 tempest-VolumesGetTest-958147190 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_c50f3ecd-5e88-4737-aa36-6e073ce70c60_ge38gkirdevstack@QuobyteHD, size 112.00 MB, duration 1.58 sec, destination /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-834d62f9-8f30-4975-a9d6-b33c44744794 {{(pid=83528) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Feb 25 15:58:16 devstack cinder-volume[83528]: INFO cinder.image.image_utils [None req-57bb3f79-029e-4fc8-9d57-02775eb38d37 tempest-VolumesGetTest-958147190 None] Converted 112.00 MB image at 70.72 MB/s Feb 25 15:58:16 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-57bb3f79-029e-4fc8-9d57-02775eb38d37 tempest-VolumesGetTest-958147190 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-834d62f9-8f30-4975-a9d6-b33c44744794 1G {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 25 15:58:16 devstack sudo[89505]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-834d62f9-8f30-4975-a9d6-b33c44744794 1G Feb 25 15:58:16 devstack sudo[89505]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 25 15:58:16 devstack sudo[89503]: pam_unix(sudo:session): session closed for user root Feb 25 15:58:16 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-f3fc3f74-a71b-44a0-b8c3-00941fd5e2a5 tempest-SnapshotDependencyTests-95648043 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-44279f1a-6ab4-4916-8fa2-ff542ca99031 1073741824" returned: 0 in 0.820s {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 25 15:58:16 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-f3fc3f74-a71b-44a0-b8c3-00941fd5e2a5 tempest-SnapshotDependencyTests-95648043 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-44279f1a-6ab4-4916-8fa2-ff542ca99031 {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 25 15:58:16 devstack sudo[89510]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-44279f1a-6ab4-4916-8fa2-ff542ca99031 Feb 25 15:58:16 devstack sudo[89510]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 25 15:58:17 devstack sudo[89505]: pam_unix(sudo:session): session closed for user root Feb 25 15:58:17 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-57bb3f79-029e-4fc8-9d57-02775eb38d37 tempest-VolumesGetTest-958147190 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-834d62f9-8f30-4975-a9d6-b33c44744794 1G" returned: 0 in 0.621s {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 25 15:58:17 devstack cinder-volume[83528]: DEBUG oslo.privsep.daemon [-] privsep: reply[29dda478-7b07-44e2-abbf-b3056e5a6626]: (4, 'raw') {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 25 15:58:17 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-57bb3f79-029e-4fc8-9d57-02775eb38d37 tempest-VolumesGetTest-958147190 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-834d62f9-8f30-4975-a9d6-b33c44744794 {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 25 15:58:17 devstack sudo[89515]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-834d62f9-8f30-4975-a9d6-b33c44744794 Feb 25 15:58:17 devstack sudo[89515]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 25 15:58:17 devstack sudo[89510]: pam_unix(sudo:session): session closed for user root Feb 25 15:58:17 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-f3fc3f74-a71b-44a0-b8c3-00941fd5e2a5 tempest-SnapshotDependencyTests-95648043 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-44279f1a-6ab4-4916-8fa2-ff542ca99031" returned: 0 in 0.611s {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 25 15:58:17 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.quobyte [None req-f3fc3f74-a71b-44a0-b8c3-00941fd5e2a5 tempest-SnapshotDependencyTests-95648043 None] <== create_volume: return (1464ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-23e9d725-3e04-4cd9-bfe0-c8ef43305589'} {{(pid=83528) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 25 15:58:17 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-f3fc3f74-a71b-44a0-b8c3-00941fd5e2a5 tempest-SnapshotDependencyTests-95648043 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.467s {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 25 15:58:17 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-f3fc3f74-a71b-44a0-b8c3-00941fd5e2a5 tempest-SnapshotDependencyTests-95648043 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9d9c95b2-f6a5-44b4-8a10-71a29622f958) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-44279f1a-6ab4-4916-8fa2-ff542ca99031', 'volume_size': 1}' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 25 15:58:17 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-f3fc3f74-a71b-44a0-b8c3-00941fd5e2a5 tempest-SnapshotDependencyTests-95648043 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4cc55b0f-f653-4a51-b6c6-ffc55d1dd589) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 25 15:58:17 devstack cinder-volume[83528]: INFO cinder.volume.flows.manager.create_volume [None req-f3fc3f74-a71b-44a0-b8c3-00941fd5e2a5 tempest-SnapshotDependencyTests-95648043 None] Volume volume-44279f1a-6ab4-4916-8fa2-ff542ca99031 (44279f1a-6ab4-4916-8fa2-ff542ca99031): created successfully Feb 25 15:58:17 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-f3fc3f74-a71b-44a0-b8c3-00941fd5e2a5 tempest-SnapshotDependencyTests-95648043 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4cc55b0f-f653-4a51-b6c6-ffc55d1dd589) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 25 15:58:17 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-f3fc3f74-a71b-44a0-b8c3-00941fd5e2a5 tempest-SnapshotDependencyTests-95648043 None] Flow 'volume_create_manager' (a08e0f53-1e39-41ef-80e3-8dd89a95a8fc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83528) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 25 15:58:17 devstack cinder-volume[83528]: INFO cinder.volume.manager [None req-f3fc3f74-a71b-44a0-b8c3-00941fd5e2a5 tempest-SnapshotDependencyTests-95648043 None] Created volume successfully. Feb 25 15:58:17 devstack sudo[89515]: pam_unix(sudo:session): session closed for user root Feb 25 15:58:17 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-57bb3f79-029e-4fc8-9d57-02775eb38d37 tempest-VolumesGetTest-958147190 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-834d62f9-8f30-4975-a9d6-b33c44744794" returned: 0 in 0.648s {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 25 15:58:17 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-57bb3f79-029e-4fc8-9d57-02775eb38d37 tempest-VolumesGetTest-958147190 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-834d62f9-8f30-4975-a9d6-b33c44744794 {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 25 15:58:18 devstack sudo[89520]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-834d62f9-8f30-4975-a9d6-b33c44744794 Feb 25 15:58:18 devstack sudo[89520]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 25 15:58:18 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-b4ef2372-a8c5-448d-a3b6-c5f0d416b8c4 tempest-SnapshotDependencyTests-95648043 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 25 15:58:18 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-b4ef2372-a8c5-448d-a3b6-c5f0d416b8c4 tempest-SnapshotDependencyTests-95648043 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 25 15:58:18 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.remotefs [None req-b4ef2372-a8c5-448d-a3b6-c5f0d416b8c4 tempest-SnapshotDependencyTests-95648043 None] Creating offline snapshot bef529bf-2174-423e-b5b3-aa861367aad7 of volume 44279f1a-6ab4-4916-8fa2-ff542ca99031 {{(pid=83528) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Feb 25 15:58:18 devstack cinder-volume[83528]: DEBUG oslo.privsep.daemon [-] privsep: reply[8cc59514-b1e5-4e60-b562-80c363c76434]: (4, 'qcow2') {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 25 15:58:18 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-b4ef2372-a8c5-448d-a3b6-c5f0d416b8c4 tempest-SnapshotDependencyTests-95648043 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-44279f1a-6ab4-4916-8fa2-ff542ca99031 {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 25 15:58:18 devstack sudo[89522]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-44279f1a-6ab4-4916-8fa2-ff542ca99031 Feb 25 15:58:18 devstack sudo[89522]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 25 15:58:18 devstack sudo[89520]: pam_unix(sudo:session): session closed for user root Feb 25 15:58:18 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-57bb3f79-029e-4fc8-9d57-02775eb38d37 tempest-VolumesGetTest-958147190 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-834d62f9-8f30-4975-a9d6-b33c44744794" returned: 1 in 0.655s {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 25 15:58:18 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-57bb3f79-029e-4fc8-9d57-02775eb38d37 tempest-VolumesGetTest-958147190 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-834d62f9-8f30-4975-a9d6-b33c44744794' failed. Not Retrying. {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Feb 25 15:58:18 devstack cinder-volume[83528]: DEBUG cinder.volume.volume_utils [None req-57bb3f79-029e-4fc8-9d57-02775eb38d37 tempest-VolumesGetTest-958147190 None] Downloaded image c50f3ecd-5e88-4737-aa36-6e073ce70c60 ((None, [{'url': 'file:///opt/stack/data/glance/images/c50f3ecd-5e88-4737-aa36-6e073ce70c60', 'metadata': {}}])) to volume 834d62f9-8f30-4975-a9d6-b33c44744794 successfully. {{(pid=83528) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1234}} Feb 25 15:58:18 devstack cinder-volume[83528]: DEBUG cinder.image.image_utils [None req-57bb3f79-029e-4fc8-9d57-02775eb38d37 tempest-VolumesGetTest-958147190 None] Temporary image c50f3ecd-5e88-4737-aa36-6e073ce70c60 for user e09e6f803ddf47f09c166c46461b2f9a is deleted. {{(pid=83528) fetch /opt/stack/cinder/cinder/image/image_utils.py:1435}} Feb 25 15:58:18 devstack cinder-volume[83528]: DEBUG cinder.volume.volume_utils [None req-57bb3f79-029e-4fc8-9d57-02775eb38d37 tempest-VolumesGetTest-958147190 None] Marking volume 834d62f9-8f30-4975-a9d6-b33c44744794 as bootable. {{(pid=83528) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1138}} Feb 25 15:58:18 devstack cinder-volume[83528]: DEBUG cinder.volume.flows.manager.create_volume [None req-57bb3f79-029e-4fc8-9d57-02775eb38d37 tempest-VolumesGetTest-958147190 None] Copying metadata from image c50f3ecd-5e88-4737-aa36-6e073ce70c60 to 834d62f9-8f30-4975-a9d6-b33c44744794. {{(pid=83528) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Feb 25 15:58:18 devstack cinder-volume[83528]: DEBUG cinder.volume.flows.manager.create_volume [None req-57bb3f79-029e-4fc8-9d57-02775eb38d37 tempest-VolumesGetTest-958147190 None] Creating volume glance metadata for volume 834d62f9-8f30-4975-a9d6-b33c44744794 backed by image c50f3ecd-5e88-4737-aa36-6e073ce70c60 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': 'c50f3ecd-5e88-4737-aa36-6e073ce70c60', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=83528) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Feb 25 15:58:18 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-57bb3f79-029e-4fc8-9d57-02775eb38d37 tempest-VolumesGetTest-958147190 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e93d7a6d-a136-4ad7-b584-6ef95873a4da) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-834d62f9-8f30-4975-a9d6-b33c44744794', 'volume_size': 1, 'image_id': 'c50f3ecd-5e88-4737-aa36-6e073ce70c60', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/c50f3ecd-5e88-4737-aa36-6e073ce70c60', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '75f8571da0ad46ec8e734ab2a4fa231d', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'c50f3ecd-5e88-4737-aa36-6e073ce70c60', 'created_at': datetime.datetime(2026, 2, 25, 14, 47, 16, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 2, 25, 14, 47, 18, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/c50f3ecd-5e88-4737-aa36-6e073ce70c60/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 25 15:58:18 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-57bb3f79-029e-4fc8-9d57-02775eb38d37 tempest-VolumesGetTest-958147190 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (43f09efd-41a5-491f-bd97-7c36a0c4da99) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 25 15:58:18 devstack cinder-volume[83528]: INFO cinder.volume.flows.manager.create_volume [None req-57bb3f79-029e-4fc8-9d57-02775eb38d37 tempest-VolumesGetTest-958147190 None] Volume volume-834d62f9-8f30-4975-a9d6-b33c44744794 (834d62f9-8f30-4975-a9d6-b33c44744794): created successfully Feb 25 15:58:18 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-57bb3f79-029e-4fc8-9d57-02775eb38d37 tempest-VolumesGetTest-958147190 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (43f09efd-41a5-491f-bd97-7c36a0c4da99) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 25 15:58:18 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-57bb3f79-029e-4fc8-9d57-02775eb38d37 tempest-VolumesGetTest-958147190 None] Flow 'volume_create_manager' (103b8ae6-97fb-4b8b-9de0-aa029af89194) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83528) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 25 15:58:18 devstack cinder-volume[83528]: INFO cinder.volume.manager [None req-57bb3f79-029e-4fc8-9d57-02775eb38d37 tempest-VolumesGetTest-958147190 None] Created volume successfully. Feb 25 15:58:18 devstack sudo[89522]: pam_unix(sudo:session): session closed for user root Feb 25 15:58:18 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-b4ef2372-a8c5-448d-a3b6-c5f0d416b8c4 tempest-SnapshotDependencyTests-95648043 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-44279f1a-6ab4-4916-8fa2-ff542ca99031" returned: 0 in 0.562s {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 25 15:58:18 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-b4ef2372-a8c5-448d-a3b6-c5f0d416b8c4 tempest-SnapshotDependencyTests-95648043 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-44279f1a-6ab4-4916-8fa2-ff542ca99031,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-44279f1a-6ab4-4916-8fa2-ff542ca99031.bef529bf-2174-423e-b5b3-aa861367aad7 1G {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 25 15:58:18 devstack sudo[89530]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-44279f1a-6ab4-4916-8fa2-ff542ca99031,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-44279f1a-6ab4-4916-8fa2-ff542ca99031.bef529bf-2174-423e-b5b3-aa861367aad7 1G Feb 25 15:58:18 devstack sudo[89530]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 25 15:58:19 devstack sudo[89530]: pam_unix(sudo:session): session closed for user root Feb 25 15:58:19 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-b4ef2372-a8c5-448d-a3b6-c5f0d416b8c4 tempest-SnapshotDependencyTests-95648043 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-44279f1a-6ab4-4916-8fa2-ff542ca99031,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-44279f1a-6ab4-4916-8fa2-ff542ca99031.bef529bf-2174-423e-b5b3-aa861367aad7 1G" returned: 0 in 0.495s {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 25 15:58:19 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-b4ef2372-a8c5-448d-a3b6-c5f0d416b8c4 tempest-SnapshotDependencyTests-95648043 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-44279f1a-6ab4-4916-8fa2-ff542ca99031 -F qcow2 /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-44279f1a-6ab4-4916-8fa2-ff542ca99031.bef529bf-2174-423e-b5b3-aa861367aad7 {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 25 15:58:19 devstack sudo[89535]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-44279f1a-6ab4-4916-8fa2-ff542ca99031 -F qcow2 /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-44279f1a-6ab4-4916-8fa2-ff542ca99031.bef529bf-2174-423e-b5b3-aa861367aad7 Feb 25 15:58:19 devstack sudo[89535]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 25 15:58:20 devstack sudo[89535]: pam_unix(sudo:session): session closed for user root Feb 25 15:58:20 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-b4ef2372-a8c5-448d-a3b6-c5f0d416b8c4 tempest-SnapshotDependencyTests-95648043 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-44279f1a-6ab4-4916-8fa2-ff542ca99031 -F qcow2 /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-44279f1a-6ab4-4916-8fa2-ff542ca99031.bef529bf-2174-423e-b5b3-aa861367aad7" returned: 0 in 0.626s {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 25 15:58:20 devstack cinder-volume[83528]: WARNING cinder.volume.drivers.remotefs [None req-b4ef2372-a8c5-448d-a3b6-c5f0d416b8c4 tempest-SnapshotDependencyTests-95648043 None] /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-44279f1a-6ab4-4916-8fa2-ff542ca99031.bef529bf-2174-423e-b5b3-aa861367aad7 is being set with open permissions: ugo+rw Feb 25 15:58:20 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-b4ef2372-a8c5-448d-a3b6-c5f0d416b8c4 tempest-SnapshotDependencyTests-95648043 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-44279f1a-6ab4-4916-8fa2-ff542ca99031.bef529bf-2174-423e-b5b3-aa861367aad7 {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 25 15:58:20 devstack sudo[89540]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-44279f1a-6ab4-4916-8fa2-ff542ca99031.bef529bf-2174-423e-b5b3-aa861367aad7 Feb 25 15:58:20 devstack sudo[89540]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 25 15:58:20 devstack cinder-volume[83528]: DEBUG cinder.volume.flows.manager.create_volume [None req-90a25328-4c3d-46c2-8ae2-5868ff4e0eaf tempest-VolumesGetTest-958147190 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83528) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 25 15:58:20 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-90a25328-4c3d-46c2-8ae2-5868ff4e0eaf tempest-VolumesGetTest-958147190 None] Flow 'volume_create_manager' (6048b744-4417-4c94-b4e3-1fa05ba2a815) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83528) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 25 15:58:20 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-90a25328-4c3d-46c2-8ae2-5868ff4e0eaf tempest-VolumesGetTest-958147190 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (22a05ef6-4d84-40b0-9643-593e8e8b0e04) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 25 15:58:20 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-90a25328-4c3d-46c2-8ae2-5868ff4e0eaf tempest-VolumesGetTest-958147190 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (22a05ef6-4d84-40b0-9643-593e8e8b0e04) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-25T14:58:20Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-2104050610',display_name='tempest-VolumesGetTest-Volume-283589934',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3b23a11d-737e-4cc0-b74e-a6b5d9f0f0bd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='30b56c3cb9b44b44bc932bfa91495865',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-25T14:58:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-25T14:58:20Z,use_quota=True,user_id='e09e6f803ddf47f09c166c46461b2f9a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ce71c2f9-6543-4165-9653-a1529b2ea243),volume_type_id=ce71c2f9-6543-4165-9653-a1529b2ea243)' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 25 15:58:20 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-90a25328-4c3d-46c2-8ae2-5868ff4e0eaf tempest-VolumesGetTest-958147190 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (14275c50-7e87-4035-b5ad-3f4c611a0afe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 25 15:58:20 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-90a25328-4c3d-46c2-8ae2-5868ff4e0eaf tempest-VolumesGetTest-958147190 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (14275c50-7e87-4035-b5ad-3f4c611a0afe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 25 15:58:20 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-90a25328-4c3d-46c2-8ae2-5868ff4e0eaf tempest-VolumesGetTest-958147190 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (362871b4-8729-4b7b-a256-630826a9a719) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 25 15:58:20 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-90a25328-4c3d-46c2-8ae2-5868ff4e0eaf tempest-VolumesGetTest-958147190 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (362871b4-8729-4b7b-a256-630826a9a719) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3b23a11d-737e-4cc0-b74e-a6b5d9f0f0bd', 'volume_name': 'volume-3b23a11d-737e-4cc0-b74e-a6b5d9f0f0bd', 'volume_size': 1}' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 25 15:58:20 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-90a25328-4c3d-46c2-8ae2-5868ff4e0eaf tempest-VolumesGetTest-958147190 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (20901ce4-ad11-41c0-8b51-62e626556611) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 25 15:58:20 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-90a25328-4c3d-46c2-8ae2-5868ff4e0eaf tempest-VolumesGetTest-958147190 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (20901ce4-ad11-41c0-8b51-62e626556611) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 25 15:58:20 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-90a25328-4c3d-46c2-8ae2-5868ff4e0eaf tempest-VolumesGetTest-958147190 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (552c60d6-57ac-465e-b039-2a755371aa19) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 25 15:58:20 devstack cinder-volume[83528]: INFO cinder.volume.flows.manager.create_volume [None req-90a25328-4c3d-46c2-8ae2-5868ff4e0eaf tempest-VolumesGetTest-958147190 None] Volume 3b23a11d-737e-4cc0-b74e-a6b5d9f0f0bd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3b23a11d-737e-4cc0-b74e-a6b5d9f0f0bd', 'volume_size': 1} Feb 25 15:58:20 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-90a25328-4c3d-46c2-8ae2-5868ff4e0eaf tempest-VolumesGetTest-958147190 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 25 15:58:20 devstack sudo[89540]: pam_unix(sudo:session): session closed for user root Feb 25 15:58:20 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-b4ef2372-a8c5-448d-a3b6-c5f0d416b8c4 tempest-SnapshotDependencyTests-95648043 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-44279f1a-6ab4-4916-8fa2-ff542ca99031.bef529bf-2174-423e-b5b3-aa861367aad7" returned: 0 in 0.590s {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 25 15:58:20 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-b4ef2372-a8c5-448d-a3b6-c5f0d416b8c4 tempest-SnapshotDependencyTests-95648043 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-44279f1a-6ab4-4916-8fa2-ff542ca99031.info {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 25 15:58:20 devstack sudo[89543]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-44279f1a-6ab4-4916-8fa2-ff542ca99031.info Feb 25 15:58:20 devstack sudo[89543]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 25 15:58:21 devstack sudo[89543]: pam_unix(sudo:session): session closed for user root Feb 25 15:58:21 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-b4ef2372-a8c5-448d-a3b6-c5f0d416b8c4 tempest-SnapshotDependencyTests-95648043 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-44279f1a-6ab4-4916-8fa2-ff542ca99031.info" returned: 0 in 0.542s {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 25 15:58:21 devstack cinder-volume[83528]: WARNING cinder.volume.drivers.remotefs [None req-b4ef2372-a8c5-448d-a3b6-c5f0d416b8c4 tempest-SnapshotDependencyTests-95648043 None] /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-44279f1a-6ab4-4916-8fa2-ff542ca99031.info is being set with open permissions: ugo+rw Feb 25 15:58:21 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-b4ef2372-a8c5-448d-a3b6-c5f0d416b8c4 tempest-SnapshotDependencyTests-95648043 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-44279f1a-6ab4-4916-8fa2-ff542ca99031.info {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 25 15:58:21 devstack sudo[89570]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-44279f1a-6ab4-4916-8fa2-ff542ca99031.info Feb 25 15:58:21 devstack sudo[89570]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 25 15:58:21 devstack sudo[89570]: pam_unix(sudo:session): session closed for user root Feb 25 15:58:21 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-b4ef2372-a8c5-448d-a3b6-c5f0d416b8c4 tempest-SnapshotDependencyTests-95648043 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-44279f1a-6ab4-4916-8fa2-ff542ca99031.info" returned: 0 in 0.555s {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 25 15:58:21 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-b4ef2372-a8c5-448d-a3b6-c5f0d416b8c4 tempest-SnapshotDependencyTests-95648043 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.448s {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 25 15:58:21 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-90a25328-4c3d-46c2-8ae2-5868ff4e0eaf tempest-VolumesGetTest-958147190 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.341s {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 25 15:58:21 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.quobyte [None req-90a25328-4c3d-46c2-8ae2-5868ff4e0eaf tempest-VolumesGetTest-958147190 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-25T14:58:20Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-2104050610',display_name='tempest-VolumesGetTest-Volume-283589934',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3b23a11d-737e-4cc0-b74e-a6b5d9f0f0bd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='30b56c3cb9b44b44bc932bfa91495865',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-25T14:58:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-25T14:58:20Z,use_quota=True,user_id='e09e6f803ddf47f09c166c46461b2f9a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ce71c2f9-6543-4165-9653-a1529b2ea243),volume_type_id=ce71c2f9-6543-4165-9653-a1529b2ea243)}" {{(pid=83528) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 25 15:58:21 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.remotefs [None req-90a25328-4c3d-46c2-8ae2-5868ff4e0eaf tempest-VolumesGetTest-958147190 None] Creating volume 3b23a11d-737e-4cc0-b74e-a6b5d9f0f0bd {{(pid=83528) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 25 15:58:21 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-90a25328-4c3d-46c2-8ae2-5868ff4e0eaf tempest-VolumesGetTest-958147190 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 25 15:58:21 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-90a25328-4c3d-46c2-8ae2-5868ff4e0eaf tempest-VolumesGetTest-958147190 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 25 15:58:21 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.quobyte [None req-90a25328-4c3d-46c2-8ae2-5868ff4e0eaf tempest-VolumesGetTest-958147190 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23e9d725-3e04-4cd9-bfe0-c8ef43305589': None} {{(pid=83528) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 25 15:58:21 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.quobyte [None req-90a25328-4c3d-46c2-8ae2-5868ff4e0eaf tempest-VolumesGetTest-958147190 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23e9d725-3e04-4cd9-bfe0-c8ef43305589'] {{(pid=83528) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 25 15:58:21 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-90a25328-4c3d-46c2-8ae2-5868ff4e0eaf tempest-VolumesGetTest-958147190 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 25 15:58:21 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.quobyte [None req-90a25328-4c3d-46c2-8ae2-5868ff4e0eaf tempest-VolumesGetTest-958147190 None] Selected osci02.corp.quobyte.com/cinder-vol-23e9d725-3e04-4cd9-bfe0-c8ef43305589 as target Quobyte volume. {{(pid=83528) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 25 15:58:21 devstack cinder-volume[83528]: INFO cinder.volume.drivers.remotefs [None req-90a25328-4c3d-46c2-8ae2-5868ff4e0eaf tempest-VolumesGetTest-958147190 None] casted to osci02.corp.quobyte.com/cinder-vol-23e9d725-3e04-4cd9-bfe0-c8ef43305589 Feb 25 15:58:21 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-90a25328-4c3d-46c2-8ae2-5868ff4e0eaf tempest-VolumesGetTest-958147190 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-3b23a11d-737e-4cc0-b74e-a6b5d9f0f0bd 1073741824 {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 25 15:58:21 devstack cinder-volume[83528]: INFO cinder.volume.manager [None req-b4ef2372-a8c5-448d-a3b6-c5f0d416b8c4 tempest-SnapshotDependencyTests-95648043 None] Create snapshot completed successfully Feb 25 15:58:21 devstack sudo[89573]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-3b23a11d-737e-4cc0-b74e-a6b5d9f0f0bd 1073741824 Feb 25 15:58:21 devstack sudo[89573]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 25 15:58:22 devstack sudo[89573]: pam_unix(sudo:session): session closed for user root Feb 25 15:58:22 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-90a25328-4c3d-46c2-8ae2-5868ff4e0eaf tempest-VolumesGetTest-958147190 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-3b23a11d-737e-4cc0-b74e-a6b5d9f0f0bd 1073741824" returned: 0 in 0.590s {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 25 15:58:22 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-90a25328-4c3d-46c2-8ae2-5868ff4e0eaf tempest-VolumesGetTest-958147190 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-3b23a11d-737e-4cc0-b74e-a6b5d9f0f0bd {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 25 15:58:22 devstack sudo[89578]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-3b23a11d-737e-4cc0-b74e-a6b5d9f0f0bd Feb 25 15:58:22 devstack sudo[89578]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 25 15:58:22 devstack sudo[89578]: pam_unix(sudo:session): session closed for user root Feb 25 15:58:22 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-90a25328-4c3d-46c2-8ae2-5868ff4e0eaf tempest-VolumesGetTest-958147190 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-3b23a11d-737e-4cc0-b74e-a6b5d9f0f0bd" returned: 0 in 0.487s {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 25 15:58:22 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.quobyte [None req-90a25328-4c3d-46c2-8ae2-5868ff4e0eaf tempest-VolumesGetTest-958147190 None] <== create_volume: return (1110ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-23e9d725-3e04-4cd9-bfe0-c8ef43305589'} {{(pid=83528) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 25 15:58:22 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-90a25328-4c3d-46c2-8ae2-5868ff4e0eaf tempest-VolumesGetTest-958147190 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.117s {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 25 15:58:22 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-90a25328-4c3d-46c2-8ae2-5868ff4e0eaf tempest-VolumesGetTest-958147190 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (552c60d6-57ac-465e-b039-2a755371aa19) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3b23a11d-737e-4cc0-b74e-a6b5d9f0f0bd', 'volume_size': 1}' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 25 15:58:22 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-90a25328-4c3d-46c2-8ae2-5868ff4e0eaf tempest-VolumesGetTest-958147190 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dd979738-2c8f-40a7-aa96-1e7fc395ff79) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 25 15:58:22 devstack cinder-volume[83528]: INFO cinder.volume.flows.manager.create_volume [None req-90a25328-4c3d-46c2-8ae2-5868ff4e0eaf tempest-VolumesGetTest-958147190 None] Volume volume-3b23a11d-737e-4cc0-b74e-a6b5d9f0f0bd (3b23a11d-737e-4cc0-b74e-a6b5d9f0f0bd): created successfully Feb 25 15:58:22 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-90a25328-4c3d-46c2-8ae2-5868ff4e0eaf tempest-VolumesGetTest-958147190 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dd979738-2c8f-40a7-aa96-1e7fc395ff79) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 25 15:58:22 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-90a25328-4c3d-46c2-8ae2-5868ff4e0eaf tempest-VolumesGetTest-958147190 None] Flow 'volume_create_manager' (6048b744-4417-4c94-b4e3-1fa05ba2a815) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83528) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 25 15:58:22 devstack cinder-volume[83528]: INFO cinder.volume.manager [None req-90a25328-4c3d-46c2-8ae2-5868ff4e0eaf tempest-VolumesGetTest-958147190 None] Created volume successfully. Feb 25 15:58:23 devstack cinder-volume[83528]: DEBUG cinder.volume.flows.manager.create_volume [None req-136b9061-4c60-42fa-b5a3-e056eb897d0a tempest-SnapshotDependencyTests-95648043 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83528) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 25 15:58:23 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-136b9061-4c60-42fa-b5a3-e056eb897d0a tempest-SnapshotDependencyTests-95648043 None] Flow 'volume_create_manager' (acffd19c-0e09-44ae-8585-0aa3582668e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83528) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 25 15:58:23 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-136b9061-4c60-42fa-b5a3-e056eb897d0a tempest-SnapshotDependencyTests-95648043 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5e85858e-500e-4d37-bdba-96d880c373a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 25 15:58:23 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-136b9061-4c60-42fa-b5a3-e056eb897d0a tempest-SnapshotDependencyTests-95648043 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5e85858e-500e-4d37-bdba-96d880c373a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-25T14:58:23Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5f03050b-acd1-4aa3-bf3f-e8227a4d15f3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3738d22ad82846e788dff0e49ced945d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-25T14:58:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=bef529bf-2174-423e-b5b3-aa861367aad7,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-25T14:58:23Z,use_quota=True,user_id='ade0df8e08a44dc9a2351c7e948d93bb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ce71c2f9-6543-4165-9653-a1529b2ea243),volume_type_id=ce71c2f9-6543-4165-9653-a1529b2ea243)' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 25 15:58:23 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-136b9061-4c60-42fa-b5a3-e056eb897d0a tempest-SnapshotDependencyTests-95648043 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e76cc5b1-3e4c-4659-8114-7b474fe1c316) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 25 15:58:23 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-136b9061-4c60-42fa-b5a3-e056eb897d0a tempest-SnapshotDependencyTests-95648043 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e76cc5b1-3e4c-4659-8114-7b474fe1c316) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 25 15:58:23 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-136b9061-4c60-42fa-b5a3-e056eb897d0a tempest-SnapshotDependencyTests-95648043 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f272046f-2e6e-49f5-991b-f634ae4e7eda) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 25 15:58:23 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-136b9061-4c60-42fa-b5a3-e056eb897d0a tempest-SnapshotDependencyTests-95648043 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f272046f-2e6e-49f5-991b-f634ae4e7eda) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '5f03050b-acd1-4aa3-bf3f-e8227a4d15f3', 'volume_name': 'volume-5f03050b-acd1-4aa3-bf3f-e8227a4d15f3', 'volume_size': 1, 'snapshot_id': 'bef529bf-2174-423e-b5b3-aa861367aad7'}' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 25 15:58:23 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-136b9061-4c60-42fa-b5a3-e056eb897d0a tempest-SnapshotDependencyTests-95648043 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5e06beb7-504e-4a89-a74a-b9e85cf2a228) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 25 15:58:23 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-136b9061-4c60-42fa-b5a3-e056eb897d0a tempest-SnapshotDependencyTests-95648043 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5e06beb7-504e-4a89-a74a-b9e85cf2a228) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 25 15:58:23 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-136b9061-4c60-42fa-b5a3-e056eb897d0a tempest-SnapshotDependencyTests-95648043 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ce9685c0-889e-49b2-a20e-6e9e3b263149) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 25 15:58:23 devstack cinder-volume[83528]: INFO cinder.volume.flows.manager.create_volume [None req-136b9061-4c60-42fa-b5a3-e056eb897d0a tempest-SnapshotDependencyTests-95648043 None] Volume 5f03050b-acd1-4aa3-bf3f-e8227a4d15f3: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-5f03050b-acd1-4aa3-bf3f-e8227a4d15f3', 'volume_size': 1, 'snapshot_id': 'bef529bf-2174-423e-b5b3-aa861367aad7'} Feb 25 15:58:23 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-136b9061-4c60-42fa-b5a3-e056eb897d0a tempest-SnapshotDependencyTests-95648043 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 25 15:58:23 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-136b9061-4c60-42fa-b5a3-e056eb897d0a tempest-SnapshotDependencyTests-95648043 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 25 15:58:23 devstack cinder-volume[83528]: DEBUG cinder.coordination [None req-136b9061-4c60-42fa-b5a3-e056eb897d0a tempest-SnapshotDependencyTests-95648043 None] Acquiring lock "cinder-quobyte-bef529bf-2174-423e-b5b3-aa861367aad7-5f03050b-acd1-4aa3-bf3f-e8227a4d15f3" by "_create_volume_from_snapshot" {{(pid=83528) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 25 15:58:23 devstack cinder-volume[83528]: DEBUG cinder.coordination [None req-136b9061-4c60-42fa-b5a3-e056eb897d0a tempest-SnapshotDependencyTests-95648043 None] Lock "cinder-quobyte-bef529bf-2174-423e-b5b3-aa861367aad7-5f03050b-acd1-4aa3-bf3f-e8227a4d15f3" acquired by "_create_volume_from_snapshot" :: waited 0.007s {{(pid=83528) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 25 15:58:23 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.quobyte [None req-136b9061-4c60-42fa-b5a3-e056eb897d0a tempest-SnapshotDependencyTests-95648043 None] Creating volume 5f03050b-acd1-4aa3-bf3f-e8227a4d15f3 from snapshot bef529bf-2174-423e-b5b3-aa861367aad7 {{(pid=83528) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Feb 25 15:58:23 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-136b9061-4c60-42fa-b5a3-e056eb897d0a tempest-SnapshotDependencyTests-95648043 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 25 15:58:23 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-136b9061-4c60-42fa-b5a3-e056eb897d0a tempest-SnapshotDependencyTests-95648043 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 25 15:58:23 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.quobyte [None req-136b9061-4c60-42fa-b5a3-e056eb897d0a tempest-SnapshotDependencyTests-95648043 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23e9d725-3e04-4cd9-bfe0-c8ef43305589': None} {{(pid=83528) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 25 15:58:23 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.quobyte [None req-136b9061-4c60-42fa-b5a3-e056eb897d0a tempest-SnapshotDependencyTests-95648043 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23e9d725-3e04-4cd9-bfe0-c8ef43305589'] {{(pid=83528) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 25 15:58:23 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-136b9061-4c60-42fa-b5a3-e056eb897d0a tempest-SnapshotDependencyTests-95648043 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 25 15:58:23 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.quobyte [None req-136b9061-4c60-42fa-b5a3-e056eb897d0a tempest-SnapshotDependencyTests-95648043 None] Selected osci02.corp.quobyte.com/cinder-vol-23e9d725-3e04-4cd9-bfe0-c8ef43305589 as target Quobyte volume. {{(pid=83528) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 25 15:58:23 devstack cinder-volume[83528]: DEBUG cinder.coordination [None req-136b9061-4c60-42fa-b5a3-e056eb897d0a tempest-SnapshotDependencyTests-95648043 None] Acquiring lock "cinder-quobyte-5f03050b-acd1-4aa3-bf3f-e8227a4d15f3" by "_copy_volume_from_snapshot" {{(pid=83528) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 25 15:58:23 devstack cinder-volume[83528]: DEBUG cinder.coordination [None req-136b9061-4c60-42fa-b5a3-e056eb897d0a tempest-SnapshotDependencyTests-95648043 None] Lock "cinder-quobyte-5f03050b-acd1-4aa3-bf3f-e8227a4d15f3" acquired by "_copy_volume_from_snapshot" :: waited 0.007s {{(pid=83528) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 25 15:58:23 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.quobyte [None req-136b9061-4c60-42fa-b5a3-e056eb897d0a tempest-SnapshotDependencyTests-95648043 None] snapshot: bef529bf-2174-423e-b5b3-aa861367aad7, volume: 5f03050b-acd1-4aa3-bf3f-e8227a4d15f3, {{(pid=83528) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Feb 25 15:58:23 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-136b9061-4c60-42fa-b5a3-e056eb897d0a tempest-SnapshotDependencyTests-95648043 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 25 15:58:23 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-136b9061-4c60-42fa-b5a3-e056eb897d0a tempest-SnapshotDependencyTests-95648043 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 25 15:58:23 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.quobyte [None req-136b9061-4c60-42fa-b5a3-e056eb897d0a tempest-SnapshotDependencyTests-95648043 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23e9d725-3e04-4cd9-bfe0-c8ef43305589': None} {{(pid=83528) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 25 15:58:23 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.quobyte [None req-136b9061-4c60-42fa-b5a3-e056eb897d0a tempest-SnapshotDependencyTests-95648043 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23e9d725-3e04-4cd9-bfe0-c8ef43305589'] {{(pid=83528) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 25 15:58:23 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-136b9061-4c60-42fa-b5a3-e056eb897d0a tempest-SnapshotDependencyTests-95648043 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 25 15:58:23 devstack cinder-volume[83528]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3e467f1-b964-4e65-bbf4-be1a710bd527]: (4, 'qcow2') {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 25 15:58:23 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-136b9061-4c60-42fa-b5a3-e056eb897d0a tempest-SnapshotDependencyTests-95648043 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-44279f1a-6ab4-4916-8fa2-ff542ca99031.bef529bf-2174-423e-b5b3-aa861367aad7 {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 25 15:58:23 devstack sudo[89583]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-44279f1a-6ab4-4916-8fa2-ff542ca99031.bef529bf-2174-423e-b5b3-aa861367aad7 Feb 25 15:58:23 devstack sudo[89583]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 25 15:58:23 devstack cinder-volume[83528]: DEBUG cinder.coordination [None req-51793c65-5b00-4bfc-a917-cb95d3d04517 tempest-VolumesGetTest-958147190 None] Acquiring lock "cinder-3b23a11d-737e-4cc0-b74e-a6b5d9f0f0bd-delete_volume" by "delete_volume" {{(pid=83528) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 25 15:58:23 devstack cinder-volume[83528]: DEBUG cinder.coordination [None req-51793c65-5b00-4bfc-a917-cb95d3d04517 tempest-VolumesGetTest-958147190 None] Lock "cinder-3b23a11d-737e-4cc0-b74e-a6b5d9f0f0bd-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=83528) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 25 15:58:23 devstack cinder-volume[83528]: DEBUG cinder.coordination [None req-51793c65-5b00-4bfc-a917-cb95d3d04517 tempest-VolumesGetTest-958147190 None] Acquiring lock "cinder-quobyte-3b23a11d-737e-4cc0-b74e-a6b5d9f0f0bd" by "delete_volume" {{(pid=83528) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 25 15:58:23 devstack cinder-volume[83528]: DEBUG cinder.coordination [None req-51793c65-5b00-4bfc-a917-cb95d3d04517 tempest-VolumesGetTest-958147190 None] Lock "cinder-quobyte-3b23a11d-737e-4cc0-b74e-a6b5d9f0f0bd" acquired by "delete_volume" :: waited 0.020s {{(pid=83528) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 25 15:58:23 devstack cinder-volume[83528]: DEBUG oslo.privsep.daemon [-] privsep: reply[a158195d-8d2a-4f31-af55-6553d6016fb4]: (4, 'qcow2') {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 25 15:58:23 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-51793c65-5b00-4bfc-a917-cb95d3d04517 tempest-VolumesGetTest-958147190 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-3b23a11d-737e-4cc0-b74e-a6b5d9f0f0bd {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 25 15:58:23 devstack sudo[89585]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-3b23a11d-737e-4cc0-b74e-a6b5d9f0f0bd Feb 25 15:58:23 devstack sudo[89585]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 25 15:58:24 devstack sudo[89583]: pam_unix(sudo:session): session closed for user root Feb 25 15:58:24 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-136b9061-4c60-42fa-b5a3-e056eb897d0a tempest-SnapshotDependencyTests-95648043 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-44279f1a-6ab4-4916-8fa2-ff542ca99031.bef529bf-2174-423e-b5b3-aa861367aad7" returned: 0 in 0.794s {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 25 15:58:24 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.remotefs [None req-136b9061-4c60-42fa-b5a3-e056eb897d0a tempest-SnapshotDependencyTests-95648043 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-44279f1a-6ab4-4916-8fa2-ff542ca99031(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83528) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Feb 25 15:58:24 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.quobyte [None req-136b9061-4c60-42fa-b5a3-e056eb897d0a tempest-SnapshotDependencyTests-95648043 None] will copy from snapshot at /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-44279f1a-6ab4-4916-8fa2-ff542ca99031 {{(pid=83528) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Feb 25 15:58:24 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.quobyte [None req-136b9061-4c60-42fa-b5a3-e056eb897d0a tempest-SnapshotDependencyTests-95648043 None] Creating direct copy from snapshot {{(pid=83528) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Feb 25 15:58:24 devstack cinder-volume[83528]: DEBUG oslo.privsep.daemon [-] privsep: reply[eec7b9f7-2689-4fe4-add4-35ab56735d4b]: (4, 'qcow2') {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 25 15:58:24 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-136b9061-4c60-42fa-b5a3-e056eb897d0a tempest-SnapshotDependencyTests-95648043 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-44279f1a-6ab4-4916-8fa2-ff542ca99031 {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 25 15:58:24 devstack sudo[89590]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-44279f1a-6ab4-4916-8fa2-ff542ca99031 Feb 25 15:58:24 devstack sudo[89590]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 25 15:58:24 devstack sudo[89585]: pam_unix(sudo:session): session closed for user root Feb 25 15:58:24 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-51793c65-5b00-4bfc-a917-cb95d3d04517 tempest-VolumesGetTest-958147190 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-3b23a11d-737e-4cc0-b74e-a6b5d9f0f0bd" returned: 0 in 0.770s {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 25 15:58:24 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-51793c65-5b00-4bfc-a917-cb95d3d04517 tempest-VolumesGetTest-958147190 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-3b23a11d-737e-4cc0-b74e-a6b5d9f0f0bd {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 25 15:58:24 devstack sudo[89595]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-3b23a11d-737e-4cc0-b74e-a6b5d9f0f0bd Feb 25 15:58:24 devstack sudo[89595]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 25 15:58:24 devstack sudo[89590]: pam_unix(sudo:session): session closed for user root Feb 25 15:58:24 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-136b9061-4c60-42fa-b5a3-e056eb897d0a tempest-SnapshotDependencyTests-95648043 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-44279f1a-6ab4-4916-8fa2-ff542ca99031" returned: 0 in 0.802s {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 25 15:58:24 devstack cinder-volume[83528]: DEBUG cinder.utils [None req-136b9061-4c60-42fa-b5a3-e056eb897d0a tempest-SnapshotDependencyTests-95648043 None] Path /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-5f03050b-acd1-4aa3-bf3f-e8227a4d15f3 not found in is_blk_device check {{(pid=83528) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Feb 25 15:58:24 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-136b9061-4c60-42fa-b5a3-e056eb897d0a tempest-SnapshotDependencyTests-95648043 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-44279f1a-6ab4-4916-8fa2-ff542ca99031 /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-5f03050b-acd1-4aa3-bf3f-e8227a4d15f3 {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 25 15:58:24 devstack sudo[89601]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-44279f1a-6ab4-4916-8fa2-ff542ca99031 /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-5f03050b-acd1-4aa3-bf3f-e8227a4d15f3 Feb 25 15:58:24 devstack sudo[89601]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 25 15:58:25 devstack sudo[89595]: pam_unix(sudo:session): session closed for user root Feb 25 15:58:25 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-51793c65-5b00-4bfc-a917-cb95d3d04517 tempest-VolumesGetTest-958147190 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-3b23a11d-737e-4cc0-b74e-a6b5d9f0f0bd" returned: 0 in 0.610s {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 25 15:58:25 devstack cinder-volume[83528]: DEBUG cinder.coordination [None req-51793c65-5b00-4bfc-a917-cb95d3d04517 tempest-VolumesGetTest-958147190 None] Lock "cinder-quobyte-3b23a11d-737e-4cc0-b74e-a6b5d9f0f0bd" released by "delete_volume" :: held 1.408s {{(pid=83528) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 25 15:58:25 devstack cinder-volume[83528]: DEBUG cinder.quota [None req-51793c65-5b00-4bfc-a917-cb95d3d04517 tempest-VolumesGetTest-958147190 None] Created reservations ['921f7b35-a9d8-404d-a01e-9903daa89c16', '58291450-4926-4497-984b-1bb5d6f86d5c', 'b6fe2387-f34f-49dc-9e83-e6e5aff5b3db', 'eee536de-8d19-485f-ace3-b8a856b67605'] {{(pid=83528) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 25 15:58:25 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-51793c65-5b00-4bfc-a917-cb95d3d04517 tempest-VolumesGetTest-958147190 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 25 15:58:25 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-51793c65-5b00-4bfc-a917-cb95d3d04517 tempest-VolumesGetTest-958147190 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 25 15:58:25 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.quobyte [None req-51793c65-5b00-4bfc-a917-cb95d3d04517 tempest-VolumesGetTest-958147190 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23e9d725-3e04-4cd9-bfe0-c8ef43305589': None} {{(pid=83528) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 25 15:58:25 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.quobyte [None req-51793c65-5b00-4bfc-a917-cb95d3d04517 tempest-VolumesGetTest-958147190 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23e9d725-3e04-4cd9-bfe0-c8ef43305589'] {{(pid=83528) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 25 15:58:25 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-51793c65-5b00-4bfc-a917-cb95d3d04517 tempest-VolumesGetTest-958147190 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 25 15:58:25 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-51793c65-5b00-4bfc-a917-cb95d3d04517 tempest-VolumesGetTest-958147190 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85 {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 25 15:58:25 devstack sudo[89604]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85 Feb 25 15:58:25 devstack sudo[89604]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 25 15:58:26 devstack cinder-volume[83528]: DEBUG cinder.coordination [None req-cc6c4d5f-fe86-47fb-bb3e-2567e53c9ab5 tempest-VolumesGetTest-958147190 None] Acquiring lock "cinder-834d62f9-8f30-4975-a9d6-b33c44744794-delete_volume" by "delete_volume" {{(pid=83528) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 25 15:58:26 devstack cinder-volume[83528]: DEBUG cinder.coordination [None req-cc6c4d5f-fe86-47fb-bb3e-2567e53c9ab5 tempest-VolumesGetTest-958147190 None] Lock "cinder-834d62f9-8f30-4975-a9d6-b33c44744794-delete_volume" acquired by "delete_volume" :: waited 0.091s {{(pid=83528) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 25 15:58:26 devstack cinder-volume[83528]: DEBUG cinder.coordination [None req-cc6c4d5f-fe86-47fb-bb3e-2567e53c9ab5 tempest-VolumesGetTest-958147190 None] Acquiring lock "cinder-quobyte-834d62f9-8f30-4975-a9d6-b33c44744794" by "delete_volume" {{(pid=83528) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 25 15:58:26 devstack cinder-volume[83528]: DEBUG cinder.coordination [None req-cc6c4d5f-fe86-47fb-bb3e-2567e53c9ab5 tempest-VolumesGetTest-958147190 None] Lock "cinder-quobyte-834d62f9-8f30-4975-a9d6-b33c44744794" acquired by "delete_volume" :: waited 0.033s {{(pid=83528) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 25 15:58:26 devstack cinder-volume[83528]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9cbc4eb-b7b0-471f-bd0c-7cf5ed45959e]: (4, 'raw') {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 25 15:58:26 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-cc6c4d5f-fe86-47fb-bb3e-2567e53c9ab5 tempest-VolumesGetTest-958147190 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-834d62f9-8f30-4975-a9d6-b33c44744794 {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 25 15:58:27 devstack sudo[89618]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-834d62f9-8f30-4975-a9d6-b33c44744794 Feb 25 15:58:27 devstack sudo[89618]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 25 15:58:27 devstack sudo[89604]: pam_unix(sudo:session): session closed for user root Feb 25 15:58:27 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-51793c65-5b00-4bfc-a917-cb95d3d04517 tempest-VolumesGetTest-958147190 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85" returned: 0 in 2.579s {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 25 15:58:27 devstack cinder-volume[83528]: DEBUG cinder.manager [None req-51793c65-5b00-4bfc-a917-cb95d3d04517 tempest-VolumesGetTest-958147190 None] Notifying Schedulers of capabilities ... {{(pid=83528) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 25 15:58:27 devstack cinder-volume[83528]: INFO cinder.volume.manager [None req-51793c65-5b00-4bfc-a917-cb95d3d04517 tempest-VolumesGetTest-958147190 None] Deleted volume successfully. Feb 25 15:58:27 devstack cinder-volume[83528]: DEBUG cinder.coordination [None req-51793c65-5b00-4bfc-a917-cb95d3d04517 tempest-VolumesGetTest-958147190 None] Lock "cinder-3b23a11d-737e-4cc0-b74e-a6b5d9f0f0bd-delete_volume" released by "delete_volume" :: held 4.260s {{(pid=83528) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 25 15:58:28 devstack sudo[89601]: pam_unix(sudo:session): session closed for user root Feb 25 15:58:28 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-136b9061-4c60-42fa-b5a3-e056eb897d0a tempest-SnapshotDependencyTests-95648043 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-44279f1a-6ab4-4916-8fa2-ff542ca99031 /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-5f03050b-acd1-4aa3-bf3f-e8227a4d15f3" returned: 0 in 3.131s {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 25 15:58:28 devstack cinder-volume[83528]: DEBUG oslo.privsep.daemon [-] privsep: reply[d257df98-928a-4012-8c40-74e198c9c6b5]: (4, 'qcow2') {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 25 15:58:28 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-136b9061-4c60-42fa-b5a3-e056eb897d0a tempest-SnapshotDependencyTests-95648043 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-44279f1a-6ab4-4916-8fa2-ff542ca99031 {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 25 15:58:28 devstack sudo[89621]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-44279f1a-6ab4-4916-8fa2-ff542ca99031 Feb 25 15:58:28 devstack sudo[89621]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 25 15:58:28 devstack sudo[89618]: pam_unix(sudo:session): session closed for user root Feb 25 15:58:28 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-cc6c4d5f-fe86-47fb-bb3e-2567e53c9ab5 tempest-VolumesGetTest-958147190 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-834d62f9-8f30-4975-a9d6-b33c44744794" returned: 0 in 1.544s {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 25 15:58:28 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-cc6c4d5f-fe86-47fb-bb3e-2567e53c9ab5 tempest-VolumesGetTest-958147190 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-834d62f9-8f30-4975-a9d6-b33c44744794 {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 25 15:58:28 devstack sudo[89626]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-834d62f9-8f30-4975-a9d6-b33c44744794 Feb 25 15:58:28 devstack sudo[89626]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 25 15:58:28 devstack sudo[89621]: pam_unix(sudo:session): session closed for user root Feb 25 15:58:28 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-136b9061-4c60-42fa-b5a3-e056eb897d0a tempest-SnapshotDependencyTests-95648043 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-44279f1a-6ab4-4916-8fa2-ff542ca99031" returned: 0 in 0.905s {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 25 15:58:28 devstack cinder-volume[83528]: DEBUG cinder.image.image_utils [None req-136b9061-4c60-42fa-b5a3-e056eb897d0a tempest-SnapshotDependencyTests-95648043 None] Image conversion details: src /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-44279f1a-6ab4-4916-8fa2-ff542ca99031, size 1024.00 MB, duration 3.13 sec, destination /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-5f03050b-acd1-4aa3-bf3f-e8227a4d15f3 {{(pid=83528) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Feb 25 15:58:28 devstack cinder-volume[83528]: INFO cinder.image.image_utils [None req-136b9061-4c60-42fa-b5a3-e056eb897d0a tempest-SnapshotDependencyTests-95648043 None] Converted 1024.00 MB image at 326.92 MB/s Feb 25 15:58:28 devstack cinder-volume[83528]: WARNING cinder.volume.drivers.remotefs [None req-136b9061-4c60-42fa-b5a3-e056eb897d0a tempest-SnapshotDependencyTests-95648043 None] /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-5f03050b-acd1-4aa3-bf3f-e8227a4d15f3 is being set with open permissions: ugo+rw Feb 25 15:58:28 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-136b9061-4c60-42fa-b5a3-e056eb897d0a tempest-SnapshotDependencyTests-95648043 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-5f03050b-acd1-4aa3-bf3f-e8227a4d15f3 {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 25 15:58:28 devstack sudo[89631]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-5f03050b-acd1-4aa3-bf3f-e8227a4d15f3 Feb 25 15:58:28 devstack sudo[89631]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 25 15:58:29 devstack sudo[89626]: pam_unix(sudo:session): session closed for user root Feb 25 15:58:29 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-cc6c4d5f-fe86-47fb-bb3e-2567e53c9ab5 tempest-VolumesGetTest-958147190 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-834d62f9-8f30-4975-a9d6-b33c44744794" returned: 1 in 0.812s {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 25 15:58:29 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-cc6c4d5f-fe86-47fb-bb3e-2567e53c9ab5 tempest-VolumesGetTest-958147190 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-834d62f9-8f30-4975-a9d6-b33c44744794' failed. Not Retrying. {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Feb 25 15:58:29 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-cc6c4d5f-fe86-47fb-bb3e-2567e53c9ab5 tempest-VolumesGetTest-958147190 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-834d62f9-8f30-4975-a9d6-b33c44744794 {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 25 15:58:29 devstack sudo[89636]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-834d62f9-8f30-4975-a9d6-b33c44744794 Feb 25 15:58:29 devstack sudo[89636]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 25 15:58:29 devstack cinder-volume[83528]: DEBUG cinder.volume.flows.manager.create_volume [None req-7d1ab6a2-e688-43da-82f4-3968517d76a1 tempest-VolumesActionsTest-1208865286 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83528) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 25 15:58:29 devstack sudo[89631]: pam_unix(sudo:session): session closed for user root Feb 25 15:58:29 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-7d1ab6a2-e688-43da-82f4-3968517d76a1 tempest-VolumesActionsTest-1208865286 None] Flow 'volume_create_manager' (ebec5a07-7857-49ce-8298-9f4d8233b1d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83528) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 25 15:58:29 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-7d1ab6a2-e688-43da-82f4-3968517d76a1 tempest-VolumesActionsTest-1208865286 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (205cb25d-9bcd-4792-aaf9-1a3fe719150b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 25 15:58:29 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-136b9061-4c60-42fa-b5a3-e056eb897d0a tempest-SnapshotDependencyTests-95648043 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-5f03050b-acd1-4aa3-bf3f-e8227a4d15f3" returned: 0 in 0.555s {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 25 15:58:29 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-7d1ab6a2-e688-43da-82f4-3968517d76a1 tempest-VolumesActionsTest-1208865286 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (205cb25d-9bcd-4792-aaf9-1a3fe719150b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-25T14:58:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1245873394',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=287168fc-0786-4716-8f23-273489f2849c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='45b6e9160a6d47b982ed66f06bfd090d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-25T14:58:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-25T14:58:29Z,use_quota=True,user_id='984fb4db499543c78bfb9032b2bb371b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ce71c2f9-6543-4165-9653-a1529b2ea243),volume_type_id=ce71c2f9-6543-4165-9653-a1529b2ea243)' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 25 15:58:29 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-7d1ab6a2-e688-43da-82f4-3968517d76a1 tempest-VolumesActionsTest-1208865286 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d92616ec-b7fc-45e6-9285-559b4b336c27) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 25 15:58:29 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-7d1ab6a2-e688-43da-82f4-3968517d76a1 tempest-VolumesActionsTest-1208865286 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d92616ec-b7fc-45e6-9285-559b4b336c27) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 25 15:58:29 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-7d1ab6a2-e688-43da-82f4-3968517d76a1 tempest-VolumesActionsTest-1208865286 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (441ba197-daf2-40b1-9bb2-0eee4ee2dca3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 25 15:58:29 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-7d1ab6a2-e688-43da-82f4-3968517d76a1 tempest-VolumesActionsTest-1208865286 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (441ba197-daf2-40b1-9bb2-0eee4ee2dca3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '287168fc-0786-4716-8f23-273489f2849c', 'volume_name': 'volume-287168fc-0786-4716-8f23-273489f2849c', 'volume_size': 1}' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 25 15:58:29 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-7d1ab6a2-e688-43da-82f4-3968517d76a1 tempest-VolumesActionsTest-1208865286 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7a283952-eefc-43ab-a52d-5457af1933cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 25 15:58:29 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-7d1ab6a2-e688-43da-82f4-3968517d76a1 tempest-VolumesActionsTest-1208865286 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7a283952-eefc-43ab-a52d-5457af1933cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 25 15:58:29 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-7d1ab6a2-e688-43da-82f4-3968517d76a1 tempest-VolumesActionsTest-1208865286 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (446e4fdc-f312-42ed-b200-a87e95539350) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 25 15:58:29 devstack cinder-volume[83528]: INFO cinder.volume.flows.manager.create_volume [None req-7d1ab6a2-e688-43da-82f4-3968517d76a1 tempest-VolumesActionsTest-1208865286 None] Volume 287168fc-0786-4716-8f23-273489f2849c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-287168fc-0786-4716-8f23-273489f2849c', 'volume_size': 1} Feb 25 15:58:29 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-7d1ab6a2-e688-43da-82f4-3968517d76a1 tempest-VolumesActionsTest-1208865286 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 25 15:58:29 devstack cinder-volume[83528]: DEBUG cinder.coordination [None req-136b9061-4c60-42fa-b5a3-e056eb897d0a tempest-SnapshotDependencyTests-95648043 None] Lock "cinder-quobyte-5f03050b-acd1-4aa3-bf3f-e8227a4d15f3" released by "_copy_volume_from_snapshot" :: held 6.295s {{(pid=83528) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 25 15:58:29 devstack cinder-volume[83528]: DEBUG cinder.coordination [None req-136b9061-4c60-42fa-b5a3-e056eb897d0a tempest-SnapshotDependencyTests-95648043 None] Lock "cinder-quobyte-bef529bf-2174-423e-b5b3-aa861367aad7-5f03050b-acd1-4aa3-bf3f-e8227a4d15f3" released by "_create_volume_from_snapshot" :: held 6.312s {{(pid=83528) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 25 15:58:29 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-136b9061-4c60-42fa-b5a3-e056eb897d0a tempest-SnapshotDependencyTests-95648043 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 6.321s {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 25 15:58:29 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-7d1ab6a2-e688-43da-82f4-3968517d76a1 tempest-VolumesActionsTest-1208865286 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.009s {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 25 15:58:29 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.quobyte [None req-7d1ab6a2-e688-43da-82f4-3968517d76a1 tempest-VolumesActionsTest-1208865286 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-25T14:58:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1245873394',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=287168fc-0786-4716-8f23-273489f2849c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='45b6e9160a6d47b982ed66f06bfd090d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-25T14:58:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-25T14:58:29Z,use_quota=True,user_id='984fb4db499543c78bfb9032b2bb371b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ce71c2f9-6543-4165-9653-a1529b2ea243),volume_type_id=ce71c2f9-6543-4165-9653-a1529b2ea243)}" {{(pid=83528) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 25 15:58:29 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.remotefs [None req-7d1ab6a2-e688-43da-82f4-3968517d76a1 tempest-VolumesActionsTest-1208865286 None] Creating volume 287168fc-0786-4716-8f23-273489f2849c {{(pid=83528) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 25 15:58:29 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-7d1ab6a2-e688-43da-82f4-3968517d76a1 tempest-VolumesActionsTest-1208865286 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 25 15:58:29 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-7d1ab6a2-e688-43da-82f4-3968517d76a1 tempest-VolumesActionsTest-1208865286 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 25 15:58:29 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.quobyte [None req-7d1ab6a2-e688-43da-82f4-3968517d76a1 tempest-VolumesActionsTest-1208865286 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23e9d725-3e04-4cd9-bfe0-c8ef43305589': None} {{(pid=83528) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 25 15:58:29 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.quobyte [None req-7d1ab6a2-e688-43da-82f4-3968517d76a1 tempest-VolumesActionsTest-1208865286 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23e9d725-3e04-4cd9-bfe0-c8ef43305589'] {{(pid=83528) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 25 15:58:29 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-7d1ab6a2-e688-43da-82f4-3968517d76a1 tempest-VolumesActionsTest-1208865286 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 25 15:58:29 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.quobyte [None req-7d1ab6a2-e688-43da-82f4-3968517d76a1 tempest-VolumesActionsTest-1208865286 None] Selected osci02.corp.quobyte.com/cinder-vol-23e9d725-3e04-4cd9-bfe0-c8ef43305589 as target Quobyte volume. {{(pid=83528) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 25 15:58:29 devstack cinder-volume[83528]: INFO cinder.volume.drivers.remotefs [None req-7d1ab6a2-e688-43da-82f4-3968517d76a1 tempest-VolumesActionsTest-1208865286 None] casted to osci02.corp.quobyte.com/cinder-vol-23e9d725-3e04-4cd9-bfe0-c8ef43305589 Feb 25 15:58:29 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-7d1ab6a2-e688-43da-82f4-3968517d76a1 tempest-VolumesActionsTest-1208865286 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-287168fc-0786-4716-8f23-273489f2849c 1073741824 {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 25 15:58:29 devstack sudo[89639]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-287168fc-0786-4716-8f23-273489f2849c 1073741824 Feb 25 15:58:29 devstack sudo[89639]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 25 15:58:29 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-136b9061-4c60-42fa-b5a3-e056eb897d0a tempest-SnapshotDependencyTests-95648043 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ce9685c0-889e-49b2-a20e-6e9e3b263149) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5f03050b-acd1-4aa3-bf3f-e8227a4d15f3', 'volume_size': 1, 'snapshot_id': 'bef529bf-2174-423e-b5b3-aa861367aad7'}' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 25 15:58:29 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-136b9061-4c60-42fa-b5a3-e056eb897d0a tempest-SnapshotDependencyTests-95648043 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9a5c899f-3da0-4538-8341-085c0b2e7ec8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 25 15:58:29 devstack cinder-volume[83528]: INFO cinder.volume.flows.manager.create_volume [None req-136b9061-4c60-42fa-b5a3-e056eb897d0a tempest-SnapshotDependencyTests-95648043 None] Volume volume-5f03050b-acd1-4aa3-bf3f-e8227a4d15f3 (5f03050b-acd1-4aa3-bf3f-e8227a4d15f3): created successfully Feb 25 15:58:29 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-136b9061-4c60-42fa-b5a3-e056eb897d0a tempest-SnapshotDependencyTests-95648043 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9a5c899f-3da0-4538-8341-085c0b2e7ec8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 25 15:58:29 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-136b9061-4c60-42fa-b5a3-e056eb897d0a tempest-SnapshotDependencyTests-95648043 None] Flow 'volume_create_manager' (acffd19c-0e09-44ae-8585-0aa3582668e7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83528) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 25 15:58:29 devstack cinder-volume[83528]: INFO cinder.volume.manager [None req-136b9061-4c60-42fa-b5a3-e056eb897d0a tempest-SnapshotDependencyTests-95648043 None] Created volume successfully. Feb 25 15:58:29 devstack sudo[89636]: pam_unix(sudo:session): session closed for user root Feb 25 15:58:29 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-cc6c4d5f-fe86-47fb-bb3e-2567e53c9ab5 tempest-VolumesGetTest-958147190 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-834d62f9-8f30-4975-a9d6-b33c44744794" returned: 0 in 0.544s {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 25 15:58:29 devstack cinder-volume[83528]: DEBUG cinder.coordination [None req-cc6c4d5f-fe86-47fb-bb3e-2567e53c9ab5 tempest-VolumesGetTest-958147190 None] Lock "cinder-quobyte-834d62f9-8f30-4975-a9d6-b33c44744794" released by "delete_volume" :: held 3.024s {{(pid=83528) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 25 15:58:29 devstack cinder-volume[83528]: DEBUG cinder.quota [None req-cc6c4d5f-fe86-47fb-bb3e-2567e53c9ab5 tempest-VolumesGetTest-958147190 None] Created reservations ['7a1c0806-11f3-455c-ac60-405eed6c40f2', 'c51ee2f1-de9b-470f-8c92-4f3a40223e61', 'c4911598-f45a-4c91-b747-20d6777b4bcc', '7fa6b8f8-2297-45cd-8076-068fe2676012'] {{(pid=83528) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 25 15:58:29 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-cc6c4d5f-fe86-47fb-bb3e-2567e53c9ab5 tempest-VolumesGetTest-958147190 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 25 15:58:29 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-cc6c4d5f-fe86-47fb-bb3e-2567e53c9ab5 tempest-VolumesGetTest-958147190 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 25 15:58:29 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.quobyte [None req-cc6c4d5f-fe86-47fb-bb3e-2567e53c9ab5 tempest-VolumesGetTest-958147190 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23e9d725-3e04-4cd9-bfe0-c8ef43305589': None} {{(pid=83528) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 25 15:58:29 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.quobyte [None req-cc6c4d5f-fe86-47fb-bb3e-2567e53c9ab5 tempest-VolumesGetTest-958147190 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23e9d725-3e04-4cd9-bfe0-c8ef43305589'] {{(pid=83528) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 25 15:58:29 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-cc6c4d5f-fe86-47fb-bb3e-2567e53c9ab5 tempest-VolumesGetTest-958147190 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 25 15:58:29 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-cc6c4d5f-fe86-47fb-bb3e-2567e53c9ab5 tempest-VolumesGetTest-958147190 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85 {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 25 15:58:29 devstack sudo[89642]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85 Feb 25 15:58:29 devstack sudo[89642]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 25 15:58:30 devstack cinder-volume[83528]: DEBUG cinder.coordination [None req-98fb412e-b839-43c4-906e-392e7bb8f4f3 tempest-SnapshotDependencyTests-95648043 None] Acquiring lock "cinder-bef529bf-2174-423e-b5b3-aa861367aad7-delete_snapshot" by "delete_snapshot" {{(pid=83528) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 25 15:58:30 devstack cinder-volume[83528]: DEBUG cinder.coordination [None req-98fb412e-b839-43c4-906e-392e7bb8f4f3 tempest-SnapshotDependencyTests-95648043 None] Lock "cinder-bef529bf-2174-423e-b5b3-aa861367aad7-delete_snapshot" acquired by "delete_snapshot" :: waited 0.040s {{(pid=83528) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 25 15:58:30 devstack cinder-volume[83528]: DEBUG cinder.coordination [None req-98fb412e-b839-43c4-906e-392e7bb8f4f3 tempest-SnapshotDependencyTests-95648043 None] Acquiring lock "cinder-quobyte-44279f1a-6ab4-4916-8fa2-ff542ca99031" by "delete_snapshot" {{(pid=83528) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 25 15:58:30 devstack cinder-volume[83528]: DEBUG cinder.coordination [None req-98fb412e-b839-43c4-906e-392e7bb8f4f3 tempest-SnapshotDependencyTests-95648043 None] Lock "cinder-quobyte-44279f1a-6ab4-4916-8fa2-ff542ca99031" acquired by "delete_snapshot" :: waited 0.015s {{(pid=83528) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 25 15:58:30 devstack cinder-volume[83528]: DEBUG cinder.coordination [None req-98fb412e-b839-43c4-906e-392e7bb8f4f3 tempest-SnapshotDependencyTests-95648043 None] Acquiring lock "cinder-quobyte-bef529bf-2174-423e-b5b3-aa861367aad7" by "_delete_snapshot" {{(pid=83528) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 25 15:58:30 devstack cinder-volume[83528]: DEBUG cinder.coordination [None req-98fb412e-b839-43c4-906e-392e7bb8f4f3 tempest-SnapshotDependencyTests-95648043 None] Lock "cinder-quobyte-bef529bf-2174-423e-b5b3-aa861367aad7" acquired by "_delete_snapshot" :: waited 0.008s {{(pid=83528) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 25 15:58:30 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.remotefs [None req-98fb412e-b839-43c4-906e-392e7bb8f4f3 tempest-SnapshotDependencyTests-95648043 None] Deleting offline snapshot bef529bf-2174-423e-b5b3-aa861367aad7 of volume 44279f1a-6ab4-4916-8fa2-ff542ca99031 {{(pid=83528) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Feb 25 15:58:30 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.remotefs [None req-98fb412e-b839-43c4-906e-392e7bb8f4f3 tempest-SnapshotDependencyTests-95648043 None] snapshot_file for this snap is: volume-44279f1a-6ab4-4916-8fa2-ff542ca99031.bef529bf-2174-423e-b5b3-aa861367aad7 {{(pid=83528) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Feb 25 15:58:30 devstack cinder-volume[83528]: DEBUG oslo.privsep.daemon [-] privsep: reply[3bd4b3ce-c3d5-4d6b-b611-3249bb45139f]: (4, 'qcow2') {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 25 15:58:30 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-98fb412e-b839-43c4-906e-392e7bb8f4f3 tempest-SnapshotDependencyTests-95648043 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-44279f1a-6ab4-4916-8fa2-ff542ca99031.bef529bf-2174-423e-b5b3-aa861367aad7 {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 25 15:58:30 devstack sudo[89639]: pam_unix(sudo:session): session closed for user root Feb 25 15:58:30 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-7d1ab6a2-e688-43da-82f4-3968517d76a1 tempest-VolumesActionsTest-1208865286 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-287168fc-0786-4716-8f23-273489f2849c 1073741824" returned: 0 in 0.745s {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 25 15:58:30 devstack sudo[89647]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-44279f1a-6ab4-4916-8fa2-ff542ca99031.bef529bf-2174-423e-b5b3-aa861367aad7 Feb 25 15:58:30 devstack sudo[89647]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 25 15:58:30 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-7d1ab6a2-e688-43da-82f4-3968517d76a1 tempest-VolumesActionsTest-1208865286 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-287168fc-0786-4716-8f23-273489f2849c {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 25 15:58:30 devstack sudo[89649]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-287168fc-0786-4716-8f23-273489f2849c Feb 25 15:58:30 devstack sudo[89649]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 25 15:58:30 devstack sudo[89642]: pam_unix(sudo:session): session closed for user root Feb 25 15:58:30 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-cc6c4d5f-fe86-47fb-bb3e-2567e53c9ab5 tempest-VolumesGetTest-958147190 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85" returned: 0 in 0.601s {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 25 15:58:30 devstack cinder-volume[83528]: DEBUG cinder.manager [None req-cc6c4d5f-fe86-47fb-bb3e-2567e53c9ab5 tempest-VolumesGetTest-958147190 None] Notifying Schedulers of capabilities ... {{(pid=83528) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 25 15:58:30 devstack cinder-volume[83528]: INFO cinder.volume.manager [None req-cc6c4d5f-fe86-47fb-bb3e-2567e53c9ab5 tempest-VolumesGetTest-958147190 None] Deleted volume successfully. Feb 25 15:58:30 devstack cinder-volume[83528]: DEBUG cinder.coordination [None req-cc6c4d5f-fe86-47fb-bb3e-2567e53c9ab5 tempest-VolumesGetTest-958147190 None] Lock "cinder-834d62f9-8f30-4975-a9d6-b33c44744794-delete_volume" released by "delete_volume" :: held 4.061s {{(pid=83528) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 25 15:58:30 devstack sudo[89647]: pam_unix(sudo:session): session closed for user root Feb 25 15:58:30 devstack sudo[89649]: pam_unix(sudo:session): session closed for user root Feb 25 15:58:30 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-98fb412e-b839-43c4-906e-392e7bb8f4f3 tempest-SnapshotDependencyTests-95648043 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-44279f1a-6ab4-4916-8fa2-ff542ca99031.bef529bf-2174-423e-b5b3-aa861367aad7" returned: 0 in 0.723s {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 25 15:58:30 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.remotefs [None req-98fb412e-b839-43c4-906e-392e7bb8f4f3 tempest-SnapshotDependencyTests-95648043 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-44279f1a-6ab4-4916-8fa2-ff542ca99031(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83528) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Feb 25 15:58:30 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-7d1ab6a2-e688-43da-82f4-3968517d76a1 tempest-VolumesActionsTest-1208865286 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-287168fc-0786-4716-8f23-273489f2849c" returned: 0 in 0.617s {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 25 15:58:30 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.quobyte [None req-7d1ab6a2-e688-43da-82f4-3968517d76a1 tempest-VolumesActionsTest-1208865286 None] <== create_volume: return (1399ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-23e9d725-3e04-4cd9-bfe0-c8ef43305589'} {{(pid=83528) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 25 15:58:30 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-7d1ab6a2-e688-43da-82f4-3968517d76a1 tempest-VolumesActionsTest-1208865286 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.402s {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 25 15:58:30 devstack cinder-volume[83528]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b70ba85-4205-4fc2-ba48-65858a13ae40]: (4, 'qcow2') {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 25 15:58:30 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-98fb412e-b839-43c4-906e-392e7bb8f4f3 tempest-SnapshotDependencyTests-95648043 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-44279f1a-6ab4-4916-8fa2-ff542ca99031 {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 25 15:58:30 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-7d1ab6a2-e688-43da-82f4-3968517d76a1 tempest-VolumesActionsTest-1208865286 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (446e4fdc-f312-42ed-b200-a87e95539350) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-287168fc-0786-4716-8f23-273489f2849c', 'volume_size': 1}' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 25 15:58:30 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-7d1ab6a2-e688-43da-82f4-3968517d76a1 tempest-VolumesActionsTest-1208865286 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8d2e2650-c3aa-4d7b-b790-534625e91619) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 25 15:58:31 devstack cinder-volume[83528]: INFO cinder.volume.flows.manager.create_volume [None req-7d1ab6a2-e688-43da-82f4-3968517d76a1 tempest-VolumesActionsTest-1208865286 None] Volume volume-287168fc-0786-4716-8f23-273489f2849c (287168fc-0786-4716-8f23-273489f2849c): created successfully Feb 25 15:58:31 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-7d1ab6a2-e688-43da-82f4-3968517d76a1 tempest-VolumesActionsTest-1208865286 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8d2e2650-c3aa-4d7b-b790-534625e91619) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 25 15:58:31 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-7d1ab6a2-e688-43da-82f4-3968517d76a1 tempest-VolumesActionsTest-1208865286 None] Flow 'volume_create_manager' (ebec5a07-7857-49ce-8298-9f4d8233b1d8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83528) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 25 15:58:31 devstack cinder-volume[83528]: INFO cinder.volume.manager [None req-7d1ab6a2-e688-43da-82f4-3968517d76a1 tempest-VolumesActionsTest-1208865286 None] Created volume successfully. Feb 25 15:58:31 devstack sudo[89656]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-44279f1a-6ab4-4916-8fa2-ff542ca99031 Feb 25 15:58:31 devstack sudo[89656]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 25 15:58:31 devstack sudo[89656]: pam_unix(sudo:session): session closed for user root Feb 25 15:58:31 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-98fb412e-b839-43c4-906e-392e7bb8f4f3 tempest-SnapshotDependencyTests-95648043 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-44279f1a-6ab4-4916-8fa2-ff542ca99031" returned: 0 in 0.706s {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 25 15:58:31 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-98fb412e-b839-43c4-906e-392e7bb8f4f3 tempest-SnapshotDependencyTests-95648043 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-44279f1a-6ab4-4916-8fa2-ff542ca99031.bef529bf-2174-423e-b5b3-aa861367aad7 {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 25 15:58:31 devstack sudo[89662]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-44279f1a-6ab4-4916-8fa2-ff542ca99031.bef529bf-2174-423e-b5b3-aa861367aad7 Feb 25 15:58:31 devstack sudo[89662]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 25 15:58:32 devstack sudo[89662]: pam_unix(sudo:session): session closed for user root Feb 25 15:58:32 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-98fb412e-b839-43c4-906e-392e7bb8f4f3 tempest-SnapshotDependencyTests-95648043 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-44279f1a-6ab4-4916-8fa2-ff542ca99031.bef529bf-2174-423e-b5b3-aa861367aad7" returned: 0 in 0.668s {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 25 15:58:32 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-98fb412e-b839-43c4-906e-392e7bb8f4f3 tempest-SnapshotDependencyTests-95648043 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-44279f1a-6ab4-4916-8fa2-ff542ca99031.bef529bf-2174-423e-b5b3-aa861367aad7 {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 25 15:58:32 devstack sudo[89669]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-44279f1a-6ab4-4916-8fa2-ff542ca99031.bef529bf-2174-423e-b5b3-aa861367aad7 Feb 25 15:58:32 devstack sudo[89669]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 25 15:58:32 devstack cinder-volume[83528]: DEBUG cinder.volume.flows.manager.create_volume [None req-b6fb1099-f865-4f95-b5d3-6fd2ec18607f tempest-VolumesSnapshotListTestJSON-1129348473 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83528) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 25 15:58:32 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-b6fb1099-f865-4f95-b5d3-6fd2ec18607f tempest-VolumesSnapshotListTestJSON-1129348473 None] Flow 'volume_create_manager' (bdc01f87-a84f-4005-ac71-4943b81140ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83528) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 25 15:58:32 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-b6fb1099-f865-4f95-b5d3-6fd2ec18607f tempest-VolumesSnapshotListTestJSON-1129348473 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (26c27170-1a9f-435f-b738-9d32fd25329b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 25 15:58:32 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-b6fb1099-f865-4f95-b5d3-6fd2ec18607f tempest-VolumesSnapshotListTestJSON-1129348473 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (26c27170-1a9f-435f-b738-9d32fd25329b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-25T14:58:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-975990545',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3fc37162-f4fc-47b7-9dc3-5489f5de5b91,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4c9e70cdbfbd424e92e88d9211be7a66',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-25T14:58:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-25T14:58:33Z,use_quota=True,user_id='fd398ef4d37749259764be0044c17352',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ce71c2f9-6543-4165-9653-a1529b2ea243),volume_type_id=ce71c2f9-6543-4165-9653-a1529b2ea243)' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 25 15:58:32 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-b6fb1099-f865-4f95-b5d3-6fd2ec18607f tempest-VolumesSnapshotListTestJSON-1129348473 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b798502f-a3be-47ac-84c7-edbc1e0bb675) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 25 15:58:32 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-b6fb1099-f865-4f95-b5d3-6fd2ec18607f tempest-VolumesSnapshotListTestJSON-1129348473 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b798502f-a3be-47ac-84c7-edbc1e0bb675) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 25 15:58:32 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-b6fb1099-f865-4f95-b5d3-6fd2ec18607f tempest-VolumesSnapshotListTestJSON-1129348473 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (41e2f685-41f4-4b5f-8604-77e38879c046) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 25 15:58:32 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-b6fb1099-f865-4f95-b5d3-6fd2ec18607f tempest-VolumesSnapshotListTestJSON-1129348473 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (41e2f685-41f4-4b5f-8604-77e38879c046) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3fc37162-f4fc-47b7-9dc3-5489f5de5b91', 'volume_name': 'volume-3fc37162-f4fc-47b7-9dc3-5489f5de5b91', 'volume_size': 1}' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 25 15:58:32 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-b6fb1099-f865-4f95-b5d3-6fd2ec18607f tempest-VolumesSnapshotListTestJSON-1129348473 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a05b76d1-f04b-42cc-9b49-05e7bd13da21) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 25 15:58:32 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-b6fb1099-f865-4f95-b5d3-6fd2ec18607f tempest-VolumesSnapshotListTestJSON-1129348473 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a05b76d1-f04b-42cc-9b49-05e7bd13da21) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 25 15:58:32 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-b6fb1099-f865-4f95-b5d3-6fd2ec18607f tempest-VolumesSnapshotListTestJSON-1129348473 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2a93a08b-16b0-46d8-9f4c-b8572538bc18) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 25 15:58:32 devstack cinder-volume[83528]: INFO cinder.volume.flows.manager.create_volume [None req-b6fb1099-f865-4f95-b5d3-6fd2ec18607f tempest-VolumesSnapshotListTestJSON-1129348473 None] Volume 3fc37162-f4fc-47b7-9dc3-5489f5de5b91: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3fc37162-f4fc-47b7-9dc3-5489f5de5b91', 'volume_size': 1} Feb 25 15:58:32 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-b6fb1099-f865-4f95-b5d3-6fd2ec18607f tempest-VolumesSnapshotListTestJSON-1129348473 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 25 15:58:32 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-b6fb1099-f865-4f95-b5d3-6fd2ec18607f tempest-VolumesSnapshotListTestJSON-1129348473 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 25 15:58:32 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.quobyte [None req-b6fb1099-f865-4f95-b5d3-6fd2ec18607f tempest-VolumesSnapshotListTestJSON-1129348473 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-25T14:58:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-975990545',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3fc37162-f4fc-47b7-9dc3-5489f5de5b91,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4c9e70cdbfbd424e92e88d9211be7a66',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-25T14:58:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-25T14:58:33Z,use_quota=True,user_id='fd398ef4d37749259764be0044c17352',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ce71c2f9-6543-4165-9653-a1529b2ea243),volume_type_id=ce71c2f9-6543-4165-9653-a1529b2ea243)}" {{(pid=83528) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 25 15:58:32 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.remotefs [None req-b6fb1099-f865-4f95-b5d3-6fd2ec18607f tempest-VolumesSnapshotListTestJSON-1129348473 None] Creating volume 3fc37162-f4fc-47b7-9dc3-5489f5de5b91 {{(pid=83528) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 25 15:58:32 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-b6fb1099-f865-4f95-b5d3-6fd2ec18607f tempest-VolumesSnapshotListTestJSON-1129348473 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 25 15:58:32 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-b6fb1099-f865-4f95-b5d3-6fd2ec18607f tempest-VolumesSnapshotListTestJSON-1129348473 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 25 15:58:32 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.quobyte [None req-b6fb1099-f865-4f95-b5d3-6fd2ec18607f tempest-VolumesSnapshotListTestJSON-1129348473 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23e9d725-3e04-4cd9-bfe0-c8ef43305589': None} {{(pid=83528) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 25 15:58:32 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.quobyte [None req-b6fb1099-f865-4f95-b5d3-6fd2ec18607f tempest-VolumesSnapshotListTestJSON-1129348473 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23e9d725-3e04-4cd9-bfe0-c8ef43305589'] {{(pid=83528) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 25 15:58:32 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-b6fb1099-f865-4f95-b5d3-6fd2ec18607f tempest-VolumesSnapshotListTestJSON-1129348473 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 25 15:58:32 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.quobyte [None req-b6fb1099-f865-4f95-b5d3-6fd2ec18607f tempest-VolumesSnapshotListTestJSON-1129348473 None] Selected osci02.corp.quobyte.com/cinder-vol-23e9d725-3e04-4cd9-bfe0-c8ef43305589 as target Quobyte volume. {{(pid=83528) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 25 15:58:32 devstack cinder-volume[83528]: INFO cinder.volume.drivers.remotefs [None req-b6fb1099-f865-4f95-b5d3-6fd2ec18607f tempest-VolumesSnapshotListTestJSON-1129348473 None] casted to osci02.corp.quobyte.com/cinder-vol-23e9d725-3e04-4cd9-bfe0-c8ef43305589 Feb 25 15:58:32 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-b6fb1099-f865-4f95-b5d3-6fd2ec18607f tempest-VolumesSnapshotListTestJSON-1129348473 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-3fc37162-f4fc-47b7-9dc3-5489f5de5b91 1073741824 {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 25 15:58:32 devstack sudo[89681]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-3fc37162-f4fc-47b7-9dc3-5489f5de5b91 1073741824 Feb 25 15:58:32 devstack sudo[89681]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 25 15:58:32 devstack sudo[89669]: pam_unix(sudo:session): session closed for user root Feb 25 15:58:32 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-98fb412e-b839-43c4-906e-392e7bb8f4f3 tempest-SnapshotDependencyTests-95648043 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-44279f1a-6ab4-4916-8fa2-ff542ca99031.bef529bf-2174-423e-b5b3-aa861367aad7" returned: 0 in 0.654s {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 25 15:58:33 devstack cinder-volume[83528]: DEBUG cinder.coordination [None req-98fb412e-b839-43c4-906e-392e7bb8f4f3 tempest-SnapshotDependencyTests-95648043 None] Lock "cinder-quobyte-bef529bf-2174-423e-b5b3-aa861367aad7" released by "_delete_snapshot" :: held 2.829s {{(pid=83528) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 25 15:58:33 devstack cinder-volume[83528]: DEBUG cinder.coordination [None req-98fb412e-b839-43c4-906e-392e7bb8f4f3 tempest-SnapshotDependencyTests-95648043 None] Lock "cinder-quobyte-44279f1a-6ab4-4916-8fa2-ff542ca99031" released by "delete_snapshot" :: held 2.867s {{(pid=83528) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 25 15:58:33 devstack cinder-volume[83528]: DEBUG cinder.quota [None req-98fb412e-b839-43c4-906e-392e7bb8f4f3 tempest-SnapshotDependencyTests-95648043 None] Created reservations ['2f15d0fe-a6b8-4e32-8a11-6bc189e94a91', '1fcaee15-1dd9-4f54-83b6-934522792c3b', '86c1b2b0-ffcc-47c2-81e7-7a3f11ad6cf8', '706c5bfb-ae1e-428e-aef1-cd51c82675d2'] {{(pid=83528) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 25 15:58:33 devstack cinder-volume[83528]: INFO cinder.volume.manager [None req-98fb412e-b839-43c4-906e-392e7bb8f4f3 tempest-SnapshotDependencyTests-95648043 None] Delete snapshot completed successfully. Feb 25 15:58:33 devstack cinder-volume[83528]: DEBUG cinder.coordination [None req-98fb412e-b839-43c4-906e-392e7bb8f4f3 tempest-SnapshotDependencyTests-95648043 None] Lock "cinder-bef529bf-2174-423e-b5b3-aa861367aad7-delete_snapshot" released by "delete_snapshot" :: held 2.992s {{(pid=83528) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 25 15:58:33 devstack cinder-volume[83528]: DEBUG cinder.coordination [None req-f96ab185-a3fc-4bf9-ae7d-b563c8b68a35 tempest-SnapshotDependencyTests-95648043 None] Acquiring lock "cinder-44279f1a-6ab4-4916-8fa2-ff542ca99031-delete_volume" by "delete_volume" {{(pid=83528) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 25 15:58:33 devstack cinder-volume[83528]: DEBUG cinder.coordination [None req-f96ab185-a3fc-4bf9-ae7d-b563c8b68a35 tempest-SnapshotDependencyTests-95648043 None] Lock "cinder-44279f1a-6ab4-4916-8fa2-ff542ca99031-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=83528) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 25 15:58:33 devstack cinder-volume[83528]: DEBUG cinder.coordination [None req-f96ab185-a3fc-4bf9-ae7d-b563c8b68a35 tempest-SnapshotDependencyTests-95648043 None] Acquiring lock "cinder-quobyte-44279f1a-6ab4-4916-8fa2-ff542ca99031" by "delete_volume" {{(pid=83528) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 25 15:58:33 devstack cinder-volume[83528]: DEBUG cinder.coordination [None req-f96ab185-a3fc-4bf9-ae7d-b563c8b68a35 tempest-SnapshotDependencyTests-95648043 None] Lock "cinder-quobyte-44279f1a-6ab4-4916-8fa2-ff542ca99031" acquired by "delete_volume" :: waited 0.010s {{(pid=83528) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 25 15:58:33 devstack cinder-volume[83528]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9c4db52-bf1e-4928-b5fa-2fd580cd7478]: (4, 'qcow2') {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 25 15:58:33 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-f96ab185-a3fc-4bf9-ae7d-b563c8b68a35 tempest-SnapshotDependencyTests-95648043 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-44279f1a-6ab4-4916-8fa2-ff542ca99031 {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 25 15:58:33 devstack sudo[89701]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-44279f1a-6ab4-4916-8fa2-ff542ca99031 Feb 25 15:58:33 devstack sudo[89701]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 25 15:58:33 devstack sudo[89681]: pam_unix(sudo:session): session closed for user root Feb 25 15:58:33 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-b6fb1099-f865-4f95-b5d3-6fd2ec18607f tempest-VolumesSnapshotListTestJSON-1129348473 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-3fc37162-f4fc-47b7-9dc3-5489f5de5b91 1073741824" returned: 0 in 0.769s {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 25 15:58:33 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-b6fb1099-f865-4f95-b5d3-6fd2ec18607f tempest-VolumesSnapshotListTestJSON-1129348473 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-3fc37162-f4fc-47b7-9dc3-5489f5de5b91 {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 25 15:58:33 devstack sudo[89703]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-3fc37162-f4fc-47b7-9dc3-5489f5de5b91 Feb 25 15:58:33 devstack sudo[89703]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 25 15:58:34 devstack sudo[89701]: pam_unix(sudo:session): session closed for user root Feb 25 15:58:34 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-f96ab185-a3fc-4bf9-ae7d-b563c8b68a35 tempest-SnapshotDependencyTests-95648043 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-44279f1a-6ab4-4916-8fa2-ff542ca99031" returned: 0 in 0.676s {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 25 15:58:34 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-f96ab185-a3fc-4bf9-ae7d-b563c8b68a35 tempest-SnapshotDependencyTests-95648043 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-44279f1a-6ab4-4916-8fa2-ff542ca99031 {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 25 15:58:34 devstack sudo[89703]: pam_unix(sudo:session): session closed for user root Feb 25 15:58:34 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-b6fb1099-f865-4f95-b5d3-6fd2ec18607f tempest-VolumesSnapshotListTestJSON-1129348473 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-3fc37162-f4fc-47b7-9dc3-5489f5de5b91" returned: 0 in 0.521s {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 25 15:58:34 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.quobyte [None req-b6fb1099-f865-4f95-b5d3-6fd2ec18607f tempest-VolumesSnapshotListTestJSON-1129348473 None] <== create_volume: return (1329ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-23e9d725-3e04-4cd9-bfe0-c8ef43305589'} {{(pid=83528) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 25 15:58:34 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-b6fb1099-f865-4f95-b5d3-6fd2ec18607f tempest-VolumesSnapshotListTestJSON-1129348473 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.332s {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 25 15:58:34 devstack sudo[89709]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-44279f1a-6ab4-4916-8fa2-ff542ca99031 Feb 25 15:58:34 devstack sudo[89709]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 25 15:58:34 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-b6fb1099-f865-4f95-b5d3-6fd2ec18607f tempest-VolumesSnapshotListTestJSON-1129348473 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2a93a08b-16b0-46d8-9f4c-b8572538bc18) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3fc37162-f4fc-47b7-9dc3-5489f5de5b91', 'volume_size': 1}' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 25 15:58:34 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-b6fb1099-f865-4f95-b5d3-6fd2ec18607f tempest-VolumesSnapshotListTestJSON-1129348473 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4f5c8baf-d563-4fec-8120-6dc1d1ae7500) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 25 15:58:34 devstack cinder-volume[83528]: INFO cinder.volume.flows.manager.create_volume [None req-b6fb1099-f865-4f95-b5d3-6fd2ec18607f tempest-VolumesSnapshotListTestJSON-1129348473 None] Volume volume-3fc37162-f4fc-47b7-9dc3-5489f5de5b91 (3fc37162-f4fc-47b7-9dc3-5489f5de5b91): created successfully Feb 25 15:58:34 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-b6fb1099-f865-4f95-b5d3-6fd2ec18607f tempest-VolumesSnapshotListTestJSON-1129348473 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4f5c8baf-d563-4fec-8120-6dc1d1ae7500) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 25 15:58:34 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-b6fb1099-f865-4f95-b5d3-6fd2ec18607f tempest-VolumesSnapshotListTestJSON-1129348473 None] Flow 'volume_create_manager' (bdc01f87-a84f-4005-ac71-4943b81140ea) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83528) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 25 15:58:34 devstack cinder-volume[83528]: INFO cinder.volume.manager [None req-b6fb1099-f865-4f95-b5d3-6fd2ec18607f tempest-VolumesSnapshotListTestJSON-1129348473 None] Created volume successfully. Feb 25 15:58:34 devstack sudo[89709]: pam_unix(sudo:session): session closed for user root Feb 25 15:58:34 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-f96ab185-a3fc-4bf9-ae7d-b563c8b68a35 tempest-SnapshotDependencyTests-95648043 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-44279f1a-6ab4-4916-8fa2-ff542ca99031" returned: 0 in 0.469s {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 25 15:58:34 devstack cinder-volume[83528]: DEBUG cinder.coordination [None req-f96ab185-a3fc-4bf9-ae7d-b563c8b68a35 tempest-SnapshotDependencyTests-95648043 None] Lock "cinder-quobyte-44279f1a-6ab4-4916-8fa2-ff542ca99031" released by "delete_volume" :: held 1.214s {{(pid=83528) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 25 15:58:34 devstack cinder-volume[83528]: DEBUG cinder.quota [None req-f96ab185-a3fc-4bf9-ae7d-b563c8b68a35 tempest-SnapshotDependencyTests-95648043 None] Created reservations ['d035f522-c3fb-4af3-82fd-7040d7147dd5', 'dfca70b6-3530-45da-a3ea-4f2e52c86618', 'b61d305f-2a0a-4da0-a919-485453c0fb0f', '86aea325-c8dc-41a7-9ba4-3742f6d84e67'] {{(pid=83528) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 25 15:58:34 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-f96ab185-a3fc-4bf9-ae7d-b563c8b68a35 tempest-SnapshotDependencyTests-95648043 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 25 15:58:34 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-f96ab185-a3fc-4bf9-ae7d-b563c8b68a35 tempest-SnapshotDependencyTests-95648043 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 25 15:58:34 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.quobyte [None req-f96ab185-a3fc-4bf9-ae7d-b563c8b68a35 tempest-SnapshotDependencyTests-95648043 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23e9d725-3e04-4cd9-bfe0-c8ef43305589': None} {{(pid=83528) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 25 15:58:34 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.quobyte [None req-f96ab185-a3fc-4bf9-ae7d-b563c8b68a35 tempest-SnapshotDependencyTests-95648043 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23e9d725-3e04-4cd9-bfe0-c8ef43305589'] {{(pid=83528) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 25 15:58:34 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-f96ab185-a3fc-4bf9-ae7d-b563c8b68a35 tempest-SnapshotDependencyTests-95648043 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 25 15:58:34 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-f96ab185-a3fc-4bf9-ae7d-b563c8b68a35 tempest-SnapshotDependencyTests-95648043 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85 {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 25 15:58:34 devstack sudo[89718]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85 Feb 25 15:58:34 devstack sudo[89718]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 25 15:58:35 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-86ef0124-dcee-4bd5-9d6d-2731cbb6a287 tempest-VolumesSnapshotListTestJSON-1129348473 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 25 15:58:35 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-86ef0124-dcee-4bd5-9d6d-2731cbb6a287 tempest-VolumesSnapshotListTestJSON-1129348473 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 25 15:58:35 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.remotefs [None req-86ef0124-dcee-4bd5-9d6d-2731cbb6a287 tempest-VolumesSnapshotListTestJSON-1129348473 None] Creating offline snapshot bfadbb56-25c0-4f1b-8f34-02cf6a6be05b of volume 3fc37162-f4fc-47b7-9dc3-5489f5de5b91 {{(pid=83528) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Feb 25 15:58:35 devstack cinder-volume[83528]: DEBUG oslo.privsep.daemon [-] privsep: reply[feb05f23-ea21-4b59-8f72-49adbc1705f7]: (4, 'qcow2') {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 25 15:58:35 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-86ef0124-dcee-4bd5-9d6d-2731cbb6a287 tempest-VolumesSnapshotListTestJSON-1129348473 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-3fc37162-f4fc-47b7-9dc3-5489f5de5b91 {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 25 15:58:35 devstack sudo[89720]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-3fc37162-f4fc-47b7-9dc3-5489f5de5b91 Feb 25 15:58:35 devstack sudo[89720]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 25 15:58:35 devstack sudo[89718]: pam_unix(sudo:session): session closed for user root Feb 25 15:58:35 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-f96ab185-a3fc-4bf9-ae7d-b563c8b68a35 tempest-SnapshotDependencyTests-95648043 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85" returned: 0 in 0.560s {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 25 15:58:35 devstack cinder-volume[83528]: DEBUG cinder.manager [None req-f96ab185-a3fc-4bf9-ae7d-b563c8b68a35 tempest-SnapshotDependencyTests-95648043 None] Notifying Schedulers of capabilities ... {{(pid=83528) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 25 15:58:35 devstack cinder-volume[83528]: INFO cinder.volume.manager [None req-f96ab185-a3fc-4bf9-ae7d-b563c8b68a35 tempest-SnapshotDependencyTests-95648043 None] Deleted volume successfully. Feb 25 15:58:35 devstack cinder-volume[83528]: DEBUG cinder.coordination [None req-f96ab185-a3fc-4bf9-ae7d-b563c8b68a35 tempest-SnapshotDependencyTests-95648043 None] Lock "cinder-44279f1a-6ab4-4916-8fa2-ff542ca99031-delete_volume" released by "delete_volume" :: held 1.991s {{(pid=83528) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 25 15:58:35 devstack cinder-volume[83528]: DEBUG cinder.coordination [None req-acc4abcf-9d9e-4a37-ac72-958a8f0b0775 tempest-SnapshotDependencyTests-95648043 None] Acquiring lock "cinder-5f03050b-acd1-4aa3-bf3f-e8227a4d15f3-delete_volume" by "delete_volume" {{(pid=83528) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 25 15:58:35 devstack cinder-volume[83528]: DEBUG cinder.coordination [None req-acc4abcf-9d9e-4a37-ac72-958a8f0b0775 tempest-SnapshotDependencyTests-95648043 None] Lock "cinder-5f03050b-acd1-4aa3-bf3f-e8227a4d15f3-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=83528) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 25 15:58:35 devstack cinder-volume[83528]: DEBUG cinder.coordination [None req-acc4abcf-9d9e-4a37-ac72-958a8f0b0775 tempest-SnapshotDependencyTests-95648043 None] Acquiring lock "cinder-quobyte-5f03050b-acd1-4aa3-bf3f-e8227a4d15f3" by "delete_volume" {{(pid=83528) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 25 15:58:35 devstack cinder-volume[83528]: DEBUG cinder.coordination [None req-acc4abcf-9d9e-4a37-ac72-958a8f0b0775 tempest-SnapshotDependencyTests-95648043 None] Lock "cinder-quobyte-5f03050b-acd1-4aa3-bf3f-e8227a4d15f3" acquired by "delete_volume" :: waited 0.010s {{(pid=83528) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 25 15:58:35 devstack sudo[89720]: pam_unix(sudo:session): session closed for user root Feb 25 15:58:35 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-86ef0124-dcee-4bd5-9d6d-2731cbb6a287 tempest-VolumesSnapshotListTestJSON-1129348473 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-3fc37162-f4fc-47b7-9dc3-5489f5de5b91" returned: 0 in 0.599s {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 25 15:58:35 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-86ef0124-dcee-4bd5-9d6d-2731cbb6a287 tempest-VolumesSnapshotListTestJSON-1129348473 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-3fc37162-f4fc-47b7-9dc3-5489f5de5b91,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-3fc37162-f4fc-47b7-9dc3-5489f5de5b91.bfadbb56-25c0-4f1b-8f34-02cf6a6be05b 1G {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 25 15:58:35 devstack cinder-volume[83528]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ce4f8a9-7988-4af5-babf-5c93bdda9a9a]: (4, 'qcow2') {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 25 15:58:35 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-acc4abcf-9d9e-4a37-ac72-958a8f0b0775 tempest-SnapshotDependencyTests-95648043 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-5f03050b-acd1-4aa3-bf3f-e8227a4d15f3 {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 25 15:58:35 devstack sudo[89726]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-3fc37162-f4fc-47b7-9dc3-5489f5de5b91,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-3fc37162-f4fc-47b7-9dc3-5489f5de5b91.bfadbb56-25c0-4f1b-8f34-02cf6a6be05b 1G Feb 25 15:58:35 devstack sudo[89726]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 25 15:58:35 devstack sudo[89727]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-5f03050b-acd1-4aa3-bf3f-e8227a4d15f3 Feb 25 15:58:35 devstack sudo[89727]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 25 15:58:36 devstack sudo[89726]: pam_unix(sudo:session): session closed for user root Feb 25 15:58:36 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-86ef0124-dcee-4bd5-9d6d-2731cbb6a287 tempest-VolumesSnapshotListTestJSON-1129348473 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-3fc37162-f4fc-47b7-9dc3-5489f5de5b91,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-3fc37162-f4fc-47b7-9dc3-5489f5de5b91.bfadbb56-25c0-4f1b-8f34-02cf6a6be05b 1G" returned: 0 in 0.557s {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 25 15:58:36 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-86ef0124-dcee-4bd5-9d6d-2731cbb6a287 tempest-VolumesSnapshotListTestJSON-1129348473 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3fc37162-f4fc-47b7-9dc3-5489f5de5b91 -F qcow2 /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-3fc37162-f4fc-47b7-9dc3-5489f5de5b91.bfadbb56-25c0-4f1b-8f34-02cf6a6be05b {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 25 15:58:36 devstack sudo[89736]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3fc37162-f4fc-47b7-9dc3-5489f5de5b91 -F qcow2 /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-3fc37162-f4fc-47b7-9dc3-5489f5de5b91.bfadbb56-25c0-4f1b-8f34-02cf6a6be05b Feb 25 15:58:36 devstack sudo[89736]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 25 15:58:36 devstack sudo[89727]: pam_unix(sudo:session): session closed for user root Feb 25 15:58:36 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-acc4abcf-9d9e-4a37-ac72-958a8f0b0775 tempest-SnapshotDependencyTests-95648043 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-5f03050b-acd1-4aa3-bf3f-e8227a4d15f3" returned: 0 in 0.623s {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 25 15:58:36 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-acc4abcf-9d9e-4a37-ac72-958a8f0b0775 tempest-SnapshotDependencyTests-95648043 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-5f03050b-acd1-4aa3-bf3f-e8227a4d15f3 {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 25 15:58:36 devstack sudo[89738]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-5f03050b-acd1-4aa3-bf3f-e8227a4d15f3 Feb 25 15:58:36 devstack sudo[89738]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 25 15:58:36 devstack sudo[89736]: pam_unix(sudo:session): session closed for user root Feb 25 15:58:36 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-86ef0124-dcee-4bd5-9d6d-2731cbb6a287 tempest-VolumesSnapshotListTestJSON-1129348473 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3fc37162-f4fc-47b7-9dc3-5489f5de5b91 -F qcow2 /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-3fc37162-f4fc-47b7-9dc3-5489f5de5b91.bfadbb56-25c0-4f1b-8f34-02cf6a6be05b" returned: 0 in 0.509s {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 25 15:58:36 devstack cinder-volume[83528]: WARNING cinder.volume.drivers.remotefs [None req-86ef0124-dcee-4bd5-9d6d-2731cbb6a287 tempest-VolumesSnapshotListTestJSON-1129348473 None] /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-3fc37162-f4fc-47b7-9dc3-5489f5de5b91.bfadbb56-25c0-4f1b-8f34-02cf6a6be05b is being set with open permissions: ugo+rw Feb 25 15:58:36 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-86ef0124-dcee-4bd5-9d6d-2731cbb6a287 tempest-VolumesSnapshotListTestJSON-1129348473 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-3fc37162-f4fc-47b7-9dc3-5489f5de5b91.bfadbb56-25c0-4f1b-8f34-02cf6a6be05b {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 25 15:58:36 devstack sudo[89738]: pam_unix(sudo:session): session closed for user root Feb 25 15:58:36 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-acc4abcf-9d9e-4a37-ac72-958a8f0b0775 tempest-SnapshotDependencyTests-95648043 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-5f03050b-acd1-4aa3-bf3f-e8227a4d15f3" returned: 0 in 0.459s {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 25 15:58:36 devstack sudo[89744]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-3fc37162-f4fc-47b7-9dc3-5489f5de5b91.bfadbb56-25c0-4f1b-8f34-02cf6a6be05b Feb 25 15:58:36 devstack sudo[89744]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 25 15:58:36 devstack cinder-volume[83528]: DEBUG cinder.coordination [None req-acc4abcf-9d9e-4a37-ac72-958a8f0b0775 tempest-SnapshotDependencyTests-95648043 None] Lock "cinder-quobyte-5f03050b-acd1-4aa3-bf3f-e8227a4d15f3" released by "delete_volume" :: held 1.125s {{(pid=83528) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 25 15:58:36 devstack cinder-volume[83528]: DEBUG cinder.quota [None req-acc4abcf-9d9e-4a37-ac72-958a8f0b0775 tempest-SnapshotDependencyTests-95648043 None] Created reservations ['987800cd-1ffb-4189-a748-6aaec80cff24', '50c141e3-0c64-4375-af71-2ec5180ecbed', '31d8df91-d3d7-464d-be49-f4764784e7e7', 'cc48b023-581f-4da1-b387-1a897dd2a219'] {{(pid=83528) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 25 15:58:36 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-acc4abcf-9d9e-4a37-ac72-958a8f0b0775 tempest-SnapshotDependencyTests-95648043 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 25 15:58:36 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-acc4abcf-9d9e-4a37-ac72-958a8f0b0775 tempest-SnapshotDependencyTests-95648043 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 25 15:58:36 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.quobyte [None req-acc4abcf-9d9e-4a37-ac72-958a8f0b0775 tempest-SnapshotDependencyTests-95648043 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23e9d725-3e04-4cd9-bfe0-c8ef43305589': None} {{(pid=83528) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 25 15:58:36 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.quobyte [None req-acc4abcf-9d9e-4a37-ac72-958a8f0b0775 tempest-SnapshotDependencyTests-95648043 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23e9d725-3e04-4cd9-bfe0-c8ef43305589'] {{(pid=83528) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 25 15:58:36 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-acc4abcf-9d9e-4a37-ac72-958a8f0b0775 tempest-SnapshotDependencyTests-95648043 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 25 15:58:36 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-acc4abcf-9d9e-4a37-ac72-958a8f0b0775 tempest-SnapshotDependencyTests-95648043 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85 {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 25 15:58:36 devstack sudo[89746]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85 Feb 25 15:58:36 devstack sudo[89746]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 25 15:58:37 devstack sudo[89744]: pam_unix(sudo:session): session closed for user root Feb 25 15:58:37 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-86ef0124-dcee-4bd5-9d6d-2731cbb6a287 tempest-VolumesSnapshotListTestJSON-1129348473 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-3fc37162-f4fc-47b7-9dc3-5489f5de5b91.bfadbb56-25c0-4f1b-8f34-02cf6a6be05b" returned: 0 in 0.587s {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 25 15:58:37 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-86ef0124-dcee-4bd5-9d6d-2731cbb6a287 tempest-VolumesSnapshotListTestJSON-1129348473 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-3fc37162-f4fc-47b7-9dc3-5489f5de5b91.info {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 25 15:58:37 devstack sudo[89750]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-3fc37162-f4fc-47b7-9dc3-5489f5de5b91.info Feb 25 15:58:37 devstack sudo[89750]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 25 15:58:37 devstack sudo[89746]: pam_unix(sudo:session): session closed for user root Feb 25 15:58:37 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-acc4abcf-9d9e-4a37-ac72-958a8f0b0775 tempest-SnapshotDependencyTests-95648043 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85" returned: 0 in 0.559s {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 25 15:58:37 devstack cinder-volume[83528]: DEBUG cinder.manager [None req-acc4abcf-9d9e-4a37-ac72-958a8f0b0775 tempest-SnapshotDependencyTests-95648043 None] Notifying Schedulers of capabilities ... {{(pid=83528) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 25 15:58:37 devstack cinder-volume[83528]: INFO cinder.volume.manager [None req-acc4abcf-9d9e-4a37-ac72-958a8f0b0775 tempest-SnapshotDependencyTests-95648043 None] Deleted volume successfully. Feb 25 15:58:37 devstack cinder-volume[83528]: DEBUG cinder.coordination [None req-acc4abcf-9d9e-4a37-ac72-958a8f0b0775 tempest-SnapshotDependencyTests-95648043 None] Lock "cinder-5f03050b-acd1-4aa3-bf3f-e8227a4d15f3-delete_volume" released by "delete_volume" :: held 1.869s {{(pid=83528) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 25 15:58:38 devstack sudo[89750]: pam_unix(sudo:session): session closed for user root Feb 25 15:58:38 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-86ef0124-dcee-4bd5-9d6d-2731cbb6a287 tempest-VolumesSnapshotListTestJSON-1129348473 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-3fc37162-f4fc-47b7-9dc3-5489f5de5b91.info" returned: 0 in 0.732s {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 25 15:58:38 devstack cinder-volume[83528]: WARNING cinder.volume.drivers.remotefs [None req-86ef0124-dcee-4bd5-9d6d-2731cbb6a287 tempest-VolumesSnapshotListTestJSON-1129348473 None] /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-3fc37162-f4fc-47b7-9dc3-5489f5de5b91.info is being set with open permissions: ugo+rw Feb 25 15:58:38 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-86ef0124-dcee-4bd5-9d6d-2731cbb6a287 tempest-VolumesSnapshotListTestJSON-1129348473 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-3fc37162-f4fc-47b7-9dc3-5489f5de5b91.info {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 25 15:58:38 devstack sudo[89753]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-3fc37162-f4fc-47b7-9dc3-5489f5de5b91.info Feb 25 15:58:38 devstack sudo[89753]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 25 15:58:38 devstack cinder-volume[83528]: DEBUG oslo_service.periodic_task [None req-d4c764ec-0ebb-4b31-b534-c9a53c1ab0dd None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=83528) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Feb 25 15:58:38 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-d4c764ec-0ebb-4b31-b534-c9a53c1ab0dd None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 25 15:58:38 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-d4c764ec-0ebb-4b31-b534-c9a53c1ab0dd None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 25 15:58:38 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.quobyte [None req-d4c764ec-0ebb-4b31-b534-c9a53c1ab0dd None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23e9d725-3e04-4cd9-bfe0-c8ef43305589': None} {{(pid=83528) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 25 15:58:38 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.quobyte [None req-d4c764ec-0ebb-4b31-b534-c9a53c1ab0dd None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23e9d725-3e04-4cd9-bfe0-c8ef43305589'] {{(pid=83528) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 25 15:58:38 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-d4c764ec-0ebb-4b31-b534-c9a53c1ab0dd None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 25 15:58:38 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-d4c764ec-0ebb-4b31-b534-c9a53c1ab0dd None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85 {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 25 15:58:38 devstack sudo[89753]: pam_unix(sudo:session): session closed for user root Feb 25 15:58:38 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-86ef0124-dcee-4bd5-9d6d-2731cbb6a287 tempest-VolumesSnapshotListTestJSON-1129348473 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-3fc37162-f4fc-47b7-9dc3-5489f5de5b91.info" returned: 0 in 0.684s {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 25 15:58:38 devstack sudo[89756]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85 Feb 25 15:58:38 devstack sudo[89756]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 25 15:58:38 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-86ef0124-dcee-4bd5-9d6d-2731cbb6a287 tempest-VolumesSnapshotListTestJSON-1129348473 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.738s {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 25 15:58:38 devstack cinder-volume[83528]: INFO cinder.volume.manager [None req-86ef0124-dcee-4bd5-9d6d-2731cbb6a287 tempest-VolumesSnapshotListTestJSON-1129348473 None] Create snapshot completed successfully Feb 25 15:58:39 devstack sudo[89756]: pam_unix(sudo:session): session closed for user root Feb 25 15:58:39 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-d4c764ec-0ebb-4b31-b534-c9a53c1ab0dd None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85" returned: 0 in 0.557s {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 25 15:58:39 devstack cinder-volume[83528]: DEBUG cinder.manager [None req-d4c764ec-0ebb-4b31-b534-c9a53c1ab0dd None None] Notifying Schedulers of capabilities ... {{(pid=83528) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 25 15:58:39 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-f339d443-3aeb-482a-af4c-86135291fa63 tempest-VolumesSnapshotListTestJSON-1129348473 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 25 15:58:39 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-f339d443-3aeb-482a-af4c-86135291fa63 tempest-VolumesSnapshotListTestJSON-1129348473 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 25 15:58:39 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.remotefs [None req-f339d443-3aeb-482a-af4c-86135291fa63 tempest-VolumesSnapshotListTestJSON-1129348473 None] Creating offline snapshot 106ca414-4789-41a6-afde-c536e494dc0e of volume 3fc37162-f4fc-47b7-9dc3-5489f5de5b91 {{(pid=83528) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Feb 25 15:58:39 devstack cinder-volume[83528]: DEBUG oslo.privsep.daemon [-] privsep: reply[b849ca87-5d5c-4dfc-bcee-345d14ca238b]: (4, 'qcow2') {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 25 15:58:39 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-f339d443-3aeb-482a-af4c-86135291fa63 tempest-VolumesSnapshotListTestJSON-1129348473 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-3fc37162-f4fc-47b7-9dc3-5489f5de5b91.bfadbb56-25c0-4f1b-8f34-02cf6a6be05b {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 25 15:58:39 devstack sudo[89773]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-3fc37162-f4fc-47b7-9dc3-5489f5de5b91.bfadbb56-25c0-4f1b-8f34-02cf6a6be05b Feb 25 15:58:39 devstack sudo[89773]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 25 15:58:40 devstack sudo[89773]: pam_unix(sudo:session): session closed for user root Feb 25 15:58:40 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-f339d443-3aeb-482a-af4c-86135291fa63 tempest-VolumesSnapshotListTestJSON-1129348473 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-3fc37162-f4fc-47b7-9dc3-5489f5de5b91.bfadbb56-25c0-4f1b-8f34-02cf6a6be05b" returned: 0 in 0.709s {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 25 15:58:40 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.remotefs [None req-f339d443-3aeb-482a-af4c-86135291fa63 tempest-VolumesSnapshotListTestJSON-1129348473 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3fc37162-f4fc-47b7-9dc3-5489f5de5b91(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83528) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Feb 25 15:58:40 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-f339d443-3aeb-482a-af4c-86135291fa63 tempest-VolumesSnapshotListTestJSON-1129348473 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-3fc37162-f4fc-47b7-9dc3-5489f5de5b91.bfadbb56-25c0-4f1b-8f34-02cf6a6be05b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-3fc37162-f4fc-47b7-9dc3-5489f5de5b91.106ca414-4789-41a6-afde-c536e494dc0e 1G {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 25 15:58:40 devstack sudo[89781]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-3fc37162-f4fc-47b7-9dc3-5489f5de5b91.bfadbb56-25c0-4f1b-8f34-02cf6a6be05b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-3fc37162-f4fc-47b7-9dc3-5489f5de5b91.106ca414-4789-41a6-afde-c536e494dc0e 1G Feb 25 15:58:40 devstack sudo[89781]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 25 15:58:41 devstack sudo[89781]: pam_unix(sudo:session): session closed for user root Feb 25 15:58:41 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-f339d443-3aeb-482a-af4c-86135291fa63 tempest-VolumesSnapshotListTestJSON-1129348473 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-3fc37162-f4fc-47b7-9dc3-5489f5de5b91.bfadbb56-25c0-4f1b-8f34-02cf6a6be05b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-3fc37162-f4fc-47b7-9dc3-5489f5de5b91.106ca414-4789-41a6-afde-c536e494dc0e 1G" returned: 0 in 0.722s {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 25 15:58:41 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-f339d443-3aeb-482a-af4c-86135291fa63 tempest-VolumesSnapshotListTestJSON-1129348473 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3fc37162-f4fc-47b7-9dc3-5489f5de5b91.bfadbb56-25c0-4f1b-8f34-02cf6a6be05b -F qcow2 /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-3fc37162-f4fc-47b7-9dc3-5489f5de5b91.106ca414-4789-41a6-afde-c536e494dc0e {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 25 15:58:41 devstack sudo[89786]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3fc37162-f4fc-47b7-9dc3-5489f5de5b91.bfadbb56-25c0-4f1b-8f34-02cf6a6be05b -F qcow2 /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-3fc37162-f4fc-47b7-9dc3-5489f5de5b91.106ca414-4789-41a6-afde-c536e494dc0e Feb 25 15:58:41 devstack sudo[89786]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 25 15:58:41 devstack sudo[89786]: pam_unix(sudo:session): session closed for user root Feb 25 15:58:41 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-f339d443-3aeb-482a-af4c-86135291fa63 tempest-VolumesSnapshotListTestJSON-1129348473 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3fc37162-f4fc-47b7-9dc3-5489f5de5b91.bfadbb56-25c0-4f1b-8f34-02cf6a6be05b -F qcow2 /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-3fc37162-f4fc-47b7-9dc3-5489f5de5b91.106ca414-4789-41a6-afde-c536e494dc0e" returned: 0 in 0.632s {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 25 15:58:41 devstack cinder-volume[83528]: WARNING cinder.volume.drivers.remotefs [None req-f339d443-3aeb-482a-af4c-86135291fa63 tempest-VolumesSnapshotListTestJSON-1129348473 None] /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-3fc37162-f4fc-47b7-9dc3-5489f5de5b91.106ca414-4789-41a6-afde-c536e494dc0e is being set with open permissions: ugo+rw Feb 25 15:58:41 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-f339d443-3aeb-482a-af4c-86135291fa63 tempest-VolumesSnapshotListTestJSON-1129348473 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-3fc37162-f4fc-47b7-9dc3-5489f5de5b91.106ca414-4789-41a6-afde-c536e494dc0e {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 25 15:58:41 devstack sudo[89791]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-3fc37162-f4fc-47b7-9dc3-5489f5de5b91.106ca414-4789-41a6-afde-c536e494dc0e Feb 25 15:58:41 devstack sudo[89791]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 25 15:58:42 devstack sudo[89791]: pam_unix(sudo:session): session closed for user root Feb 25 15:58:42 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-f339d443-3aeb-482a-af4c-86135291fa63 tempest-VolumesSnapshotListTestJSON-1129348473 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-3fc37162-f4fc-47b7-9dc3-5489f5de5b91.106ca414-4789-41a6-afde-c536e494dc0e" returned: 0 in 0.513s {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 25 15:58:42 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-f339d443-3aeb-482a-af4c-86135291fa63 tempest-VolumesSnapshotListTestJSON-1129348473 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.656s {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 25 15:58:42 devstack cinder-volume[83528]: INFO cinder.volume.manager [None req-f339d443-3aeb-482a-af4c-86135291fa63 tempest-VolumesSnapshotListTestJSON-1129348473 None] Create snapshot completed successfully Feb 25 15:58:42 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-410a61a7-196d-4cf0-a242-b573d70591ab tempest-VolumesSnapshotListTestJSON-1129348473 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 25 15:58:42 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-410a61a7-196d-4cf0-a242-b573d70591ab tempest-VolumesSnapshotListTestJSON-1129348473 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 25 15:58:42 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.remotefs [None req-410a61a7-196d-4cf0-a242-b573d70591ab tempest-VolumesSnapshotListTestJSON-1129348473 None] Creating offline snapshot ea9ac778-41b1-45ec-978e-fa2507b709c3 of volume 3fc37162-f4fc-47b7-9dc3-5489f5de5b91 {{(pid=83528) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Feb 25 15:58:42 devstack cinder-volume[83528]: DEBUG oslo.privsep.daemon [-] privsep: reply[310f2578-971b-4f7d-ada9-6b8310a01498]: (4, 'qcow2') {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 25 15:58:42 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-410a61a7-196d-4cf0-a242-b573d70591ab tempest-VolumesSnapshotListTestJSON-1129348473 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-3fc37162-f4fc-47b7-9dc3-5489f5de5b91.106ca414-4789-41a6-afde-c536e494dc0e {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 25 15:58:43 devstack sudo[89798]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-3fc37162-f4fc-47b7-9dc3-5489f5de5b91.106ca414-4789-41a6-afde-c536e494dc0e Feb 25 15:58:43 devstack sudo[89798]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 25 15:58:43 devstack sudo[89798]: pam_unix(sudo:session): session closed for user root Feb 25 15:58:43 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-410a61a7-196d-4cf0-a242-b573d70591ab tempest-VolumesSnapshotListTestJSON-1129348473 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-3fc37162-f4fc-47b7-9dc3-5489f5de5b91.106ca414-4789-41a6-afde-c536e494dc0e" returned: 0 in 0.698s {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 25 15:58:43 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.remotefs [None req-410a61a7-196d-4cf0-a242-b573d70591ab tempest-VolumesSnapshotListTestJSON-1129348473 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3fc37162-f4fc-47b7-9dc3-5489f5de5b91(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83528) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Feb 25 15:58:43 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-410a61a7-196d-4cf0-a242-b573d70591ab tempest-VolumesSnapshotListTestJSON-1129348473 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-3fc37162-f4fc-47b7-9dc3-5489f5de5b91.106ca414-4789-41a6-afde-c536e494dc0e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-3fc37162-f4fc-47b7-9dc3-5489f5de5b91.ea9ac778-41b1-45ec-978e-fa2507b709c3 1G {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 25 15:58:43 devstack sudo[89804]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-3fc37162-f4fc-47b7-9dc3-5489f5de5b91.106ca414-4789-41a6-afde-c536e494dc0e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-3fc37162-f4fc-47b7-9dc3-5489f5de5b91.ea9ac778-41b1-45ec-978e-fa2507b709c3 1G Feb 25 15:58:43 devstack sudo[89804]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 25 15:58:44 devstack sudo[89804]: pam_unix(sudo:session): session closed for user root Feb 25 15:58:44 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-410a61a7-196d-4cf0-a242-b573d70591ab tempest-VolumesSnapshotListTestJSON-1129348473 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-3fc37162-f4fc-47b7-9dc3-5489f5de5b91.106ca414-4789-41a6-afde-c536e494dc0e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-3fc37162-f4fc-47b7-9dc3-5489f5de5b91.ea9ac778-41b1-45ec-978e-fa2507b709c3 1G" returned: 0 in 0.639s {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 25 15:58:44 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-410a61a7-196d-4cf0-a242-b573d70591ab tempest-VolumesSnapshotListTestJSON-1129348473 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3fc37162-f4fc-47b7-9dc3-5489f5de5b91.106ca414-4789-41a6-afde-c536e494dc0e -F qcow2 /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-3fc37162-f4fc-47b7-9dc3-5489f5de5b91.ea9ac778-41b1-45ec-978e-fa2507b709c3 {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 25 15:58:44 devstack sudo[89826]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3fc37162-f4fc-47b7-9dc3-5489f5de5b91.106ca414-4789-41a6-afde-c536e494dc0e -F qcow2 /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-3fc37162-f4fc-47b7-9dc3-5489f5de5b91.ea9ac778-41b1-45ec-978e-fa2507b709c3 Feb 25 15:58:44 devstack sudo[89826]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 25 15:58:45 devstack sudo[89826]: pam_unix(sudo:session): session closed for user root Feb 25 15:58:45 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-410a61a7-196d-4cf0-a242-b573d70591ab tempest-VolumesSnapshotListTestJSON-1129348473 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3fc37162-f4fc-47b7-9dc3-5489f5de5b91.106ca414-4789-41a6-afde-c536e494dc0e -F qcow2 /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-3fc37162-f4fc-47b7-9dc3-5489f5de5b91.ea9ac778-41b1-45ec-978e-fa2507b709c3" returned: 0 in 0.864s {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 25 15:58:45 devstack cinder-volume[83528]: WARNING cinder.volume.drivers.remotefs [None req-410a61a7-196d-4cf0-a242-b573d70591ab tempest-VolumesSnapshotListTestJSON-1129348473 None] /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-3fc37162-f4fc-47b7-9dc3-5489f5de5b91.ea9ac778-41b1-45ec-978e-fa2507b709c3 is being set with open permissions: ugo+rw Feb 25 15:58:45 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-410a61a7-196d-4cf0-a242-b573d70591ab tempest-VolumesSnapshotListTestJSON-1129348473 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-3fc37162-f4fc-47b7-9dc3-5489f5de5b91.ea9ac778-41b1-45ec-978e-fa2507b709c3 {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 25 15:58:45 devstack sudo[89841]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-3fc37162-f4fc-47b7-9dc3-5489f5de5b91.ea9ac778-41b1-45ec-978e-fa2507b709c3 Feb 25 15:58:45 devstack sudo[89841]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 25 15:58:45 devstack sudo[89841]: pam_unix(sudo:session): session closed for user root Feb 25 15:58:45 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-410a61a7-196d-4cf0-a242-b573d70591ab tempest-VolumesSnapshotListTestJSON-1129348473 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-3fc37162-f4fc-47b7-9dc3-5489f5de5b91.ea9ac778-41b1-45ec-978e-fa2507b709c3" returned: 0 in 0.643s {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 25 15:58:45 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-410a61a7-196d-4cf0-a242-b573d70591ab tempest-VolumesSnapshotListTestJSON-1129348473 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.929s {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 25 15:58:45 devstack cinder-volume[83528]: INFO cinder.volume.manager [None req-410a61a7-196d-4cf0-a242-b573d70591ab tempest-VolumesSnapshotListTestJSON-1129348473 None] Create snapshot completed successfully Feb 25 15:58:46 devstack cinder-volume[83528]: DEBUG cinder.coordination [None req-1a884172-1fd8-46ff-8de4-0c7014f8b4b6 tempest-VolumesSnapshotListTestJSON-1129348473 None] Acquiring lock "cinder-ea9ac778-41b1-45ec-978e-fa2507b709c3-delete_snapshot" by "delete_snapshot" {{(pid=83528) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 25 15:58:46 devstack cinder-volume[83528]: DEBUG cinder.coordination [None req-1a884172-1fd8-46ff-8de4-0c7014f8b4b6 tempest-VolumesSnapshotListTestJSON-1129348473 None] Lock "cinder-ea9ac778-41b1-45ec-978e-fa2507b709c3-delete_snapshot" acquired by "delete_snapshot" :: waited 0.010s {{(pid=83528) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 25 15:58:46 devstack cinder-volume[83528]: DEBUG cinder.coordination [None req-1a884172-1fd8-46ff-8de4-0c7014f8b4b6 tempest-VolumesSnapshotListTestJSON-1129348473 None] Acquiring lock "cinder-quobyte-3fc37162-f4fc-47b7-9dc3-5489f5de5b91" by "delete_snapshot" {{(pid=83528) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 25 15:58:46 devstack cinder-volume[83528]: DEBUG cinder.coordination [None req-1a884172-1fd8-46ff-8de4-0c7014f8b4b6 tempest-VolumesSnapshotListTestJSON-1129348473 None] Lock "cinder-quobyte-3fc37162-f4fc-47b7-9dc3-5489f5de5b91" acquired by "delete_snapshot" :: waited 0.012s {{(pid=83528) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 25 15:58:46 devstack cinder-volume[83528]: DEBUG cinder.coordination [None req-1a884172-1fd8-46ff-8de4-0c7014f8b4b6 tempest-VolumesSnapshotListTestJSON-1129348473 None] Acquiring lock "cinder-quobyte-ea9ac778-41b1-45ec-978e-fa2507b709c3" by "_delete_snapshot" {{(pid=83528) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 25 15:58:46 devstack cinder-volume[83528]: DEBUG cinder.coordination [None req-1a884172-1fd8-46ff-8de4-0c7014f8b4b6 tempest-VolumesSnapshotListTestJSON-1129348473 None] Lock "cinder-quobyte-ea9ac778-41b1-45ec-978e-fa2507b709c3" acquired by "_delete_snapshot" :: waited 0.009s {{(pid=83528) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 25 15:58:46 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.remotefs [None req-1a884172-1fd8-46ff-8de4-0c7014f8b4b6 tempest-VolumesSnapshotListTestJSON-1129348473 None] Deleting offline snapshot ea9ac778-41b1-45ec-978e-fa2507b709c3 of volume 3fc37162-f4fc-47b7-9dc3-5489f5de5b91 {{(pid=83528) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Feb 25 15:58:46 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.remotefs [None req-1a884172-1fd8-46ff-8de4-0c7014f8b4b6 tempest-VolumesSnapshotListTestJSON-1129348473 None] snapshot_file for this snap is: volume-3fc37162-f4fc-47b7-9dc3-5489f5de5b91.ea9ac778-41b1-45ec-978e-fa2507b709c3 {{(pid=83528) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Feb 25 15:58:46 devstack cinder-volume[83528]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d6bd9d6-69f1-425a-8385-0425f425589b]: (4, 'qcow2') {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 25 15:58:46 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-1a884172-1fd8-46ff-8de4-0c7014f8b4b6 tempest-VolumesSnapshotListTestJSON-1129348473 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-3fc37162-f4fc-47b7-9dc3-5489f5de5b91.ea9ac778-41b1-45ec-978e-fa2507b709c3 {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 25 15:58:46 devstack sudo[89846]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-3fc37162-f4fc-47b7-9dc3-5489f5de5b91.ea9ac778-41b1-45ec-978e-fa2507b709c3 Feb 25 15:58:46 devstack sudo[89846]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 25 15:58:47 devstack cinder-volume[83528]: DEBUG cinder.coordination [None req-1fbce2d5-c4d3-49c1-8f90-8177ad35cd0c tempest-VolumesActionsTest-1208865286 None] Acquiring lock "cinder-287168fc-0786-4716-8f23-273489f2849c" by "attach_volume" {{(pid=83528) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 25 15:58:47 devstack cinder-volume[83528]: DEBUG cinder.coordination [None req-1fbce2d5-c4d3-49c1-8f90-8177ad35cd0c tempest-VolumesActionsTest-1208865286 None] Lock "cinder-287168fc-0786-4716-8f23-273489f2849c" acquired by "attach_volume" :: waited 0.013s {{(pid=83528) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 25 15:58:47 devstack cinder-volume[83528]: INFO cinder.volume.manager [None req-1fbce2d5-c4d3-49c1-8f90-8177ad35cd0c tempest-VolumesActionsTest-1208865286 None] Attaching volume 287168fc-0786-4716-8f23-273489f2849c to instance ac90138a-1efd-4eac-8f52-94f5404791d0 at mountpoint /dev/vdb on host None. Feb 25 15:58:47 devstack cinder-volume[83528]: INFO cinder.volume.manager [None req-1fbce2d5-c4d3-49c1-8f90-8177ad35cd0c tempest-VolumesActionsTest-1208865286 None] Attach volume completed successfully. Feb 25 15:58:47 devstack cinder-volume[83528]: DEBUG cinder.coordination [None req-1fbce2d5-c4d3-49c1-8f90-8177ad35cd0c tempest-VolumesActionsTest-1208865286 None] Lock "cinder-287168fc-0786-4716-8f23-273489f2849c" released by "attach_volume" :: held 0.075s {{(pid=83528) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 25 15:58:47 devstack sudo[89846]: pam_unix(sudo:session): session closed for user root Feb 25 15:58:47 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-1a884172-1fd8-46ff-8de4-0c7014f8b4b6 tempest-VolumesSnapshotListTestJSON-1129348473 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-3fc37162-f4fc-47b7-9dc3-5489f5de5b91.ea9ac778-41b1-45ec-978e-fa2507b709c3" returned: 0 in 0.641s {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 25 15:58:47 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.remotefs [None req-1a884172-1fd8-46ff-8de4-0c7014f8b4b6 tempest-VolumesSnapshotListTestJSON-1129348473 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3fc37162-f4fc-47b7-9dc3-5489f5de5b91(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83528) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Feb 25 15:58:47 devstack cinder-volume[83528]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb85dc71-7966-4015-9ddf-3103a991fad9]: (4, 'qcow2') {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 25 15:58:47 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-1a884172-1fd8-46ff-8de4-0c7014f8b4b6 tempest-VolumesSnapshotListTestJSON-1129348473 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-3fc37162-f4fc-47b7-9dc3-5489f5de5b91.106ca414-4789-41a6-afde-c536e494dc0e {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 25 15:58:47 devstack sudo[89851]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-3fc37162-f4fc-47b7-9dc3-5489f5de5b91.106ca414-4789-41a6-afde-c536e494dc0e Feb 25 15:58:47 devstack sudo[89851]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 25 15:58:47 devstack cinder-volume[83528]: DEBUG cinder.coordination [None req-3dafe280-0410-401d-9ec6-99a19df4cf54 tempest-VolumesActionsTest-1208865286 None] Acquiring lock "cinder-287168fc-0786-4716-8f23-273489f2849c-detach_volume" by "detach_volume" {{(pid=83528) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 25 15:58:47 devstack cinder-volume[83528]: DEBUG cinder.coordination [None req-3dafe280-0410-401d-9ec6-99a19df4cf54 tempest-VolumesActionsTest-1208865286 None] Lock "cinder-287168fc-0786-4716-8f23-273489f2849c-detach_volume" acquired by "detach_volume" :: waited 0.016s {{(pid=83528) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 25 15:58:47 devstack cinder-volume[83528]: INFO cinder.volume.manager [None req-3dafe280-0410-401d-9ec6-99a19df4cf54 tempest-VolumesActionsTest-1208865286 None] Detaching volume 287168fc-0786-4716-8f23-273489f2849c from instance ac90138a-1efd-4eac-8f52-94f5404791d0. Feb 25 15:58:47 devstack cinder-volume[83528]: INFO cinder.volume.manager [None req-3dafe280-0410-401d-9ec6-99a19df4cf54 tempest-VolumesActionsTest-1208865286 None] Detach volume completed successfully. Feb 25 15:58:47 devstack cinder-volume[83528]: DEBUG cinder.coordination [None req-3dafe280-0410-401d-9ec6-99a19df4cf54 tempest-VolumesActionsTest-1208865286 None] Lock "cinder-287168fc-0786-4716-8f23-273489f2849c-detach_volume" released by "detach_volume" :: held 0.046s {{(pid=83528) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 25 15:58:48 devstack sudo[89851]: pam_unix(sudo:session): session closed for user root Feb 25 15:58:48 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-1a884172-1fd8-46ff-8de4-0c7014f8b4b6 tempest-VolumesSnapshotListTestJSON-1129348473 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-3fc37162-f4fc-47b7-9dc3-5489f5de5b91.106ca414-4789-41a6-afde-c536e494dc0e" returned: 0 in 0.662s {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 25 15:58:48 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.remotefs [None req-1a884172-1fd8-46ff-8de4-0c7014f8b4b6 tempest-VolumesSnapshotListTestJSON-1129348473 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3fc37162-f4fc-47b7-9dc3-5489f5de5b91(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83528) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Feb 25 15:58:48 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-1a884172-1fd8-46ff-8de4-0c7014f8b4b6 tempest-VolumesSnapshotListTestJSON-1129348473 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-3fc37162-f4fc-47b7-9dc3-5489f5de5b91.ea9ac778-41b1-45ec-978e-fa2507b709c3 {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 25 15:58:48 devstack sudo[89856]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-3fc37162-f4fc-47b7-9dc3-5489f5de5b91.ea9ac778-41b1-45ec-978e-fa2507b709c3 Feb 25 15:58:48 devstack sudo[89856]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 25 15:58:48 devstack sudo[89856]: pam_unix(sudo:session): session closed for user root Feb 25 15:58:48 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-1a884172-1fd8-46ff-8de4-0c7014f8b4b6 tempest-VolumesSnapshotListTestJSON-1129348473 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-3fc37162-f4fc-47b7-9dc3-5489f5de5b91.ea9ac778-41b1-45ec-978e-fa2507b709c3" returned: 0 in 0.621s {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 25 15:58:48 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-1a884172-1fd8-46ff-8de4-0c7014f8b4b6 tempest-VolumesSnapshotListTestJSON-1129348473 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-3fc37162-f4fc-47b7-9dc3-5489f5de5b91.ea9ac778-41b1-45ec-978e-fa2507b709c3 {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 25 15:58:48 devstack sudo[89861]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-3fc37162-f4fc-47b7-9dc3-5489f5de5b91.ea9ac778-41b1-45ec-978e-fa2507b709c3 Feb 25 15:58:48 devstack sudo[89861]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 25 15:58:49 devstack sudo[89861]: pam_unix(sudo:session): session closed for user root Feb 25 15:58:49 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-1a884172-1fd8-46ff-8de4-0c7014f8b4b6 tempest-VolumesSnapshotListTestJSON-1129348473 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-3fc37162-f4fc-47b7-9dc3-5489f5de5b91.ea9ac778-41b1-45ec-978e-fa2507b709c3" returned: 0 in 0.457s {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 25 15:58:49 devstack cinder-volume[83528]: DEBUG cinder.coordination [None req-1a884172-1fd8-46ff-8de4-0c7014f8b4b6 tempest-VolumesSnapshotListTestJSON-1129348473 None] Lock "cinder-quobyte-ea9ac778-41b1-45ec-978e-fa2507b709c3" released by "_delete_snapshot" :: held 2.457s {{(pid=83528) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 25 15:58:49 devstack cinder-volume[83528]: DEBUG cinder.coordination [None req-1a884172-1fd8-46ff-8de4-0c7014f8b4b6 tempest-VolumesSnapshotListTestJSON-1129348473 None] Lock "cinder-quobyte-3fc37162-f4fc-47b7-9dc3-5489f5de5b91" released by "delete_snapshot" :: held 2.471s {{(pid=83528) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 25 15:58:49 devstack cinder-volume[83528]: DEBUG cinder.quota [None req-1a884172-1fd8-46ff-8de4-0c7014f8b4b6 tempest-VolumesSnapshotListTestJSON-1129348473 None] Created reservations ['8cb98e87-b61b-4b4a-aec9-a7f84becab99', '61bf5e95-74f9-49b7-8c93-5a1cbeff92cd', 'a4e83733-99ee-4fb2-b824-7066d39b8bde', 'f26e9442-c1b6-4053-82ab-f01679249f2d'] {{(pid=83528) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 25 15:58:49 devstack cinder-volume[83528]: INFO cinder.volume.manager [None req-1a884172-1fd8-46ff-8de4-0c7014f8b4b6 tempest-VolumesSnapshotListTestJSON-1129348473 None] Delete snapshot completed successfully. Feb 25 15:58:49 devstack cinder-volume[83528]: DEBUG cinder.coordination [None req-1a884172-1fd8-46ff-8de4-0c7014f8b4b6 tempest-VolumesSnapshotListTestJSON-1129348473 None] Lock "cinder-ea9ac778-41b1-45ec-978e-fa2507b709c3-delete_snapshot" released by "delete_snapshot" :: held 2.575s {{(pid=83528) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 25 15:58:49 devstack cinder-volume[83528]: DEBUG cinder.coordination [None req-78cada7e-bb3b-4e9d-8379-dc8ac1755748 tempest-VolumesSnapshotListTestJSON-1129348473 None] Acquiring lock "cinder-106ca414-4789-41a6-afde-c536e494dc0e-delete_snapshot" by "delete_snapshot" {{(pid=83528) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 25 15:58:49 devstack cinder-volume[83528]: DEBUG cinder.coordination [None req-78cada7e-bb3b-4e9d-8379-dc8ac1755748 tempest-VolumesSnapshotListTestJSON-1129348473 None] Lock "cinder-106ca414-4789-41a6-afde-c536e494dc0e-delete_snapshot" acquired by "delete_snapshot" :: waited 0.015s {{(pid=83528) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 25 15:58:49 devstack cinder-volume[83528]: DEBUG cinder.coordination [None req-78cada7e-bb3b-4e9d-8379-dc8ac1755748 tempest-VolumesSnapshotListTestJSON-1129348473 None] Acquiring lock "cinder-quobyte-3fc37162-f4fc-47b7-9dc3-5489f5de5b91" by "delete_snapshot" {{(pid=83528) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 25 15:58:49 devstack cinder-volume[83528]: DEBUG cinder.coordination [None req-78cada7e-bb3b-4e9d-8379-dc8ac1755748 tempest-VolumesSnapshotListTestJSON-1129348473 None] Lock "cinder-quobyte-3fc37162-f4fc-47b7-9dc3-5489f5de5b91" acquired by "delete_snapshot" :: waited 0.015s {{(pid=83528) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 25 15:58:49 devstack cinder-volume[83528]: DEBUG cinder.coordination [None req-78cada7e-bb3b-4e9d-8379-dc8ac1755748 tempest-VolumesSnapshotListTestJSON-1129348473 None] Acquiring lock "cinder-quobyte-106ca414-4789-41a6-afde-c536e494dc0e" by "_delete_snapshot" {{(pid=83528) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 25 15:58:49 devstack cinder-volume[83528]: DEBUG cinder.coordination [None req-78cada7e-bb3b-4e9d-8379-dc8ac1755748 tempest-VolumesSnapshotListTestJSON-1129348473 None] Lock "cinder-quobyte-106ca414-4789-41a6-afde-c536e494dc0e" acquired by "_delete_snapshot" :: waited 0.010s {{(pid=83528) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 25 15:58:49 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.remotefs [None req-78cada7e-bb3b-4e9d-8379-dc8ac1755748 tempest-VolumesSnapshotListTestJSON-1129348473 None] Deleting offline snapshot 106ca414-4789-41a6-afde-c536e494dc0e of volume 3fc37162-f4fc-47b7-9dc3-5489f5de5b91 {{(pid=83528) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Feb 25 15:58:49 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.remotefs [None req-78cada7e-bb3b-4e9d-8379-dc8ac1755748 tempest-VolumesSnapshotListTestJSON-1129348473 None] snapshot_file for this snap is: volume-3fc37162-f4fc-47b7-9dc3-5489f5de5b91.106ca414-4789-41a6-afde-c536e494dc0e {{(pid=83528) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Feb 25 15:58:49 devstack cinder-volume[83528]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f499f5c-6d9d-4bd0-993c-ea081364efc3]: (4, 'qcow2') {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 25 15:58:49 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-78cada7e-bb3b-4e9d-8379-dc8ac1755748 tempest-VolumesSnapshotListTestJSON-1129348473 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-3fc37162-f4fc-47b7-9dc3-5489f5de5b91.106ca414-4789-41a6-afde-c536e494dc0e {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 25 15:58:50 devstack sudo[89889]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-3fc37162-f4fc-47b7-9dc3-5489f5de5b91.106ca414-4789-41a6-afde-c536e494dc0e Feb 25 15:58:50 devstack sudo[89889]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 25 15:58:50 devstack sudo[89889]: pam_unix(sudo:session): session closed for user root Feb 25 15:58:50 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-78cada7e-bb3b-4e9d-8379-dc8ac1755748 tempest-VolumesSnapshotListTestJSON-1129348473 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-3fc37162-f4fc-47b7-9dc3-5489f5de5b91.106ca414-4789-41a6-afde-c536e494dc0e" returned: 0 in 0.614s {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 25 15:58:50 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.remotefs [None req-78cada7e-bb3b-4e9d-8379-dc8ac1755748 tempest-VolumesSnapshotListTestJSON-1129348473 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3fc37162-f4fc-47b7-9dc3-5489f5de5b91(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83528) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Feb 25 15:58:50 devstack cinder-volume[83528]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9f1a93f-d116-40a0-969a-8d6b044e4abd]: (4, 'qcow2') {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 25 15:58:50 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-78cada7e-bb3b-4e9d-8379-dc8ac1755748 tempest-VolumesSnapshotListTestJSON-1129348473 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-3fc37162-f4fc-47b7-9dc3-5489f5de5b91.bfadbb56-25c0-4f1b-8f34-02cf6a6be05b {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 25 15:58:50 devstack sudo[89895]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-3fc37162-f4fc-47b7-9dc3-5489f5de5b91.bfadbb56-25c0-4f1b-8f34-02cf6a6be05b Feb 25 15:58:50 devstack sudo[89895]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 25 15:58:51 devstack sudo[89895]: pam_unix(sudo:session): session closed for user root Feb 25 15:58:51 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-78cada7e-bb3b-4e9d-8379-dc8ac1755748 tempest-VolumesSnapshotListTestJSON-1129348473 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-3fc37162-f4fc-47b7-9dc3-5489f5de5b91.bfadbb56-25c0-4f1b-8f34-02cf6a6be05b" returned: 0 in 0.538s {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 25 15:58:51 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.remotefs [None req-78cada7e-bb3b-4e9d-8379-dc8ac1755748 tempest-VolumesSnapshotListTestJSON-1129348473 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3fc37162-f4fc-47b7-9dc3-5489f5de5b91(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83528) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Feb 25 15:58:51 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-78cada7e-bb3b-4e9d-8379-dc8ac1755748 tempest-VolumesSnapshotListTestJSON-1129348473 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-3fc37162-f4fc-47b7-9dc3-5489f5de5b91.106ca414-4789-41a6-afde-c536e494dc0e {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 25 15:58:51 devstack sudo[89900]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-3fc37162-f4fc-47b7-9dc3-5489f5de5b91.106ca414-4789-41a6-afde-c536e494dc0e Feb 25 15:58:51 devstack sudo[89900]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 25 15:58:51 devstack sudo[89900]: pam_unix(sudo:session): session closed for user root Feb 25 15:58:51 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-78cada7e-bb3b-4e9d-8379-dc8ac1755748 tempest-VolumesSnapshotListTestJSON-1129348473 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-3fc37162-f4fc-47b7-9dc3-5489f5de5b91.106ca414-4789-41a6-afde-c536e494dc0e" returned: 0 in 0.525s {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 25 15:58:51 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-78cada7e-bb3b-4e9d-8379-dc8ac1755748 tempest-VolumesSnapshotListTestJSON-1129348473 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-3fc37162-f4fc-47b7-9dc3-5489f5de5b91.106ca414-4789-41a6-afde-c536e494dc0e {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 25 15:58:51 devstack sudo[89906]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-3fc37162-f4fc-47b7-9dc3-5489f5de5b91.106ca414-4789-41a6-afde-c536e494dc0e Feb 25 15:58:51 devstack sudo[89906]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 25 15:58:52 devstack sudo[89906]: pam_unix(sudo:session): session closed for user root Feb 25 15:58:52 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-78cada7e-bb3b-4e9d-8379-dc8ac1755748 tempest-VolumesSnapshotListTestJSON-1129348473 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-3fc37162-f4fc-47b7-9dc3-5489f5de5b91.106ca414-4789-41a6-afde-c536e494dc0e" returned: 0 in 0.468s {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 25 15:58:52 devstack cinder-volume[83528]: DEBUG cinder.coordination [None req-78cada7e-bb3b-4e9d-8379-dc8ac1755748 tempest-VolumesSnapshotListTestJSON-1129348473 None] Lock "cinder-quobyte-106ca414-4789-41a6-afde-c536e494dc0e" released by "_delete_snapshot" :: held 2.198s {{(pid=83528) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 25 15:58:52 devstack cinder-volume[83528]: DEBUG cinder.coordination [None req-78cada7e-bb3b-4e9d-8379-dc8ac1755748 tempest-VolumesSnapshotListTestJSON-1129348473 None] Lock "cinder-quobyte-3fc37162-f4fc-47b7-9dc3-5489f5de5b91" released by "delete_snapshot" :: held 2.213s {{(pid=83528) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 25 15:58:52 devstack cinder-volume[83528]: DEBUG cinder.quota [None req-78cada7e-bb3b-4e9d-8379-dc8ac1755748 tempest-VolumesSnapshotListTestJSON-1129348473 None] Created reservations ['5c598448-468c-4189-9b88-d712972f46af', '84b1acae-f50c-44ce-babc-71004634a236', '462a57ef-02b8-4db7-a5a9-1f995b61cb44', '51749c96-8d85-4a29-919d-e26687dae456'] {{(pid=83528) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 25 15:58:52 devstack cinder-volume[83528]: INFO cinder.volume.manager [None req-78cada7e-bb3b-4e9d-8379-dc8ac1755748 tempest-VolumesSnapshotListTestJSON-1129348473 None] Delete snapshot completed successfully. Feb 25 15:58:52 devstack cinder-volume[83528]: DEBUG cinder.coordination [None req-78cada7e-bb3b-4e9d-8379-dc8ac1755748 tempest-VolumesSnapshotListTestJSON-1129348473 None] Lock "cinder-106ca414-4789-41a6-afde-c536e494dc0e-delete_snapshot" released by "delete_snapshot" :: held 2.326s {{(pid=83528) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 25 15:58:53 devstack cinder-volume[83528]: DEBUG cinder.coordination [None req-4a258078-1644-4ef8-bb3a-cf1286150442 tempest-VolumesSnapshotListTestJSON-1129348473 None] Acquiring lock "cinder-bfadbb56-25c0-4f1b-8f34-02cf6a6be05b-delete_snapshot" by "delete_snapshot" {{(pid=83528) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 25 15:58:53 devstack cinder-volume[83528]: DEBUG cinder.coordination [None req-4a258078-1644-4ef8-bb3a-cf1286150442 tempest-VolumesSnapshotListTestJSON-1129348473 None] Lock "cinder-bfadbb56-25c0-4f1b-8f34-02cf6a6be05b-delete_snapshot" acquired by "delete_snapshot" :: waited 0.011s {{(pid=83528) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 25 15:58:53 devstack cinder-volume[83528]: DEBUG cinder.coordination [None req-4a258078-1644-4ef8-bb3a-cf1286150442 tempest-VolumesSnapshotListTestJSON-1129348473 None] Acquiring lock "cinder-quobyte-3fc37162-f4fc-47b7-9dc3-5489f5de5b91" by "delete_snapshot" {{(pid=83528) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 25 15:58:53 devstack cinder-volume[83528]: DEBUG cinder.coordination [None req-4a258078-1644-4ef8-bb3a-cf1286150442 tempest-VolumesSnapshotListTestJSON-1129348473 None] Lock "cinder-quobyte-3fc37162-f4fc-47b7-9dc3-5489f5de5b91" acquired by "delete_snapshot" :: waited 0.011s {{(pid=83528) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 25 15:58:53 devstack cinder-volume[83528]: DEBUG cinder.coordination [None req-4a258078-1644-4ef8-bb3a-cf1286150442 tempest-VolumesSnapshotListTestJSON-1129348473 None] Acquiring lock "cinder-quobyte-bfadbb56-25c0-4f1b-8f34-02cf6a6be05b" by "_delete_snapshot" {{(pid=83528) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 25 15:58:53 devstack cinder-volume[83528]: DEBUG cinder.coordination [None req-4a258078-1644-4ef8-bb3a-cf1286150442 tempest-VolumesSnapshotListTestJSON-1129348473 None] Lock "cinder-quobyte-bfadbb56-25c0-4f1b-8f34-02cf6a6be05b" acquired by "_delete_snapshot" :: waited 0.008s {{(pid=83528) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 25 15:58:53 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.remotefs [None req-4a258078-1644-4ef8-bb3a-cf1286150442 tempest-VolumesSnapshotListTestJSON-1129348473 None] Deleting offline snapshot bfadbb56-25c0-4f1b-8f34-02cf6a6be05b of volume 3fc37162-f4fc-47b7-9dc3-5489f5de5b91 {{(pid=83528) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Feb 25 15:58:53 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.remotefs [None req-4a258078-1644-4ef8-bb3a-cf1286150442 tempest-VolumesSnapshotListTestJSON-1129348473 None] snapshot_file for this snap is: volume-3fc37162-f4fc-47b7-9dc3-5489f5de5b91.bfadbb56-25c0-4f1b-8f34-02cf6a6be05b {{(pid=83528) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Feb 25 15:58:53 devstack cinder-volume[83528]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb8eb51d-8f25-4509-ae51-70a95c1d3cea]: (4, 'qcow2') {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 25 15:58:53 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-4a258078-1644-4ef8-bb3a-cf1286150442 tempest-VolumesSnapshotListTestJSON-1129348473 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-3fc37162-f4fc-47b7-9dc3-5489f5de5b91.bfadbb56-25c0-4f1b-8f34-02cf6a6be05b {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 25 15:58:53 devstack sudo[89909]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-3fc37162-f4fc-47b7-9dc3-5489f5de5b91.bfadbb56-25c0-4f1b-8f34-02cf6a6be05b Feb 25 15:58:53 devstack sudo[89909]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 25 15:58:53 devstack sudo[89909]: pam_unix(sudo:session): session closed for user root Feb 25 15:58:53 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-4a258078-1644-4ef8-bb3a-cf1286150442 tempest-VolumesSnapshotListTestJSON-1129348473 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-3fc37162-f4fc-47b7-9dc3-5489f5de5b91.bfadbb56-25c0-4f1b-8f34-02cf6a6be05b" returned: 0 in 0.551s {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 25 15:58:53 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.remotefs [None req-4a258078-1644-4ef8-bb3a-cf1286150442 tempest-VolumesSnapshotListTestJSON-1129348473 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3fc37162-f4fc-47b7-9dc3-5489f5de5b91(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83528) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Feb 25 15:58:53 devstack cinder-volume[83528]: DEBUG oslo.privsep.daemon [-] privsep: reply[c71acf4b-bfae-43ab-9b46-acf0c6ac6e78]: (4, 'qcow2') {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 25 15:58:53 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-4a258078-1644-4ef8-bb3a-cf1286150442 tempest-VolumesSnapshotListTestJSON-1129348473 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-3fc37162-f4fc-47b7-9dc3-5489f5de5b91 {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 25 15:58:53 devstack sudo[89914]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-3fc37162-f4fc-47b7-9dc3-5489f5de5b91 Feb 25 15:58:53 devstack sudo[89914]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 25 15:58:54 devstack sudo[89914]: pam_unix(sudo:session): session closed for user root Feb 25 15:58:54 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-4a258078-1644-4ef8-bb3a-cf1286150442 tempest-VolumesSnapshotListTestJSON-1129348473 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-3fc37162-f4fc-47b7-9dc3-5489f5de5b91" returned: 0 in 0.534s {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 25 15:58:54 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-4a258078-1644-4ef8-bb3a-cf1286150442 tempest-VolumesSnapshotListTestJSON-1129348473 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-3fc37162-f4fc-47b7-9dc3-5489f5de5b91.bfadbb56-25c0-4f1b-8f34-02cf6a6be05b {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 25 15:58:54 devstack sudo[89919]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-3fc37162-f4fc-47b7-9dc3-5489f5de5b91.bfadbb56-25c0-4f1b-8f34-02cf6a6be05b Feb 25 15:58:54 devstack sudo[89919]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 25 15:58:54 devstack sudo[89919]: pam_unix(sudo:session): session closed for user root Feb 25 15:58:54 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-4a258078-1644-4ef8-bb3a-cf1286150442 tempest-VolumesSnapshotListTestJSON-1129348473 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-3fc37162-f4fc-47b7-9dc3-5489f5de5b91.bfadbb56-25c0-4f1b-8f34-02cf6a6be05b" returned: 0 in 0.489s {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 25 15:58:54 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-4a258078-1644-4ef8-bb3a-cf1286150442 tempest-VolumesSnapshotListTestJSON-1129348473 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-3fc37162-f4fc-47b7-9dc3-5489f5de5b91.bfadbb56-25c0-4f1b-8f34-02cf6a6be05b {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 25 15:58:54 devstack sudo[89925]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-3fc37162-f4fc-47b7-9dc3-5489f5de5b91.bfadbb56-25c0-4f1b-8f34-02cf6a6be05b Feb 25 15:58:54 devstack sudo[89925]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 25 15:58:55 devstack sudo[89925]: pam_unix(sudo:session): session closed for user root Feb 25 15:58:55 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-4a258078-1644-4ef8-bb3a-cf1286150442 tempest-VolumesSnapshotListTestJSON-1129348473 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-3fc37162-f4fc-47b7-9dc3-5489f5de5b91.bfadbb56-25c0-4f1b-8f34-02cf6a6be05b" returned: 0 in 0.479s {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 25 15:58:55 devstack cinder-volume[83528]: DEBUG cinder.coordination [None req-4a258078-1644-4ef8-bb3a-cf1286150442 tempest-VolumesSnapshotListTestJSON-1129348473 None] Lock "cinder-quobyte-bfadbb56-25c0-4f1b-8f34-02cf6a6be05b" released by "_delete_snapshot" :: held 2.126s {{(pid=83528) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 25 15:58:55 devstack cinder-volume[83528]: DEBUG cinder.coordination [None req-4a258078-1644-4ef8-bb3a-cf1286150442 tempest-VolumesSnapshotListTestJSON-1129348473 None] Lock "cinder-quobyte-3fc37162-f4fc-47b7-9dc3-5489f5de5b91" released by "delete_snapshot" :: held 2.145s {{(pid=83528) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 25 15:58:55 devstack cinder-volume[83528]: DEBUG cinder.quota [None req-4a258078-1644-4ef8-bb3a-cf1286150442 tempest-VolumesSnapshotListTestJSON-1129348473 None] Created reservations ['853e6aa8-0312-4449-acf4-96bbaf4d4cb6', 'ed325226-0ace-4b46-91c9-a4ffa0812e81', '10c329a1-66f5-4fac-a951-cf549842851b', '71d9aeb9-ae85-44b3-9cfb-cb6c10475105'] {{(pid=83528) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 25 15:58:55 devstack cinder-volume[83528]: INFO cinder.volume.manager [None req-4a258078-1644-4ef8-bb3a-cf1286150442 tempest-VolumesSnapshotListTestJSON-1129348473 None] Delete snapshot completed successfully. Feb 25 15:58:55 devstack cinder-volume[83528]: DEBUG cinder.coordination [None req-4a258078-1644-4ef8-bb3a-cf1286150442 tempest-VolumesSnapshotListTestJSON-1129348473 None] Lock "cinder-bfadbb56-25c0-4f1b-8f34-02cf6a6be05b-delete_snapshot" released by "delete_snapshot" :: held 2.265s {{(pid=83528) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 25 15:58:56 devstack cinder-volume[83528]: DEBUG cinder.coordination [None req-aebc375c-2b21-44f9-ac3e-6d1d0a7c62f9 tempest-VolumesSnapshotListTestJSON-1129348473 None] Acquiring lock "cinder-3fc37162-f4fc-47b7-9dc3-5489f5de5b91-delete_volume" by "delete_volume" {{(pid=83528) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 25 15:58:56 devstack cinder-volume[83528]: DEBUG cinder.coordination [None req-aebc375c-2b21-44f9-ac3e-6d1d0a7c62f9 tempest-VolumesSnapshotListTestJSON-1129348473 None] Lock "cinder-3fc37162-f4fc-47b7-9dc3-5489f5de5b91-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=83528) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 25 15:58:56 devstack cinder-volume[83528]: DEBUG cinder.coordination [None req-aebc375c-2b21-44f9-ac3e-6d1d0a7c62f9 tempest-VolumesSnapshotListTestJSON-1129348473 None] Acquiring lock "cinder-quobyte-3fc37162-f4fc-47b7-9dc3-5489f5de5b91" by "delete_volume" {{(pid=83528) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 25 15:58:56 devstack cinder-volume[83528]: DEBUG cinder.coordination [None req-aebc375c-2b21-44f9-ac3e-6d1d0a7c62f9 tempest-VolumesSnapshotListTestJSON-1129348473 None] Lock "cinder-quobyte-3fc37162-f4fc-47b7-9dc3-5489f5de5b91" acquired by "delete_volume" :: waited 0.009s {{(pid=83528) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 25 15:58:56 devstack cinder-volume[83528]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c0f27ff-b36e-405c-bced-b5410af57880]: (4, 'qcow2') {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 25 15:58:56 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-aebc375c-2b21-44f9-ac3e-6d1d0a7c62f9 tempest-VolumesSnapshotListTestJSON-1129348473 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-3fc37162-f4fc-47b7-9dc3-5489f5de5b91 {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 25 15:58:56 devstack sudo[89930]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-3fc37162-f4fc-47b7-9dc3-5489f5de5b91 Feb 25 15:58:56 devstack sudo[89930]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 25 15:58:57 devstack sudo[89930]: pam_unix(sudo:session): session closed for user root Feb 25 15:58:57 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-aebc375c-2b21-44f9-ac3e-6d1d0a7c62f9 tempest-VolumesSnapshotListTestJSON-1129348473 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-3fc37162-f4fc-47b7-9dc3-5489f5de5b91" returned: 0 in 0.532s {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 25 15:58:57 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-aebc375c-2b21-44f9-ac3e-6d1d0a7c62f9 tempest-VolumesSnapshotListTestJSON-1129348473 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-3fc37162-f4fc-47b7-9dc3-5489f5de5b91 {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 25 15:58:57 devstack sudo[89935]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-3fc37162-f4fc-47b7-9dc3-5489f5de5b91 Feb 25 15:58:57 devstack sudo[89935]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 25 15:58:57 devstack sudo[89935]: pam_unix(sudo:session): session closed for user root Feb 25 15:58:57 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-aebc375c-2b21-44f9-ac3e-6d1d0a7c62f9 tempest-VolumesSnapshotListTestJSON-1129348473 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-3fc37162-f4fc-47b7-9dc3-5489f5de5b91" returned: 0 in 0.467s {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 25 15:58:57 devstack cinder-volume[83528]: DEBUG cinder.coordination [None req-aebc375c-2b21-44f9-ac3e-6d1d0a7c62f9 tempest-VolumesSnapshotListTestJSON-1129348473 None] Lock "cinder-quobyte-3fc37162-f4fc-47b7-9dc3-5489f5de5b91" released by "delete_volume" :: held 1.046s {{(pid=83528) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 25 15:58:57 devstack cinder-volume[83528]: DEBUG cinder.quota [None req-aebc375c-2b21-44f9-ac3e-6d1d0a7c62f9 tempest-VolumesSnapshotListTestJSON-1129348473 None] Created reservations ['68ca9639-eb77-4340-ae56-f21503b1da92', '7a9aac06-8197-4950-88c4-5f9714b6b9cc', '510d0fe3-77f1-4503-a99a-75eed253d901', '6ea80eda-7600-4039-89ba-2c386535fbee'] {{(pid=83528) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 25 15:58:57 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-aebc375c-2b21-44f9-ac3e-6d1d0a7c62f9 tempest-VolumesSnapshotListTestJSON-1129348473 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 25 15:58:57 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-aebc375c-2b21-44f9-ac3e-6d1d0a7c62f9 tempest-VolumesSnapshotListTestJSON-1129348473 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 25 15:58:57 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.quobyte [None req-aebc375c-2b21-44f9-ac3e-6d1d0a7c62f9 tempest-VolumesSnapshotListTestJSON-1129348473 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23e9d725-3e04-4cd9-bfe0-c8ef43305589': None} {{(pid=83528) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 25 15:58:57 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.quobyte [None req-aebc375c-2b21-44f9-ac3e-6d1d0a7c62f9 tempest-VolumesSnapshotListTestJSON-1129348473 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23e9d725-3e04-4cd9-bfe0-c8ef43305589'] {{(pid=83528) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 25 15:58:57 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-aebc375c-2b21-44f9-ac3e-6d1d0a7c62f9 tempest-VolumesSnapshotListTestJSON-1129348473 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 25 15:58:57 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-aebc375c-2b21-44f9-ac3e-6d1d0a7c62f9 tempest-VolumesSnapshotListTestJSON-1129348473 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85 {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 25 15:58:57 devstack sudo[89938]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85 Feb 25 15:58:57 devstack sudo[89938]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 25 15:58:58 devstack sudo[89938]: pam_unix(sudo:session): session closed for user root Feb 25 15:58:58 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-aebc375c-2b21-44f9-ac3e-6d1d0a7c62f9 tempest-VolumesSnapshotListTestJSON-1129348473 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85" returned: 0 in 0.451s {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 25 15:58:58 devstack cinder-volume[83528]: DEBUG cinder.manager [None req-aebc375c-2b21-44f9-ac3e-6d1d0a7c62f9 tempest-VolumesSnapshotListTestJSON-1129348473 None] Notifying Schedulers of capabilities ... {{(pid=83528) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 25 15:58:58 devstack cinder-volume[83528]: INFO cinder.volume.manager [None req-aebc375c-2b21-44f9-ac3e-6d1d0a7c62f9 tempest-VolumesSnapshotListTestJSON-1129348473 None] Deleted volume successfully. Feb 25 15:58:58 devstack cinder-volume[83528]: DEBUG cinder.coordination [None req-aebc375c-2b21-44f9-ac3e-6d1d0a7c62f9 tempest-VolumesSnapshotListTestJSON-1129348473 None] Lock "cinder-3fc37162-f4fc-47b7-9dc3-5489f5de5b91-delete_volume" released by "delete_volume" :: held 1.663s {{(pid=83528) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 25 15:59:00 devstack cinder-volume[83528]: DEBUG cinder.volume.flows.manager.create_volume [None req-4bf9ad15-dada-4c80-a1c4-ea2e9a57d37e tempest-CreateVolumesFromImageTest-63702335 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83528) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 25 15:59:00 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-4bf9ad15-dada-4c80-a1c4-ea2e9a57d37e tempest-CreateVolumesFromImageTest-63702335 None] Flow 'volume_create_manager' (7baf037f-ed3b-4e08-abf1-ea210ec99b36) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83528) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 25 15:59:00 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-4bf9ad15-dada-4c80-a1c4-ea2e9a57d37e tempest-CreateVolumesFromImageTest-63702335 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (84f182e9-0d55-45e0-9521-a463d5c3e2b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 25 15:59:00 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-4bf9ad15-dada-4c80-a1c4-ea2e9a57d37e tempest-CreateVolumesFromImageTest-63702335 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (84f182e9-0d55-45e0-9521-a463d5c3e2b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-25T14:59:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1791380624',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e310405f-6cff-4a73-8336-64698ed3b2cf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='98b720422e754e5faee3aeeca3aee280',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-25T14:59:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-25T14:59:01Z,use_quota=True,user_id='13cdc7fc37014259856db2884586a2d8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ce71c2f9-6543-4165-9653-a1529b2ea243),volume_type_id=ce71c2f9-6543-4165-9653-a1529b2ea243)' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 25 15:59:00 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-4bf9ad15-dada-4c80-a1c4-ea2e9a57d37e tempest-CreateVolumesFromImageTest-63702335 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (382777c5-df07-48f2-992c-eff0ad630efc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 25 15:59:00 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-4bf9ad15-dada-4c80-a1c4-ea2e9a57d37e tempest-CreateVolumesFromImageTest-63702335 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (382777c5-df07-48f2-992c-eff0ad630efc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 25 15:59:00 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-4bf9ad15-dada-4c80-a1c4-ea2e9a57d37e tempest-CreateVolumesFromImageTest-63702335 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7b0979e5-b070-407d-af4e-0a83fc891e1c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 25 15:59:00 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-4bf9ad15-dada-4c80-a1c4-ea2e9a57d37e tempest-CreateVolumesFromImageTest-63702335 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7b0979e5-b070-407d-af4e-0a83fc891e1c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e310405f-6cff-4a73-8336-64698ed3b2cf', 'volume_name': 'volume-e310405f-6cff-4a73-8336-64698ed3b2cf', 'volume_size': 1}' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 25 15:59:00 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-4bf9ad15-dada-4c80-a1c4-ea2e9a57d37e tempest-CreateVolumesFromImageTest-63702335 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ca8004fe-ba9e-4ea8-b528-fec7978564cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 25 15:59:00 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-4bf9ad15-dada-4c80-a1c4-ea2e9a57d37e tempest-CreateVolumesFromImageTest-63702335 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ca8004fe-ba9e-4ea8-b528-fec7978564cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 25 15:59:00 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-4bf9ad15-dada-4c80-a1c4-ea2e9a57d37e tempest-CreateVolumesFromImageTest-63702335 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ef4654b9-bd9c-476f-a70f-5a1eb356f107) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 25 15:59:00 devstack cinder-volume[83528]: INFO cinder.volume.flows.manager.create_volume [None req-4bf9ad15-dada-4c80-a1c4-ea2e9a57d37e tempest-CreateVolumesFromImageTest-63702335 None] Volume e310405f-6cff-4a73-8336-64698ed3b2cf: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e310405f-6cff-4a73-8336-64698ed3b2cf', 'volume_size': 1} Feb 25 15:59:00 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-4bf9ad15-dada-4c80-a1c4-ea2e9a57d37e tempest-CreateVolumesFromImageTest-63702335 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 25 15:59:00 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-4bf9ad15-dada-4c80-a1c4-ea2e9a57d37e tempest-CreateVolumesFromImageTest-63702335 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 25 15:59:00 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.quobyte [None req-4bf9ad15-dada-4c80-a1c4-ea2e9a57d37e tempest-CreateVolumesFromImageTest-63702335 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-25T14:59:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1791380624',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e310405f-6cff-4a73-8336-64698ed3b2cf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='98b720422e754e5faee3aeeca3aee280',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-25T14:59:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-25T14:59:01Z,use_quota=True,user_id='13cdc7fc37014259856db2884586a2d8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ce71c2f9-6543-4165-9653-a1529b2ea243),volume_type_id=ce71c2f9-6543-4165-9653-a1529b2ea243)}" {{(pid=83528) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 25 15:59:00 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.remotefs [None req-4bf9ad15-dada-4c80-a1c4-ea2e9a57d37e tempest-CreateVolumesFromImageTest-63702335 None] Creating volume e310405f-6cff-4a73-8336-64698ed3b2cf {{(pid=83528) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 25 15:59:00 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-4bf9ad15-dada-4c80-a1c4-ea2e9a57d37e tempest-CreateVolumesFromImageTest-63702335 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 25 15:59:00 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-4bf9ad15-dada-4c80-a1c4-ea2e9a57d37e tempest-CreateVolumesFromImageTest-63702335 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 25 15:59:00 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.quobyte [None req-4bf9ad15-dada-4c80-a1c4-ea2e9a57d37e tempest-CreateVolumesFromImageTest-63702335 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23e9d725-3e04-4cd9-bfe0-c8ef43305589': None} {{(pid=83528) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 25 15:59:00 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.quobyte [None req-4bf9ad15-dada-4c80-a1c4-ea2e9a57d37e tempest-CreateVolumesFromImageTest-63702335 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23e9d725-3e04-4cd9-bfe0-c8ef43305589'] {{(pid=83528) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 25 15:59:00 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-4bf9ad15-dada-4c80-a1c4-ea2e9a57d37e tempest-CreateVolumesFromImageTest-63702335 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 25 15:59:00 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.quobyte [None req-4bf9ad15-dada-4c80-a1c4-ea2e9a57d37e tempest-CreateVolumesFromImageTest-63702335 None] Selected osci02.corp.quobyte.com/cinder-vol-23e9d725-3e04-4cd9-bfe0-c8ef43305589 as target Quobyte volume. {{(pid=83528) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 25 15:59:00 devstack cinder-volume[83528]: INFO cinder.volume.drivers.remotefs [None req-4bf9ad15-dada-4c80-a1c4-ea2e9a57d37e tempest-CreateVolumesFromImageTest-63702335 None] casted to osci02.corp.quobyte.com/cinder-vol-23e9d725-3e04-4cd9-bfe0-c8ef43305589 Feb 25 15:59:00 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-4bf9ad15-dada-4c80-a1c4-ea2e9a57d37e tempest-CreateVolumesFromImageTest-63702335 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-e310405f-6cff-4a73-8336-64698ed3b2cf 1073741824 {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 25 15:59:00 devstack sudo[89941]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-e310405f-6cff-4a73-8336-64698ed3b2cf 1073741824 Feb 25 15:59:00 devstack sudo[89941]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 25 15:59:01 devstack cinder-volume[83528]: DEBUG cinder.volume.flows.manager.create_volume [None req-54aa643d-64a6-47e4-a02b-ac3e5fe1328e tempest-CreateVolumesFromImageTest-63702335 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83528) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 25 15:59:01 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-54aa643d-64a6-47e4-a02b-ac3e5fe1328e tempest-CreateVolumesFromImageTest-63702335 None] Flow 'volume_create_manager' (0ebcb6c8-b503-4f1f-bd67-92072c9f5d26) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83528) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 25 15:59:01 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-54aa643d-64a6-47e4-a02b-ac3e5fe1328e tempest-CreateVolumesFromImageTest-63702335 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c8d23f77-c7ed-4bdc-b79e-c746295b003c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 25 15:59:01 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-54aa643d-64a6-47e4-a02b-ac3e5fe1328e tempest-CreateVolumesFromImageTest-63702335 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c8d23f77-c7ed-4bdc-b79e-c746295b003c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-25T14:59:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-827915326',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1dc40f40-89f7-46f5-b73d-b7959c09e0ef,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='98b720422e754e5faee3aeeca3aee280',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-25T14:59:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-25T14:59:01Z,use_quota=True,user_id='13cdc7fc37014259856db2884586a2d8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ce71c2f9-6543-4165-9653-a1529b2ea243),volume_type_id=ce71c2f9-6543-4165-9653-a1529b2ea243)' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 25 15:59:01 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-54aa643d-64a6-47e4-a02b-ac3e5fe1328e tempest-CreateVolumesFromImageTest-63702335 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (360f6266-ea6a-4901-b5d5-4aabc649eebd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 25 15:59:01 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-54aa643d-64a6-47e4-a02b-ac3e5fe1328e tempest-CreateVolumesFromImageTest-63702335 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (360f6266-ea6a-4901-b5d5-4aabc649eebd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 25 15:59:01 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-54aa643d-64a6-47e4-a02b-ac3e5fe1328e tempest-CreateVolumesFromImageTest-63702335 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2b09e763-e0e4-4ac5-ab94-8aabd94820c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 25 15:59:01 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-54aa643d-64a6-47e4-a02b-ac3e5fe1328e tempest-CreateVolumesFromImageTest-63702335 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2b09e763-e0e4-4ac5-ab94-8aabd94820c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1dc40f40-89f7-46f5-b73d-b7959c09e0ef', 'volume_name': 'volume-1dc40f40-89f7-46f5-b73d-b7959c09e0ef', 'volume_size': 1}' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 25 15:59:01 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-54aa643d-64a6-47e4-a02b-ac3e5fe1328e tempest-CreateVolumesFromImageTest-63702335 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c8ae255f-9220-4391-b935-93dea5de9a45) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 25 15:59:01 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-54aa643d-64a6-47e4-a02b-ac3e5fe1328e tempest-CreateVolumesFromImageTest-63702335 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c8ae255f-9220-4391-b935-93dea5de9a45) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 25 15:59:01 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-54aa643d-64a6-47e4-a02b-ac3e5fe1328e tempest-CreateVolumesFromImageTest-63702335 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (50dd4324-9bfe-463d-b856-fa2306c7f4ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 25 15:59:01 devstack cinder-volume[83528]: INFO cinder.volume.flows.manager.create_volume [None req-54aa643d-64a6-47e4-a02b-ac3e5fe1328e tempest-CreateVolumesFromImageTest-63702335 None] Volume 1dc40f40-89f7-46f5-b73d-b7959c09e0ef: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1dc40f40-89f7-46f5-b73d-b7959c09e0ef', 'volume_size': 1} Feb 25 15:59:01 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-54aa643d-64a6-47e4-a02b-ac3e5fe1328e tempest-CreateVolumesFromImageTest-63702335 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 25 15:59:01 devstack cinder-volume[83528]: DEBUG cinder.volume.flows.manager.create_volume [None req-61edef02-f00c-47be-9474-0cc8b7bda457 tempest-CreateVolumesFromImageTest-63702335 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83528) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 25 15:59:01 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-61edef02-f00c-47be-9474-0cc8b7bda457 tempest-CreateVolumesFromImageTest-63702335 None] Flow 'volume_create_manager' (dff6d9d3-b437-4439-af58-bf8e9c6c82d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83528) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 25 15:59:01 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-61edef02-f00c-47be-9474-0cc8b7bda457 tempest-CreateVolumesFromImageTest-63702335 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f945b546-7db6-4727-8e2b-418083f17fd6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 25 15:59:01 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-61edef02-f00c-47be-9474-0cc8b7bda457 tempest-CreateVolumesFromImageTest-63702335 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f945b546-7db6-4727-8e2b-418083f17fd6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-25T14:59:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1397428450',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b2926de3-931c-4942-8081-6fea2811d82a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='98b720422e754e5faee3aeeca3aee280',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-25T14:59:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-25T14:59:01Z,use_quota=True,user_id='13cdc7fc37014259856db2884586a2d8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ce71c2f9-6543-4165-9653-a1529b2ea243),volume_type_id=ce71c2f9-6543-4165-9653-a1529b2ea243)' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 25 15:59:01 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-61edef02-f00c-47be-9474-0cc8b7bda457 tempest-CreateVolumesFromImageTest-63702335 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (81feeadb-ebc9-4919-b396-846a0ed38c5e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 25 15:59:01 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-61edef02-f00c-47be-9474-0cc8b7bda457 tempest-CreateVolumesFromImageTest-63702335 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (81feeadb-ebc9-4919-b396-846a0ed38c5e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 25 15:59:01 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-61edef02-f00c-47be-9474-0cc8b7bda457 tempest-CreateVolumesFromImageTest-63702335 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2fb8ffbd-6baf-47a6-870c-84eb666f8c51) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 25 15:59:01 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-61edef02-f00c-47be-9474-0cc8b7bda457 tempest-CreateVolumesFromImageTest-63702335 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2fb8ffbd-6baf-47a6-870c-84eb666f8c51) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b2926de3-931c-4942-8081-6fea2811d82a', 'volume_name': 'volume-b2926de3-931c-4942-8081-6fea2811d82a', 'volume_size': 1}' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 25 15:59:01 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-61edef02-f00c-47be-9474-0cc8b7bda457 tempest-CreateVolumesFromImageTest-63702335 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (26d3f81b-a98f-4cac-b78a-c5a42813dc85) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 25 15:59:01 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-61edef02-f00c-47be-9474-0cc8b7bda457 tempest-CreateVolumesFromImageTest-63702335 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (26d3f81b-a98f-4cac-b78a-c5a42813dc85) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 25 15:59:01 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-61edef02-f00c-47be-9474-0cc8b7bda457 tempest-CreateVolumesFromImageTest-63702335 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7a930674-3537-4a5c-a152-ade7d9b9f740) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 25 15:59:01 devstack cinder-volume[83528]: INFO cinder.volume.flows.manager.create_volume [None req-61edef02-f00c-47be-9474-0cc8b7bda457 tempest-CreateVolumesFromImageTest-63702335 None] Volume b2926de3-931c-4942-8081-6fea2811d82a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b2926de3-931c-4942-8081-6fea2811d82a', 'volume_size': 1} Feb 25 15:59:01 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-61edef02-f00c-47be-9474-0cc8b7bda457 tempest-CreateVolumesFromImageTest-63702335 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 25 15:59:01 devstack cinder-volume[83528]: DEBUG cinder.volume.flows.manager.create_volume [None req-a7007b7b-e8d2-4075-82d6-eaa464b8c2b1 tempest-CreateVolumesFromImageTest-63702335 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83528) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 25 15:59:01 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-a7007b7b-e8d2-4075-82d6-eaa464b8c2b1 tempest-CreateVolumesFromImageTest-63702335 None] Flow 'volume_create_manager' (2a44a614-8a41-4e1b-977f-f62b224caaf2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83528) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 25 15:59:01 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-a7007b7b-e8d2-4075-82d6-eaa464b8c2b1 tempest-CreateVolumesFromImageTest-63702335 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (30e577f7-2377-48ed-9c0f-da41d17b24f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 25 15:59:01 devstack sudo[89941]: pam_unix(sudo:session): session closed for user root Feb 25 15:59:01 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-a7007b7b-e8d2-4075-82d6-eaa464b8c2b1 tempest-CreateVolumesFromImageTest-63702335 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (30e577f7-2377-48ed-9c0f-da41d17b24f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-25T14:59:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1534878343',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e5367f93-17d3-470c-80d9-5838abeb3815,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='98b720422e754e5faee3aeeca3aee280',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-25T14:59:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-25T14:59:02Z,use_quota=True,user_id='13cdc7fc37014259856db2884586a2d8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ce71c2f9-6543-4165-9653-a1529b2ea243),volume_type_id=ce71c2f9-6543-4165-9653-a1529b2ea243)' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 25 15:59:01 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-a7007b7b-e8d2-4075-82d6-eaa464b8c2b1 tempest-CreateVolumesFromImageTest-63702335 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ba13e790-bbd0-4d32-b955-5781b503cd05) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 25 15:59:01 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-a7007b7b-e8d2-4075-82d6-eaa464b8c2b1 tempest-CreateVolumesFromImageTest-63702335 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ba13e790-bbd0-4d32-b955-5781b503cd05) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 25 15:59:01 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-a7007b7b-e8d2-4075-82d6-eaa464b8c2b1 tempest-CreateVolumesFromImageTest-63702335 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (34b37263-7fa6-4c82-a4b7-91f4afda5814) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 25 15:59:01 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-a7007b7b-e8d2-4075-82d6-eaa464b8c2b1 tempest-CreateVolumesFromImageTest-63702335 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (34b37263-7fa6-4c82-a4b7-91f4afda5814) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e5367f93-17d3-470c-80d9-5838abeb3815', 'volume_name': 'volume-e5367f93-17d3-470c-80d9-5838abeb3815', 'volume_size': 1}' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 25 15:59:01 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-a7007b7b-e8d2-4075-82d6-eaa464b8c2b1 tempest-CreateVolumesFromImageTest-63702335 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bce1c32c-1a61-4bb6-991e-7388b6e302f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 25 15:59:01 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-a7007b7b-e8d2-4075-82d6-eaa464b8c2b1 tempest-CreateVolumesFromImageTest-63702335 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bce1c32c-1a61-4bb6-991e-7388b6e302f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 25 15:59:01 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-a7007b7b-e8d2-4075-82d6-eaa464b8c2b1 tempest-CreateVolumesFromImageTest-63702335 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (df5851b3-87fd-406d-8a63-bf28bc996c73) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 25 15:59:01 devstack cinder-volume[83528]: INFO cinder.volume.flows.manager.create_volume [None req-a7007b7b-e8d2-4075-82d6-eaa464b8c2b1 tempest-CreateVolumesFromImageTest-63702335 None] Volume e5367f93-17d3-470c-80d9-5838abeb3815: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e5367f93-17d3-470c-80d9-5838abeb3815', 'volume_size': 1} Feb 25 15:59:01 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-a7007b7b-e8d2-4075-82d6-eaa464b8c2b1 tempest-CreateVolumesFromImageTest-63702335 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 25 15:59:01 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-4bf9ad15-dada-4c80-a1c4-ea2e9a57d37e tempest-CreateVolumesFromImageTest-63702335 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-e310405f-6cff-4a73-8336-64698ed3b2cf 1073741824" returned: 0 in 0.778s {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 25 15:59:01 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-4bf9ad15-dada-4c80-a1c4-ea2e9a57d37e tempest-CreateVolumesFromImageTest-63702335 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-e310405f-6cff-4a73-8336-64698ed3b2cf {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 25 15:59:01 devstack sudo[89948]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-e310405f-6cff-4a73-8336-64698ed3b2cf Feb 25 15:59:01 devstack sudo[89948]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 25 15:59:01 devstack cinder-volume[83528]: DEBUG cinder.volume.flows.manager.create_volume [None req-c2f171da-f542-4fb2-8a08-cf4a41bf4c14 tempest-CreateVolumesFromImageTest-63702335 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83528) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 25 15:59:01 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-c2f171da-f542-4fb2-8a08-cf4a41bf4c14 tempest-CreateVolumesFromImageTest-63702335 None] Flow 'volume_create_manager' (c4dbc391-82a3-41e7-bc13-60f3c0044095) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83528) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 25 15:59:01 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-c2f171da-f542-4fb2-8a08-cf4a41bf4c14 tempest-CreateVolumesFromImageTest-63702335 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c4df43f5-c4e0-4097-aa9d-015a81eebd24) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 25 15:59:01 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-c2f171da-f542-4fb2-8a08-cf4a41bf4c14 tempest-CreateVolumesFromImageTest-63702335 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c4df43f5-c4e0-4097-aa9d-015a81eebd24) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-25T14:59:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-155553848',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c475c1ea-f15c-492a-a5ed-19852df5b939,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='98b720422e754e5faee3aeeca3aee280',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-25T14:59:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-25T14:59:02Z,use_quota=True,user_id='13cdc7fc37014259856db2884586a2d8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ce71c2f9-6543-4165-9653-a1529b2ea243),volume_type_id=ce71c2f9-6543-4165-9653-a1529b2ea243)' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 25 15:59:01 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-c2f171da-f542-4fb2-8a08-cf4a41bf4c14 tempest-CreateVolumesFromImageTest-63702335 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8cd69813-b97e-46b0-ab7c-47906d4651f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 25 15:59:01 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-c2f171da-f542-4fb2-8a08-cf4a41bf4c14 tempest-CreateVolumesFromImageTest-63702335 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8cd69813-b97e-46b0-ab7c-47906d4651f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 25 15:59:01 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-c2f171da-f542-4fb2-8a08-cf4a41bf4c14 tempest-CreateVolumesFromImageTest-63702335 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (becba22b-5d0d-489d-9e5f-3bb1dec0ecda) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 25 15:59:01 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-c2f171da-f542-4fb2-8a08-cf4a41bf4c14 tempest-CreateVolumesFromImageTest-63702335 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (becba22b-5d0d-489d-9e5f-3bb1dec0ecda) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c475c1ea-f15c-492a-a5ed-19852df5b939', 'volume_name': 'volume-c475c1ea-f15c-492a-a5ed-19852df5b939', 'volume_size': 1}' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 25 15:59:01 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-c2f171da-f542-4fb2-8a08-cf4a41bf4c14 tempest-CreateVolumesFromImageTest-63702335 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (af5f2ef4-1da8-4aa2-a9cc-8fe29bd027d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 25 15:59:01 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-c2f171da-f542-4fb2-8a08-cf4a41bf4c14 tempest-CreateVolumesFromImageTest-63702335 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (af5f2ef4-1da8-4aa2-a9cc-8fe29bd027d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 25 15:59:01 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-c2f171da-f542-4fb2-8a08-cf4a41bf4c14 tempest-CreateVolumesFromImageTest-63702335 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2536af76-ea40-4ecb-93bd-da587fe87ca3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 25 15:59:01 devstack cinder-volume[83528]: INFO cinder.volume.flows.manager.create_volume [None req-c2f171da-f542-4fb2-8a08-cf4a41bf4c14 tempest-CreateVolumesFromImageTest-63702335 None] Volume c475c1ea-f15c-492a-a5ed-19852df5b939: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c475c1ea-f15c-492a-a5ed-19852df5b939', 'volume_size': 1} Feb 25 15:59:01 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-c2f171da-f542-4fb2-8a08-cf4a41bf4c14 tempest-CreateVolumesFromImageTest-63702335 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 25 15:59:02 devstack sudo[89948]: pam_unix(sudo:session): session closed for user root Feb 25 15:59:02 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-4bf9ad15-dada-4c80-a1c4-ea2e9a57d37e tempest-CreateVolumesFromImageTest-63702335 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-e310405f-6cff-4a73-8336-64698ed3b2cf" returned: 0 in 0.511s {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 25 15:59:02 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.quobyte [None req-4bf9ad15-dada-4c80-a1c4-ea2e9a57d37e tempest-CreateVolumesFromImageTest-63702335 None] <== create_volume: return (1315ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-23e9d725-3e04-4cd9-bfe0-c8ef43305589'} {{(pid=83528) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 25 15:59:02 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-4bf9ad15-dada-4c80-a1c4-ea2e9a57d37e tempest-CreateVolumesFromImageTest-63702335 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.317s {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 25 15:59:02 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-54aa643d-64a6-47e4-a02b-ac3e5fe1328e tempest-CreateVolumesFromImageTest-63702335 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.988s {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 25 15:59:02 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.quobyte [None req-54aa643d-64a6-47e4-a02b-ac3e5fe1328e tempest-CreateVolumesFromImageTest-63702335 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-25T14:59:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-827915326',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1dc40f40-89f7-46f5-b73d-b7959c09e0ef,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='98b720422e754e5faee3aeeca3aee280',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-25T14:59:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-25T14:59:01Z,use_quota=True,user_id='13cdc7fc37014259856db2884586a2d8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ce71c2f9-6543-4165-9653-a1529b2ea243),volume_type_id=ce71c2f9-6543-4165-9653-a1529b2ea243)}" {{(pid=83528) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 25 15:59:02 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.remotefs [None req-54aa643d-64a6-47e4-a02b-ac3e5fe1328e tempest-CreateVolumesFromImageTest-63702335 None] Creating volume 1dc40f40-89f7-46f5-b73d-b7959c09e0ef {{(pid=83528) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 25 15:59:02 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-54aa643d-64a6-47e4-a02b-ac3e5fe1328e tempest-CreateVolumesFromImageTest-63702335 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 25 15:59:02 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-54aa643d-64a6-47e4-a02b-ac3e5fe1328e tempest-CreateVolumesFromImageTest-63702335 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 25 15:59:02 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.quobyte [None req-54aa643d-64a6-47e4-a02b-ac3e5fe1328e tempest-CreateVolumesFromImageTest-63702335 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23e9d725-3e04-4cd9-bfe0-c8ef43305589': None} {{(pid=83528) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 25 15:59:02 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.quobyte [None req-54aa643d-64a6-47e4-a02b-ac3e5fe1328e tempest-CreateVolumesFromImageTest-63702335 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23e9d725-3e04-4cd9-bfe0-c8ef43305589'] {{(pid=83528) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 25 15:59:02 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-54aa643d-64a6-47e4-a02b-ac3e5fe1328e tempest-CreateVolumesFromImageTest-63702335 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 25 15:59:02 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.quobyte [None req-54aa643d-64a6-47e4-a02b-ac3e5fe1328e tempest-CreateVolumesFromImageTest-63702335 None] Selected osci02.corp.quobyte.com/cinder-vol-23e9d725-3e04-4cd9-bfe0-c8ef43305589 as target Quobyte volume. {{(pid=83528) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 25 15:59:02 devstack cinder-volume[83528]: INFO cinder.volume.drivers.remotefs [None req-54aa643d-64a6-47e4-a02b-ac3e5fe1328e tempest-CreateVolumesFromImageTest-63702335 None] casted to osci02.corp.quobyte.com/cinder-vol-23e9d725-3e04-4cd9-bfe0-c8ef43305589 Feb 25 15:59:02 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-54aa643d-64a6-47e4-a02b-ac3e5fe1328e tempest-CreateVolumesFromImageTest-63702335 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-1dc40f40-89f7-46f5-b73d-b7959c09e0ef 1073741824 {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 25 15:59:02 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-4bf9ad15-dada-4c80-a1c4-ea2e9a57d37e tempest-CreateVolumesFromImageTest-63702335 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ef4654b9-bd9c-476f-a70f-5a1eb356f107) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e310405f-6cff-4a73-8336-64698ed3b2cf', 'volume_size': 1}' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 25 15:59:02 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-4bf9ad15-dada-4c80-a1c4-ea2e9a57d37e tempest-CreateVolumesFromImageTest-63702335 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f0dcb7fd-74ff-454b-9e67-211422993404) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 25 15:59:02 devstack sudo[89965]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-1dc40f40-89f7-46f5-b73d-b7959c09e0ef 1073741824 Feb 25 15:59:02 devstack sudo[89965]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 25 15:59:02 devstack cinder-volume[83528]: INFO cinder.volume.flows.manager.create_volume [None req-4bf9ad15-dada-4c80-a1c4-ea2e9a57d37e tempest-CreateVolumesFromImageTest-63702335 None] Volume volume-e310405f-6cff-4a73-8336-64698ed3b2cf (e310405f-6cff-4a73-8336-64698ed3b2cf): created successfully Feb 25 15:59:02 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-4bf9ad15-dada-4c80-a1c4-ea2e9a57d37e tempest-CreateVolumesFromImageTest-63702335 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f0dcb7fd-74ff-454b-9e67-211422993404) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 25 15:59:02 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-4bf9ad15-dada-4c80-a1c4-ea2e9a57d37e tempest-CreateVolumesFromImageTest-63702335 None] Flow 'volume_create_manager' (7baf037f-ed3b-4e08-abf1-ea210ec99b36) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83528) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 25 15:59:02 devstack cinder-volume[83528]: INFO cinder.volume.manager [None req-4bf9ad15-dada-4c80-a1c4-ea2e9a57d37e tempest-CreateVolumesFromImageTest-63702335 None] Created volume successfully. Feb 25 15:59:02 devstack sudo[89965]: pam_unix(sudo:session): session closed for user root Feb 25 15:59:02 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-54aa643d-64a6-47e4-a02b-ac3e5fe1328e tempest-CreateVolumesFromImageTest-63702335 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-1dc40f40-89f7-46f5-b73d-b7959c09e0ef 1073741824" returned: 0 in 0.516s {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 25 15:59:02 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-54aa643d-64a6-47e4-a02b-ac3e5fe1328e tempest-CreateVolumesFromImageTest-63702335 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-1dc40f40-89f7-46f5-b73d-b7959c09e0ef {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 25 15:59:02 devstack sudo[89970]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-1dc40f40-89f7-46f5-b73d-b7959c09e0ef Feb 25 15:59:02 devstack sudo[89970]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 25 15:59:03 devstack sudo[89970]: pam_unix(sudo:session): session closed for user root Feb 25 15:59:03 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-54aa643d-64a6-47e4-a02b-ac3e5fe1328e tempest-CreateVolumesFromImageTest-63702335 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-1dc40f40-89f7-46f5-b73d-b7959c09e0ef" returned: 0 in 0.406s {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 25 15:59:03 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.quobyte [None req-54aa643d-64a6-47e4-a02b-ac3e5fe1328e tempest-CreateVolumesFromImageTest-63702335 None] <== create_volume: return (956ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-23e9d725-3e04-4cd9-bfe0-c8ef43305589'} {{(pid=83528) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 25 15:59:03 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-54aa643d-64a6-47e4-a02b-ac3e5fe1328e tempest-CreateVolumesFromImageTest-63702335 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.958s {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 25 15:59:03 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-61edef02-f00c-47be-9474-0cc8b7bda457 tempest-CreateVolumesFromImageTest-63702335 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.695s {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 25 15:59:03 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.quobyte [None req-61edef02-f00c-47be-9474-0cc8b7bda457 tempest-CreateVolumesFromImageTest-63702335 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-25T14:59:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1397428450',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b2926de3-931c-4942-8081-6fea2811d82a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='98b720422e754e5faee3aeeca3aee280',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-25T14:59:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-25T14:59:01Z,use_quota=True,user_id='13cdc7fc37014259856db2884586a2d8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ce71c2f9-6543-4165-9653-a1529b2ea243),volume_type_id=ce71c2f9-6543-4165-9653-a1529b2ea243)}" {{(pid=83528) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 25 15:59:03 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.remotefs [None req-61edef02-f00c-47be-9474-0cc8b7bda457 tempest-CreateVolumesFromImageTest-63702335 None] Creating volume b2926de3-931c-4942-8081-6fea2811d82a {{(pid=83528) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 25 15:59:03 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-61edef02-f00c-47be-9474-0cc8b7bda457 tempest-CreateVolumesFromImageTest-63702335 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 25 15:59:03 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-61edef02-f00c-47be-9474-0cc8b7bda457 tempest-CreateVolumesFromImageTest-63702335 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 25 15:59:03 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.quobyte [None req-61edef02-f00c-47be-9474-0cc8b7bda457 tempest-CreateVolumesFromImageTest-63702335 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23e9d725-3e04-4cd9-bfe0-c8ef43305589': None} {{(pid=83528) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 25 15:59:03 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.quobyte [None req-61edef02-f00c-47be-9474-0cc8b7bda457 tempest-CreateVolumesFromImageTest-63702335 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23e9d725-3e04-4cd9-bfe0-c8ef43305589'] {{(pid=83528) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 25 15:59:03 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-61edef02-f00c-47be-9474-0cc8b7bda457 tempest-CreateVolumesFromImageTest-63702335 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 25 15:59:03 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.quobyte [None req-61edef02-f00c-47be-9474-0cc8b7bda457 tempest-CreateVolumesFromImageTest-63702335 None] Selected osci02.corp.quobyte.com/cinder-vol-23e9d725-3e04-4cd9-bfe0-c8ef43305589 as target Quobyte volume. {{(pid=83528) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 25 15:59:03 devstack cinder-volume[83528]: INFO cinder.volume.drivers.remotefs [None req-61edef02-f00c-47be-9474-0cc8b7bda457 tempest-CreateVolumesFromImageTest-63702335 None] casted to osci02.corp.quobyte.com/cinder-vol-23e9d725-3e04-4cd9-bfe0-c8ef43305589 Feb 25 15:59:03 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-61edef02-f00c-47be-9474-0cc8b7bda457 tempest-CreateVolumesFromImageTest-63702335 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-b2926de3-931c-4942-8081-6fea2811d82a 1073741824 {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 25 15:59:03 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-54aa643d-64a6-47e4-a02b-ac3e5fe1328e tempest-CreateVolumesFromImageTest-63702335 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (50dd4324-9bfe-463d-b856-fa2306c7f4ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1dc40f40-89f7-46f5-b73d-b7959c09e0ef', 'volume_size': 1}' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 25 15:59:03 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-54aa643d-64a6-47e4-a02b-ac3e5fe1328e tempest-CreateVolumesFromImageTest-63702335 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9d656233-017f-4bd9-b475-07a7dfb2d293) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 25 15:59:03 devstack sudo[89973]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-b2926de3-931c-4942-8081-6fea2811d82a 1073741824 Feb 25 15:59:03 devstack sudo[89973]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 25 15:59:03 devstack cinder-volume[83528]: INFO cinder.volume.flows.manager.create_volume [None req-54aa643d-64a6-47e4-a02b-ac3e5fe1328e tempest-CreateVolumesFromImageTest-63702335 None] Volume volume-1dc40f40-89f7-46f5-b73d-b7959c09e0ef (1dc40f40-89f7-46f5-b73d-b7959c09e0ef): created successfully Feb 25 15:59:03 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-54aa643d-64a6-47e4-a02b-ac3e5fe1328e tempest-CreateVolumesFromImageTest-63702335 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9d656233-017f-4bd9-b475-07a7dfb2d293) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 25 15:59:03 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-54aa643d-64a6-47e4-a02b-ac3e5fe1328e tempest-CreateVolumesFromImageTest-63702335 None] Flow 'volume_create_manager' (0ebcb6c8-b503-4f1f-bd67-92072c9f5d26) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83528) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 25 15:59:03 devstack cinder-volume[83528]: INFO cinder.volume.manager [None req-54aa643d-64a6-47e4-a02b-ac3e5fe1328e tempest-CreateVolumesFromImageTest-63702335 None] Created volume successfully. Feb 25 15:59:03 devstack sudo[89973]: pam_unix(sudo:session): session closed for user root Feb 25 15:59:03 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-61edef02-f00c-47be-9474-0cc8b7bda457 tempest-CreateVolumesFromImageTest-63702335 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-b2926de3-931c-4942-8081-6fea2811d82a 1073741824" returned: 0 in 0.579s {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 25 15:59:03 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-61edef02-f00c-47be-9474-0cc8b7bda457 tempest-CreateVolumesFromImageTest-63702335 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-b2926de3-931c-4942-8081-6fea2811d82a {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 25 15:59:03 devstack sudo[89978]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-b2926de3-931c-4942-8081-6fea2811d82a Feb 25 15:59:03 devstack sudo[89978]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 25 15:59:04 devstack sudo[89978]: pam_unix(sudo:session): session closed for user root Feb 25 15:59:04 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-61edef02-f00c-47be-9474-0cc8b7bda457 tempest-CreateVolumesFromImageTest-63702335 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-b2926de3-931c-4942-8081-6fea2811d82a" returned: 0 in 0.475s {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 25 15:59:04 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.quobyte [None req-61edef02-f00c-47be-9474-0cc8b7bda457 tempest-CreateVolumesFromImageTest-63702335 None] <== create_volume: return (1079ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-23e9d725-3e04-4cd9-bfe0-c8ef43305589'} {{(pid=83528) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 25 15:59:04 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-61edef02-f00c-47be-9474-0cc8b7bda457 tempest-CreateVolumesFromImageTest-63702335 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.082s {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 25 15:59:04 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-a7007b7b-e8d2-4075-82d6-eaa464b8c2b1 tempest-CreateVolumesFromImageTest-63702335 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.589s {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 25 15:59:04 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.quobyte [None req-a7007b7b-e8d2-4075-82d6-eaa464b8c2b1 tempest-CreateVolumesFromImageTest-63702335 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-25T14:59:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1534878343',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e5367f93-17d3-470c-80d9-5838abeb3815,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='98b720422e754e5faee3aeeca3aee280',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-25T14:59:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-25T14:59:02Z,use_quota=True,user_id='13cdc7fc37014259856db2884586a2d8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ce71c2f9-6543-4165-9653-a1529b2ea243),volume_type_id=ce71c2f9-6543-4165-9653-a1529b2ea243)}" {{(pid=83528) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 25 15:59:04 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.remotefs [None req-a7007b7b-e8d2-4075-82d6-eaa464b8c2b1 tempest-CreateVolumesFromImageTest-63702335 None] Creating volume e5367f93-17d3-470c-80d9-5838abeb3815 {{(pid=83528) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 25 15:59:04 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-a7007b7b-e8d2-4075-82d6-eaa464b8c2b1 tempest-CreateVolumesFromImageTest-63702335 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 25 15:59:04 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-a7007b7b-e8d2-4075-82d6-eaa464b8c2b1 tempest-CreateVolumesFromImageTest-63702335 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 25 15:59:04 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.quobyte [None req-a7007b7b-e8d2-4075-82d6-eaa464b8c2b1 tempest-CreateVolumesFromImageTest-63702335 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23e9d725-3e04-4cd9-bfe0-c8ef43305589': None} {{(pid=83528) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 25 15:59:04 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.quobyte [None req-a7007b7b-e8d2-4075-82d6-eaa464b8c2b1 tempest-CreateVolumesFromImageTest-63702335 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23e9d725-3e04-4cd9-bfe0-c8ef43305589'] {{(pid=83528) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 25 15:59:04 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-a7007b7b-e8d2-4075-82d6-eaa464b8c2b1 tempest-CreateVolumesFromImageTest-63702335 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 25 15:59:04 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.quobyte [None req-a7007b7b-e8d2-4075-82d6-eaa464b8c2b1 tempest-CreateVolumesFromImageTest-63702335 None] Selected osci02.corp.quobyte.com/cinder-vol-23e9d725-3e04-4cd9-bfe0-c8ef43305589 as target Quobyte volume. {{(pid=83528) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 25 15:59:04 devstack cinder-volume[83528]: INFO cinder.volume.drivers.remotefs [None req-a7007b7b-e8d2-4075-82d6-eaa464b8c2b1 tempest-CreateVolumesFromImageTest-63702335 None] casted to osci02.corp.quobyte.com/cinder-vol-23e9d725-3e04-4cd9-bfe0-c8ef43305589 Feb 25 15:59:04 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-a7007b7b-e8d2-4075-82d6-eaa464b8c2b1 tempest-CreateVolumesFromImageTest-63702335 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-e5367f93-17d3-470c-80d9-5838abeb3815 1073741824 {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 25 15:59:04 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-61edef02-f00c-47be-9474-0cc8b7bda457 tempest-CreateVolumesFromImageTest-63702335 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7a930674-3537-4a5c-a152-ade7d9b9f740) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b2926de3-931c-4942-8081-6fea2811d82a', 'volume_size': 1}' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 25 15:59:04 devstack sudo[89981]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-e5367f93-17d3-470c-80d9-5838abeb3815 1073741824 Feb 25 15:59:04 devstack sudo[89981]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 25 15:59:04 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-61edef02-f00c-47be-9474-0cc8b7bda457 tempest-CreateVolumesFromImageTest-63702335 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (43c3738d-66e2-4567-a794-51850851c69a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 25 15:59:04 devstack cinder-volume[83528]: INFO cinder.volume.flows.manager.create_volume [None req-61edef02-f00c-47be-9474-0cc8b7bda457 tempest-CreateVolumesFromImageTest-63702335 None] Volume volume-b2926de3-931c-4942-8081-6fea2811d82a (b2926de3-931c-4942-8081-6fea2811d82a): created successfully Feb 25 15:59:04 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-61edef02-f00c-47be-9474-0cc8b7bda457 tempest-CreateVolumesFromImageTest-63702335 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (43c3738d-66e2-4567-a794-51850851c69a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 25 15:59:04 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-61edef02-f00c-47be-9474-0cc8b7bda457 tempest-CreateVolumesFromImageTest-63702335 None] Flow 'volume_create_manager' (dff6d9d3-b437-4439-af58-bf8e9c6c82d3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83528) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 25 15:59:04 devstack cinder-volume[83528]: INFO cinder.volume.manager [None req-61edef02-f00c-47be-9474-0cc8b7bda457 tempest-CreateVolumesFromImageTest-63702335 None] Created volume successfully. Feb 25 15:59:04 devstack sudo[89981]: pam_unix(sudo:session): session closed for user root Feb 25 15:59:04 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-a7007b7b-e8d2-4075-82d6-eaa464b8c2b1 tempest-CreateVolumesFromImageTest-63702335 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-e5367f93-17d3-470c-80d9-5838abeb3815 1073741824" returned: 0 in 0.567s {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 25 15:59:04 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-a7007b7b-e8d2-4075-82d6-eaa464b8c2b1 tempest-CreateVolumesFromImageTest-63702335 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-e5367f93-17d3-470c-80d9-5838abeb3815 {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 25 15:59:04 devstack sudo[89990]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-e5367f93-17d3-470c-80d9-5838abeb3815 Feb 25 15:59:04 devstack sudo[89990]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 25 15:59:05 devstack sudo[89990]: pam_unix(sudo:session): session closed for user root Feb 25 15:59:05 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-a7007b7b-e8d2-4075-82d6-eaa464b8c2b1 tempest-CreateVolumesFromImageTest-63702335 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-e5367f93-17d3-470c-80d9-5838abeb3815" returned: 0 in 0.481s {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 25 15:59:05 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.quobyte [None req-a7007b7b-e8d2-4075-82d6-eaa464b8c2b1 tempest-CreateVolumesFromImageTest-63702335 None] <== create_volume: return (1076ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-23e9d725-3e04-4cd9-bfe0-c8ef43305589'} {{(pid=83528) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 25 15:59:05 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-a7007b7b-e8d2-4075-82d6-eaa464b8c2b1 tempest-CreateVolumesFromImageTest-63702335 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.080s {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 25 15:59:05 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-c2f171da-f542-4fb2-8a08-cf4a41bf4c14 tempest-CreateVolumesFromImageTest-63702335 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.470s {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 25 15:59:05 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.quobyte [None req-c2f171da-f542-4fb2-8a08-cf4a41bf4c14 tempest-CreateVolumesFromImageTest-63702335 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-25T14:59:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-155553848',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c475c1ea-f15c-492a-a5ed-19852df5b939,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='98b720422e754e5faee3aeeca3aee280',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-25T14:59:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-25T14:59:02Z,use_quota=True,user_id='13cdc7fc37014259856db2884586a2d8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ce71c2f9-6543-4165-9653-a1529b2ea243),volume_type_id=ce71c2f9-6543-4165-9653-a1529b2ea243)}" {{(pid=83528) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 25 15:59:05 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.remotefs [None req-c2f171da-f542-4fb2-8a08-cf4a41bf4c14 tempest-CreateVolumesFromImageTest-63702335 None] Creating volume c475c1ea-f15c-492a-a5ed-19852df5b939 {{(pid=83528) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 25 15:59:05 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-c2f171da-f542-4fb2-8a08-cf4a41bf4c14 tempest-CreateVolumesFromImageTest-63702335 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 25 15:59:05 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-c2f171da-f542-4fb2-8a08-cf4a41bf4c14 tempest-CreateVolumesFromImageTest-63702335 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 25 15:59:05 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.quobyte [None req-c2f171da-f542-4fb2-8a08-cf4a41bf4c14 tempest-CreateVolumesFromImageTest-63702335 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23e9d725-3e04-4cd9-bfe0-c8ef43305589': None} {{(pid=83528) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 25 15:59:05 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.quobyte [None req-c2f171da-f542-4fb2-8a08-cf4a41bf4c14 tempest-CreateVolumesFromImageTest-63702335 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23e9d725-3e04-4cd9-bfe0-c8ef43305589'] {{(pid=83528) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 25 15:59:05 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-c2f171da-f542-4fb2-8a08-cf4a41bf4c14 tempest-CreateVolumesFromImageTest-63702335 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 25 15:59:05 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.quobyte [None req-c2f171da-f542-4fb2-8a08-cf4a41bf4c14 tempest-CreateVolumesFromImageTest-63702335 None] Selected osci02.corp.quobyte.com/cinder-vol-23e9d725-3e04-4cd9-bfe0-c8ef43305589 as target Quobyte volume. {{(pid=83528) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 25 15:59:05 devstack cinder-volume[83528]: INFO cinder.volume.drivers.remotefs [None req-c2f171da-f542-4fb2-8a08-cf4a41bf4c14 tempest-CreateVolumesFromImageTest-63702335 None] casted to osci02.corp.quobyte.com/cinder-vol-23e9d725-3e04-4cd9-bfe0-c8ef43305589 Feb 25 15:59:05 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-c2f171da-f542-4fb2-8a08-cf4a41bf4c14 tempest-CreateVolumesFromImageTest-63702335 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-c475c1ea-f15c-492a-a5ed-19852df5b939 1073741824 {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 25 15:59:05 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-a7007b7b-e8d2-4075-82d6-eaa464b8c2b1 tempest-CreateVolumesFromImageTest-63702335 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (df5851b3-87fd-406d-8a63-bf28bc996c73) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e5367f93-17d3-470c-80d9-5838abeb3815', 'volume_size': 1}' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 25 15:59:05 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-a7007b7b-e8d2-4075-82d6-eaa464b8c2b1 tempest-CreateVolumesFromImageTest-63702335 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (761144eb-b8f1-4053-b4db-25c93fa5910f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 25 15:59:05 devstack sudo[89993]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-c475c1ea-f15c-492a-a5ed-19852df5b939 1073741824 Feb 25 15:59:05 devstack sudo[89993]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 25 15:59:05 devstack cinder-volume[83528]: INFO cinder.volume.flows.manager.create_volume [None req-a7007b7b-e8d2-4075-82d6-eaa464b8c2b1 tempest-CreateVolumesFromImageTest-63702335 None] Volume volume-e5367f93-17d3-470c-80d9-5838abeb3815 (e5367f93-17d3-470c-80d9-5838abeb3815): created successfully Feb 25 15:59:05 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-a7007b7b-e8d2-4075-82d6-eaa464b8c2b1 tempest-CreateVolumesFromImageTest-63702335 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (761144eb-b8f1-4053-b4db-25c93fa5910f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 25 15:59:05 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-a7007b7b-e8d2-4075-82d6-eaa464b8c2b1 tempest-CreateVolumesFromImageTest-63702335 None] Flow 'volume_create_manager' (2a44a614-8a41-4e1b-977f-f62b224caaf2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83528) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 25 15:59:05 devstack cinder-volume[83528]: INFO cinder.volume.manager [None req-a7007b7b-e8d2-4075-82d6-eaa464b8c2b1 tempest-CreateVolumesFromImageTest-63702335 None] Created volume successfully. Feb 25 15:59:05 devstack sudo[89993]: pam_unix(sudo:session): session closed for user root Feb 25 15:59:05 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-c2f171da-f542-4fb2-8a08-cf4a41bf4c14 tempest-CreateVolumesFromImageTest-63702335 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-c475c1ea-f15c-492a-a5ed-19852df5b939 1073741824" returned: 0 in 0.612s {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 25 15:59:06 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-c2f171da-f542-4fb2-8a08-cf4a41bf4c14 tempest-CreateVolumesFromImageTest-63702335 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-c475c1ea-f15c-492a-a5ed-19852df5b939 {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 25 15:59:06 devstack sudo[89998]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-c475c1ea-f15c-492a-a5ed-19852df5b939 Feb 25 15:59:06 devstack sudo[89998]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 25 15:59:06 devstack sudo[89998]: pam_unix(sudo:session): session closed for user root Feb 25 15:59:06 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-c2f171da-f542-4fb2-8a08-cf4a41bf4c14 tempest-CreateVolumesFromImageTest-63702335 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-c475c1ea-f15c-492a-a5ed-19852df5b939" returned: 0 in 0.566s {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 25 15:59:06 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.quobyte [None req-c2f171da-f542-4fb2-8a08-cf4a41bf4c14 tempest-CreateVolumesFromImageTest-63702335 None] <== create_volume: return (1268ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-23e9d725-3e04-4cd9-bfe0-c8ef43305589'} {{(pid=83528) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 25 15:59:06 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-c2f171da-f542-4fb2-8a08-cf4a41bf4c14 tempest-CreateVolumesFromImageTest-63702335 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.271s {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 25 15:59:06 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-c2f171da-f542-4fb2-8a08-cf4a41bf4c14 tempest-CreateVolumesFromImageTest-63702335 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2536af76-ea40-4ecb-93bd-da587fe87ca3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c475c1ea-f15c-492a-a5ed-19852df5b939', 'volume_size': 1}' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 25 15:59:06 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-c2f171da-f542-4fb2-8a08-cf4a41bf4c14 tempest-CreateVolumesFromImageTest-63702335 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f794bf12-4654-479c-a87c-1c9232916fce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 25 15:59:06 devstack cinder-volume[83528]: INFO cinder.volume.flows.manager.create_volume [None req-c2f171da-f542-4fb2-8a08-cf4a41bf4c14 tempest-CreateVolumesFromImageTest-63702335 None] Volume volume-c475c1ea-f15c-492a-a5ed-19852df5b939 (c475c1ea-f15c-492a-a5ed-19852df5b939): created successfully Feb 25 15:59:06 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-c2f171da-f542-4fb2-8a08-cf4a41bf4c14 tempest-CreateVolumesFromImageTest-63702335 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f794bf12-4654-479c-a87c-1c9232916fce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 25 15:59:06 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-c2f171da-f542-4fb2-8a08-cf4a41bf4c14 tempest-CreateVolumesFromImageTest-63702335 None] Flow 'volume_create_manager' (c4dbc391-82a3-41e7-bc13-60f3c0044095) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83528) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 25 15:59:06 devstack cinder-volume[83528]: INFO cinder.volume.manager [None req-c2f171da-f542-4fb2-8a08-cf4a41bf4c14 tempest-CreateVolumesFromImageTest-63702335 None] Created volume successfully. Feb 25 15:59:07 devstack cinder-volume[83528]: DEBUG cinder.coordination [None req-0a9c80bc-641f-4766-8c4f-21a7f6293696 tempest-CreateVolumesFromImageTest-63702335 None] Acquiring lock "cinder-c475c1ea-f15c-492a-a5ed-19852df5b939-delete_volume" by "delete_volume" {{(pid=83528) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 25 15:59:07 devstack cinder-volume[83528]: DEBUG cinder.coordination [None req-0a9c80bc-641f-4766-8c4f-21a7f6293696 tempest-CreateVolumesFromImageTest-63702335 None] Lock "cinder-c475c1ea-f15c-492a-a5ed-19852df5b939-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=83528) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 25 15:59:07 devstack cinder-volume[83528]: DEBUG cinder.coordination [None req-0a9c80bc-641f-4766-8c4f-21a7f6293696 tempest-CreateVolumesFromImageTest-63702335 None] Acquiring lock "cinder-quobyte-c475c1ea-f15c-492a-a5ed-19852df5b939" by "delete_volume" {{(pid=83528) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 25 15:59:07 devstack cinder-volume[83528]: DEBUG cinder.coordination [None req-0a9c80bc-641f-4766-8c4f-21a7f6293696 tempest-CreateVolumesFromImageTest-63702335 None] Lock "cinder-quobyte-c475c1ea-f15c-492a-a5ed-19852df5b939" acquired by "delete_volume" :: waited 0.011s {{(pid=83528) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 25 15:59:07 devstack cinder-volume[83528]: DEBUG oslo.privsep.daemon [-] privsep: reply[1350c316-0060-4273-934a-390ee8acb9bf]: (4, 'qcow2') {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 25 15:59:07 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-0a9c80bc-641f-4766-8c4f-21a7f6293696 tempest-CreateVolumesFromImageTest-63702335 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-c475c1ea-f15c-492a-a5ed-19852df5b939 {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 25 15:59:07 devstack sudo[90028]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-c475c1ea-f15c-492a-a5ed-19852df5b939 Feb 25 15:59:07 devstack sudo[90028]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 25 15:59:07 devstack sudo[90028]: pam_unix(sudo:session): session closed for user root Feb 25 15:59:07 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-0a9c80bc-641f-4766-8c4f-21a7f6293696 tempest-CreateVolumesFromImageTest-63702335 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-c475c1ea-f15c-492a-a5ed-19852df5b939" returned: 0 in 0.520s {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 25 15:59:07 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-0a9c80bc-641f-4766-8c4f-21a7f6293696 tempest-CreateVolumesFromImageTest-63702335 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-c475c1ea-f15c-492a-a5ed-19852df5b939 {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 25 15:59:07 devstack sudo[90033]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-c475c1ea-f15c-492a-a5ed-19852df5b939 Feb 25 15:59:07 devstack sudo[90033]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 25 15:59:08 devstack cinder-volume[83528]: DEBUG cinder.coordination [None req-1a0b37c5-be98-406f-80b9-f5699816714d tempest-VolumesActionsTest-1208865286 None] Acquiring lock "cinder-287168fc-0786-4716-8f23-273489f2849c" by "attach_volume" {{(pid=83528) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 25 15:59:08 devstack cinder-volume[83528]: DEBUG cinder.coordination [None req-1a0b37c5-be98-406f-80b9-f5699816714d tempest-VolumesActionsTest-1208865286 None] Lock "cinder-287168fc-0786-4716-8f23-273489f2849c" acquired by "attach_volume" :: waited 0.026s {{(pid=83528) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 25 15:59:08 devstack cinder-volume[83528]: INFO cinder.volume.manager [None req-1a0b37c5-be98-406f-80b9-f5699816714d tempest-VolumesActionsTest-1208865286 None] Attaching volume 287168fc-0786-4716-8f23-273489f2849c to instance ad33dbe7-13b9-4cd7-8105-ce7bd06d3433 at mountpoint /dev/vdb on host None. Feb 25 15:59:08 devstack sudo[90033]: pam_unix(sudo:session): session closed for user root Feb 25 15:59:08 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-0a9c80bc-641f-4766-8c4f-21a7f6293696 tempest-CreateVolumesFromImageTest-63702335 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-c475c1ea-f15c-492a-a5ed-19852df5b939" returned: 0 in 0.578s {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 25 15:59:08 devstack cinder-volume[83528]: INFO cinder.volume.manager [None req-1a0b37c5-be98-406f-80b9-f5699816714d tempest-VolumesActionsTest-1208865286 None] Attach volume completed successfully. Feb 25 15:59:08 devstack cinder-volume[83528]: DEBUG cinder.coordination [None req-0a9c80bc-641f-4766-8c4f-21a7f6293696 tempest-CreateVolumesFromImageTest-63702335 None] Lock "cinder-quobyte-c475c1ea-f15c-492a-a5ed-19852df5b939" released by "delete_volume" :: held 1.169s {{(pid=83528) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 25 15:59:08 devstack cinder-volume[83528]: DEBUG cinder.coordination [None req-1a0b37c5-be98-406f-80b9-f5699816714d tempest-VolumesActionsTest-1208865286 None] Lock "cinder-287168fc-0786-4716-8f23-273489f2849c" released by "attach_volume" :: held 0.113s {{(pid=83528) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 25 15:59:08 devstack cinder-volume[83528]: DEBUG cinder.quota [None req-0a9c80bc-641f-4766-8c4f-21a7f6293696 tempest-CreateVolumesFromImageTest-63702335 None] Created reservations ['f01e720c-a8d5-4def-a3d6-b820bbf47c3a', '0926ab08-27d9-404e-a395-469e1498d557', 'cad00b3e-4f28-4b5d-badf-e5bec8a6c3ec', '61e0a0b2-0144-457c-a7eb-eecfca13b1b4'] {{(pid=83528) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 25 15:59:08 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-0a9c80bc-641f-4766-8c4f-21a7f6293696 tempest-CreateVolumesFromImageTest-63702335 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 25 15:59:08 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-0a9c80bc-641f-4766-8c4f-21a7f6293696 tempest-CreateVolumesFromImageTest-63702335 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 25 15:59:08 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.quobyte [None req-0a9c80bc-641f-4766-8c4f-21a7f6293696 tempest-CreateVolumesFromImageTest-63702335 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23e9d725-3e04-4cd9-bfe0-c8ef43305589': None} {{(pid=83528) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 25 15:59:08 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.quobyte [None req-0a9c80bc-641f-4766-8c4f-21a7f6293696 tempest-CreateVolumesFromImageTest-63702335 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23e9d725-3e04-4cd9-bfe0-c8ef43305589'] {{(pid=83528) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 25 15:59:08 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-0a9c80bc-641f-4766-8c4f-21a7f6293696 tempest-CreateVolumesFromImageTest-63702335 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 25 15:59:08 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-0a9c80bc-641f-4766-8c4f-21a7f6293696 tempest-CreateVolumesFromImageTest-63702335 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85 {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 25 15:59:08 devstack sudo[90036]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85 Feb 25 15:59:08 devstack sudo[90036]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 25 15:59:09 devstack cinder-volume[83528]: DEBUG cinder.coordination [None req-aa47cad8-a05d-40b6-9e22-4732594f75ce tempest-VolumesActionsTest-1208865286 None] Acquiring lock "cinder-287168fc-0786-4716-8f23-273489f2849c-detach_volume" by "detach_volume" {{(pid=83528) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 25 15:59:09 devstack cinder-volume[83528]: DEBUG cinder.coordination [None req-aa47cad8-a05d-40b6-9e22-4732594f75ce tempest-VolumesActionsTest-1208865286 None] Lock "cinder-287168fc-0786-4716-8f23-273489f2849c-detach_volume" acquired by "detach_volume" :: waited 0.015s {{(pid=83528) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 25 15:59:09 devstack cinder-volume[83528]: INFO cinder.volume.manager [None req-aa47cad8-a05d-40b6-9e22-4732594f75ce tempest-VolumesActionsTest-1208865286 None] Detaching volume 287168fc-0786-4716-8f23-273489f2849c from instance ad33dbe7-13b9-4cd7-8105-ce7bd06d3433. Feb 25 15:59:09 devstack sudo[90036]: pam_unix(sudo:session): session closed for user root Feb 25 15:59:09 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-0a9c80bc-641f-4766-8c4f-21a7f6293696 tempest-CreateVolumesFromImageTest-63702335 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85" returned: 0 in 0.487s {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 25 15:59:09 devstack cinder-volume[83528]: DEBUG cinder.manager [None req-0a9c80bc-641f-4766-8c4f-21a7f6293696 tempest-CreateVolumesFromImageTest-63702335 None] Notifying Schedulers of capabilities ... {{(pid=83528) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 25 15:59:09 devstack cinder-volume[83528]: INFO cinder.volume.manager [None req-0a9c80bc-641f-4766-8c4f-21a7f6293696 tempest-CreateVolumesFromImageTest-63702335 None] Deleted volume successfully. Feb 25 15:59:09 devstack cinder-volume[83528]: INFO cinder.volume.manager [None req-aa47cad8-a05d-40b6-9e22-4732594f75ce tempest-VolumesActionsTest-1208865286 None] Detach volume completed successfully. Feb 25 15:59:09 devstack cinder-volume[83528]: DEBUG cinder.coordination [None req-aa47cad8-a05d-40b6-9e22-4732594f75ce tempest-VolumesActionsTest-1208865286 None] Lock "cinder-287168fc-0786-4716-8f23-273489f2849c-detach_volume" released by "detach_volume" :: held 0.071s {{(pid=83528) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 25 15:59:09 devstack cinder-volume[83528]: DEBUG cinder.coordination [None req-0a9c80bc-641f-4766-8c4f-21a7f6293696 tempest-CreateVolumesFromImageTest-63702335 None] Lock "cinder-c475c1ea-f15c-492a-a5ed-19852df5b939-delete_volume" released by "delete_volume" :: held 1.842s {{(pid=83528) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 25 15:59:09 devstack cinder-volume[83528]: DEBUG cinder.coordination [None req-08f9dbf4-9bb3-47a0-aa37-104c711d09b8 tempest-CreateVolumesFromImageTest-63702335 None] Acquiring lock "cinder-e5367f93-17d3-470c-80d9-5838abeb3815-delete_volume" by "delete_volume" {{(pid=83528) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 25 15:59:09 devstack cinder-volume[83528]: DEBUG cinder.coordination [None req-08f9dbf4-9bb3-47a0-aa37-104c711d09b8 tempest-CreateVolumesFromImageTest-63702335 None] Lock "cinder-e5367f93-17d3-470c-80d9-5838abeb3815-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=83528) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 25 15:59:09 devstack cinder-volume[83528]: DEBUG cinder.coordination [None req-08f9dbf4-9bb3-47a0-aa37-104c711d09b8 tempest-CreateVolumesFromImageTest-63702335 None] Acquiring lock "cinder-quobyte-e5367f93-17d3-470c-80d9-5838abeb3815" by "delete_volume" {{(pid=83528) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 25 15:59:09 devstack cinder-volume[83528]: DEBUG cinder.coordination [None req-08f9dbf4-9bb3-47a0-aa37-104c711d09b8 tempest-CreateVolumesFromImageTest-63702335 None] Lock "cinder-quobyte-e5367f93-17d3-470c-80d9-5838abeb3815" acquired by "delete_volume" :: waited 0.022s {{(pid=83528) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 25 15:59:09 devstack cinder-volume[83528]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7409740-7919-4666-8355-50d564233154]: (4, 'qcow2') {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 25 15:59:09 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-08f9dbf4-9bb3-47a0-aa37-104c711d09b8 tempest-CreateVolumesFromImageTest-63702335 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-e5367f93-17d3-470c-80d9-5838abeb3815 {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 25 15:59:09 devstack sudo[90039]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-e5367f93-17d3-470c-80d9-5838abeb3815 Feb 25 15:59:09 devstack sudo[90039]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 25 15:59:10 devstack sudo[90039]: pam_unix(sudo:session): session closed for user root Feb 25 15:59:10 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-08f9dbf4-9bb3-47a0-aa37-104c711d09b8 tempest-CreateVolumesFromImageTest-63702335 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-e5367f93-17d3-470c-80d9-5838abeb3815" returned: 0 in 0.558s {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 25 15:59:10 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-08f9dbf4-9bb3-47a0-aa37-104c711d09b8 tempest-CreateVolumesFromImageTest-63702335 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-e5367f93-17d3-470c-80d9-5838abeb3815 {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 25 15:59:10 devstack sudo[90044]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-e5367f93-17d3-470c-80d9-5838abeb3815 Feb 25 15:59:10 devstack sudo[90044]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 25 15:59:10 devstack sudo[90044]: pam_unix(sudo:session): session closed for user root Feb 25 15:59:10 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-08f9dbf4-9bb3-47a0-aa37-104c711d09b8 tempest-CreateVolumesFromImageTest-63702335 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-e5367f93-17d3-470c-80d9-5838abeb3815" returned: 0 in 0.452s {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 25 15:59:10 devstack cinder-volume[83528]: DEBUG cinder.coordination [None req-08f9dbf4-9bb3-47a0-aa37-104c711d09b8 tempest-CreateVolumesFromImageTest-63702335 None] Lock "cinder-quobyte-e5367f93-17d3-470c-80d9-5838abeb3815" released by "delete_volume" :: held 1.062s {{(pid=83528) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 25 15:59:10 devstack cinder-volume[83528]: DEBUG cinder.quota [None req-08f9dbf4-9bb3-47a0-aa37-104c711d09b8 tempest-CreateVolumesFromImageTest-63702335 None] Created reservations ['b8ed8b51-2d8a-4e8f-ab8f-12b88f44be33', '77e2f2df-4486-49ed-a8a7-a4695fb9148f', 'f4ce8000-2291-4e81-a7a2-c39c3f47df02', '742353ad-13bc-4a83-ae66-13615f2973ae'] {{(pid=83528) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 25 15:59:10 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-08f9dbf4-9bb3-47a0-aa37-104c711d09b8 tempest-CreateVolumesFromImageTest-63702335 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 25 15:59:10 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-08f9dbf4-9bb3-47a0-aa37-104c711d09b8 tempest-CreateVolumesFromImageTest-63702335 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 25 15:59:10 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.quobyte [None req-08f9dbf4-9bb3-47a0-aa37-104c711d09b8 tempest-CreateVolumesFromImageTest-63702335 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23e9d725-3e04-4cd9-bfe0-c8ef43305589': None} {{(pid=83528) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 25 15:59:10 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.quobyte [None req-08f9dbf4-9bb3-47a0-aa37-104c711d09b8 tempest-CreateVolumesFromImageTest-63702335 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23e9d725-3e04-4cd9-bfe0-c8ef43305589'] {{(pid=83528) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 25 15:59:10 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-08f9dbf4-9bb3-47a0-aa37-104c711d09b8 tempest-CreateVolumesFromImageTest-63702335 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 25 15:59:10 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-08f9dbf4-9bb3-47a0-aa37-104c711d09b8 tempest-CreateVolumesFromImageTest-63702335 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85 {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 25 15:59:10 devstack sudo[90056]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85 Feb 25 15:59:10 devstack sudo[90056]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 25 15:59:11 devstack sudo[90056]: pam_unix(sudo:session): session closed for user root Feb 25 15:59:11 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-08f9dbf4-9bb3-47a0-aa37-104c711d09b8 tempest-CreateVolumesFromImageTest-63702335 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85" returned: 0 in 0.545s {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 25 15:59:11 devstack cinder-volume[83528]: DEBUG cinder.manager [None req-08f9dbf4-9bb3-47a0-aa37-104c711d09b8 tempest-CreateVolumesFromImageTest-63702335 None] Notifying Schedulers of capabilities ... {{(pid=83528) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 25 15:59:11 devstack cinder-volume[83528]: INFO cinder.volume.manager [None req-08f9dbf4-9bb3-47a0-aa37-104c711d09b8 tempest-CreateVolumesFromImageTest-63702335 None] Deleted volume successfully. Feb 25 15:59:11 devstack cinder-volume[83528]: DEBUG cinder.coordination [None req-08f9dbf4-9bb3-47a0-aa37-104c711d09b8 tempest-CreateVolumesFromImageTest-63702335 None] Lock "cinder-e5367f93-17d3-470c-80d9-5838abeb3815-delete_volume" released by "delete_volume" :: held 1.816s {{(pid=83528) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 25 15:59:11 devstack cinder-volume[83528]: DEBUG cinder.coordination [None req-c6c206c7-5fcd-44c1-9623-2b7e32e23a1b tempest-CreateVolumesFromImageTest-63702335 None] Acquiring lock "cinder-b2926de3-931c-4942-8081-6fea2811d82a-delete_volume" by "delete_volume" {{(pid=83528) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 25 15:59:11 devstack cinder-volume[83528]: DEBUG cinder.coordination [None req-c6c206c7-5fcd-44c1-9623-2b7e32e23a1b tempest-CreateVolumesFromImageTest-63702335 None] Lock "cinder-b2926de3-931c-4942-8081-6fea2811d82a-delete_volume" acquired by "delete_volume" :: waited 0.014s {{(pid=83528) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 25 15:59:11 devstack cinder-volume[83528]: DEBUG cinder.coordination [None req-c6c206c7-5fcd-44c1-9623-2b7e32e23a1b tempest-CreateVolumesFromImageTest-63702335 None] Acquiring lock "cinder-quobyte-b2926de3-931c-4942-8081-6fea2811d82a" by "delete_volume" {{(pid=83528) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 25 15:59:11 devstack cinder-volume[83528]: DEBUG cinder.coordination [None req-c6c206c7-5fcd-44c1-9623-2b7e32e23a1b tempest-CreateVolumesFromImageTest-63702335 None] Lock "cinder-quobyte-b2926de3-931c-4942-8081-6fea2811d82a" acquired by "delete_volume" :: waited 0.013s {{(pid=83528) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 25 15:59:11 devstack cinder-volume[83528]: DEBUG oslo.privsep.daemon [-] privsep: reply[f089649e-d93a-4840-97d5-218244fe278a]: (4, 'qcow2') {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 25 15:59:11 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-c6c206c7-5fcd-44c1-9623-2b7e32e23a1b tempest-CreateVolumesFromImageTest-63702335 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-b2926de3-931c-4942-8081-6fea2811d82a {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 25 15:59:11 devstack sudo[90078]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-b2926de3-931c-4942-8081-6fea2811d82a Feb 25 15:59:11 devstack sudo[90078]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 25 15:59:12 devstack sudo[90078]: pam_unix(sudo:session): session closed for user root Feb 25 15:59:12 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-c6c206c7-5fcd-44c1-9623-2b7e32e23a1b tempest-CreateVolumesFromImageTest-63702335 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-b2926de3-931c-4942-8081-6fea2811d82a" returned: 0 in 0.529s {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 25 15:59:12 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-c6c206c7-5fcd-44c1-9623-2b7e32e23a1b tempest-CreateVolumesFromImageTest-63702335 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-b2926de3-931c-4942-8081-6fea2811d82a {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 25 15:59:12 devstack sudo[90083]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-b2926de3-931c-4942-8081-6fea2811d82a Feb 25 15:59:12 devstack sudo[90083]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 25 15:59:12 devstack sudo[90083]: pam_unix(sudo:session): session closed for user root Feb 25 15:59:12 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-c6c206c7-5fcd-44c1-9623-2b7e32e23a1b tempest-CreateVolumesFromImageTest-63702335 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-b2926de3-931c-4942-8081-6fea2811d82a" returned: 0 in 0.530s {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 25 15:59:12 devstack cinder-volume[83528]: DEBUG cinder.coordination [None req-c6c206c7-5fcd-44c1-9623-2b7e32e23a1b tempest-CreateVolumesFromImageTest-63702335 None] Lock "cinder-quobyte-b2926de3-931c-4942-8081-6fea2811d82a" released by "delete_volume" :: held 1.087s {{(pid=83528) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 25 15:59:12 devstack cinder-volume[83528]: DEBUG cinder.quota [None req-c6c206c7-5fcd-44c1-9623-2b7e32e23a1b tempest-CreateVolumesFromImageTest-63702335 None] Created reservations ['41fed441-1634-46ab-becd-70c5bc90ba59', '73a6b671-97c5-4896-be18-dae70470383b', 'b3bc386b-0b5c-4ac9-923c-4851dae5969e', 'bc0d3478-f287-4073-b4c1-5c3d4e9d097d'] {{(pid=83528) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 25 15:59:13 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-c6c206c7-5fcd-44c1-9623-2b7e32e23a1b tempest-CreateVolumesFromImageTest-63702335 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 25 15:59:13 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-c6c206c7-5fcd-44c1-9623-2b7e32e23a1b tempest-CreateVolumesFromImageTest-63702335 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 25 15:59:13 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.quobyte [None req-c6c206c7-5fcd-44c1-9623-2b7e32e23a1b tempest-CreateVolumesFromImageTest-63702335 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23e9d725-3e04-4cd9-bfe0-c8ef43305589': None} {{(pid=83528) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 25 15:59:13 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.quobyte [None req-c6c206c7-5fcd-44c1-9623-2b7e32e23a1b tempest-CreateVolumesFromImageTest-63702335 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23e9d725-3e04-4cd9-bfe0-c8ef43305589'] {{(pid=83528) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 25 15:59:13 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-c6c206c7-5fcd-44c1-9623-2b7e32e23a1b tempest-CreateVolumesFromImageTest-63702335 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 25 15:59:13 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-c6c206c7-5fcd-44c1-9623-2b7e32e23a1b tempest-CreateVolumesFromImageTest-63702335 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85 {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 25 15:59:13 devstack sudo[90122]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85 Feb 25 15:59:13 devstack sudo[90122]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 25 15:59:13 devstack sudo[90122]: pam_unix(sudo:session): session closed for user root Feb 25 15:59:13 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-c6c206c7-5fcd-44c1-9623-2b7e32e23a1b tempest-CreateVolumesFromImageTest-63702335 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85" returned: 0 in 0.495s {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 25 15:59:13 devstack cinder-volume[83528]: DEBUG cinder.manager [None req-c6c206c7-5fcd-44c1-9623-2b7e32e23a1b tempest-CreateVolumesFromImageTest-63702335 None] Notifying Schedulers of capabilities ... {{(pid=83528) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 25 15:59:13 devstack cinder-volume[83528]: INFO cinder.volume.manager [None req-c6c206c7-5fcd-44c1-9623-2b7e32e23a1b tempest-CreateVolumesFromImageTest-63702335 None] Deleted volume successfully. Feb 25 15:59:13 devstack cinder-volume[83528]: DEBUG cinder.coordination [None req-c6c206c7-5fcd-44c1-9623-2b7e32e23a1b tempest-CreateVolumesFromImageTest-63702335 None] Lock "cinder-b2926de3-931c-4942-8081-6fea2811d82a-delete_volume" released by "delete_volume" :: held 1.774s {{(pid=83528) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 25 15:59:13 devstack cinder-volume[83528]: DEBUG cinder.coordination [None req-7857bc4a-5857-40df-93d4-3ded91e91fa7 tempest-CreateVolumesFromImageTest-63702335 None] Acquiring lock "cinder-1dc40f40-89f7-46f5-b73d-b7959c09e0ef-delete_volume" by "delete_volume" {{(pid=83528) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 25 15:59:13 devstack cinder-volume[83528]: DEBUG cinder.coordination [None req-7857bc4a-5857-40df-93d4-3ded91e91fa7 tempest-CreateVolumesFromImageTest-63702335 None] Lock "cinder-1dc40f40-89f7-46f5-b73d-b7959c09e0ef-delete_volume" acquired by "delete_volume" :: waited 0.013s {{(pid=83528) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 25 15:59:14 devstack cinder-volume[83528]: DEBUG cinder.coordination [None req-7857bc4a-5857-40df-93d4-3ded91e91fa7 tempest-CreateVolumesFromImageTest-63702335 None] Acquiring lock "cinder-quobyte-1dc40f40-89f7-46f5-b73d-b7959c09e0ef" by "delete_volume" {{(pid=83528) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 25 15:59:14 devstack cinder-volume[83528]: DEBUG cinder.coordination [None req-7857bc4a-5857-40df-93d4-3ded91e91fa7 tempest-CreateVolumesFromImageTest-63702335 None] Lock "cinder-quobyte-1dc40f40-89f7-46f5-b73d-b7959c09e0ef" acquired by "delete_volume" :: waited 0.013s {{(pid=83528) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 25 15:59:14 devstack cinder-volume[83528]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f9e245e-88b6-4385-bb35-61e5c61ac1df]: (4, 'qcow2') {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 25 15:59:14 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-7857bc4a-5857-40df-93d4-3ded91e91fa7 tempest-CreateVolumesFromImageTest-63702335 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-1dc40f40-89f7-46f5-b73d-b7959c09e0ef {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 25 15:59:14 devstack sudo[90131]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-1dc40f40-89f7-46f5-b73d-b7959c09e0ef Feb 25 15:59:14 devstack sudo[90131]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 25 15:59:14 devstack sudo[90131]: pam_unix(sudo:session): session closed for user root Feb 25 15:59:14 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-7857bc4a-5857-40df-93d4-3ded91e91fa7 tempest-CreateVolumesFromImageTest-63702335 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-1dc40f40-89f7-46f5-b73d-b7959c09e0ef" returned: 0 in 0.492s {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 25 15:59:14 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-7857bc4a-5857-40df-93d4-3ded91e91fa7 tempest-CreateVolumesFromImageTest-63702335 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-1dc40f40-89f7-46f5-b73d-b7959c09e0ef {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 25 15:59:14 devstack sudo[90136]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-1dc40f40-89f7-46f5-b73d-b7959c09e0ef Feb 25 15:59:14 devstack sudo[90136]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 25 15:59:14 devstack sudo[90136]: pam_unix(sudo:session): session closed for user root Feb 25 15:59:14 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-7857bc4a-5857-40df-93d4-3ded91e91fa7 tempest-CreateVolumesFromImageTest-63702335 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-1dc40f40-89f7-46f5-b73d-b7959c09e0ef" returned: 0 in 0.431s {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 25 15:59:14 devstack cinder-volume[83528]: DEBUG cinder.coordination [None req-7857bc4a-5857-40df-93d4-3ded91e91fa7 tempest-CreateVolumesFromImageTest-63702335 None] Lock "cinder-quobyte-1dc40f40-89f7-46f5-b73d-b7959c09e0ef" released by "delete_volume" :: held 0.952s {{(pid=83528) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 25 15:59:15 devstack cinder-volume[83528]: DEBUG cinder.quota [None req-7857bc4a-5857-40df-93d4-3ded91e91fa7 tempest-CreateVolumesFromImageTest-63702335 None] Created reservations ['987dc8f4-5210-4072-b85e-9cc268f8230a', '2e5ff024-3b82-40e4-a547-25cadd345022', '067844f0-54ab-447d-892f-c7a95516213e', '41a7d196-00df-4c85-a330-0fc3e01b08da'] {{(pid=83528) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 25 15:59:15 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-7857bc4a-5857-40df-93d4-3ded91e91fa7 tempest-CreateVolumesFromImageTest-63702335 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 25 15:59:15 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-7857bc4a-5857-40df-93d4-3ded91e91fa7 tempest-CreateVolumesFromImageTest-63702335 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 25 15:59:15 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.quobyte [None req-7857bc4a-5857-40df-93d4-3ded91e91fa7 tempest-CreateVolumesFromImageTest-63702335 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23e9d725-3e04-4cd9-bfe0-c8ef43305589': None} {{(pid=83528) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 25 15:59:15 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.quobyte [None req-7857bc4a-5857-40df-93d4-3ded91e91fa7 tempest-CreateVolumesFromImageTest-63702335 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23e9d725-3e04-4cd9-bfe0-c8ef43305589'] {{(pid=83528) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 25 15:59:15 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-7857bc4a-5857-40df-93d4-3ded91e91fa7 tempest-CreateVolumesFromImageTest-63702335 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 25 15:59:15 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-7857bc4a-5857-40df-93d4-3ded91e91fa7 tempest-CreateVolumesFromImageTest-63702335 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85 {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 25 15:59:15 devstack sudo[90140]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85 Feb 25 15:59:15 devstack sudo[90140]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 25 15:59:15 devstack sudo[90140]: pam_unix(sudo:session): session closed for user root Feb 25 15:59:15 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-7857bc4a-5857-40df-93d4-3ded91e91fa7 tempest-CreateVolumesFromImageTest-63702335 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85" returned: 0 in 0.511s {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 25 15:59:15 devstack cinder-volume[83528]: DEBUG cinder.manager [None req-7857bc4a-5857-40df-93d4-3ded91e91fa7 tempest-CreateVolumesFromImageTest-63702335 None] Notifying Schedulers of capabilities ... {{(pid=83528) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 25 15:59:15 devstack cinder-volume[83528]: INFO cinder.volume.manager [None req-7857bc4a-5857-40df-93d4-3ded91e91fa7 tempest-CreateVolumesFromImageTest-63702335 None] Deleted volume successfully. Feb 25 15:59:15 devstack cinder-volume[83528]: DEBUG cinder.coordination [None req-7857bc4a-5857-40df-93d4-3ded91e91fa7 tempest-CreateVolumesFromImageTest-63702335 None] Lock "cinder-1dc40f40-89f7-46f5-b73d-b7959c09e0ef-delete_volume" released by "delete_volume" :: held 1.675s {{(pid=83528) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 25 15:59:16 devstack cinder-volume[83528]: DEBUG cinder.coordination [None req-b6e458af-cd18-4fb2-a86a-9d101e225218 tempest-CreateVolumesFromImageTest-63702335 None] Acquiring lock "cinder-e310405f-6cff-4a73-8336-64698ed3b2cf-delete_volume" by "delete_volume" {{(pid=83528) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 25 15:59:16 devstack cinder-volume[83528]: DEBUG cinder.coordination [None req-b6e458af-cd18-4fb2-a86a-9d101e225218 tempest-CreateVolumesFromImageTest-63702335 None] Lock "cinder-e310405f-6cff-4a73-8336-64698ed3b2cf-delete_volume" acquired by "delete_volume" :: waited 0.012s {{(pid=83528) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 25 15:59:16 devstack cinder-volume[83528]: DEBUG dbcounter [-] [83528] Writing DB stats cinder:SELECT=118,cinder:UPDATE=146,cinder:INSERT=40,cinder:DELETE=14 {{(pid=83528) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Feb 25 15:59:16 devstack cinder-volume[83528]: DEBUG dbcounter [-] [83528] Writing DB stats cinder:UPDATE=127,cinder:SELECT=117,cinder:INSERT=39,cinder:DELETE=10 {{(pid=83528) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Feb 25 15:59:16 devstack cinder-volume[83528]: DEBUG cinder.coordination [None req-b6e458af-cd18-4fb2-a86a-9d101e225218 tempest-CreateVolumesFromImageTest-63702335 None] Acquiring lock "cinder-quobyte-e310405f-6cff-4a73-8336-64698ed3b2cf" by "delete_volume" {{(pid=83528) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 25 15:59:16 devstack cinder-volume[83528]: DEBUG cinder.coordination [None req-b6e458af-cd18-4fb2-a86a-9d101e225218 tempest-CreateVolumesFromImageTest-63702335 None] Lock "cinder-quobyte-e310405f-6cff-4a73-8336-64698ed3b2cf" acquired by "delete_volume" :: waited 0.016s {{(pid=83528) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 25 15:59:16 devstack cinder-volume[83528]: DEBUG oslo.privsep.daemon [-] privsep: reply[71e99001-03c6-4536-8971-064ac49bf3b0]: (4, 'qcow2') {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 25 15:59:16 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-b6e458af-cd18-4fb2-a86a-9d101e225218 tempest-CreateVolumesFromImageTest-63702335 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-e310405f-6cff-4a73-8336-64698ed3b2cf {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 25 15:59:16 devstack sudo[90143]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-e310405f-6cff-4a73-8336-64698ed3b2cf Feb 25 15:59:16 devstack sudo[90143]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 25 15:59:16 devstack sudo[90143]: pam_unix(sudo:session): session closed for user root Feb 25 15:59:16 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-b6e458af-cd18-4fb2-a86a-9d101e225218 tempest-CreateVolumesFromImageTest-63702335 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-e310405f-6cff-4a73-8336-64698ed3b2cf" returned: 0 in 0.484s {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 25 15:59:16 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-b6e458af-cd18-4fb2-a86a-9d101e225218 tempest-CreateVolumesFromImageTest-63702335 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-e310405f-6cff-4a73-8336-64698ed3b2cf {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 25 15:59:16 devstack sudo[90148]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-e310405f-6cff-4a73-8336-64698ed3b2cf Feb 25 15:59:16 devstack sudo[90148]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 25 15:59:17 devstack sudo[90148]: pam_unix(sudo:session): session closed for user root Feb 25 15:59:17 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-b6e458af-cd18-4fb2-a86a-9d101e225218 tempest-CreateVolumesFromImageTest-63702335 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-e310405f-6cff-4a73-8336-64698ed3b2cf" returned: 0 in 0.522s {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 25 15:59:17 devstack cinder-volume[83528]: DEBUG cinder.coordination [None req-b6e458af-cd18-4fb2-a86a-9d101e225218 tempest-CreateVolumesFromImageTest-63702335 None] Lock "cinder-quobyte-e310405f-6cff-4a73-8336-64698ed3b2cf" released by "delete_volume" :: held 1.037s {{(pid=83528) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 25 15:59:17 devstack cinder-volume[83528]: DEBUG cinder.quota [None req-b6e458af-cd18-4fb2-a86a-9d101e225218 tempest-CreateVolumesFromImageTest-63702335 None] Created reservations ['d44d9af1-062e-43fb-8f6d-4ec32a79ac65', '522d8f5f-d5de-45e4-8843-3d7717d87761', 'c27027bd-e628-4539-ab24-fa7e0e4b5231', '77291f98-283d-4f97-b8c3-0ba47581493e'] {{(pid=83528) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 25 15:59:17 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-b6e458af-cd18-4fb2-a86a-9d101e225218 tempest-CreateVolumesFromImageTest-63702335 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 25 15:59:17 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-b6e458af-cd18-4fb2-a86a-9d101e225218 tempest-CreateVolumesFromImageTest-63702335 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 25 15:59:17 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.quobyte [None req-b6e458af-cd18-4fb2-a86a-9d101e225218 tempest-CreateVolumesFromImageTest-63702335 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23e9d725-3e04-4cd9-bfe0-c8ef43305589': None} {{(pid=83528) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 25 15:59:17 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.quobyte [None req-b6e458af-cd18-4fb2-a86a-9d101e225218 tempest-CreateVolumesFromImageTest-63702335 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23e9d725-3e04-4cd9-bfe0-c8ef43305589'] {{(pid=83528) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 25 15:59:17 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-b6e458af-cd18-4fb2-a86a-9d101e225218 tempest-CreateVolumesFromImageTest-63702335 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 25 15:59:17 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-b6e458af-cd18-4fb2-a86a-9d101e225218 tempest-CreateVolumesFromImageTest-63702335 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85 {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 25 15:59:17 devstack sudo[90151]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85 Feb 25 15:59:17 devstack sudo[90151]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 25 15:59:17 devstack sudo[90151]: pam_unix(sudo:session): session closed for user root Feb 25 15:59:17 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-b6e458af-cd18-4fb2-a86a-9d101e225218 tempest-CreateVolumesFromImageTest-63702335 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85" returned: 0 in 0.564s {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 25 15:59:17 devstack cinder-volume[83528]: DEBUG cinder.manager [None req-b6e458af-cd18-4fb2-a86a-9d101e225218 tempest-CreateVolumesFromImageTest-63702335 None] Notifying Schedulers of capabilities ... {{(pid=83528) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 25 15:59:17 devstack cinder-volume[83528]: INFO cinder.volume.manager [None req-b6e458af-cd18-4fb2-a86a-9d101e225218 tempest-CreateVolumesFromImageTest-63702335 None] Deleted volume successfully. Feb 25 15:59:17 devstack cinder-volume[83528]: DEBUG cinder.coordination [None req-b6e458af-cd18-4fb2-a86a-9d101e225218 tempest-CreateVolumesFromImageTest-63702335 None] Lock "cinder-e310405f-6cff-4a73-8336-64698ed3b2cf-delete_volume" released by "delete_volume" :: held 1.778s {{(pid=83528) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 25 15:59:18 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-25df3f81-7be5-4a0b-a2d8-c0e4baee5ef6 tempest-VolumesActionsTest-1208865286 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 25 15:59:18 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-25df3f81-7be5-4a0b-a2d8-c0e4baee5ef6 tempest-VolumesActionsTest-1208865286 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.001s {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 25 15:59:18 devstack cinder-volume[83528]: DEBUG oslo.privsep.daemon [-] privsep: reply[78555494-ffc4-4cad-af66-f930b0fe4d7a]: (4, 'qcow2') {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 25 15:59:18 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-25df3f81-7be5-4a0b-a2d8-c0e4baee5ef6 tempest-VolumesActionsTest-1208865286 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-287168fc-0786-4716-8f23-273489f2849c {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 25 15:59:18 devstack sudo[90154]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-287168fc-0786-4716-8f23-273489f2849c Feb 25 15:59:18 devstack sudo[90154]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 25 15:59:18 devstack sudo[90154]: pam_unix(sudo:session): session closed for user root Feb 25 15:59:18 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-25df3f81-7be5-4a0b-a2d8-c0e4baee5ef6 tempest-VolumesActionsTest-1208865286 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-287168fc-0786-4716-8f23-273489f2849c" returned: 0 in 0.581s {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 25 15:59:19 devstack cinder-volume[83528]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b76c2be-5a14-417d-9147-0eb9e1256d67]: (4, 'qcow2') {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 25 15:59:19 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-25df3f81-7be5-4a0b-a2d8-c0e4baee5ef6 tempest-VolumesActionsTest-1208865286 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-287168fc-0786-4716-8f23-273489f2849c {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 25 15:59:19 devstack sudo[90159]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-287168fc-0786-4716-8f23-273489f2849c Feb 25 15:59:19 devstack sudo[90159]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 25 15:59:19 devstack sudo[90159]: pam_unix(sudo:session): session closed for user root Feb 25 15:59:19 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-25df3f81-7be5-4a0b-a2d8-c0e4baee5ef6 tempest-VolumesActionsTest-1208865286 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-287168fc-0786-4716-8f23-273489f2849c" returned: 0 in 0.572s {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 25 15:59:19 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-25df3f81-7be5-4a0b-a2d8-c0e4baee5ef6 tempest-VolumesActionsTest-1208865286 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-287168fc-0786-4716-8f23-273489f2849c /opt/stack/data/cinder/conversion/287168fc-0786-4716-8f23-273489f2849c.temp_image.27534617-40a1-4958-8d22-ead13ba0cd04bxb43pwg.img {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 25 15:59:19 devstack sudo[90164]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-287168fc-0786-4716-8f23-273489f2849c /opt/stack/data/cinder/conversion/287168fc-0786-4716-8f23-273489f2849c.temp_image.27534617-40a1-4958-8d22-ead13ba0cd04bxb43pwg.img Feb 25 15:59:19 devstack sudo[90164]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 25 15:59:21 devstack cinder-volume[83528]: DEBUG cinder.volume.flows.manager.create_volume [None req-3045349a-3a37-4fae-91c2-40694beb7a64 tempest-CreateVolumesFromSnapshotTest-47770248 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83528) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 25 15:59:21 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-3045349a-3a37-4fae-91c2-40694beb7a64 tempest-CreateVolumesFromSnapshotTest-47770248 None] Flow 'volume_create_manager' (b9af25cc-a221-405e-8832-b2e4a418d628) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83528) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 25 15:59:21 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-3045349a-3a37-4fae-91c2-40694beb7a64 tempest-CreateVolumesFromSnapshotTest-47770248 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (424fe542-12b0-4959-9482-48d27af43e26) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 25 15:59:21 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-3045349a-3a37-4fae-91c2-40694beb7a64 tempest-CreateVolumesFromSnapshotTest-47770248 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (424fe542-12b0-4959-9482-48d27af43e26) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-25T14:59:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1484761862',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d1e5d330-5abd-438f-aba5-8deb8db05d57,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4fd17f6347f546a0847e79faf1fb9f08',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-25T14:59:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-25T14:59:21Z,use_quota=True,user_id='78613f76755f4713a6224fe4b0996917',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ce71c2f9-6543-4165-9653-a1529b2ea243),volume_type_id=ce71c2f9-6543-4165-9653-a1529b2ea243)' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 25 15:59:21 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-3045349a-3a37-4fae-91c2-40694beb7a64 tempest-CreateVolumesFromSnapshotTest-47770248 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6edccf00-d3b1-433c-a7e8-c3cc1c6be5f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 25 15:59:21 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-3045349a-3a37-4fae-91c2-40694beb7a64 tempest-CreateVolumesFromSnapshotTest-47770248 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6edccf00-d3b1-433c-a7e8-c3cc1c6be5f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 25 15:59:21 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-3045349a-3a37-4fae-91c2-40694beb7a64 tempest-CreateVolumesFromSnapshotTest-47770248 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (036e343d-0ce1-4017-84a8-ffdc80afe51d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 25 15:59:21 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-3045349a-3a37-4fae-91c2-40694beb7a64 tempest-CreateVolumesFromSnapshotTest-47770248 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (036e343d-0ce1-4017-84a8-ffdc80afe51d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd1e5d330-5abd-438f-aba5-8deb8db05d57', 'volume_name': 'volume-d1e5d330-5abd-438f-aba5-8deb8db05d57', 'volume_size': 1}' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 25 15:59:21 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-3045349a-3a37-4fae-91c2-40694beb7a64 tempest-CreateVolumesFromSnapshotTest-47770248 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bcb5931e-79c6-4eaf-971d-09403a501404) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 25 15:59:21 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-3045349a-3a37-4fae-91c2-40694beb7a64 tempest-CreateVolumesFromSnapshotTest-47770248 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bcb5931e-79c6-4eaf-971d-09403a501404) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 25 15:59:21 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-3045349a-3a37-4fae-91c2-40694beb7a64 tempest-CreateVolumesFromSnapshotTest-47770248 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (894f25b6-a8c1-4e15-8be6-fd5b47e19cd9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 25 15:59:21 devstack cinder-volume[83528]: INFO cinder.volume.flows.manager.create_volume [None req-3045349a-3a37-4fae-91c2-40694beb7a64 tempest-CreateVolumesFromSnapshotTest-47770248 None] Volume d1e5d330-5abd-438f-aba5-8deb8db05d57: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d1e5d330-5abd-438f-aba5-8deb8db05d57', 'volume_size': 1} Feb 25 15:59:21 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-3045349a-3a37-4fae-91c2-40694beb7a64 tempest-CreateVolumesFromSnapshotTest-47770248 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 25 15:59:21 devstack sudo[90164]: pam_unix(sudo:session): session closed for user root Feb 25 15:59:21 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-25df3f81-7be5-4a0b-a2d8-c0e4baee5ef6 tempest-VolumesActionsTest-1208865286 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-287168fc-0786-4716-8f23-273489f2849c /opt/stack/data/cinder/conversion/287168fc-0786-4716-8f23-273489f2849c.temp_image.27534617-40a1-4958-8d22-ead13ba0cd04bxb43pwg.img" returned: 0 in 2.042s {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 25 15:59:21 devstack cinder-volume[83528]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ed5689f-0c86-47f2-9b92-50aa5622e28c]: (4, 'qcow2') {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 25 15:59:21 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-25df3f81-7be5-4a0b-a2d8-c0e4baee5ef6 tempest-VolumesActionsTest-1208865286 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-287168fc-0786-4716-8f23-273489f2849c {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 25 15:59:21 devstack sudo[90176]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-287168fc-0786-4716-8f23-273489f2849c Feb 25 15:59:21 devstack sudo[90176]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 25 15:59:22 devstack sudo[90176]: pam_unix(sudo:session): session closed for user root Feb 25 15:59:22 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-25df3f81-7be5-4a0b-a2d8-c0e4baee5ef6 tempest-VolumesActionsTest-1208865286 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-287168fc-0786-4716-8f23-273489f2849c" returned: 0 in 0.593s {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 25 15:59:22 devstack cinder-volume[83528]: DEBUG cinder.image.image_utils [None req-25df3f81-7be5-4a0b-a2d8-c0e4baee5ef6 tempest-VolumesActionsTest-1208865286 None] Image conversion details: src /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-287168fc-0786-4716-8f23-273489f2849c, size 1024.00 MB, duration 2.04 sec, destination /opt/stack/data/cinder/conversion/287168fc-0786-4716-8f23-273489f2849c.temp_image.27534617-40a1-4958-8d22-ead13ba0cd04bxb43pwg.img {{(pid=83528) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Feb 25 15:59:22 devstack cinder-volume[83528]: INFO cinder.image.image_utils [None req-25df3f81-7be5-4a0b-a2d8-c0e4baee5ef6 tempest-VolumesActionsTest-1208865286 None] Converted 1024.00 MB image at 501.32 MB/s Feb 25 15:59:22 devstack cinder-volume[83528]: DEBUG cinder.image.image_utils [None req-25df3f81-7be5-4a0b-a2d8-c0e4baee5ef6 tempest-VolumesActionsTest-1208865286 None] 27534617-40a1-4958-8d22-ead13ba0cd04 was raw, no need to convert to raw {{(pid=83528) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1159}} Feb 25 15:59:32 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-25df3f81-7be5-4a0b-a2d8-c0e4baee5ef6 tempest-VolumesActionsTest-1208865286 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 13.849s {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 25 15:59:32 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-25df3f81-7be5-4a0b-a2d8-c0e4baee5ef6 tempest-VolumesActionsTest-1208865286 None] Uploaded volume to glance image-id: 27534617-40a1-4958-8d22-ead13ba0cd04. {{(pid=83528) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Feb 25 15:59:32 devstack cinder-volume[83528]: DEBUG dbcounter [-] [83528] Writing DB stats cinder:SELECT=10,cinder:INSERT=2,cinder:UPDATE=11 {{(pid=83528) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Feb 25 15:59:32 devstack cinder-volume[83528]: DEBUG dbcounter [-] [83528] Writing DB stats cinder:SELECT=4,cinder:INSERT=2,cinder:UPDATE=5,cinder:DELETE=1 {{(pid=83528) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Feb 25 15:59:32 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-3045349a-3a37-4fae-91c2-40694beb7a64 tempest-CreateVolumesFromSnapshotTest-47770248 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 10.899s {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 25 15:59:32 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.quobyte [None req-3045349a-3a37-4fae-91c2-40694beb7a64 tempest-CreateVolumesFromSnapshotTest-47770248 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-25T14:59:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1484761862',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d1e5d330-5abd-438f-aba5-8deb8db05d57,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4fd17f6347f546a0847e79faf1fb9f08',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-25T14:59:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-25T14:59:21Z,use_quota=True,user_id='78613f76755f4713a6224fe4b0996917',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ce71c2f9-6543-4165-9653-a1529b2ea243),volume_type_id=ce71c2f9-6543-4165-9653-a1529b2ea243)}" {{(pid=83528) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 25 15:59:32 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.remotefs [None req-3045349a-3a37-4fae-91c2-40694beb7a64 tempest-CreateVolumesFromSnapshotTest-47770248 None] Creating volume d1e5d330-5abd-438f-aba5-8deb8db05d57 {{(pid=83528) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 25 15:59:32 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-3045349a-3a37-4fae-91c2-40694beb7a64 tempest-CreateVolumesFromSnapshotTest-47770248 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 25 15:59:32 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-3045349a-3a37-4fae-91c2-40694beb7a64 tempest-CreateVolumesFromSnapshotTest-47770248 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 25 15:59:32 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.quobyte [None req-3045349a-3a37-4fae-91c2-40694beb7a64 tempest-CreateVolumesFromSnapshotTest-47770248 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23e9d725-3e04-4cd9-bfe0-c8ef43305589': None} {{(pid=83528) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 25 15:59:32 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.quobyte [None req-3045349a-3a37-4fae-91c2-40694beb7a64 tempest-CreateVolumesFromSnapshotTest-47770248 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23e9d725-3e04-4cd9-bfe0-c8ef43305589'] {{(pid=83528) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 25 15:59:32 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-3045349a-3a37-4fae-91c2-40694beb7a64 tempest-CreateVolumesFromSnapshotTest-47770248 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 25 15:59:32 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.quobyte [None req-3045349a-3a37-4fae-91c2-40694beb7a64 tempest-CreateVolumesFromSnapshotTest-47770248 None] Selected osci02.corp.quobyte.com/cinder-vol-23e9d725-3e04-4cd9-bfe0-c8ef43305589 as target Quobyte volume. {{(pid=83528) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 25 15:59:32 devstack cinder-volume[83528]: INFO cinder.volume.drivers.remotefs [None req-3045349a-3a37-4fae-91c2-40694beb7a64 tempest-CreateVolumesFromSnapshotTest-47770248 None] casted to osci02.corp.quobyte.com/cinder-vol-23e9d725-3e04-4cd9-bfe0-c8ef43305589 Feb 25 15:59:32 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-3045349a-3a37-4fae-91c2-40694beb7a64 tempest-CreateVolumesFromSnapshotTest-47770248 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-d1e5d330-5abd-438f-aba5-8deb8db05d57 1073741824 {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 25 15:59:32 devstack sudo[90185]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-d1e5d330-5abd-438f-aba5-8deb8db05d57 1073741824 Feb 25 15:59:32 devstack sudo[90185]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 25 15:59:32 devstack cinder-volume[83528]: INFO cinder.volume.manager [None req-25df3f81-7be5-4a0b-a2d8-c0e4baee5ef6 tempest-VolumesActionsTest-1208865286 None] Copy volume to image completed successfully. Feb 25 15:59:32 devstack sudo[90185]: pam_unix(sudo:session): session closed for user root Feb 25 15:59:32 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-3045349a-3a37-4fae-91c2-40694beb7a64 tempest-CreateVolumesFromSnapshotTest-47770248 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-d1e5d330-5abd-438f-aba5-8deb8db05d57 1073741824" returned: 0 in 0.535s {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 25 15:59:32 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-3045349a-3a37-4fae-91c2-40694beb7a64 tempest-CreateVolumesFromSnapshotTest-47770248 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-d1e5d330-5abd-438f-aba5-8deb8db05d57 {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 25 15:59:32 devstack sudo[90192]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-d1e5d330-5abd-438f-aba5-8deb8db05d57 Feb 25 15:59:32 devstack sudo[90192]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 25 15:59:33 devstack sudo[90192]: pam_unix(sudo:session): session closed for user root Feb 25 15:59:33 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-3045349a-3a37-4fae-91c2-40694beb7a64 tempest-CreateVolumesFromSnapshotTest-47770248 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-d1e5d330-5abd-438f-aba5-8deb8db05d57" returned: 0 in 0.474s {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 25 15:59:33 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.quobyte [None req-3045349a-3a37-4fae-91c2-40694beb7a64 tempest-CreateVolumesFromSnapshotTest-47770248 None] <== create_volume: return (1042ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-23e9d725-3e04-4cd9-bfe0-c8ef43305589'} {{(pid=83528) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 25 15:59:33 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-3045349a-3a37-4fae-91c2-40694beb7a64 tempest-CreateVolumesFromSnapshotTest-47770248 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.045s {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 25 15:59:33 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-3045349a-3a37-4fae-91c2-40694beb7a64 tempest-CreateVolumesFromSnapshotTest-47770248 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (894f25b6-a8c1-4e15-8be6-fd5b47e19cd9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d1e5d330-5abd-438f-aba5-8deb8db05d57', 'volume_size': 1}' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 25 15:59:33 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-3045349a-3a37-4fae-91c2-40694beb7a64 tempest-CreateVolumesFromSnapshotTest-47770248 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (745808f3-2824-42a9-af42-b0e82dd6ab66) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 25 15:59:33 devstack cinder-volume[83528]: INFO cinder.volume.flows.manager.create_volume [None req-3045349a-3a37-4fae-91c2-40694beb7a64 tempest-CreateVolumesFromSnapshotTest-47770248 None] Volume volume-d1e5d330-5abd-438f-aba5-8deb8db05d57 (d1e5d330-5abd-438f-aba5-8deb8db05d57): created successfully Feb 25 15:59:33 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-3045349a-3a37-4fae-91c2-40694beb7a64 tempest-CreateVolumesFromSnapshotTest-47770248 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (745808f3-2824-42a9-af42-b0e82dd6ab66) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 25 15:59:33 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-3045349a-3a37-4fae-91c2-40694beb7a64 tempest-CreateVolumesFromSnapshotTest-47770248 None] Flow 'volume_create_manager' (b9af25cc-a221-405e-8832-b2e4a418d628) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83528) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 25 15:59:33 devstack cinder-volume[83528]: INFO cinder.volume.manager [None req-3045349a-3a37-4fae-91c2-40694beb7a64 tempest-CreateVolumesFromSnapshotTest-47770248 None] Created volume successfully. Feb 25 15:59:33 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-bb52951a-94eb-45a5-aa58-975fcbeb1306 tempest-VolumesActionsTest-1208865286 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 25 15:59:33 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-bb52951a-94eb-45a5-aa58-975fcbeb1306 tempest-VolumesActionsTest-1208865286 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.001s {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 25 15:59:33 devstack cinder-volume[83528]: DEBUG oslo.privsep.daemon [-] privsep: reply[9bfeee58-ee66-47f0-8eba-1f9f88c0470a]: (4, 'qcow2') {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 25 15:59:33 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-bb52951a-94eb-45a5-aa58-975fcbeb1306 tempest-VolumesActionsTest-1208865286 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-287168fc-0786-4716-8f23-273489f2849c {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 25 15:59:33 devstack sudo[90195]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-287168fc-0786-4716-8f23-273489f2849c Feb 25 15:59:33 devstack sudo[90195]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 25 15:59:33 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-9864a2e7-7026-45b3-9072-950cfbdb86d5 tempest-CreateVolumesFromSnapshotTest-47770248 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 25 15:59:34 devstack sudo[90195]: pam_unix(sudo:session): session closed for user root Feb 25 15:59:34 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-bb52951a-94eb-45a5-aa58-975fcbeb1306 tempest-VolumesActionsTest-1208865286 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-287168fc-0786-4716-8f23-273489f2849c" returned: 0 in 0.523s {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 25 15:59:34 devstack cinder-volume[83528]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7bbf7f5-84de-4b40-affd-db30ae680606]: (4, 'qcow2') {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 25 15:59:34 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-bb52951a-94eb-45a5-aa58-975fcbeb1306 tempest-VolumesActionsTest-1208865286 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-287168fc-0786-4716-8f23-273489f2849c {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 25 15:59:34 devstack sudo[90200]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-287168fc-0786-4716-8f23-273489f2849c Feb 25 15:59:34 devstack sudo[90200]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 25 15:59:34 devstack sudo[90200]: pam_unix(sudo:session): session closed for user root Feb 25 15:59:34 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-bb52951a-94eb-45a5-aa58-975fcbeb1306 tempest-VolumesActionsTest-1208865286 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-287168fc-0786-4716-8f23-273489f2849c" returned: 0 in 0.481s {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 25 15:59:34 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-bb52951a-94eb-45a5-aa58-975fcbeb1306 tempest-VolumesActionsTest-1208865286 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-287168fc-0786-4716-8f23-273489f2849c /opt/stack/data/cinder/conversion/287168fc-0786-4716-8f23-273489f2849c.temp_image.d47c41b8-66c3-4fe3-928c-bd7119e431fack_27ye4.img {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 25 15:59:34 devstack sudo[90205]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-287168fc-0786-4716-8f23-273489f2849c /opt/stack/data/cinder/conversion/287168fc-0786-4716-8f23-273489f2849c.temp_image.d47c41b8-66c3-4fe3-928c-bd7119e431fack_27ye4.img Feb 25 15:59:34 devstack sudo[90205]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 25 15:59:36 devstack sudo[90205]: pam_unix(sudo:session): session closed for user root Feb 25 15:59:36 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-bb52951a-94eb-45a5-aa58-975fcbeb1306 tempest-VolumesActionsTest-1208865286 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-287168fc-0786-4716-8f23-273489f2849c /opt/stack/data/cinder/conversion/287168fc-0786-4716-8f23-273489f2849c.temp_image.d47c41b8-66c3-4fe3-928c-bd7119e431fack_27ye4.img" returned: 0 in 2.071s {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 25 15:59:36 devstack cinder-volume[83528]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f73d962-2205-4455-9a16-c46148c4ecf6]: (4, 'qcow2') {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 25 15:59:36 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-bb52951a-94eb-45a5-aa58-975fcbeb1306 tempest-VolumesActionsTest-1208865286 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-287168fc-0786-4716-8f23-273489f2849c {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 25 15:59:36 devstack sudo[90218]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-287168fc-0786-4716-8f23-273489f2849c Feb 25 15:59:36 devstack sudo[90218]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 25 15:59:37 devstack sudo[90218]: pam_unix(sudo:session): session closed for user root Feb 25 15:59:37 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-bb52951a-94eb-45a5-aa58-975fcbeb1306 tempest-VolumesActionsTest-1208865286 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-287168fc-0786-4716-8f23-273489f2849c" returned: 0 in 0.612s {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 25 15:59:37 devstack cinder-volume[83528]: DEBUG cinder.image.image_utils [None req-bb52951a-94eb-45a5-aa58-975fcbeb1306 tempest-VolumesActionsTest-1208865286 None] Image conversion details: src /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-287168fc-0786-4716-8f23-273489f2849c, size 1024.00 MB, duration 2.07 sec, destination /opt/stack/data/cinder/conversion/287168fc-0786-4716-8f23-273489f2849c.temp_image.d47c41b8-66c3-4fe3-928c-bd7119e431fack_27ye4.img {{(pid=83528) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Feb 25 15:59:37 devstack cinder-volume[83528]: INFO cinder.image.image_utils [None req-bb52951a-94eb-45a5-aa58-975fcbeb1306 tempest-VolumesActionsTest-1208865286 None] Converted 1024.00 MB image at 494.19 MB/s Feb 25 15:59:37 devstack cinder-volume[83528]: DEBUG cinder.image.image_utils [None req-bb52951a-94eb-45a5-aa58-975fcbeb1306 tempest-VolumesActionsTest-1208865286 None] d47c41b8-66c3-4fe3-928c-bd7119e431fa was raw, converting to qcow2 {{(pid=83528) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1176}} Feb 25 15:59:37 devstack cinder-volume[83528]: DEBUG oslo.privsep.daemon [-] privsep: reply[e36b0b9f-8d03-47d6-80cb-9cad1bfdb166]: (4, 'raw') {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 25 15:59:37 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-bb52951a-94eb-45a5-aa58-975fcbeb1306 tempest-VolumesActionsTest-1208865286 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/287168fc-0786-4716-8f23-273489f2849c.temp_image.d47c41b8-66c3-4fe3-928c-bd7119e431fack_27ye4.img {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 25 15:59:37 devstack sudo[90223]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/287168fc-0786-4716-8f23-273489f2849c.temp_image.d47c41b8-66c3-4fe3-928c-bd7119e431fack_27ye4.img Feb 25 15:59:37 devstack sudo[90223]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 25 15:59:37 devstack sudo[90223]: pam_unix(sudo:session): session closed for user root Feb 25 15:59:37 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-bb52951a-94eb-45a5-aa58-975fcbeb1306 tempest-VolumesActionsTest-1208865286 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/287168fc-0786-4716-8f23-273489f2849c.temp_image.d47c41b8-66c3-4fe3-928c-bd7119e431fack_27ye4.img" returned: 0 in 0.476s {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 25 15:59:37 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-bb52951a-94eb-45a5-aa58-975fcbeb1306 tempest-VolumesActionsTest-1208865286 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/287168fc-0786-4716-8f23-273489f2849c.temp_image.d47c41b8-66c3-4fe3-928c-bd7119e431fack_27ye4.img {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 25 15:59:37 devstack sudo[90227]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/287168fc-0786-4716-8f23-273489f2849c.temp_image.d47c41b8-66c3-4fe3-928c-bd7119e431fack_27ye4.img Feb 25 15:59:37 devstack sudo[90227]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 25 15:59:38 devstack sudo[90227]: pam_unix(sudo:session): session closed for user root Feb 25 15:59:38 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-bb52951a-94eb-45a5-aa58-975fcbeb1306 tempest-VolumesActionsTest-1208865286 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/287168fc-0786-4716-8f23-273489f2849c.temp_image.d47c41b8-66c3-4fe3-928c-bd7119e431fack_27ye4.img" returned: 1 in 0.449s {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 25 15:59:38 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-bb52951a-94eb-45a5-aa58-975fcbeb1306 tempest-VolumesActionsTest-1208865286 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/287168fc-0786-4716-8f23-273489f2849c.temp_image.d47c41b8-66c3-4fe3-928c-bd7119e431fack_27ye4.img' failed. Not Retrying. {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Feb 25 15:59:38 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-bb52951a-94eb-45a5-aa58-975fcbeb1306 tempest-VolumesActionsTest-1208865286 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/287168fc-0786-4716-8f23-273489f2849c.temp_image.d47c41b8-66c3-4fe3-928c-bd7119e431fack_27ye4.img /opt/stack/data/cinder/conversion/vol_upload_oxs5be0q {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 25 15:59:38 devstack sudo[90232]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/287168fc-0786-4716-8f23-273489f2849c.temp_image.d47c41b8-66c3-4fe3-928c-bd7119e431fack_27ye4.img /opt/stack/data/cinder/conversion/vol_upload_oxs5be0q Feb 25 15:59:38 devstack sudo[90232]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 25 15:59:38 devstack sudo[90232]: pam_unix(sudo:session): session closed for user root Feb 25 15:59:38 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-bb52951a-94eb-45a5-aa58-975fcbeb1306 tempest-VolumesActionsTest-1208865286 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/287168fc-0786-4716-8f23-273489f2849c.temp_image.d47c41b8-66c3-4fe3-928c-bd7119e431fack_27ye4.img /opt/stack/data/cinder/conversion/vol_upload_oxs5be0q" returned: 0 in 0.440s {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 25 15:59:38 devstack cinder-volume[83528]: DEBUG cinder.image.image_utils [None req-bb52951a-94eb-45a5-aa58-975fcbeb1306 tempest-VolumesActionsTest-1208865286 None] Image conversion details: src /opt/stack/data/cinder/conversion/287168fc-0786-4716-8f23-273489f2849c.temp_image.d47c41b8-66c3-4fe3-928c-bd7119e431fack_27ye4.img, size 1024.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/conversion/vol_upload_oxs5be0q {{(pid=83528) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Feb 25 15:59:38 devstack cinder-volume[83528]: INFO cinder.image.image_utils [None req-bb52951a-94eb-45a5-aa58-975fcbeb1306 tempest-VolumesActionsTest-1208865286 None] Converted 1024.00 MB image at 1024.00 MB/s Feb 25 15:59:38 devstack cinder-volume[83528]: DEBUG oslo.privsep.daemon [-] privsep: reply[a93f0f86-e92f-47b8-b2d4-2138defc442e]: (4, 'qcow2') {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 25 15:59:38 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-bb52951a-94eb-45a5-aa58-975fcbeb1306 tempest-VolumesActionsTest-1208865286 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_oxs5be0q {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 25 15:59:38 devstack cinder-volume[83528]: DEBUG oslo_service.periodic_task [None req-d4c764ec-0ebb-4b31-b534-c9a53c1ab0dd None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=83528) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Feb 25 15:59:38 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-d4c764ec-0ebb-4b31-b534-c9a53c1ab0dd None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 25 15:59:38 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-d4c764ec-0ebb-4b31-b534-c9a53c1ab0dd None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 25 15:59:38 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.quobyte [None req-d4c764ec-0ebb-4b31-b534-c9a53c1ab0dd None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23e9d725-3e04-4cd9-bfe0-c8ef43305589': None} {{(pid=83528) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 25 15:59:38 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.quobyte [None req-d4c764ec-0ebb-4b31-b534-c9a53c1ab0dd None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23e9d725-3e04-4cd9-bfe0-c8ef43305589'] {{(pid=83528) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 25 15:59:38 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-d4c764ec-0ebb-4b31-b534-c9a53c1ab0dd None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 25 15:59:38 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-d4c764ec-0ebb-4b31-b534-c9a53c1ab0dd None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85 {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 25 15:59:38 devstack sudo[90238]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85 Feb 25 15:59:38 devstack sudo[90238]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 25 15:59:38 devstack sudo[90237]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_oxs5be0q Feb 25 15:59:38 devstack sudo[90237]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 25 15:59:39 devstack sudo[90238]: pam_unix(sudo:session): session closed for user root Feb 25 15:59:39 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-d4c764ec-0ebb-4b31-b534-c9a53c1ab0dd None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85" returned: 0 in 0.383s {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 25 15:59:39 devstack cinder-volume[83528]: DEBUG cinder.manager [None req-d4c764ec-0ebb-4b31-b534-c9a53c1ab0dd None None] Notifying Schedulers of capabilities ... {{(pid=83528) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 25 15:59:39 devstack sudo[90237]: pam_unix(sudo:session): session closed for user root Feb 25 15:59:39 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-bb52951a-94eb-45a5-aa58-975fcbeb1306 tempest-VolumesActionsTest-1208865286 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_oxs5be0q" returned: 0 in 0.490s {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 25 15:59:40 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-bb52951a-94eb-45a5-aa58-975fcbeb1306 tempest-VolumesActionsTest-1208865286 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 6.536s {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 25 15:59:40 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-bb52951a-94eb-45a5-aa58-975fcbeb1306 tempest-VolumesActionsTest-1208865286 None] Uploaded volume to glance image-id: d47c41b8-66c3-4fe3-928c-bd7119e431fa. {{(pid=83528) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Feb 25 15:59:40 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-9864a2e7-7026-45b3-9072-950cfbdb86d5 tempest-CreateVolumesFromSnapshotTest-47770248 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 6.210s {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 25 15:59:40 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.remotefs [None req-9864a2e7-7026-45b3-9072-950cfbdb86d5 tempest-CreateVolumesFromSnapshotTest-47770248 None] Creating offline snapshot e104816d-69a5-4394-bba4-c6d6d2ebb2bb of volume d1e5d330-5abd-438f-aba5-8deb8db05d57 {{(pid=83528) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Feb 25 15:59:40 devstack cinder-volume[83528]: DEBUG oslo.privsep.daemon [-] privsep: reply[f53adca8-735b-4a59-8861-51281fe2a11f]: (4, 'qcow2') {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 25 15:59:40 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-9864a2e7-7026-45b3-9072-950cfbdb86d5 tempest-CreateVolumesFromSnapshotTest-47770248 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-d1e5d330-5abd-438f-aba5-8deb8db05d57 {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 25 15:59:40 devstack cinder-volume[83528]: INFO cinder.volume.manager [None req-bb52951a-94eb-45a5-aa58-975fcbeb1306 tempest-VolumesActionsTest-1208865286 None] Copy volume to image completed successfully. Feb 25 15:59:40 devstack sudo[90245]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-d1e5d330-5abd-438f-aba5-8deb8db05d57 Feb 25 15:59:40 devstack sudo[90245]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 25 15:59:40 devstack sudo[90245]: pam_unix(sudo:session): session closed for user root Feb 25 15:59:40 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-9864a2e7-7026-45b3-9072-950cfbdb86d5 tempest-CreateVolumesFromSnapshotTest-47770248 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-d1e5d330-5abd-438f-aba5-8deb8db05d57" returned: 0 in 0.514s {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 25 15:59:40 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-9864a2e7-7026-45b3-9072-950cfbdb86d5 tempest-CreateVolumesFromSnapshotTest-47770248 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-d1e5d330-5abd-438f-aba5-8deb8db05d57,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-d1e5d330-5abd-438f-aba5-8deb8db05d57.e104816d-69a5-4394-bba4-c6d6d2ebb2bb 1G {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 25 15:59:40 devstack sudo[90250]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-d1e5d330-5abd-438f-aba5-8deb8db05d57,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-d1e5d330-5abd-438f-aba5-8deb8db05d57.e104816d-69a5-4394-bba4-c6d6d2ebb2bb 1G Feb 25 15:59:40 devstack sudo[90250]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 25 15:59:41 devstack sudo[90250]: pam_unix(sudo:session): session closed for user root Feb 25 15:59:41 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-9864a2e7-7026-45b3-9072-950cfbdb86d5 tempest-CreateVolumesFromSnapshotTest-47770248 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-d1e5d330-5abd-438f-aba5-8deb8db05d57,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-d1e5d330-5abd-438f-aba5-8deb8db05d57.e104816d-69a5-4394-bba4-c6d6d2ebb2bb 1G" returned: 0 in 0.581s {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 25 15:59:41 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-9864a2e7-7026-45b3-9072-950cfbdb86d5 tempest-CreateVolumesFromSnapshotTest-47770248 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d1e5d330-5abd-438f-aba5-8deb8db05d57 -F qcow2 /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-d1e5d330-5abd-438f-aba5-8deb8db05d57.e104816d-69a5-4394-bba4-c6d6d2ebb2bb {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 25 15:59:41 devstack sudo[90255]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d1e5d330-5abd-438f-aba5-8deb8db05d57 -F qcow2 /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-d1e5d330-5abd-438f-aba5-8deb8db05d57.e104816d-69a5-4394-bba4-c6d6d2ebb2bb Feb 25 15:59:41 devstack sudo[90255]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 25 15:59:41 devstack cinder-volume[83528]: DEBUG cinder.coordination [None req-d4a4348f-f4b3-4933-8359-f475654982d2 tempest-VolumesActionsTest-1208865286 None] Acquiring lock "cinder-287168fc-0786-4716-8f23-273489f2849c-delete_volume" by "delete_volume" {{(pid=83528) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 25 15:59:41 devstack cinder-volume[83528]: DEBUG cinder.coordination [None req-d4a4348f-f4b3-4933-8359-f475654982d2 tempest-VolumesActionsTest-1208865286 None] Lock "cinder-287168fc-0786-4716-8f23-273489f2849c-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=83528) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 25 15:59:41 devstack cinder-volume[83528]: DEBUG cinder.coordination [None req-d4a4348f-f4b3-4933-8359-f475654982d2 tempest-VolumesActionsTest-1208865286 None] Acquiring lock "cinder-quobyte-287168fc-0786-4716-8f23-273489f2849c" by "delete_volume" {{(pid=83528) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 25 15:59:41 devstack cinder-volume[83528]: DEBUG cinder.coordination [None req-d4a4348f-f4b3-4933-8359-f475654982d2 tempest-VolumesActionsTest-1208865286 None] Lock "cinder-quobyte-287168fc-0786-4716-8f23-273489f2849c" acquired by "delete_volume" :: waited 0.010s {{(pid=83528) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 25 15:59:41 devstack cinder-volume[83528]: DEBUG oslo.privsep.daemon [-] privsep: reply[1cc303c3-c296-46ff-b5f9-dc390ac66c8e]: (4, 'qcow2') {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 25 15:59:41 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-d4a4348f-f4b3-4933-8359-f475654982d2 tempest-VolumesActionsTest-1208865286 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-287168fc-0786-4716-8f23-273489f2849c {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 25 15:59:41 devstack sudo[90257]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-287168fc-0786-4716-8f23-273489f2849c Feb 25 15:59:41 devstack sudo[90257]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 25 15:59:41 devstack sudo[90255]: pam_unix(sudo:session): session closed for user root Feb 25 15:59:41 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-9864a2e7-7026-45b3-9072-950cfbdb86d5 tempest-CreateVolumesFromSnapshotTest-47770248 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d1e5d330-5abd-438f-aba5-8deb8db05d57 -F qcow2 /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-d1e5d330-5abd-438f-aba5-8deb8db05d57.e104816d-69a5-4394-bba4-c6d6d2ebb2bb" returned: 0 in 0.493s {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 25 15:59:41 devstack cinder-volume[83528]: WARNING cinder.volume.drivers.remotefs [None req-9864a2e7-7026-45b3-9072-950cfbdb86d5 tempest-CreateVolumesFromSnapshotTest-47770248 None] /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-d1e5d330-5abd-438f-aba5-8deb8db05d57.e104816d-69a5-4394-bba4-c6d6d2ebb2bb is being set with open permissions: ugo+rw Feb 25 15:59:41 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-9864a2e7-7026-45b3-9072-950cfbdb86d5 tempest-CreateVolumesFromSnapshotTest-47770248 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-d1e5d330-5abd-438f-aba5-8deb8db05d57.e104816d-69a5-4394-bba4-c6d6d2ebb2bb {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 25 15:59:41 devstack sudo[90262]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-d1e5d330-5abd-438f-aba5-8deb8db05d57.e104816d-69a5-4394-bba4-c6d6d2ebb2bb Feb 25 15:59:41 devstack sudo[90262]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 25 15:59:41 devstack sudo[90257]: pam_unix(sudo:session): session closed for user root Feb 25 15:59:41 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-d4a4348f-f4b3-4933-8359-f475654982d2 tempest-VolumesActionsTest-1208865286 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-287168fc-0786-4716-8f23-273489f2849c" returned: 0 in 0.525s {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 25 15:59:41 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-d4a4348f-f4b3-4933-8359-f475654982d2 tempest-VolumesActionsTest-1208865286 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-287168fc-0786-4716-8f23-273489f2849c {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 25 15:59:41 devstack sudo[90267]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-287168fc-0786-4716-8f23-273489f2849c Feb 25 15:59:41 devstack sudo[90267]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 25 15:59:42 devstack sudo[90262]: pam_unix(sudo:session): session closed for user root Feb 25 15:59:42 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-9864a2e7-7026-45b3-9072-950cfbdb86d5 tempest-CreateVolumesFromSnapshotTest-47770248 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-d1e5d330-5abd-438f-aba5-8deb8db05d57.e104816d-69a5-4394-bba4-c6d6d2ebb2bb" returned: 0 in 0.449s {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 25 15:59:42 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-9864a2e7-7026-45b3-9072-950cfbdb86d5 tempest-CreateVolumesFromSnapshotTest-47770248 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-d1e5d330-5abd-438f-aba5-8deb8db05d57.info {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 25 15:59:42 devstack sudo[90270]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-d1e5d330-5abd-438f-aba5-8deb8db05d57.info Feb 25 15:59:42 devstack sudo[90270]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 25 15:59:42 devstack sudo[90267]: pam_unix(sudo:session): session closed for user root Feb 25 15:59:42 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-d4a4348f-f4b3-4933-8359-f475654982d2 tempest-VolumesActionsTest-1208865286 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-287168fc-0786-4716-8f23-273489f2849c" returned: 0 in 0.432s {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 25 15:59:42 devstack cinder-volume[83528]: DEBUG cinder.coordination [None req-d4a4348f-f4b3-4933-8359-f475654982d2 tempest-VolumesActionsTest-1208865286 None] Lock "cinder-quobyte-287168fc-0786-4716-8f23-273489f2849c" released by "delete_volume" :: held 0.980s {{(pid=83528) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 25 15:59:42 devstack cinder-volume[83528]: DEBUG cinder.quota [None req-d4a4348f-f4b3-4933-8359-f475654982d2 tempest-VolumesActionsTest-1208865286 None] Created reservations ['d29c4422-23a8-42b2-93cf-45cd6ab8f4cd', '5175f4ef-a97f-4b50-a777-5e206d823a3a', '0abffc65-9af3-4458-96c7-cd55fa8941a7', 'd3d0868a-e0b2-43e1-851c-30bb1a8abd28'] {{(pid=83528) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 25 15:59:42 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-d4a4348f-f4b3-4933-8359-f475654982d2 tempest-VolumesActionsTest-1208865286 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 25 15:59:42 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-d4a4348f-f4b3-4933-8359-f475654982d2 tempest-VolumesActionsTest-1208865286 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 25 15:59:42 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.quobyte [None req-d4a4348f-f4b3-4933-8359-f475654982d2 tempest-VolumesActionsTest-1208865286 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23e9d725-3e04-4cd9-bfe0-c8ef43305589': None} {{(pid=83528) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 25 15:59:42 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.quobyte [None req-d4a4348f-f4b3-4933-8359-f475654982d2 tempest-VolumesActionsTest-1208865286 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23e9d725-3e04-4cd9-bfe0-c8ef43305589'] {{(pid=83528) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 25 15:59:42 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-d4a4348f-f4b3-4933-8359-f475654982d2 tempest-VolumesActionsTest-1208865286 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 25 15:59:42 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-d4a4348f-f4b3-4933-8359-f475654982d2 tempest-VolumesActionsTest-1208865286 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85 {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 25 15:59:42 devstack sudo[90273]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85 Feb 25 15:59:42 devstack sudo[90273]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 25 15:59:42 devstack sudo[90270]: pam_unix(sudo:session): session closed for user root Feb 25 15:59:42 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-9864a2e7-7026-45b3-9072-950cfbdb86d5 tempest-CreateVolumesFromSnapshotTest-47770248 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-d1e5d330-5abd-438f-aba5-8deb8db05d57.info" returned: 0 in 0.469s {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 25 15:59:42 devstack cinder-volume[83528]: WARNING cinder.volume.drivers.remotefs [None req-9864a2e7-7026-45b3-9072-950cfbdb86d5 tempest-CreateVolumesFromSnapshotTest-47770248 None] /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-d1e5d330-5abd-438f-aba5-8deb8db05d57.info is being set with open permissions: ugo+rw Feb 25 15:59:42 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-9864a2e7-7026-45b3-9072-950cfbdb86d5 tempest-CreateVolumesFromSnapshotTest-47770248 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-d1e5d330-5abd-438f-aba5-8deb8db05d57.info {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 25 15:59:42 devstack sudo[90276]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-d1e5d330-5abd-438f-aba5-8deb8db05d57.info Feb 25 15:59:42 devstack sudo[90276]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 25 15:59:42 devstack sudo[90273]: pam_unix(sudo:session): session closed for user root Feb 25 15:59:42 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-d4a4348f-f4b3-4933-8359-f475654982d2 tempest-VolumesActionsTest-1208865286 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85" returned: 0 in 0.481s {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 25 15:59:42 devstack cinder-volume[83528]: DEBUG cinder.manager [None req-d4a4348f-f4b3-4933-8359-f475654982d2 tempest-VolumesActionsTest-1208865286 None] Notifying Schedulers of capabilities ... {{(pid=83528) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 25 15:59:42 devstack cinder-volume[83528]: INFO cinder.volume.manager [None req-d4a4348f-f4b3-4933-8359-f475654982d2 tempest-VolumesActionsTest-1208865286 None] Deleted volume successfully. Feb 25 15:59:42 devstack cinder-volume[83528]: DEBUG cinder.coordination [None req-d4a4348f-f4b3-4933-8359-f475654982d2 tempest-VolumesActionsTest-1208865286 None] Lock "cinder-287168fc-0786-4716-8f23-273489f2849c-delete_volume" released by "delete_volume" :: held 1.653s {{(pid=83528) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 25 15:59:43 devstack sudo[90276]: pam_unix(sudo:session): session closed for user root Feb 25 15:59:43 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-9864a2e7-7026-45b3-9072-950cfbdb86d5 tempest-CreateVolumesFromSnapshotTest-47770248 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-d1e5d330-5abd-438f-aba5-8deb8db05d57.info" returned: 0 in 0.468s {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 25 15:59:43 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-9864a2e7-7026-45b3-9072-950cfbdb86d5 tempest-CreateVolumesFromSnapshotTest-47770248 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.040s {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 25 15:59:43 devstack cinder-volume[83528]: INFO cinder.volume.manager [None req-9864a2e7-7026-45b3-9072-950cfbdb86d5 tempest-CreateVolumesFromSnapshotTest-47770248 None] Create snapshot completed successfully Feb 25 15:59:43 devstack cinder-volume[83528]: DEBUG cinder.volume.flows.manager.create_volume [None req-f9710f58-33c5-492a-ad40-060b4d37631c tempest-CreateVolumesFromSnapshotTest-47770248 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83528) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 25 15:59:43 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-f9710f58-33c5-492a-ad40-060b4d37631c tempest-CreateVolumesFromSnapshotTest-47770248 None] Flow 'volume_create_manager' (fc0834b8-05ec-48dd-92fb-764b2176f2e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83528) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 25 15:59:43 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-f9710f58-33c5-492a-ad40-060b4d37631c tempest-CreateVolumesFromSnapshotTest-47770248 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cc043aee-3c7e-43b0-8aa4-6681f75a030e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 25 15:59:43 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-f9710f58-33c5-492a-ad40-060b4d37631c tempest-CreateVolumesFromSnapshotTest-47770248 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cc043aee-3c7e-43b0-8aa4-6681f75a030e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-25T14:59:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1801026396',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5e291938-4fcc-472a-b758-6438bac0c3c0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4fd17f6347f546a0847e79faf1fb9f08',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-25T14:59:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-25T14:59:43Z,use_quota=True,user_id='78613f76755f4713a6224fe4b0996917',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ce71c2f9-6543-4165-9653-a1529b2ea243),volume_type_id=ce71c2f9-6543-4165-9653-a1529b2ea243)' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 25 15:59:43 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-f9710f58-33c5-492a-ad40-060b4d37631c tempest-CreateVolumesFromSnapshotTest-47770248 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a45a22ad-3641-4a18-88c7-62f82b36adfc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 25 15:59:43 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-f9710f58-33c5-492a-ad40-060b4d37631c tempest-CreateVolumesFromSnapshotTest-47770248 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a45a22ad-3641-4a18-88c7-62f82b36adfc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 25 15:59:43 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-f9710f58-33c5-492a-ad40-060b4d37631c tempest-CreateVolumesFromSnapshotTest-47770248 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d974da75-99bb-419d-9b53-0d50400b956b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 25 15:59:43 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-f9710f58-33c5-492a-ad40-060b4d37631c tempest-CreateVolumesFromSnapshotTest-47770248 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d974da75-99bb-419d-9b53-0d50400b956b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5e291938-4fcc-472a-b758-6438bac0c3c0', 'volume_name': 'volume-5e291938-4fcc-472a-b758-6438bac0c3c0', 'volume_size': 1}' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 25 15:59:43 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-f9710f58-33c5-492a-ad40-060b4d37631c tempest-CreateVolumesFromSnapshotTest-47770248 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cce51209-304e-4ea7-8bfa-1338496785cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 25 15:59:43 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-f9710f58-33c5-492a-ad40-060b4d37631c tempest-CreateVolumesFromSnapshotTest-47770248 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cce51209-304e-4ea7-8bfa-1338496785cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 25 15:59:43 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-f9710f58-33c5-492a-ad40-060b4d37631c tempest-CreateVolumesFromSnapshotTest-47770248 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8caaf0b8-fa7f-43df-bfe0-f633d01c3eac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 25 15:59:43 devstack cinder-volume[83528]: INFO cinder.volume.flows.manager.create_volume [None req-f9710f58-33c5-492a-ad40-060b4d37631c tempest-CreateVolumesFromSnapshotTest-47770248 None] Volume 5e291938-4fcc-472a-b758-6438bac0c3c0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5e291938-4fcc-472a-b758-6438bac0c3c0', 'volume_size': 1} Feb 25 15:59:43 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-f9710f58-33c5-492a-ad40-060b4d37631c tempest-CreateVolumesFromSnapshotTest-47770248 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 25 15:59:43 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-f9710f58-33c5-492a-ad40-060b4d37631c tempest-CreateVolumesFromSnapshotTest-47770248 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 25 15:59:43 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.quobyte [None req-f9710f58-33c5-492a-ad40-060b4d37631c tempest-CreateVolumesFromSnapshotTest-47770248 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-25T14:59:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1801026396',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5e291938-4fcc-472a-b758-6438bac0c3c0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4fd17f6347f546a0847e79faf1fb9f08',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-25T14:59:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-25T14:59:43Z,use_quota=True,user_id='78613f76755f4713a6224fe4b0996917',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ce71c2f9-6543-4165-9653-a1529b2ea243),volume_type_id=ce71c2f9-6543-4165-9653-a1529b2ea243)}" {{(pid=83528) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 25 15:59:43 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.remotefs [None req-f9710f58-33c5-492a-ad40-060b4d37631c tempest-CreateVolumesFromSnapshotTest-47770248 None] Creating volume 5e291938-4fcc-472a-b758-6438bac0c3c0 {{(pid=83528) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 25 15:59:43 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-f9710f58-33c5-492a-ad40-060b4d37631c tempest-CreateVolumesFromSnapshotTest-47770248 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 25 15:59:43 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-f9710f58-33c5-492a-ad40-060b4d37631c tempest-CreateVolumesFromSnapshotTest-47770248 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 25 15:59:43 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.quobyte [None req-f9710f58-33c5-492a-ad40-060b4d37631c tempest-CreateVolumesFromSnapshotTest-47770248 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23e9d725-3e04-4cd9-bfe0-c8ef43305589': None} {{(pid=83528) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 25 15:59:43 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.quobyte [None req-f9710f58-33c5-492a-ad40-060b4d37631c tempest-CreateVolumesFromSnapshotTest-47770248 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23e9d725-3e04-4cd9-bfe0-c8ef43305589'] {{(pid=83528) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 25 15:59:43 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-f9710f58-33c5-492a-ad40-060b4d37631c tempest-CreateVolumesFromSnapshotTest-47770248 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 25 15:59:43 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.quobyte [None req-f9710f58-33c5-492a-ad40-060b4d37631c tempest-CreateVolumesFromSnapshotTest-47770248 None] Selected osci02.corp.quobyte.com/cinder-vol-23e9d725-3e04-4cd9-bfe0-c8ef43305589 as target Quobyte volume. {{(pid=83528) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 25 15:59:43 devstack cinder-volume[83528]: INFO cinder.volume.drivers.remotefs [None req-f9710f58-33c5-492a-ad40-060b4d37631c tempest-CreateVolumesFromSnapshotTest-47770248 None] casted to osci02.corp.quobyte.com/cinder-vol-23e9d725-3e04-4cd9-bfe0-c8ef43305589 Feb 25 15:59:43 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-f9710f58-33c5-492a-ad40-060b4d37631c tempest-CreateVolumesFromSnapshotTest-47770248 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-5e291938-4fcc-472a-b758-6438bac0c3c0 1073741824 {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 25 15:59:43 devstack sudo[90280]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-5e291938-4fcc-472a-b758-6438bac0c3c0 1073741824 Feb 25 15:59:43 devstack sudo[90280]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 25 15:59:43 devstack cinder-volume[83528]: DEBUG cinder.volume.flows.manager.create_volume [None req-a3e24d8e-00d8-46ad-978d-79dc397d01d3 tempest-CreateVolumesFromSnapshotTest-47770248 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83528) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 25 15:59:43 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-a3e24d8e-00d8-46ad-978d-79dc397d01d3 tempest-CreateVolumesFromSnapshotTest-47770248 None] Flow 'volume_create_manager' (e259ac66-5d33-4d7b-8423-9731a2f91df9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83528) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 25 15:59:43 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-a3e24d8e-00d8-46ad-978d-79dc397d01d3 tempest-CreateVolumesFromSnapshotTest-47770248 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (940640bb-4848-4d18-baab-bfc680fa000b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 25 15:59:43 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-a3e24d8e-00d8-46ad-978d-79dc397d01d3 tempest-CreateVolumesFromSnapshotTest-47770248 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (940640bb-4848-4d18-baab-bfc680fa000b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-25T14:59:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1822434629',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=031c1ee0-ff6a-4595-892a-964994b28d78,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4fd17f6347f546a0847e79faf1fb9f08',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-25T14:59:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-25T14:59:44Z,use_quota=True,user_id='78613f76755f4713a6224fe4b0996917',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ce71c2f9-6543-4165-9653-a1529b2ea243),volume_type_id=ce71c2f9-6543-4165-9653-a1529b2ea243)' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 25 15:59:43 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-a3e24d8e-00d8-46ad-978d-79dc397d01d3 tempest-CreateVolumesFromSnapshotTest-47770248 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (423a8d62-f7d9-42e9-9942-a988e7a0ec26) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 25 15:59:43 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-a3e24d8e-00d8-46ad-978d-79dc397d01d3 tempest-CreateVolumesFromSnapshotTest-47770248 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (423a8d62-f7d9-42e9-9942-a988e7a0ec26) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 25 15:59:43 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-a3e24d8e-00d8-46ad-978d-79dc397d01d3 tempest-CreateVolumesFromSnapshotTest-47770248 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (78e37c36-8eae-417f-9f09-d7128f8d538a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 25 15:59:43 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-a3e24d8e-00d8-46ad-978d-79dc397d01d3 tempest-CreateVolumesFromSnapshotTest-47770248 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (78e37c36-8eae-417f-9f09-d7128f8d538a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '031c1ee0-ff6a-4595-892a-964994b28d78', 'volume_name': 'volume-031c1ee0-ff6a-4595-892a-964994b28d78', 'volume_size': 1}' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 25 15:59:43 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-a3e24d8e-00d8-46ad-978d-79dc397d01d3 tempest-CreateVolumesFromSnapshotTest-47770248 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b32b4a1f-fb3f-4277-a3ec-0b32d540cd53) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 25 15:59:43 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-a3e24d8e-00d8-46ad-978d-79dc397d01d3 tempest-CreateVolumesFromSnapshotTest-47770248 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b32b4a1f-fb3f-4277-a3ec-0b32d540cd53) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 25 15:59:43 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-a3e24d8e-00d8-46ad-978d-79dc397d01d3 tempest-CreateVolumesFromSnapshotTest-47770248 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3f585589-858e-4345-927d-730b4238df2b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 25 15:59:43 devstack cinder-volume[83528]: INFO cinder.volume.flows.manager.create_volume [None req-a3e24d8e-00d8-46ad-978d-79dc397d01d3 tempest-CreateVolumesFromSnapshotTest-47770248 None] Volume 031c1ee0-ff6a-4595-892a-964994b28d78: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-031c1ee0-ff6a-4595-892a-964994b28d78', 'volume_size': 1} Feb 25 15:59:43 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-a3e24d8e-00d8-46ad-978d-79dc397d01d3 tempest-CreateVolumesFromSnapshotTest-47770248 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 25 15:59:43 devstack cinder-volume[83528]: DEBUG cinder.volume.flows.manager.create_volume [None req-453f8cee-9880-465d-8761-0f252a566c58 tempest-CreateVolumesFromSnapshotTest-47770248 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83528) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 25 15:59:43 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-453f8cee-9880-465d-8761-0f252a566c58 tempest-CreateVolumesFromSnapshotTest-47770248 None] Flow 'volume_create_manager' (719c6ed7-cec3-45ce-b000-6b2844794563) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83528) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 25 15:59:43 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-453f8cee-9880-465d-8761-0f252a566c58 tempest-CreateVolumesFromSnapshotTest-47770248 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3826b8d3-8920-453c-83c6-841c98d86ffd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 25 15:59:44 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-453f8cee-9880-465d-8761-0f252a566c58 tempest-CreateVolumesFromSnapshotTest-47770248 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3826b8d3-8920-453c-83c6-841c98d86ffd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-25T14:59:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1561311709',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e99b8253-a56f-4445-86f8-601bed5d74cc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4fd17f6347f546a0847e79faf1fb9f08',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-25T14:59:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-25T14:59:44Z,use_quota=True,user_id='78613f76755f4713a6224fe4b0996917',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ce71c2f9-6543-4165-9653-a1529b2ea243),volume_type_id=ce71c2f9-6543-4165-9653-a1529b2ea243)' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 25 15:59:44 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-453f8cee-9880-465d-8761-0f252a566c58 tempest-CreateVolumesFromSnapshotTest-47770248 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7e22e4b4-aebf-49df-bb89-c5f857ba12d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 25 15:59:44 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-453f8cee-9880-465d-8761-0f252a566c58 tempest-CreateVolumesFromSnapshotTest-47770248 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7e22e4b4-aebf-49df-bb89-c5f857ba12d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 25 15:59:44 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-453f8cee-9880-465d-8761-0f252a566c58 tempest-CreateVolumesFromSnapshotTest-47770248 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (28645f17-a8c0-473a-af51-9b8accdad459) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 25 15:59:44 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-453f8cee-9880-465d-8761-0f252a566c58 tempest-CreateVolumesFromSnapshotTest-47770248 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (28645f17-a8c0-473a-af51-9b8accdad459) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e99b8253-a56f-4445-86f8-601bed5d74cc', 'volume_name': 'volume-e99b8253-a56f-4445-86f8-601bed5d74cc', 'volume_size': 1}' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 25 15:59:44 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-453f8cee-9880-465d-8761-0f252a566c58 tempest-CreateVolumesFromSnapshotTest-47770248 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (41eff743-5b77-4ec3-b531-2fbe8b5336cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 25 15:59:44 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-453f8cee-9880-465d-8761-0f252a566c58 tempest-CreateVolumesFromSnapshotTest-47770248 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (41eff743-5b77-4ec3-b531-2fbe8b5336cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 25 15:59:44 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-453f8cee-9880-465d-8761-0f252a566c58 tempest-CreateVolumesFromSnapshotTest-47770248 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (189f9110-1eef-420f-b6ab-87cc96918ba3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 25 15:59:44 devstack cinder-volume[83528]: INFO cinder.volume.flows.manager.create_volume [None req-453f8cee-9880-465d-8761-0f252a566c58 tempest-CreateVolumesFromSnapshotTest-47770248 None] Volume e99b8253-a56f-4445-86f8-601bed5d74cc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e99b8253-a56f-4445-86f8-601bed5d74cc', 'volume_size': 1} Feb 25 15:59:44 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-453f8cee-9880-465d-8761-0f252a566c58 tempest-CreateVolumesFromSnapshotTest-47770248 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 25 15:59:44 devstack cinder-volume[83528]: DEBUG cinder.volume.flows.manager.create_volume [None req-97836627-8366-4e6b-9f0e-331904707450 tempest-CreateVolumesFromSnapshotTest-47770248 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83528) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 25 15:59:44 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-97836627-8366-4e6b-9f0e-331904707450 tempest-CreateVolumesFromSnapshotTest-47770248 None] Flow 'volume_create_manager' (6e99b349-3d28-4a5b-b5de-74801a356ef9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83528) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 25 15:59:44 devstack sudo[90280]: pam_unix(sudo:session): session closed for user root Feb 25 15:59:44 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-97836627-8366-4e6b-9f0e-331904707450 tempest-CreateVolumesFromSnapshotTest-47770248 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (79abc378-7a20-4375-90ae-bf53eff5f856) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 25 15:59:44 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-f9710f58-33c5-492a-ad40-060b4d37631c tempest-CreateVolumesFromSnapshotTest-47770248 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-5e291938-4fcc-472a-b758-6438bac0c3c0 1073741824" returned: 0 in 0.704s {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 25 15:59:44 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-97836627-8366-4e6b-9f0e-331904707450 tempest-CreateVolumesFromSnapshotTest-47770248 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (79abc378-7a20-4375-90ae-bf53eff5f856) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-25T14:59:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1567488333',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4acd7d60-c88e-4941-8324-9cf287263386,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4fd17f6347f546a0847e79faf1fb9f08',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-25T14:59:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-25T14:59:44Z,use_quota=True,user_id='78613f76755f4713a6224fe4b0996917',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ce71c2f9-6543-4165-9653-a1529b2ea243),volume_type_id=ce71c2f9-6543-4165-9653-a1529b2ea243)' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 25 15:59:44 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-97836627-8366-4e6b-9f0e-331904707450 tempest-CreateVolumesFromSnapshotTest-47770248 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7d624d18-5f5b-4eb9-baf8-a50b986c94ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 25 15:59:44 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-97836627-8366-4e6b-9f0e-331904707450 tempest-CreateVolumesFromSnapshotTest-47770248 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7d624d18-5f5b-4eb9-baf8-a50b986c94ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 25 15:59:44 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-97836627-8366-4e6b-9f0e-331904707450 tempest-CreateVolumesFromSnapshotTest-47770248 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ec09ad28-3700-4e2e-a2b9-34d2d013afa7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 25 15:59:44 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-97836627-8366-4e6b-9f0e-331904707450 tempest-CreateVolumesFromSnapshotTest-47770248 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ec09ad28-3700-4e2e-a2b9-34d2d013afa7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4acd7d60-c88e-4941-8324-9cf287263386', 'volume_name': 'volume-4acd7d60-c88e-4941-8324-9cf287263386', 'volume_size': 1}' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 25 15:59:44 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-97836627-8366-4e6b-9f0e-331904707450 tempest-CreateVolumesFromSnapshotTest-47770248 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (af84cfbe-3d49-4f73-8b3e-374fd0e1d4b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 25 15:59:44 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-97836627-8366-4e6b-9f0e-331904707450 tempest-CreateVolumesFromSnapshotTest-47770248 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (af84cfbe-3d49-4f73-8b3e-374fd0e1d4b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 25 15:59:44 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-97836627-8366-4e6b-9f0e-331904707450 tempest-CreateVolumesFromSnapshotTest-47770248 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (10b6c7e9-a503-492c-96d2-3f865ef08c8b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 25 15:59:44 devstack cinder-volume[83528]: INFO cinder.volume.flows.manager.create_volume [None req-97836627-8366-4e6b-9f0e-331904707450 tempest-CreateVolumesFromSnapshotTest-47770248 None] Volume 4acd7d60-c88e-4941-8324-9cf287263386: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4acd7d60-c88e-4941-8324-9cf287263386', 'volume_size': 1} Feb 25 15:59:44 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-97836627-8366-4e6b-9f0e-331904707450 tempest-CreateVolumesFromSnapshotTest-47770248 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 25 15:59:44 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-f9710f58-33c5-492a-ad40-060b4d37631c tempest-CreateVolumesFromSnapshotTest-47770248 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-5e291938-4fcc-472a-b758-6438bac0c3c0 {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 25 15:59:44 devstack sudo[90286]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-5e291938-4fcc-472a-b758-6438bac0c3c0 Feb 25 15:59:44 devstack sudo[90286]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 25 15:59:44 devstack cinder-volume[83528]: DEBUG cinder.volume.flows.manager.create_volume [None req-36f294d6-013f-4327-bbcf-4678c1fa3eb3 tempest-CreateVolumesFromSnapshotTest-47770248 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83528) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 25 15:59:44 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-36f294d6-013f-4327-bbcf-4678c1fa3eb3 tempest-CreateVolumesFromSnapshotTest-47770248 None] Flow 'volume_create_manager' (d3c5d13e-e36d-4252-80a2-86c321208503) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83528) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 25 15:59:44 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-36f294d6-013f-4327-bbcf-4678c1fa3eb3 tempest-CreateVolumesFromSnapshotTest-47770248 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (19996639-217e-4fbe-8baf-ccc7b775b8ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 25 15:59:44 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-36f294d6-013f-4327-bbcf-4678c1fa3eb3 tempest-CreateVolumesFromSnapshotTest-47770248 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (19996639-217e-4fbe-8baf-ccc7b775b8ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-25T14:59:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-338325748',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5c5dca65-0e46-4505-9b93-46d78a1f0197,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4fd17f6347f546a0847e79faf1fb9f08',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-25T14:59:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-25T14:59:44Z,use_quota=True,user_id='78613f76755f4713a6224fe4b0996917',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ce71c2f9-6543-4165-9653-a1529b2ea243),volume_type_id=ce71c2f9-6543-4165-9653-a1529b2ea243)' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 25 15:59:44 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-36f294d6-013f-4327-bbcf-4678c1fa3eb3 tempest-CreateVolumesFromSnapshotTest-47770248 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (becd3121-71f8-499d-b96b-f7c301ac8ffc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 25 15:59:44 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-36f294d6-013f-4327-bbcf-4678c1fa3eb3 tempest-CreateVolumesFromSnapshotTest-47770248 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (becd3121-71f8-499d-b96b-f7c301ac8ffc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 25 15:59:44 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-36f294d6-013f-4327-bbcf-4678c1fa3eb3 tempest-CreateVolumesFromSnapshotTest-47770248 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0fd4db9e-65b5-45ec-9fef-a244979dbfe2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 25 15:59:44 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-36f294d6-013f-4327-bbcf-4678c1fa3eb3 tempest-CreateVolumesFromSnapshotTest-47770248 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0fd4db9e-65b5-45ec-9fef-a244979dbfe2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5c5dca65-0e46-4505-9b93-46d78a1f0197', 'volume_name': 'volume-5c5dca65-0e46-4505-9b93-46d78a1f0197', 'volume_size': 1}' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 25 15:59:44 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-36f294d6-013f-4327-bbcf-4678c1fa3eb3 tempest-CreateVolumesFromSnapshotTest-47770248 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5bea6f97-96f0-4409-9e48-9931922655b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 25 15:59:44 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-36f294d6-013f-4327-bbcf-4678c1fa3eb3 tempest-CreateVolumesFromSnapshotTest-47770248 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5bea6f97-96f0-4409-9e48-9931922655b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 25 15:59:44 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-36f294d6-013f-4327-bbcf-4678c1fa3eb3 tempest-CreateVolumesFromSnapshotTest-47770248 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (52a03f88-0479-476b-9e6f-8c13b87172a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 25 15:59:44 devstack cinder-volume[83528]: INFO cinder.volume.flows.manager.create_volume [None req-36f294d6-013f-4327-bbcf-4678c1fa3eb3 tempest-CreateVolumesFromSnapshotTest-47770248 None] Volume 5c5dca65-0e46-4505-9b93-46d78a1f0197: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5c5dca65-0e46-4505-9b93-46d78a1f0197', 'volume_size': 1} Feb 25 15:59:44 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-36f294d6-013f-4327-bbcf-4678c1fa3eb3 tempest-CreateVolumesFromSnapshotTest-47770248 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 25 15:59:44 devstack sudo[90286]: pam_unix(sudo:session): session closed for user root Feb 25 15:59:44 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-f9710f58-33c5-492a-ad40-060b4d37631c tempest-CreateVolumesFromSnapshotTest-47770248 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-5e291938-4fcc-472a-b758-6438bac0c3c0" returned: 0 in 0.459s {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 25 15:59:44 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.quobyte [None req-f9710f58-33c5-492a-ad40-060b4d37631c tempest-CreateVolumesFromSnapshotTest-47770248 None] <== create_volume: return (1262ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-23e9d725-3e04-4cd9-bfe0-c8ef43305589'} {{(pid=83528) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 25 15:59:44 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-f9710f58-33c5-492a-ad40-060b4d37631c tempest-CreateVolumesFromSnapshotTest-47770248 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.265s {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 25 15:59:44 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-a3e24d8e-00d8-46ad-978d-79dc397d01d3 tempest-CreateVolumesFromSnapshotTest-47770248 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.955s {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 25 15:59:44 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.quobyte [None req-a3e24d8e-00d8-46ad-978d-79dc397d01d3 tempest-CreateVolumesFromSnapshotTest-47770248 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-25T14:59:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1822434629',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=031c1ee0-ff6a-4595-892a-964994b28d78,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4fd17f6347f546a0847e79faf1fb9f08',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-25T14:59:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-25T14:59:44Z,use_quota=True,user_id='78613f76755f4713a6224fe4b0996917',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ce71c2f9-6543-4165-9653-a1529b2ea243),volume_type_id=ce71c2f9-6543-4165-9653-a1529b2ea243)}" {{(pid=83528) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 25 15:59:44 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.remotefs [None req-a3e24d8e-00d8-46ad-978d-79dc397d01d3 tempest-CreateVolumesFromSnapshotTest-47770248 None] Creating volume 031c1ee0-ff6a-4595-892a-964994b28d78 {{(pid=83528) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 25 15:59:44 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-a3e24d8e-00d8-46ad-978d-79dc397d01d3 tempest-CreateVolumesFromSnapshotTest-47770248 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 25 15:59:44 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-a3e24d8e-00d8-46ad-978d-79dc397d01d3 tempest-CreateVolumesFromSnapshotTest-47770248 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 25 15:59:44 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.quobyte [None req-a3e24d8e-00d8-46ad-978d-79dc397d01d3 tempest-CreateVolumesFromSnapshotTest-47770248 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23e9d725-3e04-4cd9-bfe0-c8ef43305589': None} {{(pid=83528) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 25 15:59:44 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.quobyte [None req-a3e24d8e-00d8-46ad-978d-79dc397d01d3 tempest-CreateVolumesFromSnapshotTest-47770248 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23e9d725-3e04-4cd9-bfe0-c8ef43305589'] {{(pid=83528) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 25 15:59:44 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-a3e24d8e-00d8-46ad-978d-79dc397d01d3 tempest-CreateVolumesFromSnapshotTest-47770248 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 25 15:59:44 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.quobyte [None req-a3e24d8e-00d8-46ad-978d-79dc397d01d3 tempest-CreateVolumesFromSnapshotTest-47770248 None] Selected osci02.corp.quobyte.com/cinder-vol-23e9d725-3e04-4cd9-bfe0-c8ef43305589 as target Quobyte volume. {{(pid=83528) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 25 15:59:44 devstack cinder-volume[83528]: INFO cinder.volume.drivers.remotefs [None req-a3e24d8e-00d8-46ad-978d-79dc397d01d3 tempest-CreateVolumesFromSnapshotTest-47770248 None] casted to osci02.corp.quobyte.com/cinder-vol-23e9d725-3e04-4cd9-bfe0-c8ef43305589 Feb 25 15:59:44 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-a3e24d8e-00d8-46ad-978d-79dc397d01d3 tempest-CreateVolumesFromSnapshotTest-47770248 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-031c1ee0-ff6a-4595-892a-964994b28d78 1073741824 {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 25 15:59:44 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-f9710f58-33c5-492a-ad40-060b4d37631c tempest-CreateVolumesFromSnapshotTest-47770248 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8caaf0b8-fa7f-43df-bfe0-f633d01c3eac) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5e291938-4fcc-472a-b758-6438bac0c3c0', 'volume_size': 1}' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 25 15:59:44 devstack sudo[90290]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-031c1ee0-ff6a-4595-892a-964994b28d78 1073741824 Feb 25 15:59:44 devstack sudo[90290]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 25 15:59:44 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-f9710f58-33c5-492a-ad40-060b4d37631c tempest-CreateVolumesFromSnapshotTest-47770248 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6533bb78-b4e0-48b6-83c4-28c9ad407d78) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 25 15:59:44 devstack cinder-volume[83528]: INFO cinder.volume.flows.manager.create_volume [None req-f9710f58-33c5-492a-ad40-060b4d37631c tempest-CreateVolumesFromSnapshotTest-47770248 None] Volume volume-5e291938-4fcc-472a-b758-6438bac0c3c0 (5e291938-4fcc-472a-b758-6438bac0c3c0): created successfully Feb 25 15:59:44 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-f9710f58-33c5-492a-ad40-060b4d37631c tempest-CreateVolumesFromSnapshotTest-47770248 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6533bb78-b4e0-48b6-83c4-28c9ad407d78) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 25 15:59:44 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-f9710f58-33c5-492a-ad40-060b4d37631c tempest-CreateVolumesFromSnapshotTest-47770248 None] Flow 'volume_create_manager' (fc0834b8-05ec-48dd-92fb-764b2176f2e8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83528) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 25 15:59:44 devstack cinder-volume[83528]: INFO cinder.volume.manager [None req-f9710f58-33c5-492a-ad40-060b4d37631c tempest-CreateVolumesFromSnapshotTest-47770248 None] Created volume successfully. Feb 25 15:59:45 devstack sudo[90290]: pam_unix(sudo:session): session closed for user root Feb 25 15:59:45 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-a3e24d8e-00d8-46ad-978d-79dc397d01d3 tempest-CreateVolumesFromSnapshotTest-47770248 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-031c1ee0-ff6a-4595-892a-964994b28d78 1073741824" returned: 0 in 0.546s {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 25 15:59:45 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-a3e24d8e-00d8-46ad-978d-79dc397d01d3 tempest-CreateVolumesFromSnapshotTest-47770248 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-031c1ee0-ff6a-4595-892a-964994b28d78 {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 25 15:59:45 devstack sudo[90296]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-031c1ee0-ff6a-4595-892a-964994b28d78 Feb 25 15:59:45 devstack sudo[90296]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 25 15:59:45 devstack sudo[90296]: pam_unix(sudo:session): session closed for user root Feb 25 15:59:45 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-a3e24d8e-00d8-46ad-978d-79dc397d01d3 tempest-CreateVolumesFromSnapshotTest-47770248 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-031c1ee0-ff6a-4595-892a-964994b28d78" returned: 0 in 0.473s {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 25 15:59:45 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.quobyte [None req-a3e24d8e-00d8-46ad-978d-79dc397d01d3 tempest-CreateVolumesFromSnapshotTest-47770248 None] <== create_volume: return (1046ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-23e9d725-3e04-4cd9-bfe0-c8ef43305589'} {{(pid=83528) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 25 15:59:45 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-a3e24d8e-00d8-46ad-978d-79dc397d01d3 tempest-CreateVolumesFromSnapshotTest-47770248 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.049s {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 25 15:59:45 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-453f8cee-9880-465d-8761-0f252a566c58 tempest-CreateVolumesFromSnapshotTest-47770248 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.850s {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 25 15:59:45 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.quobyte [None req-453f8cee-9880-465d-8761-0f252a566c58 tempest-CreateVolumesFromSnapshotTest-47770248 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-25T14:59:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1561311709',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e99b8253-a56f-4445-86f8-601bed5d74cc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4fd17f6347f546a0847e79faf1fb9f08',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-25T14:59:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-25T14:59:44Z,use_quota=True,user_id='78613f76755f4713a6224fe4b0996917',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ce71c2f9-6543-4165-9653-a1529b2ea243),volume_type_id=ce71c2f9-6543-4165-9653-a1529b2ea243)}" {{(pid=83528) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 25 15:59:45 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.remotefs [None req-453f8cee-9880-465d-8761-0f252a566c58 tempest-CreateVolumesFromSnapshotTest-47770248 None] Creating volume e99b8253-a56f-4445-86f8-601bed5d74cc {{(pid=83528) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 25 15:59:45 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-453f8cee-9880-465d-8761-0f252a566c58 tempest-CreateVolumesFromSnapshotTest-47770248 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 25 15:59:45 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-453f8cee-9880-465d-8761-0f252a566c58 tempest-CreateVolumesFromSnapshotTest-47770248 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 25 15:59:45 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.quobyte [None req-453f8cee-9880-465d-8761-0f252a566c58 tempest-CreateVolumesFromSnapshotTest-47770248 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23e9d725-3e04-4cd9-bfe0-c8ef43305589': None} {{(pid=83528) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 25 15:59:45 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.quobyte [None req-453f8cee-9880-465d-8761-0f252a566c58 tempest-CreateVolumesFromSnapshotTest-47770248 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23e9d725-3e04-4cd9-bfe0-c8ef43305589'] {{(pid=83528) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 25 15:59:45 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-453f8cee-9880-465d-8761-0f252a566c58 tempest-CreateVolumesFromSnapshotTest-47770248 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 25 15:59:45 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.quobyte [None req-453f8cee-9880-465d-8761-0f252a566c58 tempest-CreateVolumesFromSnapshotTest-47770248 None] Selected osci02.corp.quobyte.com/cinder-vol-23e9d725-3e04-4cd9-bfe0-c8ef43305589 as target Quobyte volume. {{(pid=83528) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 25 15:59:45 devstack cinder-volume[83528]: INFO cinder.volume.drivers.remotefs [None req-453f8cee-9880-465d-8761-0f252a566c58 tempest-CreateVolumesFromSnapshotTest-47770248 None] casted to osci02.corp.quobyte.com/cinder-vol-23e9d725-3e04-4cd9-bfe0-c8ef43305589 Feb 25 15:59:45 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-453f8cee-9880-465d-8761-0f252a566c58 tempest-CreateVolumesFromSnapshotTest-47770248 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-e99b8253-a56f-4445-86f8-601bed5d74cc 1073741824 {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 25 15:59:45 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-a3e24d8e-00d8-46ad-978d-79dc397d01d3 tempest-CreateVolumesFromSnapshotTest-47770248 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3f585589-858e-4345-927d-730b4238df2b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-031c1ee0-ff6a-4595-892a-964994b28d78', 'volume_size': 1}' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 25 15:59:45 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-a3e24d8e-00d8-46ad-978d-79dc397d01d3 tempest-CreateVolumesFromSnapshotTest-47770248 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c03644d4-3b15-43c7-8f10-fe5dcaa10364) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 25 15:59:45 devstack sudo[90299]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-e99b8253-a56f-4445-86f8-601bed5d74cc 1073741824 Feb 25 15:59:45 devstack sudo[90299]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 25 15:59:45 devstack cinder-volume[83528]: INFO cinder.volume.flows.manager.create_volume [None req-a3e24d8e-00d8-46ad-978d-79dc397d01d3 tempest-CreateVolumesFromSnapshotTest-47770248 None] Volume volume-031c1ee0-ff6a-4595-892a-964994b28d78 (031c1ee0-ff6a-4595-892a-964994b28d78): created successfully Feb 25 15:59:45 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-a3e24d8e-00d8-46ad-978d-79dc397d01d3 tempest-CreateVolumesFromSnapshotTest-47770248 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c03644d4-3b15-43c7-8f10-fe5dcaa10364) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 25 15:59:45 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-a3e24d8e-00d8-46ad-978d-79dc397d01d3 tempest-CreateVolumesFromSnapshotTest-47770248 None] Flow 'volume_create_manager' (e259ac66-5d33-4d7b-8423-9731a2f91df9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83528) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 25 15:59:45 devstack cinder-volume[83528]: INFO cinder.volume.manager [None req-a3e24d8e-00d8-46ad-978d-79dc397d01d3 tempest-CreateVolumesFromSnapshotTest-47770248 None] Created volume successfully. Feb 25 15:59:46 devstack sudo[90299]: pam_unix(sudo:session): session closed for user root Feb 25 15:59:46 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-453f8cee-9880-465d-8761-0f252a566c58 tempest-CreateVolumesFromSnapshotTest-47770248 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-e99b8253-a56f-4445-86f8-601bed5d74cc 1073741824" returned: 0 in 0.596s {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 25 15:59:46 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-453f8cee-9880-465d-8761-0f252a566c58 tempest-CreateVolumesFromSnapshotTest-47770248 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-e99b8253-a56f-4445-86f8-601bed5d74cc {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 25 15:59:46 devstack sudo[90305]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-e99b8253-a56f-4445-86f8-601bed5d74cc Feb 25 15:59:46 devstack sudo[90305]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 25 15:59:46 devstack sudo[90305]: pam_unix(sudo:session): session closed for user root Feb 25 15:59:46 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-453f8cee-9880-465d-8761-0f252a566c58 tempest-CreateVolumesFromSnapshotTest-47770248 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-e99b8253-a56f-4445-86f8-601bed5d74cc" returned: 0 in 0.478s {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 25 15:59:46 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.quobyte [None req-453f8cee-9880-465d-8761-0f252a566c58 tempest-CreateVolumesFromSnapshotTest-47770248 None] <== create_volume: return (1098ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-23e9d725-3e04-4cd9-bfe0-c8ef43305589'} {{(pid=83528) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 25 15:59:46 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-453f8cee-9880-465d-8761-0f252a566c58 tempest-CreateVolumesFromSnapshotTest-47770248 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.101s {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 25 15:59:47 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-97836627-8366-4e6b-9f0e-331904707450 tempest-CreateVolumesFromSnapshotTest-47770248 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.646s {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 25 15:59:47 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.quobyte [None req-97836627-8366-4e6b-9f0e-331904707450 tempest-CreateVolumesFromSnapshotTest-47770248 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-25T14:59:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1567488333',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4acd7d60-c88e-4941-8324-9cf287263386,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4fd17f6347f546a0847e79faf1fb9f08',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-25T14:59:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-25T14:59:44Z,use_quota=True,user_id='78613f76755f4713a6224fe4b0996917',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ce71c2f9-6543-4165-9653-a1529b2ea243),volume_type_id=ce71c2f9-6543-4165-9653-a1529b2ea243)}" {{(pid=83528) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 25 15:59:47 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.remotefs [None req-97836627-8366-4e6b-9f0e-331904707450 tempest-CreateVolumesFromSnapshotTest-47770248 None] Creating volume 4acd7d60-c88e-4941-8324-9cf287263386 {{(pid=83528) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 25 15:59:47 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-97836627-8366-4e6b-9f0e-331904707450 tempest-CreateVolumesFromSnapshotTest-47770248 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 25 15:59:47 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-97836627-8366-4e6b-9f0e-331904707450 tempest-CreateVolumesFromSnapshotTest-47770248 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 25 15:59:47 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.quobyte [None req-97836627-8366-4e6b-9f0e-331904707450 tempest-CreateVolumesFromSnapshotTest-47770248 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23e9d725-3e04-4cd9-bfe0-c8ef43305589': None} {{(pid=83528) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 25 15:59:47 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.quobyte [None req-97836627-8366-4e6b-9f0e-331904707450 tempest-CreateVolumesFromSnapshotTest-47770248 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23e9d725-3e04-4cd9-bfe0-c8ef43305589'] {{(pid=83528) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 25 15:59:47 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-97836627-8366-4e6b-9f0e-331904707450 tempest-CreateVolumesFromSnapshotTest-47770248 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 25 15:59:47 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.quobyte [None req-97836627-8366-4e6b-9f0e-331904707450 tempest-CreateVolumesFromSnapshotTest-47770248 None] Selected osci02.corp.quobyte.com/cinder-vol-23e9d725-3e04-4cd9-bfe0-c8ef43305589 as target Quobyte volume. {{(pid=83528) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 25 15:59:47 devstack cinder-volume[83528]: INFO cinder.volume.drivers.remotefs [None req-97836627-8366-4e6b-9f0e-331904707450 tempest-CreateVolumesFromSnapshotTest-47770248 None] casted to osci02.corp.quobyte.com/cinder-vol-23e9d725-3e04-4cd9-bfe0-c8ef43305589 Feb 25 15:59:47 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-97836627-8366-4e6b-9f0e-331904707450 tempest-CreateVolumesFromSnapshotTest-47770248 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-4acd7d60-c88e-4941-8324-9cf287263386 1073741824 {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 25 15:59:47 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-453f8cee-9880-465d-8761-0f252a566c58 tempest-CreateVolumesFromSnapshotTest-47770248 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (189f9110-1eef-420f-b6ab-87cc96918ba3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e99b8253-a56f-4445-86f8-601bed5d74cc', 'volume_size': 1}' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 25 15:59:47 devstack sudo[90309]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-4acd7d60-c88e-4941-8324-9cf287263386 1073741824 Feb 25 15:59:47 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-453f8cee-9880-465d-8761-0f252a566c58 tempest-CreateVolumesFromSnapshotTest-47770248 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b272e807-4aeb-4940-b94e-f9875a092193) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 25 15:59:47 devstack sudo[90309]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 25 15:59:47 devstack cinder-volume[83528]: INFO cinder.volume.flows.manager.create_volume [None req-453f8cee-9880-465d-8761-0f252a566c58 tempest-CreateVolumesFromSnapshotTest-47770248 None] Volume volume-e99b8253-a56f-4445-86f8-601bed5d74cc (e99b8253-a56f-4445-86f8-601bed5d74cc): created successfully Feb 25 15:59:47 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-453f8cee-9880-465d-8761-0f252a566c58 tempest-CreateVolumesFromSnapshotTest-47770248 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b272e807-4aeb-4940-b94e-f9875a092193) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 25 15:59:47 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-453f8cee-9880-465d-8761-0f252a566c58 tempest-CreateVolumesFromSnapshotTest-47770248 None] Flow 'volume_create_manager' (719c6ed7-cec3-45ce-b000-6b2844794563) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83528) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 25 15:59:47 devstack cinder-volume[83528]: INFO cinder.volume.manager [None req-453f8cee-9880-465d-8761-0f252a566c58 tempest-CreateVolumesFromSnapshotTest-47770248 None] Created volume successfully. Feb 25 15:59:47 devstack sudo[90309]: pam_unix(sudo:session): session closed for user root Feb 25 15:59:47 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-97836627-8366-4e6b-9f0e-331904707450 tempest-CreateVolumesFromSnapshotTest-47770248 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-4acd7d60-c88e-4941-8324-9cf287263386 1073741824" returned: 0 in 0.558s {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 25 15:59:47 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-97836627-8366-4e6b-9f0e-331904707450 tempest-CreateVolumesFromSnapshotTest-47770248 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-4acd7d60-c88e-4941-8324-9cf287263386 {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 25 15:59:47 devstack sudo[90314]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-4acd7d60-c88e-4941-8324-9cf287263386 Feb 25 15:59:47 devstack sudo[90314]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 25 15:59:48 devstack sudo[90314]: pam_unix(sudo:session): session closed for user root Feb 25 15:59:48 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-97836627-8366-4e6b-9f0e-331904707450 tempest-CreateVolumesFromSnapshotTest-47770248 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-4acd7d60-c88e-4941-8324-9cf287263386" returned: 0 in 0.474s {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 25 15:59:48 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.quobyte [None req-97836627-8366-4e6b-9f0e-331904707450 tempest-CreateVolumesFromSnapshotTest-47770248 None] <== create_volume: return (1066ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-23e9d725-3e04-4cd9-bfe0-c8ef43305589'} {{(pid=83528) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 25 15:59:48 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-97836627-8366-4e6b-9f0e-331904707450 tempest-CreateVolumesFromSnapshotTest-47770248 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.069s {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 25 15:59:48 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-36f294d6-013f-4327-bbcf-4678c1fa3eb3 tempest-CreateVolumesFromSnapshotTest-47770248 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.446s {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 25 15:59:48 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.quobyte [None req-36f294d6-013f-4327-bbcf-4678c1fa3eb3 tempest-CreateVolumesFromSnapshotTest-47770248 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-25T14:59:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-338325748',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5c5dca65-0e46-4505-9b93-46d78a1f0197,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4fd17f6347f546a0847e79faf1fb9f08',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-25T14:59:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-25T14:59:44Z,use_quota=True,user_id='78613f76755f4713a6224fe4b0996917',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ce71c2f9-6543-4165-9653-a1529b2ea243),volume_type_id=ce71c2f9-6543-4165-9653-a1529b2ea243)}" {{(pid=83528) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 25 15:59:48 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.remotefs [None req-36f294d6-013f-4327-bbcf-4678c1fa3eb3 tempest-CreateVolumesFromSnapshotTest-47770248 None] Creating volume 5c5dca65-0e46-4505-9b93-46d78a1f0197 {{(pid=83528) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 25 15:59:48 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-36f294d6-013f-4327-bbcf-4678c1fa3eb3 tempest-CreateVolumesFromSnapshotTest-47770248 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 25 15:59:48 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-36f294d6-013f-4327-bbcf-4678c1fa3eb3 tempest-CreateVolumesFromSnapshotTest-47770248 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 25 15:59:48 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.quobyte [None req-36f294d6-013f-4327-bbcf-4678c1fa3eb3 tempest-CreateVolumesFromSnapshotTest-47770248 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23e9d725-3e04-4cd9-bfe0-c8ef43305589': None} {{(pid=83528) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 25 15:59:48 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.quobyte [None req-36f294d6-013f-4327-bbcf-4678c1fa3eb3 tempest-CreateVolumesFromSnapshotTest-47770248 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23e9d725-3e04-4cd9-bfe0-c8ef43305589'] {{(pid=83528) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 25 15:59:48 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-36f294d6-013f-4327-bbcf-4678c1fa3eb3 tempest-CreateVolumesFromSnapshotTest-47770248 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 25 15:59:48 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.quobyte [None req-36f294d6-013f-4327-bbcf-4678c1fa3eb3 tempest-CreateVolumesFromSnapshotTest-47770248 None] Selected osci02.corp.quobyte.com/cinder-vol-23e9d725-3e04-4cd9-bfe0-c8ef43305589 as target Quobyte volume. {{(pid=83528) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 25 15:59:48 devstack cinder-volume[83528]: INFO cinder.volume.drivers.remotefs [None req-36f294d6-013f-4327-bbcf-4678c1fa3eb3 tempest-CreateVolumesFromSnapshotTest-47770248 None] casted to osci02.corp.quobyte.com/cinder-vol-23e9d725-3e04-4cd9-bfe0-c8ef43305589 Feb 25 15:59:48 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-36f294d6-013f-4327-bbcf-4678c1fa3eb3 tempest-CreateVolumesFromSnapshotTest-47770248 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-5c5dca65-0e46-4505-9b93-46d78a1f0197 1073741824 {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 25 15:59:48 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-97836627-8366-4e6b-9f0e-331904707450 tempest-CreateVolumesFromSnapshotTest-47770248 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (10b6c7e9-a503-492c-96d2-3f865ef08c8b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4acd7d60-c88e-4941-8324-9cf287263386', 'volume_size': 1}' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 25 15:59:48 devstack sudo[90317]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-5c5dca65-0e46-4505-9b93-46d78a1f0197 1073741824 Feb 25 15:59:48 devstack sudo[90317]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 25 15:59:48 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-97836627-8366-4e6b-9f0e-331904707450 tempest-CreateVolumesFromSnapshotTest-47770248 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4afbbb75-a7dd-43e4-8d66-df2962db1a16) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 25 15:59:48 devstack cinder-volume[83528]: INFO cinder.volume.flows.manager.create_volume [None req-97836627-8366-4e6b-9f0e-331904707450 tempest-CreateVolumesFromSnapshotTest-47770248 None] Volume volume-4acd7d60-c88e-4941-8324-9cf287263386 (4acd7d60-c88e-4941-8324-9cf287263386): created successfully Feb 25 15:59:48 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-97836627-8366-4e6b-9f0e-331904707450 tempest-CreateVolumesFromSnapshotTest-47770248 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4afbbb75-a7dd-43e4-8d66-df2962db1a16) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 25 15:59:48 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-97836627-8366-4e6b-9f0e-331904707450 tempest-CreateVolumesFromSnapshotTest-47770248 None] Flow 'volume_create_manager' (6e99b349-3d28-4a5b-b5de-74801a356ef9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83528) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 25 15:59:48 devstack cinder-volume[83528]: INFO cinder.volume.manager [None req-97836627-8366-4e6b-9f0e-331904707450 tempest-CreateVolumesFromSnapshotTest-47770248 None] Created volume successfully. Feb 25 15:59:48 devstack cinder-volume[83528]: DEBUG cinder.volume.flows.manager.create_volume [None req-ebee3659-e8cc-4448-a86d-3d3d50371f68 tempest-VolumesCloneNegativeTest-137813940 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83528) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 25 15:59:48 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-ebee3659-e8cc-4448-a86d-3d3d50371f68 tempest-VolumesCloneNegativeTest-137813940 None] Flow 'volume_create_manager' (58721b34-45c4-4e87-b1f1-fd4f5613fa93) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83528) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 25 15:59:48 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-ebee3659-e8cc-4448-a86d-3d3d50371f68 tempest-VolumesCloneNegativeTest-137813940 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (46cb7278-98eb-4110-a85f-9ac9bd4b300d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 25 15:59:48 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-ebee3659-e8cc-4448-a86d-3d3d50371f68 tempest-VolumesCloneNegativeTest-137813940 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (46cb7278-98eb-4110-a85f-9ac9bd4b300d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-25T14:59:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-927928518',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=60e4136d-02db-4d19-9075-410fb66598cf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='54fc43bb1b6949399d3b35ef444c165a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-25T14:59:48Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-25T14:59:48Z,use_quota=True,user_id='34f6b16366ab4cfe86919343fb5c276a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ce71c2f9-6543-4165-9653-a1529b2ea243),volume_type_id=ce71c2f9-6543-4165-9653-a1529b2ea243)' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 25 15:59:48 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-ebee3659-e8cc-4448-a86d-3d3d50371f68 tempest-VolumesCloneNegativeTest-137813940 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1319026a-3578-4b2c-8d08-b0c022b6323f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 25 15:59:48 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-ebee3659-e8cc-4448-a86d-3d3d50371f68 tempest-VolumesCloneNegativeTest-137813940 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1319026a-3578-4b2c-8d08-b0c022b6323f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 25 15:59:48 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-ebee3659-e8cc-4448-a86d-3d3d50371f68 tempest-VolumesCloneNegativeTest-137813940 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (12a0a997-9181-4d2e-b687-baac25c9817c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 25 15:59:48 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-ebee3659-e8cc-4448-a86d-3d3d50371f68 tempest-VolumesCloneNegativeTest-137813940 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (12a0a997-9181-4d2e-b687-baac25c9817c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '60e4136d-02db-4d19-9075-410fb66598cf', 'volume_name': 'volume-60e4136d-02db-4d19-9075-410fb66598cf', 'volume_size': 2}' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 25 15:59:48 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-ebee3659-e8cc-4448-a86d-3d3d50371f68 tempest-VolumesCloneNegativeTest-137813940 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (271aa8ac-413a-47db-b2fe-a76e45eebc9f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 25 15:59:48 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-ebee3659-e8cc-4448-a86d-3d3d50371f68 tempest-VolumesCloneNegativeTest-137813940 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (271aa8ac-413a-47db-b2fe-a76e45eebc9f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 25 15:59:48 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-ebee3659-e8cc-4448-a86d-3d3d50371f68 tempest-VolumesCloneNegativeTest-137813940 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c53db87d-f1c5-470f-89bc-1e2736553cd3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 25 15:59:48 devstack cinder-volume[83528]: INFO cinder.volume.flows.manager.create_volume [None req-ebee3659-e8cc-4448-a86d-3d3d50371f68 tempest-VolumesCloneNegativeTest-137813940 None] Volume 60e4136d-02db-4d19-9075-410fb66598cf: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-60e4136d-02db-4d19-9075-410fb66598cf', 'volume_size': 2} Feb 25 15:59:48 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-ebee3659-e8cc-4448-a86d-3d3d50371f68 tempest-VolumesCloneNegativeTest-137813940 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 25 15:59:48 devstack sudo[90317]: pam_unix(sudo:session): session closed for user root Feb 25 15:59:48 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-36f294d6-013f-4327-bbcf-4678c1fa3eb3 tempest-CreateVolumesFromSnapshotTest-47770248 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-5c5dca65-0e46-4505-9b93-46d78a1f0197 1073741824" returned: 0 in 0.540s {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 25 15:59:48 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-36f294d6-013f-4327-bbcf-4678c1fa3eb3 tempest-CreateVolumesFromSnapshotTest-47770248 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-5c5dca65-0e46-4505-9b93-46d78a1f0197 {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 25 15:59:48 devstack sudo[90322]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-5c5dca65-0e46-4505-9b93-46d78a1f0197 Feb 25 15:59:48 devstack sudo[90322]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 25 15:59:49 devstack sudo[90322]: pam_unix(sudo:session): session closed for user root Feb 25 15:59:49 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-36f294d6-013f-4327-bbcf-4678c1fa3eb3 tempest-CreateVolumesFromSnapshotTest-47770248 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-5c5dca65-0e46-4505-9b93-46d78a1f0197" returned: 0 in 0.409s {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 25 15:59:49 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.quobyte [None req-36f294d6-013f-4327-bbcf-4678c1fa3eb3 tempest-CreateVolumesFromSnapshotTest-47770248 None] <== create_volume: return (975ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-23e9d725-3e04-4cd9-bfe0-c8ef43305589'} {{(pid=83528) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 25 15:59:49 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-36f294d6-013f-4327-bbcf-4678c1fa3eb3 tempest-CreateVolumesFromSnapshotTest-47770248 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.978s {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 25 15:59:49 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-ebee3659-e8cc-4448-a86d-3d3d50371f68 tempest-VolumesCloneNegativeTest-137813940 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.638s {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 25 15:59:49 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.quobyte [None req-ebee3659-e8cc-4448-a86d-3d3d50371f68 tempest-VolumesCloneNegativeTest-137813940 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-25T14:59:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-927928518',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=60e4136d-02db-4d19-9075-410fb66598cf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='54fc43bb1b6949399d3b35ef444c165a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-25T14:59:48Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-25T14:59:48Z,use_quota=True,user_id='34f6b16366ab4cfe86919343fb5c276a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ce71c2f9-6543-4165-9653-a1529b2ea243),volume_type_id=ce71c2f9-6543-4165-9653-a1529b2ea243)}" {{(pid=83528) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 25 15:59:49 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.remotefs [None req-ebee3659-e8cc-4448-a86d-3d3d50371f68 tempest-VolumesCloneNegativeTest-137813940 None] Creating volume 60e4136d-02db-4d19-9075-410fb66598cf {{(pid=83528) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 25 15:59:49 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-ebee3659-e8cc-4448-a86d-3d3d50371f68 tempest-VolumesCloneNegativeTest-137813940 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 25 15:59:49 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-ebee3659-e8cc-4448-a86d-3d3d50371f68 tempest-VolumesCloneNegativeTest-137813940 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 25 15:59:49 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.quobyte [None req-ebee3659-e8cc-4448-a86d-3d3d50371f68 tempest-VolumesCloneNegativeTest-137813940 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23e9d725-3e04-4cd9-bfe0-c8ef43305589': None} {{(pid=83528) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 25 15:59:49 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.quobyte [None req-ebee3659-e8cc-4448-a86d-3d3d50371f68 tempest-VolumesCloneNegativeTest-137813940 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23e9d725-3e04-4cd9-bfe0-c8ef43305589'] {{(pid=83528) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 25 15:59:49 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-ebee3659-e8cc-4448-a86d-3d3d50371f68 tempest-VolumesCloneNegativeTest-137813940 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 25 15:59:49 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.quobyte [None req-ebee3659-e8cc-4448-a86d-3d3d50371f68 tempest-VolumesCloneNegativeTest-137813940 None] Selected osci02.corp.quobyte.com/cinder-vol-23e9d725-3e04-4cd9-bfe0-c8ef43305589 as target Quobyte volume. {{(pid=83528) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 25 15:59:49 devstack cinder-volume[83528]: INFO cinder.volume.drivers.remotefs [None req-ebee3659-e8cc-4448-a86d-3d3d50371f68 tempest-VolumesCloneNegativeTest-137813940 None] casted to osci02.corp.quobyte.com/cinder-vol-23e9d725-3e04-4cd9-bfe0-c8ef43305589 Feb 25 15:59:49 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-ebee3659-e8cc-4448-a86d-3d3d50371f68 tempest-VolumesCloneNegativeTest-137813940 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-60e4136d-02db-4d19-9075-410fb66598cf 2147483648 {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 25 15:59:49 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-36f294d6-013f-4327-bbcf-4678c1fa3eb3 tempest-CreateVolumesFromSnapshotTest-47770248 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (52a03f88-0479-476b-9e6f-8c13b87172a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5c5dca65-0e46-4505-9b93-46d78a1f0197', 'volume_size': 1}' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 25 15:59:49 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-36f294d6-013f-4327-bbcf-4678c1fa3eb3 tempest-CreateVolumesFromSnapshotTest-47770248 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (17eadf85-9bea-48c9-ac3e-d2576d98f1f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 25 15:59:49 devstack sudo[90325]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-60e4136d-02db-4d19-9075-410fb66598cf 2147483648 Feb 25 15:59:49 devstack sudo[90325]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 25 15:59:49 devstack cinder-volume[83528]: INFO cinder.volume.flows.manager.create_volume [None req-36f294d6-013f-4327-bbcf-4678c1fa3eb3 tempest-CreateVolumesFromSnapshotTest-47770248 None] Volume volume-5c5dca65-0e46-4505-9b93-46d78a1f0197 (5c5dca65-0e46-4505-9b93-46d78a1f0197): created successfully Feb 25 15:59:49 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-36f294d6-013f-4327-bbcf-4678c1fa3eb3 tempest-CreateVolumesFromSnapshotTest-47770248 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (17eadf85-9bea-48c9-ac3e-d2576d98f1f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 25 15:59:49 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-36f294d6-013f-4327-bbcf-4678c1fa3eb3 tempest-CreateVolumesFromSnapshotTest-47770248 None] Flow 'volume_create_manager' (d3c5d13e-e36d-4252-80a2-86c321208503) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83528) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 25 15:59:49 devstack cinder-volume[83528]: INFO cinder.volume.manager [None req-36f294d6-013f-4327-bbcf-4678c1fa3eb3 tempest-CreateVolumesFromSnapshotTest-47770248 None] Created volume successfully. Feb 25 15:59:49 devstack sudo[90325]: pam_unix(sudo:session): session closed for user root Feb 25 15:59:49 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-ebee3659-e8cc-4448-a86d-3d3d50371f68 tempest-VolumesCloneNegativeTest-137813940 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-60e4136d-02db-4d19-9075-410fb66598cf 2147483648" returned: 0 in 0.484s {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 25 15:59:49 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-ebee3659-e8cc-4448-a86d-3d3d50371f68 tempest-VolumesCloneNegativeTest-137813940 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-60e4136d-02db-4d19-9075-410fb66598cf {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 25 15:59:49 devstack sudo[90330]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-60e4136d-02db-4d19-9075-410fb66598cf Feb 25 15:59:49 devstack sudo[90330]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 25 15:59:49 devstack sudo[90330]: pam_unix(sudo:session): session closed for user root Feb 25 15:59:49 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-ebee3659-e8cc-4448-a86d-3d3d50371f68 tempest-VolumesCloneNegativeTest-137813940 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-60e4136d-02db-4d19-9075-410fb66598cf" returned: 0 in 0.420s {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 25 15:59:49 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.quobyte [None req-ebee3659-e8cc-4448-a86d-3d3d50371f68 tempest-VolumesCloneNegativeTest-137813940 None] <== create_volume: return (927ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-23e9d725-3e04-4cd9-bfe0-c8ef43305589'} {{(pid=83528) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 25 15:59:49 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-ebee3659-e8cc-4448-a86d-3d3d50371f68 tempest-VolumesCloneNegativeTest-137813940 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.929s {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 25 15:59:50 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-ebee3659-e8cc-4448-a86d-3d3d50371f68 tempest-VolumesCloneNegativeTest-137813940 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c53db87d-f1c5-470f-89bc-1e2736553cd3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-60e4136d-02db-4d19-9075-410fb66598cf', 'volume_size': 2}' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 25 15:59:50 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-ebee3659-e8cc-4448-a86d-3d3d50371f68 tempest-VolumesCloneNegativeTest-137813940 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b4e3bff7-8e60-4f50-bdef-02745ff2fd95) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 25 15:59:50 devstack cinder-volume[83528]: DEBUG cinder.coordination [None req-44598122-f879-46ed-b54a-931fb341a54c tempest-CreateVolumesFromSnapshotTest-47770248 None] Acquiring lock "cinder-5c5dca65-0e46-4505-9b93-46d78a1f0197-delete_volume" by "delete_volume" {{(pid=83528) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 25 15:59:50 devstack cinder-volume[83528]: INFO cinder.volume.flows.manager.create_volume [None req-ebee3659-e8cc-4448-a86d-3d3d50371f68 tempest-VolumesCloneNegativeTest-137813940 None] Volume volume-60e4136d-02db-4d19-9075-410fb66598cf (60e4136d-02db-4d19-9075-410fb66598cf): created successfully Feb 25 15:59:50 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-ebee3659-e8cc-4448-a86d-3d3d50371f68 tempest-VolumesCloneNegativeTest-137813940 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b4e3bff7-8e60-4f50-bdef-02745ff2fd95) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 25 15:59:50 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-ebee3659-e8cc-4448-a86d-3d3d50371f68 tempest-VolumesCloneNegativeTest-137813940 None] Flow 'volume_create_manager' (58721b34-45c4-4e87-b1f1-fd4f5613fa93) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83528) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 25 15:59:50 devstack cinder-volume[83528]: DEBUG cinder.coordination [None req-44598122-f879-46ed-b54a-931fb341a54c tempest-CreateVolumesFromSnapshotTest-47770248 None] Lock "cinder-5c5dca65-0e46-4505-9b93-46d78a1f0197-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=83528) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 25 15:59:50 devstack cinder-volume[83528]: INFO cinder.volume.manager [None req-ebee3659-e8cc-4448-a86d-3d3d50371f68 tempest-VolumesCloneNegativeTest-137813940 None] Created volume successfully. Feb 25 15:59:50 devstack cinder-volume[83528]: DEBUG cinder.coordination [None req-44598122-f879-46ed-b54a-931fb341a54c tempest-CreateVolumesFromSnapshotTest-47770248 None] Acquiring lock "cinder-quobyte-5c5dca65-0e46-4505-9b93-46d78a1f0197" by "delete_volume" {{(pid=83528) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 25 15:59:50 devstack cinder-volume[83528]: DEBUG cinder.coordination [None req-44598122-f879-46ed-b54a-931fb341a54c tempest-CreateVolumesFromSnapshotTest-47770248 None] Lock "cinder-quobyte-5c5dca65-0e46-4505-9b93-46d78a1f0197" acquired by "delete_volume" :: waited 0.008s {{(pid=83528) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 25 15:59:50 devstack cinder-volume[83528]: DEBUG oslo.privsep.daemon [-] privsep: reply[6172842a-8a1e-4c7e-9f6c-452f2e7bbc9c]: (4, 'qcow2') {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 25 15:59:50 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-44598122-f879-46ed-b54a-931fb341a54c tempest-CreateVolumesFromSnapshotTest-47770248 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-5c5dca65-0e46-4505-9b93-46d78a1f0197 {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 25 15:59:50 devstack sudo[90333]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-5c5dca65-0e46-4505-9b93-46d78a1f0197 Feb 25 15:59:50 devstack sudo[90333]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 25 15:59:50 devstack sudo[90333]: pam_unix(sudo:session): session closed for user root Feb 25 15:59:50 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-44598122-f879-46ed-b54a-931fb341a54c tempest-CreateVolumesFromSnapshotTest-47770248 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-5c5dca65-0e46-4505-9b93-46d78a1f0197" returned: 0 in 0.499s {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 25 15:59:50 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-44598122-f879-46ed-b54a-931fb341a54c tempest-CreateVolumesFromSnapshotTest-47770248 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-5c5dca65-0e46-4505-9b93-46d78a1f0197 {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 25 15:59:50 devstack sudo[90338]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-5c5dca65-0e46-4505-9b93-46d78a1f0197 Feb 25 15:59:50 devstack sudo[90338]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 25 15:59:50 devstack cinder-volume[83528]: DEBUG cinder.coordination [None req-7d222289-aa02-4799-bf1a-dbf7a8b61f6c tempest-VolumesCloneNegativeTest-137813940 None] Acquiring lock "cinder-60e4136d-02db-4d19-9075-410fb66598cf-delete_volume" by "delete_volume" {{(pid=83528) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 25 15:59:50 devstack cinder-volume[83528]: DEBUG cinder.coordination [None req-7d222289-aa02-4799-bf1a-dbf7a8b61f6c tempest-VolumesCloneNegativeTest-137813940 None] Lock "cinder-60e4136d-02db-4d19-9075-410fb66598cf-delete_volume" acquired by "delete_volume" :: waited 0.012s {{(pid=83528) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 25 15:59:50 devstack cinder-volume[83528]: DEBUG cinder.coordination [None req-7d222289-aa02-4799-bf1a-dbf7a8b61f6c tempest-VolumesCloneNegativeTest-137813940 None] Acquiring lock "cinder-quobyte-60e4136d-02db-4d19-9075-410fb66598cf" by "delete_volume" {{(pid=83528) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 25 15:59:50 devstack cinder-volume[83528]: DEBUG cinder.coordination [None req-7d222289-aa02-4799-bf1a-dbf7a8b61f6c tempest-VolumesCloneNegativeTest-137813940 None] Lock "cinder-quobyte-60e4136d-02db-4d19-9075-410fb66598cf" acquired by "delete_volume" :: waited 0.011s {{(pid=83528) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 25 15:59:50 devstack cinder-volume[83528]: DEBUG oslo.privsep.daemon [-] privsep: reply[577f089e-4c90-4d15-a5c2-04f2e86cd5e2]: (4, 'qcow2') {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 25 15:59:50 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-7d222289-aa02-4799-bf1a-dbf7a8b61f6c tempest-VolumesCloneNegativeTest-137813940 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-60e4136d-02db-4d19-9075-410fb66598cf {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 25 15:59:50 devstack sudo[90340]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-60e4136d-02db-4d19-9075-410fb66598cf Feb 25 15:59:50 devstack sudo[90340]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 25 15:59:51 devstack sudo[90338]: pam_unix(sudo:session): session closed for user root Feb 25 15:59:51 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-44598122-f879-46ed-b54a-931fb341a54c tempest-CreateVolumesFromSnapshotTest-47770248 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-5c5dca65-0e46-4505-9b93-46d78a1f0197" returned: 0 in 0.433s {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 25 15:59:51 devstack cinder-volume[83528]: DEBUG cinder.coordination [None req-44598122-f879-46ed-b54a-931fb341a54c tempest-CreateVolumesFromSnapshotTest-47770248 None] Lock "cinder-quobyte-5c5dca65-0e46-4505-9b93-46d78a1f0197" released by "delete_volume" :: held 0.955s {{(pid=83528) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 25 15:59:51 devstack cinder-volume[83528]: DEBUG cinder.quota [None req-44598122-f879-46ed-b54a-931fb341a54c tempest-CreateVolumesFromSnapshotTest-47770248 None] Created reservations ['13bc53be-9e46-40b5-95bd-7ef267a4cc1f', '21acdd70-510d-420a-8918-d4c8cfe7f6c0', '9b5818d8-e469-4311-88f4-c461598f7cf2', '7ad7b985-8950-4ef2-907f-050316e03b58'] {{(pid=83528) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 25 15:59:51 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-44598122-f879-46ed-b54a-931fb341a54c tempest-CreateVolumesFromSnapshotTest-47770248 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 25 15:59:51 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-44598122-f879-46ed-b54a-931fb341a54c tempest-CreateVolumesFromSnapshotTest-47770248 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 25 15:59:51 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.quobyte [None req-44598122-f879-46ed-b54a-931fb341a54c tempest-CreateVolumesFromSnapshotTest-47770248 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23e9d725-3e04-4cd9-bfe0-c8ef43305589': None} {{(pid=83528) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 25 15:59:51 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.quobyte [None req-44598122-f879-46ed-b54a-931fb341a54c tempest-CreateVolumesFromSnapshotTest-47770248 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23e9d725-3e04-4cd9-bfe0-c8ef43305589'] {{(pid=83528) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 25 15:59:51 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-44598122-f879-46ed-b54a-931fb341a54c tempest-CreateVolumesFromSnapshotTest-47770248 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 25 15:59:51 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-44598122-f879-46ed-b54a-931fb341a54c tempest-CreateVolumesFromSnapshotTest-47770248 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85 {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 25 15:59:51 devstack sudo[90346]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85 Feb 25 15:59:51 devstack sudo[90346]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 25 15:59:51 devstack cinder-volume[83528]: DEBUG cinder.coordination [None req-357ebcca-841c-470d-83e8-af80f688b198 tempest-CreateVolumesFromSnapshotTest-47770248 None] Acquiring lock "cinder-4acd7d60-c88e-4941-8324-9cf287263386-delete_volume" by "delete_volume" {{(pid=83528) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 25 15:59:51 devstack cinder-volume[83528]: DEBUG cinder.coordination [None req-357ebcca-841c-470d-83e8-af80f688b198 tempest-CreateVolumesFromSnapshotTest-47770248 None] Lock "cinder-4acd7d60-c88e-4941-8324-9cf287263386-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=83528) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 25 15:59:51 devstack cinder-volume[83528]: DEBUG cinder.coordination [None req-357ebcca-841c-470d-83e8-af80f688b198 tempest-CreateVolumesFromSnapshotTest-47770248 None] Acquiring lock "cinder-quobyte-4acd7d60-c88e-4941-8324-9cf287263386" by "delete_volume" {{(pid=83528) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 25 15:59:51 devstack cinder-volume[83528]: DEBUG cinder.coordination [None req-357ebcca-841c-470d-83e8-af80f688b198 tempest-CreateVolumesFromSnapshotTest-47770248 None] Lock "cinder-quobyte-4acd7d60-c88e-4941-8324-9cf287263386" acquired by "delete_volume" :: waited 0.011s {{(pid=83528) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 25 15:59:51 devstack sudo[90340]: pam_unix(sudo:session): session closed for user root Feb 25 15:59:51 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-7d222289-aa02-4799-bf1a-dbf7a8b61f6c tempest-VolumesCloneNegativeTest-137813940 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-60e4136d-02db-4d19-9075-410fb66598cf" returned: 0 in 0.527s {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 25 15:59:51 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-7d222289-aa02-4799-bf1a-dbf7a8b61f6c tempest-VolumesCloneNegativeTest-137813940 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-60e4136d-02db-4d19-9075-410fb66598cf {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 25 15:59:51 devstack cinder-volume[83528]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d50bed6-22b5-4b4d-869d-b4839b08703a]: (4, 'qcow2') {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 25 15:59:51 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-357ebcca-841c-470d-83e8-af80f688b198 tempest-CreateVolumesFromSnapshotTest-47770248 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-4acd7d60-c88e-4941-8324-9cf287263386 {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 25 15:59:51 devstack sudo[90348]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-60e4136d-02db-4d19-9075-410fb66598cf Feb 25 15:59:51 devstack sudo[90348]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 25 15:59:51 devstack sudo[90349]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-4acd7d60-c88e-4941-8324-9cf287263386 Feb 25 15:59:51 devstack sudo[90349]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 25 15:59:51 devstack sudo[90346]: pam_unix(sudo:session): session closed for user root Feb 25 15:59:51 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-44598122-f879-46ed-b54a-931fb341a54c tempest-CreateVolumesFromSnapshotTest-47770248 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85" returned: 0 in 0.478s {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 25 15:59:51 devstack cinder-volume[83528]: DEBUG cinder.manager [None req-44598122-f879-46ed-b54a-931fb341a54c tempest-CreateVolumesFromSnapshotTest-47770248 None] Notifying Schedulers of capabilities ... {{(pid=83528) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 25 15:59:51 devstack cinder-volume[83528]: INFO cinder.volume.manager [None req-44598122-f879-46ed-b54a-931fb341a54c tempest-CreateVolumesFromSnapshotTest-47770248 None] Deleted volume successfully. Feb 25 15:59:51 devstack sudo[90348]: pam_unix(sudo:session): session closed for user root Feb 25 15:59:51 devstack cinder-volume[83528]: DEBUG cinder.coordination [None req-44598122-f879-46ed-b54a-931fb341a54c tempest-CreateVolumesFromSnapshotTest-47770248 None] Lock "cinder-5c5dca65-0e46-4505-9b93-46d78a1f0197-delete_volume" released by "delete_volume" :: held 1.590s {{(pid=83528) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 25 15:59:51 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-7d222289-aa02-4799-bf1a-dbf7a8b61f6c tempest-VolumesCloneNegativeTest-137813940 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-60e4136d-02db-4d19-9075-410fb66598cf" returned: 0 in 0.420s {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 25 15:59:51 devstack cinder-volume[83528]: DEBUG cinder.coordination [None req-7d222289-aa02-4799-bf1a-dbf7a8b61f6c tempest-VolumesCloneNegativeTest-137813940 None] Lock "cinder-quobyte-60e4136d-02db-4d19-9075-410fb66598cf" released by "delete_volume" :: held 0.967s {{(pid=83528) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 25 15:59:51 devstack cinder-volume[83528]: DEBUG cinder.quota [None req-7d222289-aa02-4799-bf1a-dbf7a8b61f6c tempest-VolumesCloneNegativeTest-137813940 None] Created reservations ['27e37d53-f505-42bf-afa7-85918b23d56d', 'dd4df066-953a-4395-bb17-6c05efeadafd', 'd4e9d374-ae4a-41c8-bba0-ee9603c22a37', '85caf7e2-cdee-4b17-b6a9-46cb6766fbd5'] {{(pid=83528) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 25 15:59:51 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-7d222289-aa02-4799-bf1a-dbf7a8b61f6c tempest-VolumesCloneNegativeTest-137813940 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 25 15:59:51 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-7d222289-aa02-4799-bf1a-dbf7a8b61f6c tempest-VolumesCloneNegativeTest-137813940 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 25 15:59:51 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.quobyte [None req-7d222289-aa02-4799-bf1a-dbf7a8b61f6c tempest-VolumesCloneNegativeTest-137813940 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23e9d725-3e04-4cd9-bfe0-c8ef43305589': None} {{(pid=83528) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 25 15:59:51 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.quobyte [None req-7d222289-aa02-4799-bf1a-dbf7a8b61f6c tempest-VolumesCloneNegativeTest-137813940 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23e9d725-3e04-4cd9-bfe0-c8ef43305589'] {{(pid=83528) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 25 15:59:51 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-7d222289-aa02-4799-bf1a-dbf7a8b61f6c tempest-VolumesCloneNegativeTest-137813940 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 25 15:59:51 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-7d222289-aa02-4799-bf1a-dbf7a8b61f6c tempest-VolumesCloneNegativeTest-137813940 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85 {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 25 15:59:51 devstack sudo[90349]: pam_unix(sudo:session): session closed for user root Feb 25 15:59:51 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-357ebcca-841c-470d-83e8-af80f688b198 tempest-CreateVolumesFromSnapshotTest-47770248 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-4acd7d60-c88e-4941-8324-9cf287263386" returned: 0 in 0.511s {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 25 15:59:51 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-357ebcca-841c-470d-83e8-af80f688b198 tempest-CreateVolumesFromSnapshotTest-47770248 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-4acd7d60-c88e-4941-8324-9cf287263386 {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 25 15:59:51 devstack sudo[90357]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85 Feb 25 15:59:51 devstack sudo[90357]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 25 15:59:51 devstack sudo[90358]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-4acd7d60-c88e-4941-8324-9cf287263386 Feb 25 15:59:51 devstack sudo[90358]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 25 15:59:52 devstack sudo[90357]: pam_unix(sudo:session): session closed for user root Feb 25 15:59:52 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-7d222289-aa02-4799-bf1a-dbf7a8b61f6c tempest-VolumesCloneNegativeTest-137813940 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85" returned: 0 in 0.415s {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 25 15:59:52 devstack cinder-volume[83528]: DEBUG cinder.manager [None req-7d222289-aa02-4799-bf1a-dbf7a8b61f6c tempest-VolumesCloneNegativeTest-137813940 None] Notifying Schedulers of capabilities ... {{(pid=83528) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 25 15:59:52 devstack cinder-volume[83528]: INFO cinder.volume.manager [None req-7d222289-aa02-4799-bf1a-dbf7a8b61f6c tempest-VolumesCloneNegativeTest-137813940 None] Deleted volume successfully. Feb 25 15:59:52 devstack cinder-volume[83528]: DEBUG cinder.coordination [None req-7d222289-aa02-4799-bf1a-dbf7a8b61f6c tempest-VolumesCloneNegativeTest-137813940 None] Lock "cinder-60e4136d-02db-4d19-9075-410fb66598cf-delete_volume" released by "delete_volume" :: held 1.533s {{(pid=83528) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 25 15:59:52 devstack sudo[90358]: pam_unix(sudo:session): session closed for user root Feb 25 15:59:52 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-357ebcca-841c-470d-83e8-af80f688b198 tempest-CreateVolumesFromSnapshotTest-47770248 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-4acd7d60-c88e-4941-8324-9cf287263386" returned: 0 in 0.453s {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 25 15:59:52 devstack cinder-volume[83528]: DEBUG cinder.coordination [None req-357ebcca-841c-470d-83e8-af80f688b198 tempest-CreateVolumesFromSnapshotTest-47770248 None] Lock "cinder-quobyte-4acd7d60-c88e-4941-8324-9cf287263386" released by "delete_volume" :: held 0.994s {{(pid=83528) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 25 15:59:52 devstack cinder-volume[83528]: DEBUG cinder.quota [None req-357ebcca-841c-470d-83e8-af80f688b198 tempest-CreateVolumesFromSnapshotTest-47770248 None] Created reservations ['67ff06e3-13dc-4b56-9245-ba4ee670531e', '5bf688e7-38ae-4b07-a69b-808c0fcc7aac', 'abe7335f-abb4-4c32-aa4b-7db8d20ebbac', '45fdee46-3966-40dc-a052-1a10d0fa41d1'] {{(pid=83528) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 25 15:59:52 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-357ebcca-841c-470d-83e8-af80f688b198 tempest-CreateVolumesFromSnapshotTest-47770248 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 25 15:59:52 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-357ebcca-841c-470d-83e8-af80f688b198 tempest-CreateVolumesFromSnapshotTest-47770248 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 25 15:59:52 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.quobyte [None req-357ebcca-841c-470d-83e8-af80f688b198 tempest-CreateVolumesFromSnapshotTest-47770248 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23e9d725-3e04-4cd9-bfe0-c8ef43305589': None} {{(pid=83528) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 25 15:59:52 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.quobyte [None req-357ebcca-841c-470d-83e8-af80f688b198 tempest-CreateVolumesFromSnapshotTest-47770248 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23e9d725-3e04-4cd9-bfe0-c8ef43305589'] {{(pid=83528) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 25 15:59:52 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-357ebcca-841c-470d-83e8-af80f688b198 tempest-CreateVolumesFromSnapshotTest-47770248 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 25 15:59:52 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-357ebcca-841c-470d-83e8-af80f688b198 tempest-CreateVolumesFromSnapshotTest-47770248 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85 {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 25 15:59:52 devstack sudo[90363]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85 Feb 25 15:59:52 devstack sudo[90363]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 25 15:59:52 devstack sudo[90363]: pam_unix(sudo:session): session closed for user root Feb 25 15:59:52 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-357ebcca-841c-470d-83e8-af80f688b198 tempest-CreateVolumesFromSnapshotTest-47770248 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85" returned: 0 in 0.413s {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 25 15:59:52 devstack cinder-volume[83528]: DEBUG cinder.manager [None req-357ebcca-841c-470d-83e8-af80f688b198 tempest-CreateVolumesFromSnapshotTest-47770248 None] Notifying Schedulers of capabilities ... {{(pid=83528) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 25 15:59:52 devstack cinder-volume[83528]: INFO cinder.volume.manager [None req-357ebcca-841c-470d-83e8-af80f688b198 tempest-CreateVolumesFromSnapshotTest-47770248 None] Deleted volume successfully. Feb 25 15:59:52 devstack cinder-volume[83528]: DEBUG cinder.coordination [None req-357ebcca-841c-470d-83e8-af80f688b198 tempest-CreateVolumesFromSnapshotTest-47770248 None] Lock "cinder-4acd7d60-c88e-4941-8324-9cf287263386-delete_volume" released by "delete_volume" :: held 1.547s {{(pid=83528) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 25 15:59:53 devstack cinder-volume[83528]: DEBUG cinder.coordination [None req-c2bcb0f4-e4e6-485a-9a9f-366185292c58 tempest-CreateVolumesFromSnapshotTest-47770248 None] Acquiring lock "cinder-e99b8253-a56f-4445-86f8-601bed5d74cc-delete_volume" by "delete_volume" {{(pid=83528) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 25 15:59:53 devstack cinder-volume[83528]: DEBUG cinder.coordination [None req-c2bcb0f4-e4e6-485a-9a9f-366185292c58 tempest-CreateVolumesFromSnapshotTest-47770248 None] Lock "cinder-e99b8253-a56f-4445-86f8-601bed5d74cc-delete_volume" acquired by "delete_volume" :: waited 0.013s {{(pid=83528) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 25 15:59:53 devstack cinder-volume[83528]: DEBUG cinder.coordination [None req-c2bcb0f4-e4e6-485a-9a9f-366185292c58 tempest-CreateVolumesFromSnapshotTest-47770248 None] Acquiring lock "cinder-quobyte-e99b8253-a56f-4445-86f8-601bed5d74cc" by "delete_volume" {{(pid=83528) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 25 15:59:53 devstack cinder-volume[83528]: DEBUG cinder.coordination [None req-c2bcb0f4-e4e6-485a-9a9f-366185292c58 tempest-CreateVolumesFromSnapshotTest-47770248 None] Lock "cinder-quobyte-e99b8253-a56f-4445-86f8-601bed5d74cc" acquired by "delete_volume" :: waited 0.007s {{(pid=83528) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 25 15:59:53 devstack cinder-volume[83528]: DEBUG oslo.privsep.daemon [-] privsep: reply[43888667-6d52-420f-8926-f94a996dccc9]: (4, 'qcow2') {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 25 15:59:53 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-c2bcb0f4-e4e6-485a-9a9f-366185292c58 tempest-CreateVolumesFromSnapshotTest-47770248 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-e99b8253-a56f-4445-86f8-601bed5d74cc {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 25 15:59:53 devstack sudo[90366]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-e99b8253-a56f-4445-86f8-601bed5d74cc Feb 25 15:59:53 devstack sudo[90366]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 25 15:59:53 devstack sudo[90366]: pam_unix(sudo:session): session closed for user root Feb 25 15:59:53 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-c2bcb0f4-e4e6-485a-9a9f-366185292c58 tempest-CreateVolumesFromSnapshotTest-47770248 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-e99b8253-a56f-4445-86f8-601bed5d74cc" returned: 0 in 0.539s {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 25 15:59:53 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-c2bcb0f4-e4e6-485a-9a9f-366185292c58 tempest-CreateVolumesFromSnapshotTest-47770248 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-e99b8253-a56f-4445-86f8-601bed5d74cc {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 25 15:59:53 devstack sudo[90371]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-e99b8253-a56f-4445-86f8-601bed5d74cc Feb 25 15:59:53 devstack sudo[90371]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 25 15:59:54 devstack sudo[90371]: pam_unix(sudo:session): session closed for user root Feb 25 15:59:54 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-c2bcb0f4-e4e6-485a-9a9f-366185292c58 tempest-CreateVolumesFromSnapshotTest-47770248 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-e99b8253-a56f-4445-86f8-601bed5d74cc" returned: 0 in 0.481s {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 25 15:59:54 devstack cinder-volume[83528]: DEBUG cinder.coordination [None req-c2bcb0f4-e4e6-485a-9a9f-366185292c58 tempest-CreateVolumesFromSnapshotTest-47770248 None] Lock "cinder-quobyte-e99b8253-a56f-4445-86f8-601bed5d74cc" released by "delete_volume" :: held 1.049s {{(pid=83528) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 25 15:59:54 devstack cinder-volume[83528]: DEBUG cinder.quota [None req-c2bcb0f4-e4e6-485a-9a9f-366185292c58 tempest-CreateVolumesFromSnapshotTest-47770248 None] Created reservations ['c026b865-1411-4aee-9620-b5157e4d37ee', 'a808e5b3-7da1-48d1-8490-e98ba83358f0', '59f00756-7d12-47c4-be48-5a144482119f', '07642931-85de-4385-a4cf-1f914c4accf5'] {{(pid=83528) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 25 15:59:54 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-c2bcb0f4-e4e6-485a-9a9f-366185292c58 tempest-CreateVolumesFromSnapshotTest-47770248 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 25 15:59:54 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-c2bcb0f4-e4e6-485a-9a9f-366185292c58 tempest-CreateVolumesFromSnapshotTest-47770248 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 25 15:59:54 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.quobyte [None req-c2bcb0f4-e4e6-485a-9a9f-366185292c58 tempest-CreateVolumesFromSnapshotTest-47770248 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23e9d725-3e04-4cd9-bfe0-c8ef43305589': None} {{(pid=83528) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 25 15:59:54 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.quobyte [None req-c2bcb0f4-e4e6-485a-9a9f-366185292c58 tempest-CreateVolumesFromSnapshotTest-47770248 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23e9d725-3e04-4cd9-bfe0-c8ef43305589'] {{(pid=83528) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 25 15:59:54 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-c2bcb0f4-e4e6-485a-9a9f-366185292c58 tempest-CreateVolumesFromSnapshotTest-47770248 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 25 15:59:54 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-c2bcb0f4-e4e6-485a-9a9f-366185292c58 tempest-CreateVolumesFromSnapshotTest-47770248 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85 {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 25 15:59:54 devstack sudo[90374]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85 Feb 25 15:59:54 devstack sudo[90374]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 25 15:59:54 devstack cinder-volume[83528]: DEBUG cinder.volume.flows.manager.create_volume [None req-b68f064f-f4bf-4fdd-98fc-d589bcd2dbf1 tempest-VolumesNegativeTest-117213089 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83528) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 25 15:59:54 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-b68f064f-f4bf-4fdd-98fc-d589bcd2dbf1 tempest-VolumesNegativeTest-117213089 None] Flow 'volume_create_manager' (4259f8cf-85da-48b2-bef4-68871100bf89) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83528) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 25 15:59:54 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-b68f064f-f4bf-4fdd-98fc-d589bcd2dbf1 tempest-VolumesNegativeTest-117213089 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bd97741f-249f-480f-8bd5-39dfcbf3649f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 25 15:59:54 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-b68f064f-f4bf-4fdd-98fc-d589bcd2dbf1 tempest-VolumesNegativeTest-117213089 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bd97741f-249f-480f-8bd5-39dfcbf3649f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-25T14:59:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-93667844',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=39476f23-2b30-4647-a3ff-d8ac35c2e6de,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a509e7cff1124dd79eaf28321d4bfc72',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-25T14:59:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-25T14:59:55Z,use_quota=True,user_id='fc3a73f1daa54ccea1f2c63cd5b5146e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ce71c2f9-6543-4165-9653-a1529b2ea243),volume_type_id=ce71c2f9-6543-4165-9653-a1529b2ea243)' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 25 15:59:54 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-b68f064f-f4bf-4fdd-98fc-d589bcd2dbf1 tempest-VolumesNegativeTest-117213089 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (74eacf52-9760-407f-8d58-4886f1ab5c0e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 25 15:59:54 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-b68f064f-f4bf-4fdd-98fc-d589bcd2dbf1 tempest-VolumesNegativeTest-117213089 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (74eacf52-9760-407f-8d58-4886f1ab5c0e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 25 15:59:54 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-b68f064f-f4bf-4fdd-98fc-d589bcd2dbf1 tempest-VolumesNegativeTest-117213089 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (603dc514-abc8-4a03-958f-ccb7f3534c2c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 25 15:59:54 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-b68f064f-f4bf-4fdd-98fc-d589bcd2dbf1 tempest-VolumesNegativeTest-117213089 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (603dc514-abc8-4a03-958f-ccb7f3534c2c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '39476f23-2b30-4647-a3ff-d8ac35c2e6de', 'volume_name': 'volume-39476f23-2b30-4647-a3ff-d8ac35c2e6de', 'volume_size': 1}' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 25 15:59:54 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-b68f064f-f4bf-4fdd-98fc-d589bcd2dbf1 tempest-VolumesNegativeTest-117213089 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f3f09d75-242d-46cb-a577-39853a859204) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 25 15:59:54 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-b68f064f-f4bf-4fdd-98fc-d589bcd2dbf1 tempest-VolumesNegativeTest-117213089 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f3f09d75-242d-46cb-a577-39853a859204) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 25 15:59:54 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-b68f064f-f4bf-4fdd-98fc-d589bcd2dbf1 tempest-VolumesNegativeTest-117213089 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (134a6ba0-2ad1-45bc-8637-67b79b025b8d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 25 15:59:54 devstack cinder-volume[83528]: INFO cinder.volume.flows.manager.create_volume [None req-b68f064f-f4bf-4fdd-98fc-d589bcd2dbf1 tempest-VolumesNegativeTest-117213089 None] Volume 39476f23-2b30-4647-a3ff-d8ac35c2e6de: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-39476f23-2b30-4647-a3ff-d8ac35c2e6de', 'volume_size': 1} Feb 25 15:59:54 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-b68f064f-f4bf-4fdd-98fc-d589bcd2dbf1 tempest-VolumesNegativeTest-117213089 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 25 15:59:54 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-b68f064f-f4bf-4fdd-98fc-d589bcd2dbf1 tempest-VolumesNegativeTest-117213089 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 25 15:59:54 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.quobyte [None req-b68f064f-f4bf-4fdd-98fc-d589bcd2dbf1 tempest-VolumesNegativeTest-117213089 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-25T14:59:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-93667844',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=39476f23-2b30-4647-a3ff-d8ac35c2e6de,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a509e7cff1124dd79eaf28321d4bfc72',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-25T14:59:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-25T14:59:55Z,use_quota=True,user_id='fc3a73f1daa54ccea1f2c63cd5b5146e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ce71c2f9-6543-4165-9653-a1529b2ea243),volume_type_id=ce71c2f9-6543-4165-9653-a1529b2ea243)}" {{(pid=83528) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 25 15:59:54 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.remotefs [None req-b68f064f-f4bf-4fdd-98fc-d589bcd2dbf1 tempest-VolumesNegativeTest-117213089 None] Creating volume 39476f23-2b30-4647-a3ff-d8ac35c2e6de {{(pid=83528) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 25 15:59:54 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-b68f064f-f4bf-4fdd-98fc-d589bcd2dbf1 tempest-VolumesNegativeTest-117213089 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 25 15:59:54 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-b68f064f-f4bf-4fdd-98fc-d589bcd2dbf1 tempest-VolumesNegativeTest-117213089 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 25 15:59:54 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.quobyte [None req-b68f064f-f4bf-4fdd-98fc-d589bcd2dbf1 tempest-VolumesNegativeTest-117213089 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23e9d725-3e04-4cd9-bfe0-c8ef43305589': None} {{(pid=83528) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 25 15:59:54 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.quobyte [None req-b68f064f-f4bf-4fdd-98fc-d589bcd2dbf1 tempest-VolumesNegativeTest-117213089 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23e9d725-3e04-4cd9-bfe0-c8ef43305589'] {{(pid=83528) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 25 15:59:54 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-b68f064f-f4bf-4fdd-98fc-d589bcd2dbf1 tempest-VolumesNegativeTest-117213089 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 25 15:59:54 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.quobyte [None req-b68f064f-f4bf-4fdd-98fc-d589bcd2dbf1 tempest-VolumesNegativeTest-117213089 None] Selected osci02.corp.quobyte.com/cinder-vol-23e9d725-3e04-4cd9-bfe0-c8ef43305589 as target Quobyte volume. {{(pid=83528) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 25 15:59:54 devstack cinder-volume[83528]: INFO cinder.volume.drivers.remotefs [None req-b68f064f-f4bf-4fdd-98fc-d589bcd2dbf1 tempest-VolumesNegativeTest-117213089 None] casted to osci02.corp.quobyte.com/cinder-vol-23e9d725-3e04-4cd9-bfe0-c8ef43305589 Feb 25 15:59:54 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-b68f064f-f4bf-4fdd-98fc-d589bcd2dbf1 tempest-VolumesNegativeTest-117213089 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-39476f23-2b30-4647-a3ff-d8ac35c2e6de 1073741824 {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 25 15:59:54 devstack sudo[90377]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-39476f23-2b30-4647-a3ff-d8ac35c2e6de 1073741824 Feb 25 15:59:54 devstack sudo[90377]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 25 15:59:54 devstack sudo[90374]: pam_unix(sudo:session): session closed for user root Feb 25 15:59:54 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-c2bcb0f4-e4e6-485a-9a9f-366185292c58 tempest-CreateVolumesFromSnapshotTest-47770248 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85" returned: 0 in 0.455s {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 25 15:59:54 devstack cinder-volume[83528]: DEBUG cinder.manager [None req-c2bcb0f4-e4e6-485a-9a9f-366185292c58 tempest-CreateVolumesFromSnapshotTest-47770248 None] Notifying Schedulers of capabilities ... {{(pid=83528) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 25 15:59:54 devstack cinder-volume[83528]: INFO cinder.volume.manager [None req-c2bcb0f4-e4e6-485a-9a9f-366185292c58 tempest-CreateVolumesFromSnapshotTest-47770248 None] Deleted volume successfully. Feb 25 15:59:55 devstack cinder-volume[83528]: DEBUG cinder.coordination [None req-c2bcb0f4-e4e6-485a-9a9f-366185292c58 tempest-CreateVolumesFromSnapshotTest-47770248 None] Lock "cinder-e99b8253-a56f-4445-86f8-601bed5d74cc-delete_volume" released by "delete_volume" :: held 1.687s {{(pid=83528) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 25 15:59:55 devstack sudo[90377]: pam_unix(sudo:session): session closed for user root Feb 25 15:59:55 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-b68f064f-f4bf-4fdd-98fc-d589bcd2dbf1 tempest-VolumesNegativeTest-117213089 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-39476f23-2b30-4647-a3ff-d8ac35c2e6de 1073741824" returned: 0 in 0.543s {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 25 15:59:55 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-b68f064f-f4bf-4fdd-98fc-d589bcd2dbf1 tempest-VolumesNegativeTest-117213089 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-39476f23-2b30-4647-a3ff-d8ac35c2e6de {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 25 15:59:55 devstack sudo[90383]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-39476f23-2b30-4647-a3ff-d8ac35c2e6de Feb 25 15:59:55 devstack sudo[90383]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 25 15:59:55 devstack cinder-volume[83528]: DEBUG cinder.coordination [None req-7c1b8f12-a872-4606-b1e8-386d95a51417 tempest-CreateVolumesFromSnapshotTest-47770248 None] Acquiring lock "cinder-031c1ee0-ff6a-4595-892a-964994b28d78-delete_volume" by "delete_volume" {{(pid=83528) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 25 15:59:55 devstack cinder-volume[83528]: DEBUG cinder.coordination [None req-7c1b8f12-a872-4606-b1e8-386d95a51417 tempest-CreateVolumesFromSnapshotTest-47770248 None] Lock "cinder-031c1ee0-ff6a-4595-892a-964994b28d78-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=83528) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 25 15:59:55 devstack cinder-volume[83528]: DEBUG cinder.coordination [None req-7c1b8f12-a872-4606-b1e8-386d95a51417 tempest-CreateVolumesFromSnapshotTest-47770248 None] Acquiring lock "cinder-quobyte-031c1ee0-ff6a-4595-892a-964994b28d78" by "delete_volume" {{(pid=83528) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 25 15:59:55 devstack cinder-volume[83528]: DEBUG cinder.coordination [None req-7c1b8f12-a872-4606-b1e8-386d95a51417 tempest-CreateVolumesFromSnapshotTest-47770248 None] Lock "cinder-quobyte-031c1ee0-ff6a-4595-892a-964994b28d78" acquired by "delete_volume" :: waited 0.009s {{(pid=83528) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 25 15:59:55 devstack cinder-volume[83528]: DEBUG oslo.privsep.daemon [-] privsep: reply[7dbb1fd8-8dd3-4b3d-8ef8-2e1c55b66a45]: (4, 'qcow2') {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 25 15:59:55 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-7c1b8f12-a872-4606-b1e8-386d95a51417 tempest-CreateVolumesFromSnapshotTest-47770248 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-031c1ee0-ff6a-4595-892a-964994b28d78 {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 25 15:59:55 devstack sudo[90385]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-031c1ee0-ff6a-4595-892a-964994b28d78 Feb 25 15:59:55 devstack sudo[90385]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 25 15:59:55 devstack sudo[90383]: pam_unix(sudo:session): session closed for user root Feb 25 15:59:55 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-b68f064f-f4bf-4fdd-98fc-d589bcd2dbf1 tempest-VolumesNegativeTest-117213089 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-39476f23-2b30-4647-a3ff-d8ac35c2e6de" returned: 0 in 0.466s {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 25 15:59:55 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.quobyte [None req-b68f064f-f4bf-4fdd-98fc-d589bcd2dbf1 tempest-VolumesNegativeTest-117213089 None] <== create_volume: return (1083ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-23e9d725-3e04-4cd9-bfe0-c8ef43305589'} {{(pid=83528) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 25 15:59:55 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-b68f064f-f4bf-4fdd-98fc-d589bcd2dbf1 tempest-VolumesNegativeTest-117213089 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.085s {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 25 15:59:55 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-b68f064f-f4bf-4fdd-98fc-d589bcd2dbf1 tempest-VolumesNegativeTest-117213089 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (134a6ba0-2ad1-45bc-8637-67b79b025b8d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-39476f23-2b30-4647-a3ff-d8ac35c2e6de', 'volume_size': 1}' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 25 15:59:55 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-b68f064f-f4bf-4fdd-98fc-d589bcd2dbf1 tempest-VolumesNegativeTest-117213089 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6df86ae2-5d51-4ceb-acfb-ef38f3a102f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 25 15:59:55 devstack cinder-volume[83528]: INFO cinder.volume.flows.manager.create_volume [None req-b68f064f-f4bf-4fdd-98fc-d589bcd2dbf1 tempest-VolumesNegativeTest-117213089 None] Volume volume-39476f23-2b30-4647-a3ff-d8ac35c2e6de (39476f23-2b30-4647-a3ff-d8ac35c2e6de): created successfully Feb 25 15:59:55 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-b68f064f-f4bf-4fdd-98fc-d589bcd2dbf1 tempest-VolumesNegativeTest-117213089 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6df86ae2-5d51-4ceb-acfb-ef38f3a102f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 25 15:59:55 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-b68f064f-f4bf-4fdd-98fc-d589bcd2dbf1 tempest-VolumesNegativeTest-117213089 None] Flow 'volume_create_manager' (4259f8cf-85da-48b2-bef4-68871100bf89) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83528) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 25 15:59:55 devstack cinder-volume[83528]: INFO cinder.volume.manager [None req-b68f064f-f4bf-4fdd-98fc-d589bcd2dbf1 tempest-VolumesNegativeTest-117213089 None] Created volume successfully. Feb 25 15:59:56 devstack sudo[90385]: pam_unix(sudo:session): session closed for user root Feb 25 15:59:56 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-7c1b8f12-a872-4606-b1e8-386d95a51417 tempest-CreateVolumesFromSnapshotTest-47770248 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-031c1ee0-ff6a-4595-892a-964994b28d78" returned: 0 in 0.496s {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 25 15:59:56 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-7c1b8f12-a872-4606-b1e8-386d95a51417 tempest-CreateVolumesFromSnapshotTest-47770248 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-031c1ee0-ff6a-4595-892a-964994b28d78 {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 25 15:59:56 devstack sudo[90391]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-031c1ee0-ff6a-4595-892a-964994b28d78 Feb 25 15:59:56 devstack sudo[90391]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 25 15:59:56 devstack sudo[90391]: pam_unix(sudo:session): session closed for user root Feb 25 15:59:56 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-7c1b8f12-a872-4606-b1e8-386d95a51417 tempest-CreateVolumesFromSnapshotTest-47770248 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-031c1ee0-ff6a-4595-892a-964994b28d78" returned: 0 in 0.422s {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 25 15:59:56 devstack cinder-volume[83528]: DEBUG cinder.coordination [None req-7c1b8f12-a872-4606-b1e8-386d95a51417 tempest-CreateVolumesFromSnapshotTest-47770248 None] Lock "cinder-quobyte-031c1ee0-ff6a-4595-892a-964994b28d78" released by "delete_volume" :: held 0.947s {{(pid=83528) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 25 15:59:56 devstack cinder-volume[83528]: DEBUG cinder.quota [None req-7c1b8f12-a872-4606-b1e8-386d95a51417 tempest-CreateVolumesFromSnapshotTest-47770248 None] Created reservations ['4c05bc2c-a938-4f58-accf-96ad0e8d51b1', '1aad1921-5534-4a79-99cf-1c42cf8c2a5c', '7265c75a-6b9b-44fc-aabd-fe5bb45fd47d', '23c376fd-6811-4173-bbb8-f6f2c7f3a198'] {{(pid=83528) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 25 15:59:56 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-7c1b8f12-a872-4606-b1e8-386d95a51417 tempest-CreateVolumesFromSnapshotTest-47770248 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 25 15:59:56 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-7c1b8f12-a872-4606-b1e8-386d95a51417 tempest-CreateVolumesFromSnapshotTest-47770248 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 25 15:59:56 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.quobyte [None req-7c1b8f12-a872-4606-b1e8-386d95a51417 tempest-CreateVolumesFromSnapshotTest-47770248 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23e9d725-3e04-4cd9-bfe0-c8ef43305589': None} {{(pid=83528) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 25 15:59:56 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.quobyte [None req-7c1b8f12-a872-4606-b1e8-386d95a51417 tempest-CreateVolumesFromSnapshotTest-47770248 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23e9d725-3e04-4cd9-bfe0-c8ef43305589'] {{(pid=83528) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 25 15:59:56 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-7c1b8f12-a872-4606-b1e8-386d95a51417 tempest-CreateVolumesFromSnapshotTest-47770248 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 25 15:59:56 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-7c1b8f12-a872-4606-b1e8-386d95a51417 tempest-CreateVolumesFromSnapshotTest-47770248 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85 {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 25 15:59:56 devstack sudo[90394]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85 Feb 25 15:59:56 devstack sudo[90394]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 25 15:59:56 devstack cinder-volume[83528]: DEBUG cinder.coordination [None req-2b0451e2-e427-4674-982f-e14480f37c41 tempest-CreateVolumesFromSnapshotTest-47770248 None] Acquiring lock "cinder-5e291938-4fcc-472a-b758-6438bac0c3c0-delete_volume" by "delete_volume" {{(pid=83528) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 25 15:59:56 devstack cinder-volume[83528]: DEBUG cinder.coordination [None req-2b0451e2-e427-4674-982f-e14480f37c41 tempest-CreateVolumesFromSnapshotTest-47770248 None] Lock "cinder-5e291938-4fcc-472a-b758-6438bac0c3c0-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=83528) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 25 15:59:56 devstack cinder-volume[83528]: DEBUG cinder.coordination [None req-2b0451e2-e427-4674-982f-e14480f37c41 tempest-CreateVolumesFromSnapshotTest-47770248 None] Acquiring lock "cinder-quobyte-5e291938-4fcc-472a-b758-6438bac0c3c0" by "delete_volume" {{(pid=83528) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 25 15:59:56 devstack cinder-volume[83528]: DEBUG cinder.coordination [None req-2b0451e2-e427-4674-982f-e14480f37c41 tempest-CreateVolumesFromSnapshotTest-47770248 None] Lock "cinder-quobyte-5e291938-4fcc-472a-b758-6438bac0c3c0" acquired by "delete_volume" :: waited 0.015s {{(pid=83528) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 25 15:59:56 devstack cinder-volume[83528]: DEBUG oslo.privsep.daemon [-] privsep: reply[40dbfc37-5b52-49c3-bfe8-1fafc001fbd9]: (4, 'qcow2') {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 25 15:59:56 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-2b0451e2-e427-4674-982f-e14480f37c41 tempest-CreateVolumesFromSnapshotTest-47770248 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-5e291938-4fcc-472a-b758-6438bac0c3c0 {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 25 15:59:56 devstack sudo[90396]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-5e291938-4fcc-472a-b758-6438bac0c3c0 Feb 25 15:59:56 devstack sudo[90396]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 25 15:59:57 devstack sudo[90394]: pam_unix(sudo:session): session closed for user root Feb 25 15:59:57 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-7c1b8f12-a872-4606-b1e8-386d95a51417 tempest-CreateVolumesFromSnapshotTest-47770248 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85" returned: 0 in 0.465s {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 25 15:59:57 devstack cinder-volume[83528]: DEBUG cinder.manager [None req-7c1b8f12-a872-4606-b1e8-386d95a51417 tempest-CreateVolumesFromSnapshotTest-47770248 None] Notifying Schedulers of capabilities ... {{(pid=83528) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 25 15:59:57 devstack cinder-volume[83528]: INFO cinder.volume.manager [None req-7c1b8f12-a872-4606-b1e8-386d95a51417 tempest-CreateVolumesFromSnapshotTest-47770248 None] Deleted volume successfully. Feb 25 15:59:57 devstack cinder-volume[83528]: DEBUG cinder.coordination [None req-7c1b8f12-a872-4606-b1e8-386d95a51417 tempest-CreateVolumesFromSnapshotTest-47770248 None] Lock "cinder-031c1ee0-ff6a-4595-892a-964994b28d78-delete_volume" released by "delete_volume" :: held 1.572s {{(pid=83528) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 25 15:59:57 devstack sudo[90396]: pam_unix(sudo:session): session closed for user root Feb 25 15:59:57 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-2b0451e2-e427-4674-982f-e14480f37c41 tempest-CreateVolumesFromSnapshotTest-47770248 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-5e291938-4fcc-472a-b758-6438bac0c3c0" returned: 0 in 0.586s {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 25 15:59:57 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-2b0451e2-e427-4674-982f-e14480f37c41 tempest-CreateVolumesFromSnapshotTest-47770248 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-5e291938-4fcc-472a-b758-6438bac0c3c0 {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 25 15:59:57 devstack sudo[90404]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-5e291938-4fcc-472a-b758-6438bac0c3c0 Feb 25 15:59:57 devstack sudo[90404]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 25 15:59:57 devstack sudo[90404]: pam_unix(sudo:session): session closed for user root Feb 25 15:59:57 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-2b0451e2-e427-4674-982f-e14480f37c41 tempest-CreateVolumesFromSnapshotTest-47770248 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-5e291938-4fcc-472a-b758-6438bac0c3c0" returned: 0 in 0.456s {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 25 15:59:57 devstack cinder-volume[83528]: DEBUG cinder.coordination [None req-2b0451e2-e427-4674-982f-e14480f37c41 tempest-CreateVolumesFromSnapshotTest-47770248 None] Lock "cinder-quobyte-5e291938-4fcc-472a-b758-6438bac0c3c0" released by "delete_volume" :: held 1.068s {{(pid=83528) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 25 15:59:57 devstack cinder-volume[83528]: DEBUG cinder.quota [None req-2b0451e2-e427-4674-982f-e14480f37c41 tempest-CreateVolumesFromSnapshotTest-47770248 None] Created reservations ['453450a6-5259-47d2-b14f-578501dcdcfb', '37ec5c9d-95e0-46a5-a5e8-61c4876ae6cb', 'a2d1b7d8-203b-4568-bba6-8a8c03a73b7f', 'e3b18e80-4508-4011-8d00-a1dd6d638bd5'] {{(pid=83528) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 25 15:59:57 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-2b0451e2-e427-4674-982f-e14480f37c41 tempest-CreateVolumesFromSnapshotTest-47770248 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 25 15:59:57 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-2b0451e2-e427-4674-982f-e14480f37c41 tempest-CreateVolumesFromSnapshotTest-47770248 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 25 15:59:57 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.quobyte [None req-2b0451e2-e427-4674-982f-e14480f37c41 tempest-CreateVolumesFromSnapshotTest-47770248 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23e9d725-3e04-4cd9-bfe0-c8ef43305589': None} {{(pid=83528) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 25 15:59:57 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.quobyte [None req-2b0451e2-e427-4674-982f-e14480f37c41 tempest-CreateVolumesFromSnapshotTest-47770248 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23e9d725-3e04-4cd9-bfe0-c8ef43305589'] {{(pid=83528) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 25 15:59:57 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-2b0451e2-e427-4674-982f-e14480f37c41 tempest-CreateVolumesFromSnapshotTest-47770248 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 25 15:59:57 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-2b0451e2-e427-4674-982f-e14480f37c41 tempest-CreateVolumesFromSnapshotTest-47770248 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85 {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 25 15:59:57 devstack sudo[90407]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85 Feb 25 15:59:57 devstack sudo[90407]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 25 15:59:58 devstack sudo[90407]: pam_unix(sudo:session): session closed for user root Feb 25 15:59:58 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-2b0451e2-e427-4674-982f-e14480f37c41 tempest-CreateVolumesFromSnapshotTest-47770248 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85" returned: 0 in 0.421s {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 25 15:59:58 devstack cinder-volume[83528]: DEBUG cinder.manager [None req-2b0451e2-e427-4674-982f-e14480f37c41 tempest-CreateVolumesFromSnapshotTest-47770248 None] Notifying Schedulers of capabilities ... {{(pid=83528) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 25 15:59:58 devstack cinder-volume[83528]: INFO cinder.volume.manager [None req-2b0451e2-e427-4674-982f-e14480f37c41 tempest-CreateVolumesFromSnapshotTest-47770248 None] Deleted volume successfully. Feb 25 15:59:58 devstack cinder-volume[83528]: DEBUG cinder.coordination [None req-2b0451e2-e427-4674-982f-e14480f37c41 tempest-CreateVolumesFromSnapshotTest-47770248 None] Lock "cinder-5e291938-4fcc-472a-b758-6438bac0c3c0-delete_volume" released by "delete_volume" :: held 1.638s {{(pid=83528) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 25 15:59:58 devstack cinder-volume[83528]: DEBUG cinder.coordination [None req-c2ad9710-9aed-4547-b1c7-df932da4af9a tempest-CreateVolumesFromSnapshotTest-47770248 None] Acquiring lock "cinder-e104816d-69a5-4394-bba4-c6d6d2ebb2bb-delete_snapshot" by "delete_snapshot" {{(pid=83528) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 25 15:59:58 devstack cinder-volume[83528]: DEBUG cinder.coordination [None req-c2ad9710-9aed-4547-b1c7-df932da4af9a tempest-CreateVolumesFromSnapshotTest-47770248 None] Lock "cinder-e104816d-69a5-4394-bba4-c6d6d2ebb2bb-delete_snapshot" acquired by "delete_snapshot" :: waited 0.011s {{(pid=83528) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 25 15:59:58 devstack cinder-volume[83528]: DEBUG cinder.coordination [None req-c2ad9710-9aed-4547-b1c7-df932da4af9a tempest-CreateVolumesFromSnapshotTest-47770248 None] Acquiring lock "cinder-quobyte-d1e5d330-5abd-438f-aba5-8deb8db05d57" by "delete_snapshot" {{(pid=83528) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 25 15:59:58 devstack cinder-volume[83528]: DEBUG cinder.coordination [None req-c2ad9710-9aed-4547-b1c7-df932da4af9a tempest-CreateVolumesFromSnapshotTest-47770248 None] Lock "cinder-quobyte-d1e5d330-5abd-438f-aba5-8deb8db05d57" acquired by "delete_snapshot" :: waited 0.011s {{(pid=83528) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 25 15:59:58 devstack cinder-volume[83528]: DEBUG cinder.coordination [None req-c2ad9710-9aed-4547-b1c7-df932da4af9a tempest-CreateVolumesFromSnapshotTest-47770248 None] Acquiring lock "cinder-quobyte-e104816d-69a5-4394-bba4-c6d6d2ebb2bb" by "_delete_snapshot" {{(pid=83528) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 25 15:59:58 devstack cinder-volume[83528]: DEBUG cinder.coordination [None req-c2ad9710-9aed-4547-b1c7-df932da4af9a tempest-CreateVolumesFromSnapshotTest-47770248 None] Lock "cinder-quobyte-e104816d-69a5-4394-bba4-c6d6d2ebb2bb" acquired by "_delete_snapshot" :: waited 0.009s {{(pid=83528) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 25 15:59:58 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.remotefs [None req-c2ad9710-9aed-4547-b1c7-df932da4af9a tempest-CreateVolumesFromSnapshotTest-47770248 None] Deleting offline snapshot e104816d-69a5-4394-bba4-c6d6d2ebb2bb of volume d1e5d330-5abd-438f-aba5-8deb8db05d57 {{(pid=83528) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Feb 25 15:59:58 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.remotefs [None req-c2ad9710-9aed-4547-b1c7-df932da4af9a tempest-CreateVolumesFromSnapshotTest-47770248 None] snapshot_file for this snap is: volume-d1e5d330-5abd-438f-aba5-8deb8db05d57.e104816d-69a5-4394-bba4-c6d6d2ebb2bb {{(pid=83528) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Feb 25 15:59:58 devstack cinder-volume[83528]: DEBUG oslo.privsep.daemon [-] privsep: reply[283273e1-6518-4c26-aa26-ef2fecbc55fa]: (4, 'qcow2') {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 25 15:59:58 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-c2ad9710-9aed-4547-b1c7-df932da4af9a tempest-CreateVolumesFromSnapshotTest-47770248 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-d1e5d330-5abd-438f-aba5-8deb8db05d57.e104816d-69a5-4394-bba4-c6d6d2ebb2bb {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 25 15:59:59 devstack sudo[90410]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-d1e5d330-5abd-438f-aba5-8deb8db05d57.e104816d-69a5-4394-bba4-c6d6d2ebb2bb Feb 25 15:59:59 devstack sudo[90410]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 25 15:59:59 devstack sudo[90410]: pam_unix(sudo:session): session closed for user root Feb 25 15:59:59 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-c2ad9710-9aed-4547-b1c7-df932da4af9a tempest-CreateVolumesFromSnapshotTest-47770248 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-d1e5d330-5abd-438f-aba5-8deb8db05d57.e104816d-69a5-4394-bba4-c6d6d2ebb2bb" returned: 0 in 0.500s {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 25 15:59:59 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.remotefs [None req-c2ad9710-9aed-4547-b1c7-df932da4af9a tempest-CreateVolumesFromSnapshotTest-47770248 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d1e5d330-5abd-438f-aba5-8deb8db05d57(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83528) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Feb 25 15:59:59 devstack cinder-volume[83528]: DEBUG oslo.privsep.daemon [-] privsep: reply[14e188df-f482-4f4a-95ae-f42153102f01]: (4, 'qcow2') {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 25 15:59:59 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-c2ad9710-9aed-4547-b1c7-df932da4af9a tempest-CreateVolumesFromSnapshotTest-47770248 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-d1e5d330-5abd-438f-aba5-8deb8db05d57 {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 25 15:59:59 devstack sudo[90415]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-d1e5d330-5abd-438f-aba5-8deb8db05d57 Feb 25 15:59:59 devstack sudo[90415]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 25 15:59:59 devstack sudo[90415]: pam_unix(sudo:session): session closed for user root Feb 25 15:59:59 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-c2ad9710-9aed-4547-b1c7-df932da4af9a tempest-CreateVolumesFromSnapshotTest-47770248 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-d1e5d330-5abd-438f-aba5-8deb8db05d57" returned: 0 in 0.528s {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 25 15:59:59 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-c2ad9710-9aed-4547-b1c7-df932da4af9a tempest-CreateVolumesFromSnapshotTest-47770248 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-d1e5d330-5abd-438f-aba5-8deb8db05d57.e104816d-69a5-4394-bba4-c6d6d2ebb2bb {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 25 16:00:00 devstack sudo[90420]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-d1e5d330-5abd-438f-aba5-8deb8db05d57.e104816d-69a5-4394-bba4-c6d6d2ebb2bb Feb 25 16:00:00 devstack sudo[90420]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 25 16:00:00 devstack sudo[90420]: pam_unix(sudo:session): session closed for user root Feb 25 16:00:00 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-c2ad9710-9aed-4547-b1c7-df932da4af9a tempest-CreateVolumesFromSnapshotTest-47770248 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-d1e5d330-5abd-438f-aba5-8deb8db05d57.e104816d-69a5-4394-bba4-c6d6d2ebb2bb" returned: 0 in 0.534s {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 25 16:00:00 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-c2ad9710-9aed-4547-b1c7-df932da4af9a tempest-CreateVolumesFromSnapshotTest-47770248 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-d1e5d330-5abd-438f-aba5-8deb8db05d57.e104816d-69a5-4394-bba4-c6d6d2ebb2bb {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 25 16:00:00 devstack sudo[90425]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-d1e5d330-5abd-438f-aba5-8deb8db05d57.e104816d-69a5-4394-bba4-c6d6d2ebb2bb Feb 25 16:00:00 devstack sudo[90425]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 25 16:00:00 devstack sudo[90425]: pam_unix(sudo:session): session closed for user root Feb 25 16:00:00 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-c2ad9710-9aed-4547-b1c7-df932da4af9a tempest-CreateVolumesFromSnapshotTest-47770248 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-d1e5d330-5abd-438f-aba5-8deb8db05d57.e104816d-69a5-4394-bba4-c6d6d2ebb2bb" returned: 0 in 0.457s {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 25 16:00:01 devstack cinder-volume[83528]: DEBUG cinder.coordination [None req-c2ad9710-9aed-4547-b1c7-df932da4af9a tempest-CreateVolumesFromSnapshotTest-47770248 None] Lock "cinder-quobyte-e104816d-69a5-4394-bba4-c6d6d2ebb2bb" released by "_delete_snapshot" :: held 2.087s {{(pid=83528) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 25 16:00:01 devstack cinder-volume[83528]: DEBUG cinder.coordination [None req-c2ad9710-9aed-4547-b1c7-df932da4af9a tempest-CreateVolumesFromSnapshotTest-47770248 None] Lock "cinder-quobyte-d1e5d330-5abd-438f-aba5-8deb8db05d57" released by "delete_snapshot" :: held 2.101s {{(pid=83528) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 25 16:00:01 devstack cinder-volume[83528]: DEBUG cinder.quota [None req-c2ad9710-9aed-4547-b1c7-df932da4af9a tempest-CreateVolumesFromSnapshotTest-47770248 None] Created reservations ['c351b999-b926-4d82-acfc-232554596021', 'ab362da8-3ed8-4f09-bcb1-4545d47138ee', '745eda88-c4e1-4b5b-8e2d-e519e2fd7e53', '103f8f78-ad1c-407b-b15d-7e4cd50a774b'] {{(pid=83528) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 25 16:00:01 devstack cinder-volume[83528]: INFO cinder.volume.manager [None req-c2ad9710-9aed-4547-b1c7-df932da4af9a tempest-CreateVolumesFromSnapshotTest-47770248 None] Delete snapshot completed successfully. Feb 25 16:00:01 devstack cinder-volume[83528]: DEBUG cinder.coordination [None req-c2ad9710-9aed-4547-b1c7-df932da4af9a tempest-CreateVolumesFromSnapshotTest-47770248 None] Lock "cinder-e104816d-69a5-4394-bba4-c6d6d2ebb2bb-delete_snapshot" released by "delete_snapshot" :: held 2.205s {{(pid=83528) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 25 16:00:02 devstack cinder-volume[83528]: DEBUG cinder.coordination [None req-9715623c-6eb9-404c-befe-687db41a83e2 tempest-CreateVolumesFromSnapshotTest-47770248 None] Acquiring lock "cinder-d1e5d330-5abd-438f-aba5-8deb8db05d57-delete_volume" by "delete_volume" {{(pid=83528) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 25 16:00:02 devstack cinder-volume[83528]: DEBUG cinder.coordination [None req-9715623c-6eb9-404c-befe-687db41a83e2 tempest-CreateVolumesFromSnapshotTest-47770248 None] Lock "cinder-d1e5d330-5abd-438f-aba5-8deb8db05d57-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=83528) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 25 16:00:02 devstack cinder-volume[83528]: DEBUG cinder.coordination [None req-9715623c-6eb9-404c-befe-687db41a83e2 tempest-CreateVolumesFromSnapshotTest-47770248 None] Acquiring lock "cinder-quobyte-d1e5d330-5abd-438f-aba5-8deb8db05d57" by "delete_volume" {{(pid=83528) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 25 16:00:02 devstack cinder-volume[83528]: DEBUG cinder.coordination [None req-9715623c-6eb9-404c-befe-687db41a83e2 tempest-CreateVolumesFromSnapshotTest-47770248 None] Lock "cinder-quobyte-d1e5d330-5abd-438f-aba5-8deb8db05d57" acquired by "delete_volume" :: waited 0.008s {{(pid=83528) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 25 16:00:02 devstack cinder-volume[83528]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d5ee8d2-242d-4226-bb11-e3de3fb8abfb]: (4, 'qcow2') {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 25 16:00:02 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-9715623c-6eb9-404c-befe-687db41a83e2 tempest-CreateVolumesFromSnapshotTest-47770248 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-d1e5d330-5abd-438f-aba5-8deb8db05d57 {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 25 16:00:02 devstack sudo[90428]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-d1e5d330-5abd-438f-aba5-8deb8db05d57 Feb 25 16:00:02 devstack sudo[90428]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 25 16:00:02 devstack sudo[90428]: pam_unix(sudo:session): session closed for user root Feb 25 16:00:02 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-9715623c-6eb9-404c-befe-687db41a83e2 tempest-CreateVolumesFromSnapshotTest-47770248 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-d1e5d330-5abd-438f-aba5-8deb8db05d57" returned: 0 in 0.576s {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 25 16:00:02 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-9715623c-6eb9-404c-befe-687db41a83e2 tempest-CreateVolumesFromSnapshotTest-47770248 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-d1e5d330-5abd-438f-aba5-8deb8db05d57 {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 25 16:00:02 devstack sudo[90433]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-d1e5d330-5abd-438f-aba5-8deb8db05d57 Feb 25 16:00:02 devstack sudo[90433]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 25 16:00:03 devstack sudo[90433]: pam_unix(sudo:session): session closed for user root Feb 25 16:00:03 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-9715623c-6eb9-404c-befe-687db41a83e2 tempest-CreateVolumesFromSnapshotTest-47770248 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-d1e5d330-5abd-438f-aba5-8deb8db05d57" returned: 0 in 0.456s {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 25 16:00:03 devstack cinder-volume[83528]: DEBUG cinder.coordination [None req-9715623c-6eb9-404c-befe-687db41a83e2 tempest-CreateVolumesFromSnapshotTest-47770248 None] Lock "cinder-quobyte-d1e5d330-5abd-438f-aba5-8deb8db05d57" released by "delete_volume" :: held 1.079s {{(pid=83528) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 25 16:00:03 devstack cinder-volume[83528]: DEBUG cinder.quota [None req-9715623c-6eb9-404c-befe-687db41a83e2 tempest-CreateVolumesFromSnapshotTest-47770248 None] Created reservations ['e4c483ea-439c-4f0b-becf-66a698b7619d', '1c956558-743a-4270-809f-8917293c29c6', 'c5beeea5-b968-4a3b-859b-d4a0937ce3a8', '156c964b-2081-4634-8064-db26d89cd3ff'] {{(pid=83528) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 25 16:00:03 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-9715623c-6eb9-404c-befe-687db41a83e2 tempest-CreateVolumesFromSnapshotTest-47770248 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 25 16:00:03 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-9715623c-6eb9-404c-befe-687db41a83e2 tempest-CreateVolumesFromSnapshotTest-47770248 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 25 16:00:03 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.quobyte [None req-9715623c-6eb9-404c-befe-687db41a83e2 tempest-CreateVolumesFromSnapshotTest-47770248 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23e9d725-3e04-4cd9-bfe0-c8ef43305589': None} {{(pid=83528) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 25 16:00:03 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.quobyte [None req-9715623c-6eb9-404c-befe-687db41a83e2 tempest-CreateVolumesFromSnapshotTest-47770248 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23e9d725-3e04-4cd9-bfe0-c8ef43305589'] {{(pid=83528) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 25 16:00:03 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-9715623c-6eb9-404c-befe-687db41a83e2 tempest-CreateVolumesFromSnapshotTest-47770248 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 25 16:00:03 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-9715623c-6eb9-404c-befe-687db41a83e2 tempest-CreateVolumesFromSnapshotTest-47770248 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85 {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 25 16:00:03 devstack sudo[90436]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85 Feb 25 16:00:03 devstack sudo[90436]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 25 16:00:03 devstack sudo[90436]: pam_unix(sudo:session): session closed for user root Feb 25 16:00:03 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-9715623c-6eb9-404c-befe-687db41a83e2 tempest-CreateVolumesFromSnapshotTest-47770248 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85" returned: 0 in 0.433s {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 25 16:00:03 devstack cinder-volume[83528]: DEBUG cinder.manager [None req-9715623c-6eb9-404c-befe-687db41a83e2 tempest-CreateVolumesFromSnapshotTest-47770248 None] Notifying Schedulers of capabilities ... {{(pid=83528) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 25 16:00:03 devstack cinder-volume[83528]: INFO cinder.volume.manager [None req-9715623c-6eb9-404c-befe-687db41a83e2 tempest-CreateVolumesFromSnapshotTest-47770248 None] Deleted volume successfully. Feb 25 16:00:03 devstack cinder-volume[83528]: DEBUG cinder.coordination [None req-9715623c-6eb9-404c-befe-687db41a83e2 tempest-CreateVolumesFromSnapshotTest-47770248 None] Lock "cinder-d1e5d330-5abd-438f-aba5-8deb8db05d57-delete_volume" released by "delete_volume" :: held 1.654s {{(pid=83528) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 25 16:00:06 devstack cinder-volume[83528]: DEBUG cinder.volume.flows.manager.create_volume [None req-c682e9a5-6dcf-42ca-9b0f-2a93b5d0b409 tempest-VolumeDependencyTests-124298755 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83528) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 25 16:00:06 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-c682e9a5-6dcf-42ca-9b0f-2a93b5d0b409 tempest-VolumeDependencyTests-124298755 None] Flow 'volume_create_manager' (ec104ede-6b65-4e96-8c52-d349b9f904f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83528) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 25 16:00:06 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-c682e9a5-6dcf-42ca-9b0f-2a93b5d0b409 tempest-VolumeDependencyTests-124298755 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (961f44f3-d398-4e71-a787-8e81db1527fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 25 16:00:06 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-c682e9a5-6dcf-42ca-9b0f-2a93b5d0b409 tempest-VolumeDependencyTests-124298755 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (961f44f3-d398-4e71-a787-8e81db1527fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-25T15:00:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1755307300',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dd6af1a9-a4e1-4143-9cd4-2c96bb4295a0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c62c9c28c9e84220908959477ca53cb0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-25T15:00:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-25T15:00:06Z,use_quota=True,user_id='45d46312e99d489a8a18877333766389',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ce71c2f9-6543-4165-9653-a1529b2ea243),volume_type_id=ce71c2f9-6543-4165-9653-a1529b2ea243)' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 25 16:00:06 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-c682e9a5-6dcf-42ca-9b0f-2a93b5d0b409 tempest-VolumeDependencyTests-124298755 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e7566cc5-2d7e-4260-8fb0-f4add30e21c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 25 16:00:06 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-c682e9a5-6dcf-42ca-9b0f-2a93b5d0b409 tempest-VolumeDependencyTests-124298755 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e7566cc5-2d7e-4260-8fb0-f4add30e21c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 25 16:00:06 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-c682e9a5-6dcf-42ca-9b0f-2a93b5d0b409 tempest-VolumeDependencyTests-124298755 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3f9e4319-6709-4b32-9093-cf1633f039b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 25 16:00:06 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-c682e9a5-6dcf-42ca-9b0f-2a93b5d0b409 tempest-VolumeDependencyTests-124298755 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3f9e4319-6709-4b32-9093-cf1633f039b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'dd6af1a9-a4e1-4143-9cd4-2c96bb4295a0', 'volume_name': 'volume-dd6af1a9-a4e1-4143-9cd4-2c96bb4295a0', 'volume_size': 1}' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 25 16:00:06 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-c682e9a5-6dcf-42ca-9b0f-2a93b5d0b409 tempest-VolumeDependencyTests-124298755 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (19a07abe-4d24-485e-a79a-a7fe195b7b5a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 25 16:00:06 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-c682e9a5-6dcf-42ca-9b0f-2a93b5d0b409 tempest-VolumeDependencyTests-124298755 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (19a07abe-4d24-485e-a79a-a7fe195b7b5a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 25 16:00:06 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-c682e9a5-6dcf-42ca-9b0f-2a93b5d0b409 tempest-VolumeDependencyTests-124298755 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b7c5c6d2-63bf-4ed2-90bb-f50d3847469f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 25 16:00:06 devstack cinder-volume[83528]: INFO cinder.volume.flows.manager.create_volume [None req-c682e9a5-6dcf-42ca-9b0f-2a93b5d0b409 tempest-VolumeDependencyTests-124298755 None] Volume dd6af1a9-a4e1-4143-9cd4-2c96bb4295a0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-dd6af1a9-a4e1-4143-9cd4-2c96bb4295a0', 'volume_size': 1} Feb 25 16:00:06 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-c682e9a5-6dcf-42ca-9b0f-2a93b5d0b409 tempest-VolumeDependencyTests-124298755 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 25 16:00:06 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-c682e9a5-6dcf-42ca-9b0f-2a93b5d0b409 tempest-VolumeDependencyTests-124298755 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 25 16:00:06 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.quobyte [None req-c682e9a5-6dcf-42ca-9b0f-2a93b5d0b409 tempest-VolumeDependencyTests-124298755 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-25T15:00:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1755307300',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dd6af1a9-a4e1-4143-9cd4-2c96bb4295a0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c62c9c28c9e84220908959477ca53cb0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-25T15:00:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-25T15:00:06Z,use_quota=True,user_id='45d46312e99d489a8a18877333766389',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ce71c2f9-6543-4165-9653-a1529b2ea243),volume_type_id=ce71c2f9-6543-4165-9653-a1529b2ea243)}" {{(pid=83528) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 25 16:00:06 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.remotefs [None req-c682e9a5-6dcf-42ca-9b0f-2a93b5d0b409 tempest-VolumeDependencyTests-124298755 None] Creating volume dd6af1a9-a4e1-4143-9cd4-2c96bb4295a0 {{(pid=83528) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 25 16:00:06 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-c682e9a5-6dcf-42ca-9b0f-2a93b5d0b409 tempest-VolumeDependencyTests-124298755 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 25 16:00:06 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-c682e9a5-6dcf-42ca-9b0f-2a93b5d0b409 tempest-VolumeDependencyTests-124298755 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 25 16:00:06 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.quobyte [None req-c682e9a5-6dcf-42ca-9b0f-2a93b5d0b409 tempest-VolumeDependencyTests-124298755 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23e9d725-3e04-4cd9-bfe0-c8ef43305589': None} {{(pid=83528) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 25 16:00:06 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.quobyte [None req-c682e9a5-6dcf-42ca-9b0f-2a93b5d0b409 tempest-VolumeDependencyTests-124298755 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23e9d725-3e04-4cd9-bfe0-c8ef43305589'] {{(pid=83528) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 25 16:00:06 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-c682e9a5-6dcf-42ca-9b0f-2a93b5d0b409 tempest-VolumeDependencyTests-124298755 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 25 16:00:06 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.quobyte [None req-c682e9a5-6dcf-42ca-9b0f-2a93b5d0b409 tempest-VolumeDependencyTests-124298755 None] Selected osci02.corp.quobyte.com/cinder-vol-23e9d725-3e04-4cd9-bfe0-c8ef43305589 as target Quobyte volume. {{(pid=83528) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 25 16:00:06 devstack cinder-volume[83528]: INFO cinder.volume.drivers.remotefs [None req-c682e9a5-6dcf-42ca-9b0f-2a93b5d0b409 tempest-VolumeDependencyTests-124298755 None] casted to osci02.corp.quobyte.com/cinder-vol-23e9d725-3e04-4cd9-bfe0-c8ef43305589 Feb 25 16:00:06 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-c682e9a5-6dcf-42ca-9b0f-2a93b5d0b409 tempest-VolumeDependencyTests-124298755 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-dd6af1a9-a4e1-4143-9cd4-2c96bb4295a0 1073741824 {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 25 16:00:06 devstack sudo[90456]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-dd6af1a9-a4e1-4143-9cd4-2c96bb4295a0 1073741824 Feb 25 16:00:06 devstack sudo[90456]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 25 16:00:06 devstack sudo[90456]: pam_unix(sudo:session): session closed for user root Feb 25 16:00:06 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-c682e9a5-6dcf-42ca-9b0f-2a93b5d0b409 tempest-VolumeDependencyTests-124298755 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-dd6af1a9-a4e1-4143-9cd4-2c96bb4295a0 1073741824" returned: 0 in 0.510s {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 25 16:00:06 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-c682e9a5-6dcf-42ca-9b0f-2a93b5d0b409 tempest-VolumeDependencyTests-124298755 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-dd6af1a9-a4e1-4143-9cd4-2c96bb4295a0 {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 25 16:00:06 devstack sudo[90464]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-dd6af1a9-a4e1-4143-9cd4-2c96bb4295a0 Feb 25 16:00:06 devstack sudo[90464]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 25 16:00:07 devstack sudo[90464]: pam_unix(sudo:session): session closed for user root Feb 25 16:00:07 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-c682e9a5-6dcf-42ca-9b0f-2a93b5d0b409 tempest-VolumeDependencyTests-124298755 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-dd6af1a9-a4e1-4143-9cd4-2c96bb4295a0" returned: 0 in 0.433s {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 25 16:00:07 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.quobyte [None req-c682e9a5-6dcf-42ca-9b0f-2a93b5d0b409 tempest-VolumeDependencyTests-124298755 None] <== create_volume: return (974ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-23e9d725-3e04-4cd9-bfe0-c8ef43305589'} {{(pid=83528) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 25 16:00:07 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-c682e9a5-6dcf-42ca-9b0f-2a93b5d0b409 tempest-VolumeDependencyTests-124298755 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.976s {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 25 16:00:07 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-c682e9a5-6dcf-42ca-9b0f-2a93b5d0b409 tempest-VolumeDependencyTests-124298755 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b7c5c6d2-63bf-4ed2-90bb-f50d3847469f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dd6af1a9-a4e1-4143-9cd4-2c96bb4295a0', 'volume_size': 1}' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 25 16:00:07 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-c682e9a5-6dcf-42ca-9b0f-2a93b5d0b409 tempest-VolumeDependencyTests-124298755 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (af18404c-7622-46a7-896a-1dfbd57f05d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 25 16:00:07 devstack cinder-volume[83528]: INFO cinder.volume.flows.manager.create_volume [None req-c682e9a5-6dcf-42ca-9b0f-2a93b5d0b409 tempest-VolumeDependencyTests-124298755 None] Volume volume-dd6af1a9-a4e1-4143-9cd4-2c96bb4295a0 (dd6af1a9-a4e1-4143-9cd4-2c96bb4295a0): created successfully Feb 25 16:00:07 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-c682e9a5-6dcf-42ca-9b0f-2a93b5d0b409 tempest-VolumeDependencyTests-124298755 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (af18404c-7622-46a7-896a-1dfbd57f05d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 25 16:00:07 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-c682e9a5-6dcf-42ca-9b0f-2a93b5d0b409 tempest-VolumeDependencyTests-124298755 None] Flow 'volume_create_manager' (ec104ede-6b65-4e96-8c52-d349b9f904f6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83528) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 25 16:00:07 devstack cinder-volume[83528]: INFO cinder.volume.manager [None req-c682e9a5-6dcf-42ca-9b0f-2a93b5d0b409 tempest-VolumeDependencyTests-124298755 None] Created volume successfully. Feb 25 16:00:08 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-963f6c7b-b37a-4064-9d31-d9558be2f67f tempest-VolumeDependencyTests-124298755 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 25 16:00:08 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-963f6c7b-b37a-4064-9d31-d9558be2f67f tempest-VolumeDependencyTests-124298755 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 25 16:00:08 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.remotefs [None req-963f6c7b-b37a-4064-9d31-d9558be2f67f tempest-VolumeDependencyTests-124298755 None] Creating offline snapshot 3917ea36-5381-4f03-a643-1df048632311 of volume dd6af1a9-a4e1-4143-9cd4-2c96bb4295a0 {{(pid=83528) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Feb 25 16:00:08 devstack cinder-volume[83528]: DEBUG oslo.privsep.daemon [-] privsep: reply[10a4716f-f487-4dae-9c23-2d9a7c51ab4a]: (4, 'qcow2') {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 25 16:00:08 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-963f6c7b-b37a-4064-9d31-d9558be2f67f tempest-VolumeDependencyTests-124298755 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-dd6af1a9-a4e1-4143-9cd4-2c96bb4295a0 {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 25 16:00:08 devstack sudo[90493]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-dd6af1a9-a4e1-4143-9cd4-2c96bb4295a0 Feb 25 16:00:08 devstack sudo[90493]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 25 16:00:09 devstack sudo[90493]: pam_unix(sudo:session): session closed for user root Feb 25 16:00:09 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-963f6c7b-b37a-4064-9d31-d9558be2f67f tempest-VolumeDependencyTests-124298755 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-dd6af1a9-a4e1-4143-9cd4-2c96bb4295a0" returned: 0 in 0.565s {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 25 16:00:09 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-963f6c7b-b37a-4064-9d31-d9558be2f67f tempest-VolumeDependencyTests-124298755 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-dd6af1a9-a4e1-4143-9cd4-2c96bb4295a0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-dd6af1a9-a4e1-4143-9cd4-2c96bb4295a0.3917ea36-5381-4f03-a643-1df048632311 1G {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 25 16:00:09 devstack sudo[90499]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-dd6af1a9-a4e1-4143-9cd4-2c96bb4295a0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-dd6af1a9-a4e1-4143-9cd4-2c96bb4295a0.3917ea36-5381-4f03-a643-1df048632311 1G Feb 25 16:00:09 devstack sudo[90499]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 25 16:00:09 devstack sudo[90499]: pam_unix(sudo:session): session closed for user root Feb 25 16:00:09 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-963f6c7b-b37a-4064-9d31-d9558be2f67f tempest-VolumeDependencyTests-124298755 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-dd6af1a9-a4e1-4143-9cd4-2c96bb4295a0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-dd6af1a9-a4e1-4143-9cd4-2c96bb4295a0.3917ea36-5381-4f03-a643-1df048632311 1G" returned: 0 in 0.513s {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 25 16:00:09 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-963f6c7b-b37a-4064-9d31-d9558be2f67f tempest-VolumeDependencyTests-124298755 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-dd6af1a9-a4e1-4143-9cd4-2c96bb4295a0 -F qcow2 /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-dd6af1a9-a4e1-4143-9cd4-2c96bb4295a0.3917ea36-5381-4f03-a643-1df048632311 {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 25 16:00:09 devstack sudo[90504]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-dd6af1a9-a4e1-4143-9cd4-2c96bb4295a0 -F qcow2 /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-dd6af1a9-a4e1-4143-9cd4-2c96bb4295a0.3917ea36-5381-4f03-a643-1df048632311 Feb 25 16:00:09 devstack sudo[90504]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 25 16:00:10 devstack sudo[90504]: pam_unix(sudo:session): session closed for user root Feb 25 16:00:10 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-963f6c7b-b37a-4064-9d31-d9558be2f67f tempest-VolumeDependencyTests-124298755 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-dd6af1a9-a4e1-4143-9cd4-2c96bb4295a0 -F qcow2 /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-dd6af1a9-a4e1-4143-9cd4-2c96bb4295a0.3917ea36-5381-4f03-a643-1df048632311" returned: 0 in 0.570s {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 25 16:00:10 devstack cinder-volume[83528]: WARNING cinder.volume.drivers.remotefs [None req-963f6c7b-b37a-4064-9d31-d9558be2f67f tempest-VolumeDependencyTests-124298755 None] /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-dd6af1a9-a4e1-4143-9cd4-2c96bb4295a0.3917ea36-5381-4f03-a643-1df048632311 is being set with open permissions: ugo+rw Feb 25 16:00:10 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-963f6c7b-b37a-4064-9d31-d9558be2f67f tempest-VolumeDependencyTests-124298755 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-dd6af1a9-a4e1-4143-9cd4-2c96bb4295a0.3917ea36-5381-4f03-a643-1df048632311 {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 25 16:00:10 devstack sudo[90509]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-dd6af1a9-a4e1-4143-9cd4-2c96bb4295a0.3917ea36-5381-4f03-a643-1df048632311 Feb 25 16:00:10 devstack sudo[90509]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 25 16:00:10 devstack sudo[90509]: pam_unix(sudo:session): session closed for user root Feb 25 16:00:10 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-963f6c7b-b37a-4064-9d31-d9558be2f67f tempest-VolumeDependencyTests-124298755 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-dd6af1a9-a4e1-4143-9cd4-2c96bb4295a0.3917ea36-5381-4f03-a643-1df048632311" returned: 0 in 0.455s {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 25 16:00:10 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-963f6c7b-b37a-4064-9d31-d9558be2f67f tempest-VolumeDependencyTests-124298755 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-dd6af1a9-a4e1-4143-9cd4-2c96bb4295a0.info {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 25 16:00:10 devstack sudo[90512]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-dd6af1a9-a4e1-4143-9cd4-2c96bb4295a0.info Feb 25 16:00:10 devstack sudo[90512]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 25 16:00:11 devstack sudo[90512]: pam_unix(sudo:session): session closed for user root Feb 25 16:00:11 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-963f6c7b-b37a-4064-9d31-d9558be2f67f tempest-VolumeDependencyTests-124298755 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-dd6af1a9-a4e1-4143-9cd4-2c96bb4295a0.info" returned: 0 in 0.443s {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 25 16:00:11 devstack cinder-volume[83528]: WARNING cinder.volume.drivers.remotefs [None req-963f6c7b-b37a-4064-9d31-d9558be2f67f tempest-VolumeDependencyTests-124298755 None] /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-dd6af1a9-a4e1-4143-9cd4-2c96bb4295a0.info is being set with open permissions: ugo+rw Feb 25 16:00:11 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-963f6c7b-b37a-4064-9d31-d9558be2f67f tempest-VolumeDependencyTests-124298755 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-dd6af1a9-a4e1-4143-9cd4-2c96bb4295a0.info {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 25 16:00:11 devstack sudo[90515]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-dd6af1a9-a4e1-4143-9cd4-2c96bb4295a0.info Feb 25 16:00:11 devstack sudo[90515]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 25 16:00:11 devstack sudo[90515]: pam_unix(sudo:session): session closed for user root Feb 25 16:00:11 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-963f6c7b-b37a-4064-9d31-d9558be2f67f tempest-VolumeDependencyTests-124298755 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-dd6af1a9-a4e1-4143-9cd4-2c96bb4295a0.info" returned: 0 in 0.514s {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 25 16:00:11 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-963f6c7b-b37a-4064-9d31-d9558be2f67f tempest-VolumeDependencyTests-124298755 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.131s {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 25 16:00:11 devstack cinder-volume[83528]: INFO cinder.volume.manager [None req-963f6c7b-b37a-4064-9d31-d9558be2f67f tempest-VolumeDependencyTests-124298755 None] Create snapshot completed successfully Feb 25 16:00:13 devstack cinder-volume[83528]: DEBUG cinder.volume.flows.manager.create_volume [None req-38956734-bfa5-464c-bf88-fcb40c92d9fa tempest-VolumeDependencyTests-124298755 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83528) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 25 16:00:13 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-38956734-bfa5-464c-bf88-fcb40c92d9fa tempest-VolumeDependencyTests-124298755 None] Flow 'volume_create_manager' (4d6950a7-0a87-40be-be9d-b372a3210d63) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83528) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 25 16:00:13 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-38956734-bfa5-464c-bf88-fcb40c92d9fa tempest-VolumeDependencyTests-124298755 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ef22d5ec-3305-4b7e-af8f-e32a5a3cc6a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 25 16:00:13 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-38956734-bfa5-464c-bf88-fcb40c92d9fa tempest-VolumeDependencyTests-124298755 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ef22d5ec-3305-4b7e-af8f-e32a5a3cc6a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-25T15:00:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1365080988',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7dcb89fe-7b49-48d7-b9cd-03e542fd1e8b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c62c9c28c9e84220908959477ca53cb0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-25T15:00:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=3917ea36-5381-4f03-a643-1df048632311,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-25T15:00:13Z,use_quota=True,user_id='45d46312e99d489a8a18877333766389',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ce71c2f9-6543-4165-9653-a1529b2ea243),volume_type_id=ce71c2f9-6543-4165-9653-a1529b2ea243)' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 25 16:00:13 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-38956734-bfa5-464c-bf88-fcb40c92d9fa tempest-VolumeDependencyTests-124298755 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ab96c4ca-ff58-41b1-961d-e623bea26198) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 25 16:00:13 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-38956734-bfa5-464c-bf88-fcb40c92d9fa tempest-VolumeDependencyTests-124298755 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ab96c4ca-ff58-41b1-961d-e623bea26198) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 25 16:00:13 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-38956734-bfa5-464c-bf88-fcb40c92d9fa tempest-VolumeDependencyTests-124298755 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aa6ef4ba-05a4-4760-b3dd-8df0fd051ea2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 25 16:00:13 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-38956734-bfa5-464c-bf88-fcb40c92d9fa tempest-VolumeDependencyTests-124298755 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aa6ef4ba-05a4-4760-b3dd-8df0fd051ea2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '7dcb89fe-7b49-48d7-b9cd-03e542fd1e8b', 'volume_name': 'volume-7dcb89fe-7b49-48d7-b9cd-03e542fd1e8b', 'volume_size': 1, 'snapshot_id': '3917ea36-5381-4f03-a643-1df048632311'}' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 25 16:00:13 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-38956734-bfa5-464c-bf88-fcb40c92d9fa tempest-VolumeDependencyTests-124298755 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4cce8c0e-8db2-46be-9c62-3a2d5d1957e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 25 16:00:13 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-38956734-bfa5-464c-bf88-fcb40c92d9fa tempest-VolumeDependencyTests-124298755 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4cce8c0e-8db2-46be-9c62-3a2d5d1957e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 25 16:00:13 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-38956734-bfa5-464c-bf88-fcb40c92d9fa tempest-VolumeDependencyTests-124298755 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (717524e6-bbb6-4f3e-96b5-b13b5cc7886a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 25 16:00:13 devstack cinder-volume[83528]: INFO cinder.volume.flows.manager.create_volume [None req-38956734-bfa5-464c-bf88-fcb40c92d9fa tempest-VolumeDependencyTests-124298755 None] Volume 7dcb89fe-7b49-48d7-b9cd-03e542fd1e8b: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-7dcb89fe-7b49-48d7-b9cd-03e542fd1e8b', 'volume_size': 1, 'snapshot_id': '3917ea36-5381-4f03-a643-1df048632311'} Feb 25 16:00:13 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-38956734-bfa5-464c-bf88-fcb40c92d9fa tempest-VolumeDependencyTests-124298755 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 25 16:00:13 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-38956734-bfa5-464c-bf88-fcb40c92d9fa tempest-VolumeDependencyTests-124298755 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 25 16:00:13 devstack cinder-volume[83528]: DEBUG cinder.coordination [None req-38956734-bfa5-464c-bf88-fcb40c92d9fa tempest-VolumeDependencyTests-124298755 None] Acquiring lock "cinder-quobyte-3917ea36-5381-4f03-a643-1df048632311-7dcb89fe-7b49-48d7-b9cd-03e542fd1e8b" by "_create_volume_from_snapshot" {{(pid=83528) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 25 16:00:13 devstack cinder-volume[83528]: DEBUG cinder.coordination [None req-38956734-bfa5-464c-bf88-fcb40c92d9fa tempest-VolumeDependencyTests-124298755 None] Lock "cinder-quobyte-3917ea36-5381-4f03-a643-1df048632311-7dcb89fe-7b49-48d7-b9cd-03e542fd1e8b" acquired by "_create_volume_from_snapshot" :: waited 0.010s {{(pid=83528) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 25 16:00:13 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.quobyte [None req-38956734-bfa5-464c-bf88-fcb40c92d9fa tempest-VolumeDependencyTests-124298755 None] Creating volume 7dcb89fe-7b49-48d7-b9cd-03e542fd1e8b from snapshot 3917ea36-5381-4f03-a643-1df048632311 {{(pid=83528) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Feb 25 16:00:13 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-38956734-bfa5-464c-bf88-fcb40c92d9fa tempest-VolumeDependencyTests-124298755 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 25 16:00:13 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-38956734-bfa5-464c-bf88-fcb40c92d9fa tempest-VolumeDependencyTests-124298755 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 25 16:00:13 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.quobyte [None req-38956734-bfa5-464c-bf88-fcb40c92d9fa tempest-VolumeDependencyTests-124298755 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23e9d725-3e04-4cd9-bfe0-c8ef43305589': None} {{(pid=83528) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 25 16:00:13 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.quobyte [None req-38956734-bfa5-464c-bf88-fcb40c92d9fa tempest-VolumeDependencyTests-124298755 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23e9d725-3e04-4cd9-bfe0-c8ef43305589'] {{(pid=83528) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 25 16:00:13 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-38956734-bfa5-464c-bf88-fcb40c92d9fa tempest-VolumeDependencyTests-124298755 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 25 16:00:13 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.quobyte [None req-38956734-bfa5-464c-bf88-fcb40c92d9fa tempest-VolumeDependencyTests-124298755 None] Selected osci02.corp.quobyte.com/cinder-vol-23e9d725-3e04-4cd9-bfe0-c8ef43305589 as target Quobyte volume. {{(pid=83528) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 25 16:00:13 devstack cinder-volume[83528]: DEBUG cinder.coordination [None req-38956734-bfa5-464c-bf88-fcb40c92d9fa tempest-VolumeDependencyTests-124298755 None] Acquiring lock "cinder-quobyte-7dcb89fe-7b49-48d7-b9cd-03e542fd1e8b" by "_copy_volume_from_snapshot" {{(pid=83528) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 25 16:00:13 devstack cinder-volume[83528]: DEBUG cinder.coordination [None req-38956734-bfa5-464c-bf88-fcb40c92d9fa tempest-VolumeDependencyTests-124298755 None] Lock "cinder-quobyte-7dcb89fe-7b49-48d7-b9cd-03e542fd1e8b" acquired by "_copy_volume_from_snapshot" :: waited 0.016s {{(pid=83528) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 25 16:00:13 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.quobyte [None req-38956734-bfa5-464c-bf88-fcb40c92d9fa tempest-VolumeDependencyTests-124298755 None] snapshot: 3917ea36-5381-4f03-a643-1df048632311, volume: 7dcb89fe-7b49-48d7-b9cd-03e542fd1e8b, {{(pid=83528) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Feb 25 16:00:13 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-38956734-bfa5-464c-bf88-fcb40c92d9fa tempest-VolumeDependencyTests-124298755 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 25 16:00:13 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-38956734-bfa5-464c-bf88-fcb40c92d9fa tempest-VolumeDependencyTests-124298755 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 25 16:00:13 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.quobyte [None req-38956734-bfa5-464c-bf88-fcb40c92d9fa tempest-VolumeDependencyTests-124298755 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23e9d725-3e04-4cd9-bfe0-c8ef43305589': None} {{(pid=83528) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 25 16:00:13 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.quobyte [None req-38956734-bfa5-464c-bf88-fcb40c92d9fa tempest-VolumeDependencyTests-124298755 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23e9d725-3e04-4cd9-bfe0-c8ef43305589'] {{(pid=83528) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 25 16:00:13 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-38956734-bfa5-464c-bf88-fcb40c92d9fa tempest-VolumeDependencyTests-124298755 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 25 16:00:13 devstack cinder-volume[83528]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb4ed887-64d8-4d09-a629-b117c8aa5589]: (4, 'qcow2') {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 25 16:00:13 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-38956734-bfa5-464c-bf88-fcb40c92d9fa tempest-VolumeDependencyTests-124298755 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-dd6af1a9-a4e1-4143-9cd4-2c96bb4295a0.3917ea36-5381-4f03-a643-1df048632311 {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 25 16:00:13 devstack sudo[90579]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-dd6af1a9-a4e1-4143-9cd4-2c96bb4295a0.3917ea36-5381-4f03-a643-1df048632311 Feb 25 16:00:13 devstack sudo[90579]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 25 16:00:13 devstack sudo[90579]: pam_unix(sudo:session): session closed for user root Feb 25 16:00:13 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-38956734-bfa5-464c-bf88-fcb40c92d9fa tempest-VolumeDependencyTests-124298755 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-dd6af1a9-a4e1-4143-9cd4-2c96bb4295a0.3917ea36-5381-4f03-a643-1df048632311" returned: 0 in 0.515s {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 25 16:00:13 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.remotefs [None req-38956734-bfa5-464c-bf88-fcb40c92d9fa tempest-VolumeDependencyTests-124298755 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-dd6af1a9-a4e1-4143-9cd4-2c96bb4295a0(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83528) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Feb 25 16:00:13 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.quobyte [None req-38956734-bfa5-464c-bf88-fcb40c92d9fa tempest-VolumeDependencyTests-124298755 None] will copy from snapshot at /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-dd6af1a9-a4e1-4143-9cd4-2c96bb4295a0 {{(pid=83528) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Feb 25 16:00:13 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.quobyte [None req-38956734-bfa5-464c-bf88-fcb40c92d9fa tempest-VolumeDependencyTests-124298755 None] Creating direct copy from snapshot {{(pid=83528) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Feb 25 16:00:13 devstack cinder-volume[83528]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7556dad-53ee-4885-a7f9-66a5b5129c3f]: (4, 'qcow2') {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 25 16:00:13 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-38956734-bfa5-464c-bf88-fcb40c92d9fa tempest-VolumeDependencyTests-124298755 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-dd6af1a9-a4e1-4143-9cd4-2c96bb4295a0 {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 25 16:00:13 devstack sudo[90585]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-dd6af1a9-a4e1-4143-9cd4-2c96bb4295a0 Feb 25 16:00:13 devstack sudo[90585]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 25 16:00:14 devstack sudo[90585]: pam_unix(sudo:session): session closed for user root Feb 25 16:00:14 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-38956734-bfa5-464c-bf88-fcb40c92d9fa tempest-VolumeDependencyTests-124298755 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-dd6af1a9-a4e1-4143-9cd4-2c96bb4295a0" returned: 0 in 0.511s {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 25 16:00:14 devstack cinder-volume[83528]: DEBUG cinder.utils [None req-38956734-bfa5-464c-bf88-fcb40c92d9fa tempest-VolumeDependencyTests-124298755 None] Path /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-7dcb89fe-7b49-48d7-b9cd-03e542fd1e8b not found in is_blk_device check {{(pid=83528) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Feb 25 16:00:14 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-38956734-bfa5-464c-bf88-fcb40c92d9fa tempest-VolumeDependencyTests-124298755 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-dd6af1a9-a4e1-4143-9cd4-2c96bb4295a0 /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-7dcb89fe-7b49-48d7-b9cd-03e542fd1e8b {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 25 16:00:14 devstack sudo[90590]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-dd6af1a9-a4e1-4143-9cd4-2c96bb4295a0 /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-7dcb89fe-7b49-48d7-b9cd-03e542fd1e8b Feb 25 16:00:14 devstack sudo[90590]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 25 16:00:16 devstack sudo[90590]: pam_unix(sudo:session): session closed for user root Feb 25 16:00:16 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-38956734-bfa5-464c-bf88-fcb40c92d9fa tempest-VolumeDependencyTests-124298755 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-dd6af1a9-a4e1-4143-9cd4-2c96bb4295a0 /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-7dcb89fe-7b49-48d7-b9cd-03e542fd1e8b" returned: 0 in 2.168s {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 25 16:00:16 devstack cinder-volume[83528]: DEBUG oslo.privsep.daemon [-] privsep: reply[1bb2a4c5-eedc-4ada-a5ed-a9662ff1d3a6]: (4, 'qcow2') {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 25 16:00:16 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-38956734-bfa5-464c-bf88-fcb40c92d9fa tempest-VolumeDependencyTests-124298755 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-dd6af1a9-a4e1-4143-9cd4-2c96bb4295a0 {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 25 16:00:16 devstack sudo[90603]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-dd6af1a9-a4e1-4143-9cd4-2c96bb4295a0 Feb 25 16:00:16 devstack sudo[90603]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 25 16:00:17 devstack sudo[90603]: pam_unix(sudo:session): session closed for user root Feb 25 16:00:17 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-38956734-bfa5-464c-bf88-fcb40c92d9fa tempest-VolumeDependencyTests-124298755 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-dd6af1a9-a4e1-4143-9cd4-2c96bb4295a0" returned: 0 in 0.606s {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 25 16:00:17 devstack cinder-volume[83528]: DEBUG cinder.image.image_utils [None req-38956734-bfa5-464c-bf88-fcb40c92d9fa tempest-VolumeDependencyTests-124298755 None] Image conversion details: src /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-dd6af1a9-a4e1-4143-9cd4-2c96bb4295a0, size 1024.00 MB, duration 2.17 sec, destination /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-7dcb89fe-7b49-48d7-b9cd-03e542fd1e8b {{(pid=83528) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Feb 25 16:00:17 devstack cinder-volume[83528]: INFO cinder.image.image_utils [None req-38956734-bfa5-464c-bf88-fcb40c92d9fa tempest-VolumeDependencyTests-124298755 None] Converted 1024.00 MB image at 472.13 MB/s Feb 25 16:00:17 devstack cinder-volume[83528]: WARNING cinder.volume.drivers.remotefs [None req-38956734-bfa5-464c-bf88-fcb40c92d9fa tempest-VolumeDependencyTests-124298755 None] /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-7dcb89fe-7b49-48d7-b9cd-03e542fd1e8b is being set with open permissions: ugo+rw Feb 25 16:00:17 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-38956734-bfa5-464c-bf88-fcb40c92d9fa tempest-VolumeDependencyTests-124298755 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-7dcb89fe-7b49-48d7-b9cd-03e542fd1e8b {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 25 16:00:17 devstack sudo[90608]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-7dcb89fe-7b49-48d7-b9cd-03e542fd1e8b Feb 25 16:00:17 devstack sudo[90608]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 25 16:00:17 devstack sudo[90608]: pam_unix(sudo:session): session closed for user root Feb 25 16:00:17 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-38956734-bfa5-464c-bf88-fcb40c92d9fa tempest-VolumeDependencyTests-124298755 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-7dcb89fe-7b49-48d7-b9cd-03e542fd1e8b" returned: 0 in 0.433s {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 25 16:00:17 devstack cinder-volume[83528]: DEBUG cinder.coordination [None req-38956734-bfa5-464c-bf88-fcb40c92d9fa tempest-VolumeDependencyTests-124298755 None] Lock "cinder-quobyte-7dcb89fe-7b49-48d7-b9cd-03e542fd1e8b" released by "_copy_volume_from_snapshot" :: held 4.296s {{(pid=83528) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 25 16:00:17 devstack cinder-volume[83528]: DEBUG cinder.coordination [None req-38956734-bfa5-464c-bf88-fcb40c92d9fa tempest-VolumeDependencyTests-124298755 None] Lock "cinder-quobyte-3917ea36-5381-4f03-a643-1df048632311-7dcb89fe-7b49-48d7-b9cd-03e542fd1e8b" released by "_create_volume_from_snapshot" :: held 4.334s {{(pid=83528) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 25 16:00:17 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-38956734-bfa5-464c-bf88-fcb40c92d9fa tempest-VolumeDependencyTests-124298755 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 4.345s {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 25 16:00:17 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-38956734-bfa5-464c-bf88-fcb40c92d9fa tempest-VolumeDependencyTests-124298755 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (717524e6-bbb6-4f3e-96b5-b13b5cc7886a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7dcb89fe-7b49-48d7-b9cd-03e542fd1e8b', 'volume_size': 1, 'snapshot_id': '3917ea36-5381-4f03-a643-1df048632311'}' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 25 16:00:17 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-38956734-bfa5-464c-bf88-fcb40c92d9fa tempest-VolumeDependencyTests-124298755 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cc8adb57-56fc-4590-b743-a4131a2dde30) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 25 16:00:17 devstack cinder-volume[83528]: INFO cinder.volume.flows.manager.create_volume [None req-38956734-bfa5-464c-bf88-fcb40c92d9fa tempest-VolumeDependencyTests-124298755 None] Volume volume-7dcb89fe-7b49-48d7-b9cd-03e542fd1e8b (7dcb89fe-7b49-48d7-b9cd-03e542fd1e8b): created successfully Feb 25 16:00:17 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-38956734-bfa5-464c-bf88-fcb40c92d9fa tempest-VolumeDependencyTests-124298755 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cc8adb57-56fc-4590-b743-a4131a2dde30) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 25 16:00:17 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-38956734-bfa5-464c-bf88-fcb40c92d9fa tempest-VolumeDependencyTests-124298755 None] Flow 'volume_create_manager' (4d6950a7-0a87-40be-be9d-b372a3210d63) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83528) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 25 16:00:17 devstack cinder-volume[83528]: INFO cinder.volume.manager [None req-38956734-bfa5-464c-bf88-fcb40c92d9fa tempest-VolumeDependencyTests-124298755 None] Created volume successfully. Feb 25 16:00:18 devstack cinder-volume[83528]: DEBUG cinder.coordination [None req-cdcef86e-8df9-40a8-9224-3c493133f765 tempest-VolumeDependencyTests-124298755 None] Acquiring lock "cinder-3917ea36-5381-4f03-a643-1df048632311-delete_snapshot" by "delete_snapshot" {{(pid=83528) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 25 16:00:18 devstack cinder-volume[83528]: DEBUG cinder.coordination [None req-cdcef86e-8df9-40a8-9224-3c493133f765 tempest-VolumeDependencyTests-124298755 None] Lock "cinder-3917ea36-5381-4f03-a643-1df048632311-delete_snapshot" acquired by "delete_snapshot" :: waited 0.008s {{(pid=83528) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 25 16:00:18 devstack cinder-volume[83528]: DEBUG cinder.coordination [None req-cdcef86e-8df9-40a8-9224-3c493133f765 tempest-VolumeDependencyTests-124298755 None] Acquiring lock "cinder-quobyte-dd6af1a9-a4e1-4143-9cd4-2c96bb4295a0" by "delete_snapshot" {{(pid=83528) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 25 16:00:18 devstack cinder-volume[83528]: DEBUG cinder.coordination [None req-cdcef86e-8df9-40a8-9224-3c493133f765 tempest-VolumeDependencyTests-124298755 None] Lock "cinder-quobyte-dd6af1a9-a4e1-4143-9cd4-2c96bb4295a0" acquired by "delete_snapshot" :: waited 0.008s {{(pid=83528) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 25 16:00:18 devstack cinder-volume[83528]: DEBUG cinder.coordination [None req-cdcef86e-8df9-40a8-9224-3c493133f765 tempest-VolumeDependencyTests-124298755 None] Acquiring lock "cinder-quobyte-3917ea36-5381-4f03-a643-1df048632311" by "_delete_snapshot" {{(pid=83528) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 25 16:00:18 devstack cinder-volume[83528]: DEBUG cinder.coordination [None req-cdcef86e-8df9-40a8-9224-3c493133f765 tempest-VolumeDependencyTests-124298755 None] Lock "cinder-quobyte-3917ea36-5381-4f03-a643-1df048632311" acquired by "_delete_snapshot" :: waited 0.008s {{(pid=83528) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 25 16:00:18 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.remotefs [None req-cdcef86e-8df9-40a8-9224-3c493133f765 tempest-VolumeDependencyTests-124298755 None] Deleting offline snapshot 3917ea36-5381-4f03-a643-1df048632311 of volume dd6af1a9-a4e1-4143-9cd4-2c96bb4295a0 {{(pid=83528) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Feb 25 16:00:18 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.remotefs [None req-cdcef86e-8df9-40a8-9224-3c493133f765 tempest-VolumeDependencyTests-124298755 None] snapshot_file for this snap is: volume-dd6af1a9-a4e1-4143-9cd4-2c96bb4295a0.3917ea36-5381-4f03-a643-1df048632311 {{(pid=83528) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Feb 25 16:00:18 devstack cinder-volume[83528]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b884b3b-9eda-426c-9ce0-aa487ff22f2e]: (4, 'qcow2') {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 25 16:00:18 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-cdcef86e-8df9-40a8-9224-3c493133f765 tempest-VolumeDependencyTests-124298755 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-dd6af1a9-a4e1-4143-9cd4-2c96bb4295a0.3917ea36-5381-4f03-a643-1df048632311 {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 25 16:00:18 devstack sudo[90611]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-dd6af1a9-a4e1-4143-9cd4-2c96bb4295a0.3917ea36-5381-4f03-a643-1df048632311 Feb 25 16:00:18 devstack sudo[90611]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 25 16:00:19 devstack sudo[90611]: pam_unix(sudo:session): session closed for user root Feb 25 16:00:19 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-cdcef86e-8df9-40a8-9224-3c493133f765 tempest-VolumeDependencyTests-124298755 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-dd6af1a9-a4e1-4143-9cd4-2c96bb4295a0.3917ea36-5381-4f03-a643-1df048632311" returned: 0 in 0.557s {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 25 16:00:19 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.remotefs [None req-cdcef86e-8df9-40a8-9224-3c493133f765 tempest-VolumeDependencyTests-124298755 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-dd6af1a9-a4e1-4143-9cd4-2c96bb4295a0(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83528) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Feb 25 16:00:19 devstack cinder-volume[83528]: DEBUG oslo.privsep.daemon [-] privsep: reply[94ebee08-514e-4203-8ff3-1b947eefe27e]: (4, 'qcow2') {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 25 16:00:19 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-cdcef86e-8df9-40a8-9224-3c493133f765 tempest-VolumeDependencyTests-124298755 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-dd6af1a9-a4e1-4143-9cd4-2c96bb4295a0 {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 25 16:00:19 devstack sudo[90616]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-dd6af1a9-a4e1-4143-9cd4-2c96bb4295a0 Feb 25 16:00:19 devstack sudo[90616]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 25 16:00:19 devstack sudo[90616]: pam_unix(sudo:session): session closed for user root Feb 25 16:00:19 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-cdcef86e-8df9-40a8-9224-3c493133f765 tempest-VolumeDependencyTests-124298755 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-dd6af1a9-a4e1-4143-9cd4-2c96bb4295a0" returned: 0 in 0.543s {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 25 16:00:19 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-cdcef86e-8df9-40a8-9224-3c493133f765 tempest-VolumeDependencyTests-124298755 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-dd6af1a9-a4e1-4143-9cd4-2c96bb4295a0.3917ea36-5381-4f03-a643-1df048632311 {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 25 16:00:19 devstack sudo[90623]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-dd6af1a9-a4e1-4143-9cd4-2c96bb4295a0.3917ea36-5381-4f03-a643-1df048632311 Feb 25 16:00:19 devstack sudo[90623]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 25 16:00:20 devstack sudo[90623]: pam_unix(sudo:session): session closed for user root Feb 25 16:00:20 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-cdcef86e-8df9-40a8-9224-3c493133f765 tempest-VolumeDependencyTests-124298755 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-dd6af1a9-a4e1-4143-9cd4-2c96bb4295a0.3917ea36-5381-4f03-a643-1df048632311" returned: 0 in 0.525s {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 25 16:00:20 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-cdcef86e-8df9-40a8-9224-3c493133f765 tempest-VolumeDependencyTests-124298755 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-dd6af1a9-a4e1-4143-9cd4-2c96bb4295a0.3917ea36-5381-4f03-a643-1df048632311 {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 25 16:00:20 devstack sudo[90628]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-dd6af1a9-a4e1-4143-9cd4-2c96bb4295a0.3917ea36-5381-4f03-a643-1df048632311 Feb 25 16:00:20 devstack sudo[90628]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 25 16:00:20 devstack sudo[90628]: pam_unix(sudo:session): session closed for user root Feb 25 16:00:20 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-cdcef86e-8df9-40a8-9224-3c493133f765 tempest-VolumeDependencyTests-124298755 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-dd6af1a9-a4e1-4143-9cd4-2c96bb4295a0.3917ea36-5381-4f03-a643-1df048632311" returned: 0 in 0.490s {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 25 16:00:20 devstack cinder-volume[83528]: DEBUG cinder.coordination [None req-cdcef86e-8df9-40a8-9224-3c493133f765 tempest-VolumeDependencyTests-124298755 None] Lock "cinder-quobyte-3917ea36-5381-4f03-a643-1df048632311" released by "_delete_snapshot" :: held 2.185s {{(pid=83528) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 25 16:00:20 devstack cinder-volume[83528]: DEBUG cinder.coordination [None req-cdcef86e-8df9-40a8-9224-3c493133f765 tempest-VolumeDependencyTests-124298755 None] Lock "cinder-quobyte-dd6af1a9-a4e1-4143-9cd4-2c96bb4295a0" released by "delete_snapshot" :: held 2.199s {{(pid=83528) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 25 16:00:20 devstack cinder-volume[83528]: DEBUG cinder.quota [None req-cdcef86e-8df9-40a8-9224-3c493133f765 tempest-VolumeDependencyTests-124298755 None] Created reservations ['58c13c31-e48d-4e09-80f8-9001bbb8a5aa', 'b5b8aa9c-c6f5-4d9a-88a8-2345827bce19', '9cab4634-a867-4791-a4f5-953aa34db2a0', '2368a446-9c5e-4093-a9be-270f0be9b8b1'] {{(pid=83528) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 25 16:00:20 devstack cinder-volume[83528]: INFO cinder.volume.manager [None req-cdcef86e-8df9-40a8-9224-3c493133f765 tempest-VolumeDependencyTests-124298755 None] Delete snapshot completed successfully. Feb 25 16:00:20 devstack cinder-volume[83528]: DEBUG cinder.coordination [None req-cdcef86e-8df9-40a8-9224-3c493133f765 tempest-VolumeDependencyTests-124298755 None] Lock "cinder-3917ea36-5381-4f03-a643-1df048632311-delete_snapshot" released by "delete_snapshot" :: held 2.298s {{(pid=83528) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 25 16:00:21 devstack cinder-volume[83528]: DEBUG cinder.coordination [None req-c748d00c-8595-47d9-99ec-81cfec879aa0 tempest-VolumeDependencyTests-124298755 None] Acquiring lock "cinder-dd6af1a9-a4e1-4143-9cd4-2c96bb4295a0-delete_volume" by "delete_volume" {{(pid=83528) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 25 16:00:21 devstack cinder-volume[83528]: DEBUG cinder.coordination [None req-c748d00c-8595-47d9-99ec-81cfec879aa0 tempest-VolumeDependencyTests-124298755 None] Lock "cinder-dd6af1a9-a4e1-4143-9cd4-2c96bb4295a0-delete_volume" acquired by "delete_volume" :: waited 0.009s {{(pid=83528) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 25 16:00:21 devstack cinder-volume[83528]: DEBUG cinder.coordination [None req-c748d00c-8595-47d9-99ec-81cfec879aa0 tempest-VolumeDependencyTests-124298755 None] Acquiring lock "cinder-quobyte-dd6af1a9-a4e1-4143-9cd4-2c96bb4295a0" by "delete_volume" {{(pid=83528) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 25 16:00:21 devstack cinder-volume[83528]: DEBUG cinder.coordination [None req-c748d00c-8595-47d9-99ec-81cfec879aa0 tempest-VolumeDependencyTests-124298755 None] Lock "cinder-quobyte-dd6af1a9-a4e1-4143-9cd4-2c96bb4295a0" acquired by "delete_volume" :: waited 0.010s {{(pid=83528) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 25 16:00:21 devstack cinder-volume[83528]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ce696e5-8d1d-49ff-aa78-54d69677c733]: (4, 'qcow2') {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 25 16:00:21 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-c748d00c-8595-47d9-99ec-81cfec879aa0 tempest-VolumeDependencyTests-124298755 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-dd6af1a9-a4e1-4143-9cd4-2c96bb4295a0 {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 25 16:00:21 devstack sudo[90631]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-dd6af1a9-a4e1-4143-9cd4-2c96bb4295a0 Feb 25 16:00:21 devstack sudo[90631]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 25 16:00:22 devstack cinder-volume[83528]: DEBUG cinder.coordination [None req-b1ea7108-ee43-4090-b7bb-6619f9fcc1ef tempest-VolumesNegativeTest-117213089 None] Acquiring lock "cinder-39476f23-2b30-4647-a3ff-d8ac35c2e6de-delete_volume" by "delete_volume" {{(pid=83528) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 25 16:00:22 devstack cinder-volume[83528]: DEBUG cinder.coordination [None req-b1ea7108-ee43-4090-b7bb-6619f9fcc1ef tempest-VolumesNegativeTest-117213089 None] Lock "cinder-39476f23-2b30-4647-a3ff-d8ac35c2e6de-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=83528) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 25 16:00:22 devstack cinder-volume[83528]: DEBUG cinder.coordination [None req-b1ea7108-ee43-4090-b7bb-6619f9fcc1ef tempest-VolumesNegativeTest-117213089 None] Acquiring lock "cinder-quobyte-39476f23-2b30-4647-a3ff-d8ac35c2e6de" by "delete_volume" {{(pid=83528) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 25 16:00:22 devstack cinder-volume[83528]: DEBUG cinder.coordination [None req-b1ea7108-ee43-4090-b7bb-6619f9fcc1ef tempest-VolumesNegativeTest-117213089 None] Lock "cinder-quobyte-39476f23-2b30-4647-a3ff-d8ac35c2e6de" acquired by "delete_volume" :: waited 0.009s {{(pid=83528) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 25 16:00:22 devstack cinder-volume[83528]: DEBUG oslo.privsep.daemon [-] privsep: reply[62098dc8-c44c-4d60-ac12-606015408e2e]: (4, 'qcow2') {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 25 16:00:22 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-b1ea7108-ee43-4090-b7bb-6619f9fcc1ef tempest-VolumesNegativeTest-117213089 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-39476f23-2b30-4647-a3ff-d8ac35c2e6de {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 25 16:00:22 devstack sudo[90633]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-39476f23-2b30-4647-a3ff-d8ac35c2e6de Feb 25 16:00:22 devstack sudo[90633]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 25 16:00:22 devstack sudo[90631]: pam_unix(sudo:session): session closed for user root Feb 25 16:00:22 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-c748d00c-8595-47d9-99ec-81cfec879aa0 tempest-VolumeDependencyTests-124298755 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-dd6af1a9-a4e1-4143-9cd4-2c96bb4295a0" returned: 0 in 0.519s {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 25 16:00:22 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-c748d00c-8595-47d9-99ec-81cfec879aa0 tempest-VolumeDependencyTests-124298755 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-dd6af1a9-a4e1-4143-9cd4-2c96bb4295a0 {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 25 16:00:22 devstack sudo[90638]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-dd6af1a9-a4e1-4143-9cd4-2c96bb4295a0 Feb 25 16:00:22 devstack sudo[90638]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 25 16:00:22 devstack sudo[90633]: pam_unix(sudo:session): session closed for user root Feb 25 16:00:22 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-b1ea7108-ee43-4090-b7bb-6619f9fcc1ef tempest-VolumesNegativeTest-117213089 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-39476f23-2b30-4647-a3ff-d8ac35c2e6de" returned: 0 in 0.456s {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 25 16:00:22 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-b1ea7108-ee43-4090-b7bb-6619f9fcc1ef tempest-VolumesNegativeTest-117213089 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-39476f23-2b30-4647-a3ff-d8ac35c2e6de {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 25 16:00:22 devstack sudo[90644]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-39476f23-2b30-4647-a3ff-d8ac35c2e6de Feb 25 16:00:22 devstack sudo[90644]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 25 16:00:22 devstack sudo[90638]: pam_unix(sudo:session): session closed for user root Feb 25 16:00:22 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-c748d00c-8595-47d9-99ec-81cfec879aa0 tempest-VolumeDependencyTests-124298755 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-dd6af1a9-a4e1-4143-9cd4-2c96bb4295a0" returned: 0 in 0.401s {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 25 16:00:22 devstack cinder-volume[83528]: DEBUG cinder.coordination [None req-c748d00c-8595-47d9-99ec-81cfec879aa0 tempest-VolumeDependencyTests-124298755 None] Lock "cinder-quobyte-dd6af1a9-a4e1-4143-9cd4-2c96bb4295a0" released by "delete_volume" :: held 0.959s {{(pid=83528) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 25 16:00:22 devstack cinder-volume[83528]: DEBUG cinder.quota [None req-c748d00c-8595-47d9-99ec-81cfec879aa0 tempest-VolumeDependencyTests-124298755 None] Created reservations ['03531d61-0f0f-44b5-81cb-adf4211b47c6', 'd74b5ae4-0315-4343-9a71-ca101acb811c', '8af0ade5-c994-44cb-bf9f-02c94c280d99', '4d6416c7-4dea-4830-83c4-c3988145b9c6'] {{(pid=83528) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 25 16:00:22 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-c748d00c-8595-47d9-99ec-81cfec879aa0 tempest-VolumeDependencyTests-124298755 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 25 16:00:22 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-c748d00c-8595-47d9-99ec-81cfec879aa0 tempest-VolumeDependencyTests-124298755 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 25 16:00:22 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.quobyte [None req-c748d00c-8595-47d9-99ec-81cfec879aa0 tempest-VolumeDependencyTests-124298755 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23e9d725-3e04-4cd9-bfe0-c8ef43305589': None} {{(pid=83528) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 25 16:00:22 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.quobyte [None req-c748d00c-8595-47d9-99ec-81cfec879aa0 tempest-VolumeDependencyTests-124298755 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23e9d725-3e04-4cd9-bfe0-c8ef43305589'] {{(pid=83528) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 25 16:00:22 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-c748d00c-8595-47d9-99ec-81cfec879aa0 tempest-VolumeDependencyTests-124298755 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 25 16:00:22 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-c748d00c-8595-47d9-99ec-81cfec879aa0 tempest-VolumeDependencyTests-124298755 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85 {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 25 16:00:22 devstack sudo[90646]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85 Feb 25 16:00:22 devstack sudo[90646]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 25 16:00:23 devstack sudo[90644]: pam_unix(sudo:session): session closed for user root Feb 25 16:00:23 devstack cinder-volume[83528]: DEBUG cinder.volume.flows.manager.create_volume [None req-e3f7d97a-93d1-4326-a8c4-77594b23fb68 tempest-VolumeDependencyTests-124298755 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83528) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 25 16:00:23 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-e3f7d97a-93d1-4326-a8c4-77594b23fb68 tempest-VolumeDependencyTests-124298755 None] Flow 'volume_create_manager' (71f12bbf-6301-4ce4-a20f-11a97b279996) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83528) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 25 16:00:23 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-e3f7d97a-93d1-4326-a8c4-77594b23fb68 tempest-VolumeDependencyTests-124298755 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (209cefaf-bb76-4518-8e68-fbc941cffcc4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 25 16:00:23 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-b1ea7108-ee43-4090-b7bb-6619f9fcc1ef tempest-VolumesNegativeTest-117213089 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-39476f23-2b30-4647-a3ff-d8ac35c2e6de" returned: 0 in 0.474s {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 25 16:00:23 devstack cinder-volume[83528]: DEBUG cinder.coordination [None req-b1ea7108-ee43-4090-b7bb-6619f9fcc1ef tempest-VolumesNegativeTest-117213089 None] Lock "cinder-quobyte-39476f23-2b30-4647-a3ff-d8ac35c2e6de" released by "delete_volume" :: held 0.966s {{(pid=83528) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 25 16:00:23 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-e3f7d97a-93d1-4326-a8c4-77594b23fb68 tempest-VolumeDependencyTests-124298755 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (209cefaf-bb76-4518-8e68-fbc941cffcc4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-25T15:00:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1520871106',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cb6254d4-bf9f-4bb4-8b46-a889ec2af743,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c62c9c28c9e84220908959477ca53cb0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-25T15:00:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-25T15:00:23Z,use_quota=True,user_id='45d46312e99d489a8a18877333766389',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ce71c2f9-6543-4165-9653-a1529b2ea243),volume_type_id=ce71c2f9-6543-4165-9653-a1529b2ea243)' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 25 16:00:23 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-e3f7d97a-93d1-4326-a8c4-77594b23fb68 tempest-VolumeDependencyTests-124298755 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (268cb3c8-d06d-491d-9630-48b1b5d0be01) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 25 16:00:23 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-e3f7d97a-93d1-4326-a8c4-77594b23fb68 tempest-VolumeDependencyTests-124298755 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (268cb3c8-d06d-491d-9630-48b1b5d0be01) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 25 16:00:23 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-e3f7d97a-93d1-4326-a8c4-77594b23fb68 tempest-VolumeDependencyTests-124298755 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f43a6421-5b43-44a7-9d09-4e40acdaa8f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 25 16:00:23 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-e3f7d97a-93d1-4326-a8c4-77594b23fb68 tempest-VolumeDependencyTests-124298755 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f43a6421-5b43-44a7-9d09-4e40acdaa8f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cb6254d4-bf9f-4bb4-8b46-a889ec2af743', 'volume_name': 'volume-cb6254d4-bf9f-4bb4-8b46-a889ec2af743', 'volume_size': 1}' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 25 16:00:23 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-e3f7d97a-93d1-4326-a8c4-77594b23fb68 tempest-VolumeDependencyTests-124298755 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9776b62f-d7f9-466a-89cc-99247fcd8dfb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 25 16:00:23 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-e3f7d97a-93d1-4326-a8c4-77594b23fb68 tempest-VolumeDependencyTests-124298755 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9776b62f-d7f9-466a-89cc-99247fcd8dfb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 25 16:00:23 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-e3f7d97a-93d1-4326-a8c4-77594b23fb68 tempest-VolumeDependencyTests-124298755 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (44ec4cd2-fbae-46b6-854f-f7fcd94a425a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 25 16:00:23 devstack cinder-volume[83528]: INFO cinder.volume.flows.manager.create_volume [None req-e3f7d97a-93d1-4326-a8c4-77594b23fb68 tempest-VolumeDependencyTests-124298755 None] Volume cb6254d4-bf9f-4bb4-8b46-a889ec2af743: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cb6254d4-bf9f-4bb4-8b46-a889ec2af743', 'volume_size': 1} Feb 25 16:00:23 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-e3f7d97a-93d1-4326-a8c4-77594b23fb68 tempest-VolumeDependencyTests-124298755 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 25 16:00:23 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-e3f7d97a-93d1-4326-a8c4-77594b23fb68 tempest-VolumeDependencyTests-124298755 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 25 16:00:23 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.quobyte [None req-e3f7d97a-93d1-4326-a8c4-77594b23fb68 tempest-VolumeDependencyTests-124298755 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-25T15:00:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1520871106',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cb6254d4-bf9f-4bb4-8b46-a889ec2af743,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c62c9c28c9e84220908959477ca53cb0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-25T15:00:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-25T15:00:23Z,use_quota=True,user_id='45d46312e99d489a8a18877333766389',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ce71c2f9-6543-4165-9653-a1529b2ea243),volume_type_id=ce71c2f9-6543-4165-9653-a1529b2ea243)}" {{(pid=83528) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 25 16:00:23 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.remotefs [None req-e3f7d97a-93d1-4326-a8c4-77594b23fb68 tempest-VolumeDependencyTests-124298755 None] Creating volume cb6254d4-bf9f-4bb4-8b46-a889ec2af743 {{(pid=83528) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 25 16:00:23 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-e3f7d97a-93d1-4326-a8c4-77594b23fb68 tempest-VolumeDependencyTests-124298755 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 25 16:00:23 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-e3f7d97a-93d1-4326-a8c4-77594b23fb68 tempest-VolumeDependencyTests-124298755 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 25 16:00:23 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.quobyte [None req-e3f7d97a-93d1-4326-a8c4-77594b23fb68 tempest-VolumeDependencyTests-124298755 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23e9d725-3e04-4cd9-bfe0-c8ef43305589': None} {{(pid=83528) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 25 16:00:23 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.quobyte [None req-e3f7d97a-93d1-4326-a8c4-77594b23fb68 tempest-VolumeDependencyTests-124298755 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23e9d725-3e04-4cd9-bfe0-c8ef43305589'] {{(pid=83528) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 25 16:00:23 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-e3f7d97a-93d1-4326-a8c4-77594b23fb68 tempest-VolumeDependencyTests-124298755 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 25 16:00:23 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.quobyte [None req-e3f7d97a-93d1-4326-a8c4-77594b23fb68 tempest-VolumeDependencyTests-124298755 None] Selected osci02.corp.quobyte.com/cinder-vol-23e9d725-3e04-4cd9-bfe0-c8ef43305589 as target Quobyte volume. {{(pid=83528) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 25 16:00:23 devstack cinder-volume[83528]: INFO cinder.volume.drivers.remotefs [None req-e3f7d97a-93d1-4326-a8c4-77594b23fb68 tempest-VolumeDependencyTests-124298755 None] casted to osci02.corp.quobyte.com/cinder-vol-23e9d725-3e04-4cd9-bfe0-c8ef43305589 Feb 25 16:00:23 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-e3f7d97a-93d1-4326-a8c4-77594b23fb68 tempest-VolumeDependencyTests-124298755 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-cb6254d4-bf9f-4bb4-8b46-a889ec2af743 1073741824 {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 25 16:00:23 devstack sudo[90650]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-cb6254d4-bf9f-4bb4-8b46-a889ec2af743 1073741824 Feb 25 16:00:23 devstack sudo[90650]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 25 16:00:23 devstack cinder-volume[83528]: DEBUG cinder.quota [None req-b1ea7108-ee43-4090-b7bb-6619f9fcc1ef tempest-VolumesNegativeTest-117213089 None] Created reservations ['d94673a4-4670-4702-9a25-794bfb543e7b', '93f47f22-9cea-49e3-8de2-78858344c2c0', '698efc70-9efe-4fdc-be15-9cb6efd07267', '2b859622-ed5c-4def-a453-8ca6f3e35f4c'] {{(pid=83528) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 25 16:00:23 devstack sudo[90646]: pam_unix(sudo:session): session closed for user root Feb 25 16:00:23 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-c748d00c-8595-47d9-99ec-81cfec879aa0 tempest-VolumeDependencyTests-124298755 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85" returned: 0 in 0.482s {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 25 16:00:23 devstack cinder-volume[83528]: DEBUG cinder.manager [None req-c748d00c-8595-47d9-99ec-81cfec879aa0 tempest-VolumeDependencyTests-124298755 None] Notifying Schedulers of capabilities ... {{(pid=83528) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 25 16:00:23 devstack cinder-volume[83528]: INFO cinder.volume.manager [None req-c748d00c-8595-47d9-99ec-81cfec879aa0 tempest-VolumeDependencyTests-124298755 None] Deleted volume successfully. Feb 25 16:00:23 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-b1ea7108-ee43-4090-b7bb-6619f9fcc1ef tempest-VolumesNegativeTest-117213089 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 25 16:00:23 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-b1ea7108-ee43-4090-b7bb-6619f9fcc1ef tempest-VolumesNegativeTest-117213089 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 25 16:00:23 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.quobyte [None req-b1ea7108-ee43-4090-b7bb-6619f9fcc1ef tempest-VolumesNegativeTest-117213089 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23e9d725-3e04-4cd9-bfe0-c8ef43305589': None} {{(pid=83528) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 25 16:00:23 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.quobyte [None req-b1ea7108-ee43-4090-b7bb-6619f9fcc1ef tempest-VolumesNegativeTest-117213089 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23e9d725-3e04-4cd9-bfe0-c8ef43305589'] {{(pid=83528) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 25 16:00:23 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-b1ea7108-ee43-4090-b7bb-6619f9fcc1ef tempest-VolumesNegativeTest-117213089 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 25 16:00:23 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-b1ea7108-ee43-4090-b7bb-6619f9fcc1ef tempest-VolumesNegativeTest-117213089 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85 {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 25 16:00:23 devstack cinder-volume[83528]: DEBUG cinder.coordination [None req-c748d00c-8595-47d9-99ec-81cfec879aa0 tempest-VolumeDependencyTests-124298755 None] Lock "cinder-dd6af1a9-a4e1-4143-9cd4-2c96bb4295a0-delete_volume" released by "delete_volume" :: held 1.592s {{(pid=83528) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 25 16:00:23 devstack sudo[90652]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85 Feb 25 16:00:23 devstack sudo[90652]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 25 16:00:23 devstack sudo[90650]: pam_unix(sudo:session): session closed for user root Feb 25 16:00:23 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-e3f7d97a-93d1-4326-a8c4-77594b23fb68 tempest-VolumeDependencyTests-124298755 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-cb6254d4-bf9f-4bb4-8b46-a889ec2af743 1073741824" returned: 0 in 0.500s {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 25 16:00:23 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-e3f7d97a-93d1-4326-a8c4-77594b23fb68 tempest-VolumeDependencyTests-124298755 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-cb6254d4-bf9f-4bb4-8b46-a889ec2af743 {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 25 16:00:23 devstack sudo[90660]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-cb6254d4-bf9f-4bb4-8b46-a889ec2af743 Feb 25 16:00:23 devstack sudo[90660]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 25 16:00:23 devstack sudo[90652]: pam_unix(sudo:session): session closed for user root Feb 25 16:00:23 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-b1ea7108-ee43-4090-b7bb-6619f9fcc1ef tempest-VolumesNegativeTest-117213089 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85" returned: 0 in 0.434s {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 25 16:00:23 devstack cinder-volume[83528]: DEBUG cinder.manager [None req-b1ea7108-ee43-4090-b7bb-6619f9fcc1ef tempest-VolumesNegativeTest-117213089 None] Notifying Schedulers of capabilities ... {{(pid=83528) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 25 16:00:23 devstack cinder-volume[83528]: INFO cinder.volume.manager [None req-b1ea7108-ee43-4090-b7bb-6619f9fcc1ef tempest-VolumesNegativeTest-117213089 None] Deleted volume successfully. Feb 25 16:00:23 devstack cinder-volume[83528]: DEBUG cinder.coordination [None req-b1ea7108-ee43-4090-b7bb-6619f9fcc1ef tempest-VolumesNegativeTest-117213089 None] Lock "cinder-39476f23-2b30-4647-a3ff-d8ac35c2e6de-delete_volume" released by "delete_volume" :: held 1.620s {{(pid=83528) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 25 16:00:24 devstack sudo[90660]: pam_unix(sudo:session): session closed for user root Feb 25 16:00:24 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-e3f7d97a-93d1-4326-a8c4-77594b23fb68 tempest-VolumeDependencyTests-124298755 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-cb6254d4-bf9f-4bb4-8b46-a889ec2af743" returned: 0 in 0.436s {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 25 16:00:24 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.quobyte [None req-e3f7d97a-93d1-4326-a8c4-77594b23fb68 tempest-VolumeDependencyTests-124298755 None] <== create_volume: return (970ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-23e9d725-3e04-4cd9-bfe0-c8ef43305589'} {{(pid=83528) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 25 16:00:24 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-e3f7d97a-93d1-4326-a8c4-77594b23fb68 tempest-VolumeDependencyTests-124298755 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.973s {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 25 16:00:24 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-e3f7d97a-93d1-4326-a8c4-77594b23fb68 tempest-VolumeDependencyTests-124298755 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (44ec4cd2-fbae-46b6-854f-f7fcd94a425a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cb6254d4-bf9f-4bb4-8b46-a889ec2af743', 'volume_size': 1}' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 25 16:00:24 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-e3f7d97a-93d1-4326-a8c4-77594b23fb68 tempest-VolumeDependencyTests-124298755 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cd27f3d3-7548-49e0-8788-65f446654645) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 25 16:00:24 devstack cinder-volume[83528]: INFO cinder.volume.flows.manager.create_volume [None req-e3f7d97a-93d1-4326-a8c4-77594b23fb68 tempest-VolumeDependencyTests-124298755 None] Volume volume-cb6254d4-bf9f-4bb4-8b46-a889ec2af743 (cb6254d4-bf9f-4bb4-8b46-a889ec2af743): created successfully Feb 25 16:00:24 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-e3f7d97a-93d1-4326-a8c4-77594b23fb68 tempest-VolumeDependencyTests-124298755 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cd27f3d3-7548-49e0-8788-65f446654645) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 25 16:00:24 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-e3f7d97a-93d1-4326-a8c4-77594b23fb68 tempest-VolumeDependencyTests-124298755 None] Flow 'volume_create_manager' (71f12bbf-6301-4ce4-a20f-11a97b279996) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83528) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 25 16:00:24 devstack cinder-volume[83528]: INFO cinder.volume.manager [None req-e3f7d97a-93d1-4326-a8c4-77594b23fb68 tempest-VolumeDependencyTests-124298755 None] Created volume successfully. Feb 25 16:00:25 devstack cinder-volume[83528]: DEBUG cinder.volume.flows.manager.create_volume [None req-dd16e9e6-8b88-4c7d-b0ce-ecb5190b641a tempest-VolumeDependencyTests-124298755 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83528) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 25 16:00:25 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-dd16e9e6-8b88-4c7d-b0ce-ecb5190b641a tempest-VolumeDependencyTests-124298755 None] Flow 'volume_create_manager' (d58b0527-221d-4878-8b93-e26360496798) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83528) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 25 16:00:25 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-dd16e9e6-8b88-4c7d-b0ce-ecb5190b641a tempest-VolumeDependencyTests-124298755 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3a159b2f-da81-4de8-a3db-dfa42f7042d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 25 16:00:25 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-dd16e9e6-8b88-4c7d-b0ce-ecb5190b641a tempest-VolumeDependencyTests-124298755 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3a159b2f-da81-4de8-a3db-dfa42f7042d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-25T15:00:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1756759913',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b4fd46f1-4056-4693-ab49-dc6a5c60964a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c62c9c28c9e84220908959477ca53cb0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-25T15:00:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=cb6254d4-bf9f-4bb4-8b46-a889ec2af743,status='creating',terminated_at=None,updated_at=2026-02-25T15:00:26Z,use_quota=True,user_id='45d46312e99d489a8a18877333766389',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ce71c2f9-6543-4165-9653-a1529b2ea243),volume_type_id=ce71c2f9-6543-4165-9653-a1529b2ea243)' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 25 16:00:25 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-dd16e9e6-8b88-4c7d-b0ce-ecb5190b641a tempest-VolumeDependencyTests-124298755 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9cd59714-e50a-4131-8187-b5627f93e0b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 25 16:00:25 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-dd16e9e6-8b88-4c7d-b0ce-ecb5190b641a tempest-VolumeDependencyTests-124298755 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9cd59714-e50a-4131-8187-b5627f93e0b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 25 16:00:25 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-dd16e9e6-8b88-4c7d-b0ce-ecb5190b641a tempest-VolumeDependencyTests-124298755 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5101d63d-ab15-41fd-9c9f-29d86394d47e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 25 16:00:25 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-dd16e9e6-8b88-4c7d-b0ce-ecb5190b641a tempest-VolumeDependencyTests-124298755 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5101d63d-ab15-41fd-9c9f-29d86394d47e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': 'b4fd46f1-4056-4693-ab49-dc6a5c60964a', 'volume_name': 'volume-b4fd46f1-4056-4693-ab49-dc6a5c60964a', 'volume_size': 1, 'source_volid': 'cb6254d4-bf9f-4bb4-8b46-a889ec2af743', 'source_volstatus': 'available'}' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 25 16:00:25 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-dd16e9e6-8b88-4c7d-b0ce-ecb5190b641a tempest-VolumeDependencyTests-124298755 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a3aff1ce-9af1-40c9-8b5a-1a746880253c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 25 16:00:25 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-dd16e9e6-8b88-4c7d-b0ce-ecb5190b641a tempest-VolumeDependencyTests-124298755 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a3aff1ce-9af1-40c9-8b5a-1a746880253c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 25 16:00:25 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-dd16e9e6-8b88-4c7d-b0ce-ecb5190b641a tempest-VolumeDependencyTests-124298755 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2eea5e93-dcc7-4857-bd0f-a29c461ac8b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 25 16:00:25 devstack cinder-volume[83528]: INFO cinder.volume.flows.manager.create_volume [None req-dd16e9e6-8b88-4c7d-b0ce-ecb5190b641a tempest-VolumeDependencyTests-124298755 None] Volume b4fd46f1-4056-4693-ab49-dc6a5c60964a: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-b4fd46f1-4056-4693-ab49-dc6a5c60964a', 'volume_size': 1, 'source_volid': 'cb6254d4-bf9f-4bb4-8b46-a889ec2af743', 'source_volstatus': 'available'} Feb 25 16:00:25 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-dd16e9e6-8b88-4c7d-b0ce-ecb5190b641a tempest-VolumeDependencyTests-124298755 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 25 16:00:25 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-dd16e9e6-8b88-4c7d-b0ce-ecb5190b641a tempest-VolumeDependencyTests-124298755 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 25 16:00:25 devstack cinder-volume[83528]: INFO cinder.volume.drivers.remotefs [None req-dd16e9e6-8b88-4c7d-b0ce-ecb5190b641a tempest-VolumeDependencyTests-124298755 None] Cloning volume cb6254d4-bf9f-4bb4-8b46-a889ec2af743 to volume b4fd46f1-4056-4693-ab49-dc6a5c60964a Feb 25 16:00:25 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.remotefs [None req-dd16e9e6-8b88-4c7d-b0ce-ecb5190b641a tempest-VolumeDependencyTests-124298755 None] Creating offline snapshot 01373db1-614a-45da-b381-f25a2c92ed49 of volume cb6254d4-bf9f-4bb4-8b46-a889ec2af743 {{(pid=83528) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Feb 25 16:00:25 devstack cinder-volume[83528]: DEBUG oslo.privsep.daemon [-] privsep: reply[6959272d-ff45-4e0f-adc1-ea1df474d78d]: (4, 'qcow2') {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 25 16:00:25 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-dd16e9e6-8b88-4c7d-b0ce-ecb5190b641a tempest-VolumeDependencyTests-124298755 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-cb6254d4-bf9f-4bb4-8b46-a889ec2af743 {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 25 16:00:25 devstack sudo[90664]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-cb6254d4-bf9f-4bb4-8b46-a889ec2af743 Feb 25 16:00:25 devstack sudo[90664]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 25 16:00:26 devstack sudo[90664]: pam_unix(sudo:session): session closed for user root Feb 25 16:00:26 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-dd16e9e6-8b88-4c7d-b0ce-ecb5190b641a tempest-VolumeDependencyTests-124298755 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-cb6254d4-bf9f-4bb4-8b46-a889ec2af743" returned: 0 in 0.620s {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 25 16:00:26 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-dd16e9e6-8b88-4c7d-b0ce-ecb5190b641a tempest-VolumeDependencyTests-124298755 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-cb6254d4-bf9f-4bb4-8b46-a889ec2af743,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-cb6254d4-bf9f-4bb4-8b46-a889ec2af743.01373db1-614a-45da-b381-f25a2c92ed49 1G {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 25 16:00:26 devstack sudo[90669]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-cb6254d4-bf9f-4bb4-8b46-a889ec2af743,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-cb6254d4-bf9f-4bb4-8b46-a889ec2af743.01373db1-614a-45da-b381-f25a2c92ed49 1G Feb 25 16:00:26 devstack sudo[90669]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 25 16:00:26 devstack sudo[90669]: pam_unix(sudo:session): session closed for user root Feb 25 16:00:26 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-dd16e9e6-8b88-4c7d-b0ce-ecb5190b641a tempest-VolumeDependencyTests-124298755 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-cb6254d4-bf9f-4bb4-8b46-a889ec2af743,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-cb6254d4-bf9f-4bb4-8b46-a889ec2af743.01373db1-614a-45da-b381-f25a2c92ed49 1G" returned: 0 in 0.550s {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 25 16:00:26 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-dd16e9e6-8b88-4c7d-b0ce-ecb5190b641a tempest-VolumeDependencyTests-124298755 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cb6254d4-bf9f-4bb4-8b46-a889ec2af743 -F qcow2 /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-cb6254d4-bf9f-4bb4-8b46-a889ec2af743.01373db1-614a-45da-b381-f25a2c92ed49 {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 25 16:00:26 devstack sudo[90674]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cb6254d4-bf9f-4bb4-8b46-a889ec2af743 -F qcow2 /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-cb6254d4-bf9f-4bb4-8b46-a889ec2af743.01373db1-614a-45da-b381-f25a2c92ed49 Feb 25 16:00:26 devstack sudo[90674]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 25 16:00:27 devstack sudo[90674]: pam_unix(sudo:session): session closed for user root Feb 25 16:00:27 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-dd16e9e6-8b88-4c7d-b0ce-ecb5190b641a tempest-VolumeDependencyTests-124298755 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cb6254d4-bf9f-4bb4-8b46-a889ec2af743 -F qcow2 /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-cb6254d4-bf9f-4bb4-8b46-a889ec2af743.01373db1-614a-45da-b381-f25a2c92ed49" returned: 0 in 0.451s {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 25 16:00:27 devstack cinder-volume[83528]: WARNING cinder.volume.drivers.remotefs [None req-dd16e9e6-8b88-4c7d-b0ce-ecb5190b641a tempest-VolumeDependencyTests-124298755 None] /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-cb6254d4-bf9f-4bb4-8b46-a889ec2af743.01373db1-614a-45da-b381-f25a2c92ed49 is being set with open permissions: ugo+rw Feb 25 16:00:27 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-dd16e9e6-8b88-4c7d-b0ce-ecb5190b641a tempest-VolumeDependencyTests-124298755 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-cb6254d4-bf9f-4bb4-8b46-a889ec2af743.01373db1-614a-45da-b381-f25a2c92ed49 {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 25 16:00:27 devstack sudo[90679]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-cb6254d4-bf9f-4bb4-8b46-a889ec2af743.01373db1-614a-45da-b381-f25a2c92ed49 Feb 25 16:00:27 devstack sudo[90679]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 25 16:00:27 devstack sudo[90679]: pam_unix(sudo:session): session closed for user root Feb 25 16:00:27 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-dd16e9e6-8b88-4c7d-b0ce-ecb5190b641a tempest-VolumeDependencyTests-124298755 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-cb6254d4-bf9f-4bb4-8b46-a889ec2af743.01373db1-614a-45da-b381-f25a2c92ed49" returned: 0 in 0.504s {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 25 16:00:27 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-dd16e9e6-8b88-4c7d-b0ce-ecb5190b641a tempest-VolumeDependencyTests-124298755 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-cb6254d4-bf9f-4bb4-8b46-a889ec2af743.info {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 25 16:00:27 devstack sudo[90682]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-cb6254d4-bf9f-4bb4-8b46-a889ec2af743.info Feb 25 16:00:27 devstack sudo[90682]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 25 16:00:28 devstack sudo[90682]: pam_unix(sudo:session): session closed for user root Feb 25 16:00:28 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-dd16e9e6-8b88-4c7d-b0ce-ecb5190b641a tempest-VolumeDependencyTests-124298755 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-cb6254d4-bf9f-4bb4-8b46-a889ec2af743.info" returned: 0 in 0.426s {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 25 16:00:28 devstack cinder-volume[83528]: WARNING cinder.volume.drivers.remotefs [None req-dd16e9e6-8b88-4c7d-b0ce-ecb5190b641a tempest-VolumeDependencyTests-124298755 None] /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-cb6254d4-bf9f-4bb4-8b46-a889ec2af743.info is being set with open permissions: ugo+rw Feb 25 16:00:28 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-dd16e9e6-8b88-4c7d-b0ce-ecb5190b641a tempest-VolumeDependencyTests-124298755 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-cb6254d4-bf9f-4bb4-8b46-a889ec2af743.info {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 25 16:00:28 devstack sudo[90686]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-cb6254d4-bf9f-4bb4-8b46-a889ec2af743.info Feb 25 16:00:28 devstack sudo[90686]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 25 16:00:28 devstack sudo[90686]: pam_unix(sudo:session): session closed for user root Feb 25 16:00:28 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-dd16e9e6-8b88-4c7d-b0ce-ecb5190b641a tempest-VolumeDependencyTests-124298755 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-cb6254d4-bf9f-4bb4-8b46-a889ec2af743.info" returned: 0 in 0.475s {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 25 16:00:28 devstack cinder-volume[83528]: DEBUG cinder.coordination [None req-dd16e9e6-8b88-4c7d-b0ce-ecb5190b641a tempest-VolumeDependencyTests-124298755 None] Acquiring lock "cinder-quobyte-b4fd46f1-4056-4693-ab49-dc6a5c60964a" by "_copy_volume_from_snapshot" {{(pid=83528) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 25 16:00:28 devstack cinder-volume[83528]: DEBUG cinder.coordination [None req-dd16e9e6-8b88-4c7d-b0ce-ecb5190b641a tempest-VolumeDependencyTests-124298755 None] Lock "cinder-quobyte-b4fd46f1-4056-4693-ab49-dc6a5c60964a" acquired by "_copy_volume_from_snapshot" :: waited 0.008s {{(pid=83528) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 25 16:00:28 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.quobyte [None req-dd16e9e6-8b88-4c7d-b0ce-ecb5190b641a tempest-VolumeDependencyTests-124298755 None] snapshot: 01373db1-614a-45da-b381-f25a2c92ed49, volume: b4fd46f1-4056-4693-ab49-dc6a5c60964a, {{(pid=83528) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Feb 25 16:00:28 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-dd16e9e6-8b88-4c7d-b0ce-ecb5190b641a tempest-VolumeDependencyTests-124298755 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 25 16:00:28 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-dd16e9e6-8b88-4c7d-b0ce-ecb5190b641a tempest-VolumeDependencyTests-124298755 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 25 16:00:28 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.quobyte [None req-dd16e9e6-8b88-4c7d-b0ce-ecb5190b641a tempest-VolumeDependencyTests-124298755 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23e9d725-3e04-4cd9-bfe0-c8ef43305589': None} {{(pid=83528) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 25 16:00:28 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.quobyte [None req-dd16e9e6-8b88-4c7d-b0ce-ecb5190b641a tempest-VolumeDependencyTests-124298755 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23e9d725-3e04-4cd9-bfe0-c8ef43305589'] {{(pid=83528) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 25 16:00:28 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-dd16e9e6-8b88-4c7d-b0ce-ecb5190b641a tempest-VolumeDependencyTests-124298755 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 25 16:00:28 devstack cinder-volume[83528]: DEBUG oslo.privsep.daemon [-] privsep: reply[46e92819-bdb0-4071-93f6-89095194d9a1]: (4, 'qcow2') {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 25 16:00:28 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-dd16e9e6-8b88-4c7d-b0ce-ecb5190b641a tempest-VolumeDependencyTests-124298755 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-cb6254d4-bf9f-4bb4-8b46-a889ec2af743.01373db1-614a-45da-b381-f25a2c92ed49 {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 25 16:00:28 devstack sudo[90689]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-cb6254d4-bf9f-4bb4-8b46-a889ec2af743.01373db1-614a-45da-b381-f25a2c92ed49 Feb 25 16:00:28 devstack sudo[90689]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 25 16:00:29 devstack sudo[90689]: pam_unix(sudo:session): session closed for user root Feb 25 16:00:29 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-dd16e9e6-8b88-4c7d-b0ce-ecb5190b641a tempest-VolumeDependencyTests-124298755 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-cb6254d4-bf9f-4bb4-8b46-a889ec2af743.01373db1-614a-45da-b381-f25a2c92ed49" returned: 0 in 0.581s {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 25 16:00:29 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.remotefs [None req-dd16e9e6-8b88-4c7d-b0ce-ecb5190b641a tempest-VolumeDependencyTests-124298755 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-cb6254d4-bf9f-4bb4-8b46-a889ec2af743(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83528) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Feb 25 16:00:29 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.quobyte [None req-dd16e9e6-8b88-4c7d-b0ce-ecb5190b641a tempest-VolumeDependencyTests-124298755 None] will copy from snapshot at /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-cb6254d4-bf9f-4bb4-8b46-a889ec2af743 {{(pid=83528) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Feb 25 16:00:29 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.quobyte [None req-dd16e9e6-8b88-4c7d-b0ce-ecb5190b641a tempest-VolumeDependencyTests-124298755 None] Creating direct copy from snapshot {{(pid=83528) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Feb 25 16:00:29 devstack cinder-volume[83528]: DEBUG oslo.privsep.daemon [-] privsep: reply[de5e4d0c-1dd5-40a2-84c3-2a73a3042e2c]: (4, 'qcow2') {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 25 16:00:29 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-dd16e9e6-8b88-4c7d-b0ce-ecb5190b641a tempest-VolumeDependencyTests-124298755 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-cb6254d4-bf9f-4bb4-8b46-a889ec2af743 {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 25 16:00:29 devstack sudo[90694]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-cb6254d4-bf9f-4bb4-8b46-a889ec2af743 Feb 25 16:00:29 devstack sudo[90694]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 25 16:00:29 devstack sudo[90694]: pam_unix(sudo:session): session closed for user root Feb 25 16:00:29 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-dd16e9e6-8b88-4c7d-b0ce-ecb5190b641a tempest-VolumeDependencyTests-124298755 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-cb6254d4-bf9f-4bb4-8b46-a889ec2af743" returned: 0 in 0.605s {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 25 16:00:29 devstack cinder-volume[83528]: DEBUG cinder.utils [None req-dd16e9e6-8b88-4c7d-b0ce-ecb5190b641a tempest-VolumeDependencyTests-124298755 None] Path /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-b4fd46f1-4056-4693-ab49-dc6a5c60964a not found in is_blk_device check {{(pid=83528) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Feb 25 16:00:29 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-dd16e9e6-8b88-4c7d-b0ce-ecb5190b641a tempest-VolumeDependencyTests-124298755 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-cb6254d4-bf9f-4bb4-8b46-a889ec2af743 /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-b4fd46f1-4056-4693-ab49-dc6a5c60964a {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 25 16:00:30 devstack sudo[90699]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-cb6254d4-bf9f-4bb4-8b46-a889ec2af743 /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-b4fd46f1-4056-4693-ab49-dc6a5c60964a Feb 25 16:00:30 devstack sudo[90699]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 25 16:00:32 devstack sudo[90699]: pam_unix(sudo:session): session closed for user root Feb 25 16:00:32 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-dd16e9e6-8b88-4c7d-b0ce-ecb5190b641a tempest-VolumeDependencyTests-124298755 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-cb6254d4-bf9f-4bb4-8b46-a889ec2af743 /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-b4fd46f1-4056-4693-ab49-dc6a5c60964a" returned: 0 in 2.328s {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 25 16:00:32 devstack cinder-volume[83528]: DEBUG oslo.privsep.daemon [-] privsep: reply[92269db4-23cb-4f70-9932-dc9003e4b8b6]: (4, 'qcow2') {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 25 16:00:32 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-dd16e9e6-8b88-4c7d-b0ce-ecb5190b641a tempest-VolumeDependencyTests-124298755 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-cb6254d4-bf9f-4bb4-8b46-a889ec2af743 {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 25 16:00:32 devstack sudo[90711]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-cb6254d4-bf9f-4bb4-8b46-a889ec2af743 Feb 25 16:00:32 devstack sudo[90711]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 25 16:00:32 devstack sudo[90711]: pam_unix(sudo:session): session closed for user root Feb 25 16:00:32 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-dd16e9e6-8b88-4c7d-b0ce-ecb5190b641a tempest-VolumeDependencyTests-124298755 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-cb6254d4-bf9f-4bb4-8b46-a889ec2af743" returned: 0 in 0.637s {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 25 16:00:32 devstack cinder-volume[83528]: DEBUG cinder.image.image_utils [None req-dd16e9e6-8b88-4c7d-b0ce-ecb5190b641a tempest-VolumeDependencyTests-124298755 None] Image conversion details: src /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-cb6254d4-bf9f-4bb4-8b46-a889ec2af743, size 1024.00 MB, duration 2.33 sec, destination /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-b4fd46f1-4056-4693-ab49-dc6a5c60964a {{(pid=83528) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Feb 25 16:00:32 devstack cinder-volume[83528]: INFO cinder.image.image_utils [None req-dd16e9e6-8b88-4c7d-b0ce-ecb5190b641a tempest-VolumeDependencyTests-124298755 None] Converted 1024.00 MB image at 439.60 MB/s Feb 25 16:00:32 devstack cinder-volume[83528]: WARNING cinder.volume.drivers.remotefs [None req-dd16e9e6-8b88-4c7d-b0ce-ecb5190b641a tempest-VolumeDependencyTests-124298755 None] /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-b4fd46f1-4056-4693-ab49-dc6a5c60964a is being set with open permissions: ugo+rw Feb 25 16:00:32 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-dd16e9e6-8b88-4c7d-b0ce-ecb5190b641a tempest-VolumeDependencyTests-124298755 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-b4fd46f1-4056-4693-ab49-dc6a5c60964a {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 25 16:00:32 devstack sudo[90718]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-b4fd46f1-4056-4693-ab49-dc6a5c60964a Feb 25 16:00:32 devstack sudo[90718]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 25 16:00:33 devstack sudo[90718]: pam_unix(sudo:session): session closed for user root Feb 25 16:00:33 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-dd16e9e6-8b88-4c7d-b0ce-ecb5190b641a tempest-VolumeDependencyTests-124298755 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-b4fd46f1-4056-4693-ab49-dc6a5c60964a" returned: 0 in 0.449s {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 25 16:00:33 devstack cinder-volume[83528]: DEBUG cinder.coordination [None req-dd16e9e6-8b88-4c7d-b0ce-ecb5190b641a tempest-VolumeDependencyTests-124298755 None] Lock "cinder-quobyte-b4fd46f1-4056-4693-ab49-dc6a5c60964a" released by "_copy_volume_from_snapshot" :: held 4.657s {{(pid=83528) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 25 16:00:33 devstack cinder-volume[83528]: DEBUG dbcounter [-] [83528] Writing DB stats cinder:UPDATE=127,cinder:INSERT=27,cinder:SELECT=102,cinder:DELETE=12 {{(pid=83528) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Feb 25 16:00:33 devstack cinder-volume[83528]: DEBUG cinder.coordination [None req-dd16e9e6-8b88-4c7d-b0ce-ecb5190b641a tempest-VolumeDependencyTests-124298755 None] Acquiring lock "cinder-quobyte-01373db1-614a-45da-b381-f25a2c92ed49" by "_delete_snapshot" {{(pid=83528) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 25 16:00:33 devstack cinder-volume[83528]: DEBUG cinder.coordination [None req-dd16e9e6-8b88-4c7d-b0ce-ecb5190b641a tempest-VolumeDependencyTests-124298755 None] Lock "cinder-quobyte-01373db1-614a-45da-b381-f25a2c92ed49" acquired by "_delete_snapshot" :: waited 0.009s {{(pid=83528) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 25 16:00:33 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.remotefs [None req-dd16e9e6-8b88-4c7d-b0ce-ecb5190b641a tempest-VolumeDependencyTests-124298755 None] Deleting offline snapshot 01373db1-614a-45da-b381-f25a2c92ed49 of volume cb6254d4-bf9f-4bb4-8b46-a889ec2af743 {{(pid=83528) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Feb 25 16:00:33 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.remotefs [None req-dd16e9e6-8b88-4c7d-b0ce-ecb5190b641a tempest-VolumeDependencyTests-124298755 None] snapshot_file for this snap is: volume-cb6254d4-bf9f-4bb4-8b46-a889ec2af743.01373db1-614a-45da-b381-f25a2c92ed49 {{(pid=83528) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Feb 25 16:00:33 devstack cinder-volume[83528]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d0eb5eb-dfcb-4422-9f9b-5685af63b4e4]: (4, 'qcow2') {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 25 16:00:33 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-dd16e9e6-8b88-4c7d-b0ce-ecb5190b641a tempest-VolumeDependencyTests-124298755 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-cb6254d4-bf9f-4bb4-8b46-a889ec2af743.01373db1-614a-45da-b381-f25a2c92ed49 {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 25 16:00:33 devstack sudo[90721]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-cb6254d4-bf9f-4bb4-8b46-a889ec2af743.01373db1-614a-45da-b381-f25a2c92ed49 Feb 25 16:00:33 devstack sudo[90721]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 25 16:00:33 devstack cinder-volume[83528]: DEBUG dbcounter [-] [83528] Writing DB stats cinder:SELECT=91,cinder:UPDATE=129,cinder:DELETE=11,cinder:INSERT=35 {{(pid=83528) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Feb 25 16:00:34 devstack cinder-volume[83528]: DEBUG cinder.volume.flows.manager.create_volume [None req-ad101524-b66c-4b00-bdd2-24ba5b7e277f tempest-VolumesSnapshotTestJSON-366459210 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83528) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 25 16:00:34 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-ad101524-b66c-4b00-bdd2-24ba5b7e277f tempest-VolumesSnapshotTestJSON-366459210 None] Flow 'volume_create_manager' (04ccab13-fa10-4152-91c7-fec4b19f14fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83528) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 25 16:00:34 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-ad101524-b66c-4b00-bdd2-24ba5b7e277f tempest-VolumesSnapshotTestJSON-366459210 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8976b492-544d-4c12-b3b2-44bd74ce54e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 25 16:00:34 devstack sudo[90721]: pam_unix(sudo:session): session closed for user root Feb 25 16:00:34 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-dd16e9e6-8b88-4c7d-b0ce-ecb5190b641a tempest-VolumeDependencyTests-124298755 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-cb6254d4-bf9f-4bb4-8b46-a889ec2af743.01373db1-614a-45da-b381-f25a2c92ed49" returned: 0 in 0.572s {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 25 16:00:34 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.remotefs [None req-dd16e9e6-8b88-4c7d-b0ce-ecb5190b641a tempest-VolumeDependencyTests-124298755 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-cb6254d4-bf9f-4bb4-8b46-a889ec2af743(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83528) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Feb 25 16:00:34 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-ad101524-b66c-4b00-bdd2-24ba5b7e277f tempest-VolumesSnapshotTestJSON-366459210 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8976b492-544d-4c12-b3b2-44bd74ce54e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-25T15:00:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-763548654',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d23be46c-1bc9-4e71-a575-ad3fc427b14a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='917f8237bca44873961445fb49da5285',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-25T15:00:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-25T15:00:34Z,use_quota=True,user_id='e3b48447bee44546b9ac4b4e7514fcb6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ce71c2f9-6543-4165-9653-a1529b2ea243),volume_type_id=ce71c2f9-6543-4165-9653-a1529b2ea243)' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 25 16:00:34 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-ad101524-b66c-4b00-bdd2-24ba5b7e277f tempest-VolumesSnapshotTestJSON-366459210 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0ddf8d0e-c91b-457f-8f00-3c4d886e1b7b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 25 16:00:34 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-ad101524-b66c-4b00-bdd2-24ba5b7e277f tempest-VolumesSnapshotTestJSON-366459210 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0ddf8d0e-c91b-457f-8f00-3c4d886e1b7b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 25 16:00:34 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-ad101524-b66c-4b00-bdd2-24ba5b7e277f tempest-VolumesSnapshotTestJSON-366459210 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3aab3100-67b8-4e15-bbf6-7f548d3551fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 25 16:00:34 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-ad101524-b66c-4b00-bdd2-24ba5b7e277f tempest-VolumesSnapshotTestJSON-366459210 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3aab3100-67b8-4e15-bbf6-7f548d3551fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd23be46c-1bc9-4e71-a575-ad3fc427b14a', 'volume_name': 'volume-d23be46c-1bc9-4e71-a575-ad3fc427b14a', 'volume_size': 1}' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 25 16:00:34 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-ad101524-b66c-4b00-bdd2-24ba5b7e277f tempest-VolumesSnapshotTestJSON-366459210 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (57eba111-e444-42ab-af2e-1cf0bdfd7015) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 25 16:00:34 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-ad101524-b66c-4b00-bdd2-24ba5b7e277f tempest-VolumesSnapshotTestJSON-366459210 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (57eba111-e444-42ab-af2e-1cf0bdfd7015) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 25 16:00:34 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-ad101524-b66c-4b00-bdd2-24ba5b7e277f tempest-VolumesSnapshotTestJSON-366459210 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (721394e7-2829-4c22-baca-abb1246e742c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 25 16:00:34 devstack cinder-volume[83528]: INFO cinder.volume.flows.manager.create_volume [None req-ad101524-b66c-4b00-bdd2-24ba5b7e277f tempest-VolumesSnapshotTestJSON-366459210 None] Volume d23be46c-1bc9-4e71-a575-ad3fc427b14a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d23be46c-1bc9-4e71-a575-ad3fc427b14a', 'volume_size': 1} Feb 25 16:00:34 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-ad101524-b66c-4b00-bdd2-24ba5b7e277f tempest-VolumesSnapshotTestJSON-366459210 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 25 16:00:34 devstack cinder-volume[83528]: DEBUG oslo.privsep.daemon [-] privsep: reply[b65c231c-c9e0-47e4-9c79-d9f3ca908582]: (4, 'qcow2') {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 25 16:00:34 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-dd16e9e6-8b88-4c7d-b0ce-ecb5190b641a tempest-VolumeDependencyTests-124298755 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-cb6254d4-bf9f-4bb4-8b46-a889ec2af743 {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 25 16:00:34 devstack sudo[90726]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-cb6254d4-bf9f-4bb4-8b46-a889ec2af743 Feb 25 16:00:34 devstack sudo[90726]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 25 16:00:34 devstack sudo[90726]: pam_unix(sudo:session): session closed for user root Feb 25 16:00:34 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-dd16e9e6-8b88-4c7d-b0ce-ecb5190b641a tempest-VolumeDependencyTests-124298755 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-cb6254d4-bf9f-4bb4-8b46-a889ec2af743" returned: 0 in 0.479s {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 25 16:00:34 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-dd16e9e6-8b88-4c7d-b0ce-ecb5190b641a tempest-VolumeDependencyTests-124298755 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-cb6254d4-bf9f-4bb4-8b46-a889ec2af743.01373db1-614a-45da-b381-f25a2c92ed49 {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 25 16:00:34 devstack sudo[90731]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-cb6254d4-bf9f-4bb4-8b46-a889ec2af743.01373db1-614a-45da-b381-f25a2c92ed49 Feb 25 16:00:34 devstack sudo[90731]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 25 16:00:35 devstack sudo[90731]: pam_unix(sudo:session): session closed for user root Feb 25 16:00:35 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-dd16e9e6-8b88-4c7d-b0ce-ecb5190b641a tempest-VolumeDependencyTests-124298755 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-cb6254d4-bf9f-4bb4-8b46-a889ec2af743.01373db1-614a-45da-b381-f25a2c92ed49" returned: 0 in 0.502s {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 25 16:00:35 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-dd16e9e6-8b88-4c7d-b0ce-ecb5190b641a tempest-VolumeDependencyTests-124298755 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-cb6254d4-bf9f-4bb4-8b46-a889ec2af743.01373db1-614a-45da-b381-f25a2c92ed49 {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 25 16:00:35 devstack sudo[90737]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-cb6254d4-bf9f-4bb4-8b46-a889ec2af743.01373db1-614a-45da-b381-f25a2c92ed49 Feb 25 16:00:35 devstack sudo[90737]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 25 16:00:35 devstack sudo[90737]: pam_unix(sudo:session): session closed for user root Feb 25 16:00:35 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-dd16e9e6-8b88-4c7d-b0ce-ecb5190b641a tempest-VolumeDependencyTests-124298755 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-cb6254d4-bf9f-4bb4-8b46-a889ec2af743.01373db1-614a-45da-b381-f25a2c92ed49" returned: 0 in 0.426s {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 25 16:00:35 devstack cinder-volume[83528]: DEBUG cinder.coordination [None req-dd16e9e6-8b88-4c7d-b0ce-ecb5190b641a tempest-VolumeDependencyTests-124298755 None] Lock "cinder-quobyte-01373db1-614a-45da-b381-f25a2c92ed49" released by "_delete_snapshot" :: held 2.066s {{(pid=83528) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 25 16:00:35 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-dd16e9e6-8b88-4c7d-b0ce-ecb5190b641a tempest-VolumeDependencyTests-124298755 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 9.876s {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 25 16:00:35 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-ad101524-b66c-4b00-bdd2-24ba5b7e277f tempest-VolumesSnapshotTestJSON-366459210 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.463s {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 25 16:00:35 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.quobyte [None req-ad101524-b66c-4b00-bdd2-24ba5b7e277f tempest-VolumesSnapshotTestJSON-366459210 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-25T15:00:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-763548654',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d23be46c-1bc9-4e71-a575-ad3fc427b14a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='917f8237bca44873961445fb49da5285',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-25T15:00:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-25T15:00:34Z,use_quota=True,user_id='e3b48447bee44546b9ac4b4e7514fcb6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ce71c2f9-6543-4165-9653-a1529b2ea243),volume_type_id=ce71c2f9-6543-4165-9653-a1529b2ea243)}" {{(pid=83528) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 25 16:00:35 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.remotefs [None req-ad101524-b66c-4b00-bdd2-24ba5b7e277f tempest-VolumesSnapshotTestJSON-366459210 None] Creating volume d23be46c-1bc9-4e71-a575-ad3fc427b14a {{(pid=83528) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 25 16:00:35 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-ad101524-b66c-4b00-bdd2-24ba5b7e277f tempest-VolumesSnapshotTestJSON-366459210 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 25 16:00:35 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-ad101524-b66c-4b00-bdd2-24ba5b7e277f tempest-VolumesSnapshotTestJSON-366459210 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 25 16:00:35 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.quobyte [None req-ad101524-b66c-4b00-bdd2-24ba5b7e277f tempest-VolumesSnapshotTestJSON-366459210 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23e9d725-3e04-4cd9-bfe0-c8ef43305589': None} {{(pid=83528) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 25 16:00:35 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.quobyte [None req-ad101524-b66c-4b00-bdd2-24ba5b7e277f tempest-VolumesSnapshotTestJSON-366459210 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23e9d725-3e04-4cd9-bfe0-c8ef43305589'] {{(pid=83528) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 25 16:00:35 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-ad101524-b66c-4b00-bdd2-24ba5b7e277f tempest-VolumesSnapshotTestJSON-366459210 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 25 16:00:35 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.quobyte [None req-ad101524-b66c-4b00-bdd2-24ba5b7e277f tempest-VolumesSnapshotTestJSON-366459210 None] Selected osci02.corp.quobyte.com/cinder-vol-23e9d725-3e04-4cd9-bfe0-c8ef43305589 as target Quobyte volume. {{(pid=83528) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 25 16:00:35 devstack cinder-volume[83528]: INFO cinder.volume.drivers.remotefs [None req-ad101524-b66c-4b00-bdd2-24ba5b7e277f tempest-VolumesSnapshotTestJSON-366459210 None] casted to osci02.corp.quobyte.com/cinder-vol-23e9d725-3e04-4cd9-bfe0-c8ef43305589 Feb 25 16:00:35 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-ad101524-b66c-4b00-bdd2-24ba5b7e277f tempest-VolumesSnapshotTestJSON-366459210 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-d23be46c-1bc9-4e71-a575-ad3fc427b14a 1073741824 {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 25 16:00:35 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-dd16e9e6-8b88-4c7d-b0ce-ecb5190b641a tempest-VolumeDependencyTests-124298755 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2eea5e93-dcc7-4857-bd0f-a29c461ac8b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b4fd46f1-4056-4693-ab49-dc6a5c60964a', 'volume_size': 1, 'source_volid': 'cb6254d4-bf9f-4bb4-8b46-a889ec2af743', 'source_volstatus': 'available'}' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 25 16:00:35 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-dd16e9e6-8b88-4c7d-b0ce-ecb5190b641a tempest-VolumeDependencyTests-124298755 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ceec6c77-98e8-48df-a87e-08049ee8e75d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 25 16:00:35 devstack sudo[90740]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-d23be46c-1bc9-4e71-a575-ad3fc427b14a 1073741824 Feb 25 16:00:35 devstack sudo[90740]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 25 16:00:35 devstack cinder-volume[83528]: INFO cinder.volume.flows.manager.create_volume [None req-dd16e9e6-8b88-4c7d-b0ce-ecb5190b641a tempest-VolumeDependencyTests-124298755 None] Volume volume-b4fd46f1-4056-4693-ab49-dc6a5c60964a (b4fd46f1-4056-4693-ab49-dc6a5c60964a): created successfully Feb 25 16:00:35 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-dd16e9e6-8b88-4c7d-b0ce-ecb5190b641a tempest-VolumeDependencyTests-124298755 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ceec6c77-98e8-48df-a87e-08049ee8e75d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 25 16:00:35 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-dd16e9e6-8b88-4c7d-b0ce-ecb5190b641a tempest-VolumeDependencyTests-124298755 None] Flow 'volume_create_manager' (d58b0527-221d-4878-8b93-e26360496798) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83528) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 25 16:00:35 devstack cinder-volume[83528]: INFO cinder.volume.manager [None req-dd16e9e6-8b88-4c7d-b0ce-ecb5190b641a tempest-VolumeDependencyTests-124298755 None] Created volume successfully. Feb 25 16:00:36 devstack sudo[90740]: pam_unix(sudo:session): session closed for user root Feb 25 16:00:36 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-ad101524-b66c-4b00-bdd2-24ba5b7e277f tempest-VolumesSnapshotTestJSON-366459210 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-d23be46c-1bc9-4e71-a575-ad3fc427b14a 1073741824" returned: 0 in 0.504s {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 25 16:00:36 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-ad101524-b66c-4b00-bdd2-24ba5b7e277f tempest-VolumesSnapshotTestJSON-366459210 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-d23be46c-1bc9-4e71-a575-ad3fc427b14a {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 25 16:00:36 devstack sudo[90745]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-d23be46c-1bc9-4e71-a575-ad3fc427b14a Feb 25 16:00:36 devstack sudo[90745]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 25 16:00:36 devstack sudo[90745]: pam_unix(sudo:session): session closed for user root Feb 25 16:00:36 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-ad101524-b66c-4b00-bdd2-24ba5b7e277f tempest-VolumesSnapshotTestJSON-366459210 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-d23be46c-1bc9-4e71-a575-ad3fc427b14a" returned: 0 in 0.415s {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 25 16:00:36 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.quobyte [None req-ad101524-b66c-4b00-bdd2-24ba5b7e277f tempest-VolumesSnapshotTestJSON-366459210 None] <== create_volume: return (946ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-23e9d725-3e04-4cd9-bfe0-c8ef43305589'} {{(pid=83528) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 25 16:00:36 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-ad101524-b66c-4b00-bdd2-24ba5b7e277f tempest-VolumesSnapshotTestJSON-366459210 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.949s {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 25 16:00:36 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-ad101524-b66c-4b00-bdd2-24ba5b7e277f tempest-VolumesSnapshotTestJSON-366459210 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (721394e7-2829-4c22-baca-abb1246e742c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d23be46c-1bc9-4e71-a575-ad3fc427b14a', 'volume_size': 1}' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 25 16:00:36 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-ad101524-b66c-4b00-bdd2-24ba5b7e277f tempest-VolumesSnapshotTestJSON-366459210 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (32db77af-59b4-4072-88a8-152019ed83ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 25 16:00:36 devstack cinder-volume[83528]: INFO cinder.volume.flows.manager.create_volume [None req-ad101524-b66c-4b00-bdd2-24ba5b7e277f tempest-VolumesSnapshotTestJSON-366459210 None] Volume volume-d23be46c-1bc9-4e71-a575-ad3fc427b14a (d23be46c-1bc9-4e71-a575-ad3fc427b14a): created successfully Feb 25 16:00:36 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-ad101524-b66c-4b00-bdd2-24ba5b7e277f tempest-VolumesSnapshotTestJSON-366459210 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (32db77af-59b4-4072-88a8-152019ed83ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 25 16:00:36 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-ad101524-b66c-4b00-bdd2-24ba5b7e277f tempest-VolumesSnapshotTestJSON-366459210 None] Flow 'volume_create_manager' (04ccab13-fa10-4152-91c7-fec4b19f14fe) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83528) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 25 16:00:36 devstack cinder-volume[83528]: INFO cinder.volume.manager [None req-ad101524-b66c-4b00-bdd2-24ba5b7e277f tempest-VolumesSnapshotTestJSON-366459210 None] Created volume successfully. Feb 25 16:00:36 devstack cinder-volume[83528]: DEBUG cinder.coordination [None req-9922998c-2778-401e-ba93-6153bfa65424 tempest-VolumeDependencyTests-124298755 None] Acquiring lock "cinder-cb6254d4-bf9f-4bb4-8b46-a889ec2af743-delete_volume" by "delete_volume" {{(pid=83528) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 25 16:00:36 devstack cinder-volume[83528]: DEBUG cinder.coordination [None req-9922998c-2778-401e-ba93-6153bfa65424 tempest-VolumeDependencyTests-124298755 None] Lock "cinder-cb6254d4-bf9f-4bb4-8b46-a889ec2af743-delete_volume" acquired by "delete_volume" :: waited 0.013s {{(pid=83528) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 25 16:00:36 devstack cinder-volume[83528]: DEBUG cinder.coordination [None req-9922998c-2778-401e-ba93-6153bfa65424 tempest-VolumeDependencyTests-124298755 None] Acquiring lock "cinder-quobyte-cb6254d4-bf9f-4bb4-8b46-a889ec2af743" by "delete_volume" {{(pid=83528) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 25 16:00:36 devstack cinder-volume[83528]: DEBUG cinder.coordination [None req-9922998c-2778-401e-ba93-6153bfa65424 tempest-VolumeDependencyTests-124298755 None] Lock "cinder-quobyte-cb6254d4-bf9f-4bb4-8b46-a889ec2af743" acquired by "delete_volume" :: waited 0.010s {{(pid=83528) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 25 16:00:36 devstack cinder-volume[83528]: DEBUG oslo.privsep.daemon [-] privsep: reply[10d1040e-8be8-4f39-a607-6f75c0e1a8ca]: (4, 'qcow2') {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 25 16:00:36 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-9922998c-2778-401e-ba93-6153bfa65424 tempest-VolumeDependencyTests-124298755 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-cb6254d4-bf9f-4bb4-8b46-a889ec2af743 {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 25 16:00:36 devstack sudo[90748]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-cb6254d4-bf9f-4bb4-8b46-a889ec2af743 Feb 25 16:00:36 devstack sudo[90748]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 25 16:00:37 devstack sudo[90748]: pam_unix(sudo:session): session closed for user root Feb 25 16:00:37 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-9922998c-2778-401e-ba93-6153bfa65424 tempest-VolumeDependencyTests-124298755 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-cb6254d4-bf9f-4bb4-8b46-a889ec2af743" returned: 0 in 0.474s {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 25 16:00:37 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-9922998c-2778-401e-ba93-6153bfa65424 tempest-VolumeDependencyTests-124298755 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-cb6254d4-bf9f-4bb4-8b46-a889ec2af743 {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 25 16:00:37 devstack sudo[90753]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-cb6254d4-bf9f-4bb4-8b46-a889ec2af743 Feb 25 16:00:37 devstack sudo[90753]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 25 16:00:37 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-72abe5ae-566c-4e54-aeca-13ff9fa59b1d tempest-VolumesSnapshotTestJSON-366459210 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 25 16:00:37 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-72abe5ae-566c-4e54-aeca-13ff9fa59b1d tempest-VolumesSnapshotTestJSON-366459210 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 25 16:00:37 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.remotefs [None req-72abe5ae-566c-4e54-aeca-13ff9fa59b1d tempest-VolumesSnapshotTestJSON-366459210 None] Creating offline snapshot f7f79701-a754-4a59-946b-3ffc64b30ada of volume d23be46c-1bc9-4e71-a575-ad3fc427b14a {{(pid=83528) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Feb 25 16:00:37 devstack cinder-volume[83528]: DEBUG oslo.privsep.daemon [-] privsep: reply[322c3007-1ba6-4896-be86-3cdb5a9f5cc8]: (4, 'qcow2') {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 25 16:00:37 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-72abe5ae-566c-4e54-aeca-13ff9fa59b1d tempest-VolumesSnapshotTestJSON-366459210 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-d23be46c-1bc9-4e71-a575-ad3fc427b14a {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 25 16:00:37 devstack sudo[90755]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-d23be46c-1bc9-4e71-a575-ad3fc427b14a Feb 25 16:00:37 devstack sudo[90755]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 25 16:00:37 devstack sudo[90753]: pam_unix(sudo:session): session closed for user root Feb 25 16:00:37 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-9922998c-2778-401e-ba93-6153bfa65424 tempest-VolumeDependencyTests-124298755 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-cb6254d4-bf9f-4bb4-8b46-a889ec2af743" returned: 0 in 0.443s {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 25 16:00:37 devstack cinder-volume[83528]: DEBUG cinder.coordination [None req-9922998c-2778-401e-ba93-6153bfa65424 tempest-VolumeDependencyTests-124298755 None] Lock "cinder-quobyte-cb6254d4-bf9f-4bb4-8b46-a889ec2af743" released by "delete_volume" :: held 0.956s {{(pid=83528) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 25 16:00:37 devstack cinder-volume[83528]: DEBUG cinder.quota [None req-9922998c-2778-401e-ba93-6153bfa65424 tempest-VolumeDependencyTests-124298755 None] Created reservations ['28d5f3e0-b744-4d19-8cb2-55c4ee625830', '799732a5-5b02-4b20-81ff-532e6f9a403b', 'd38ab4eb-1a28-4d4b-8c36-c0d130e5b2fa', '5f8965c0-b175-4ce8-9ba8-3fe65766b500'] {{(pid=83528) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 25 16:00:37 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-9922998c-2778-401e-ba93-6153bfa65424 tempest-VolumeDependencyTests-124298755 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 25 16:00:37 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-9922998c-2778-401e-ba93-6153bfa65424 tempest-VolumeDependencyTests-124298755 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 25 16:00:37 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.quobyte [None req-9922998c-2778-401e-ba93-6153bfa65424 tempest-VolumeDependencyTests-124298755 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23e9d725-3e04-4cd9-bfe0-c8ef43305589': None} {{(pid=83528) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 25 16:00:37 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.quobyte [None req-9922998c-2778-401e-ba93-6153bfa65424 tempest-VolumeDependencyTests-124298755 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23e9d725-3e04-4cd9-bfe0-c8ef43305589'] {{(pid=83528) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 25 16:00:37 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-9922998c-2778-401e-ba93-6153bfa65424 tempest-VolumeDependencyTests-124298755 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 25 16:00:37 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-9922998c-2778-401e-ba93-6153bfa65424 tempest-VolumeDependencyTests-124298755 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85 {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 25 16:00:37 devstack sudo[90758]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85 Feb 25 16:00:37 devstack sudo[90758]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 25 16:00:37 devstack cinder-volume[83528]: DEBUG cinder.coordination [None req-78af963c-d8be-4f85-952f-59398b80272f tempest-VolumeDependencyTests-124298755 None] Acquiring lock "cinder-b4fd46f1-4056-4693-ab49-dc6a5c60964a-delete_volume" by "delete_volume" {{(pid=83528) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 25 16:00:37 devstack cinder-volume[83528]: DEBUG cinder.coordination [None req-78af963c-d8be-4f85-952f-59398b80272f tempest-VolumeDependencyTests-124298755 None] Lock "cinder-b4fd46f1-4056-4693-ab49-dc6a5c60964a-delete_volume" acquired by "delete_volume" :: waited 0.013s {{(pid=83528) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 25 16:00:37 devstack cinder-volume[83528]: DEBUG cinder.coordination [None req-78af963c-d8be-4f85-952f-59398b80272f tempest-VolumeDependencyTests-124298755 None] Acquiring lock "cinder-quobyte-b4fd46f1-4056-4693-ab49-dc6a5c60964a" by "delete_volume" {{(pid=83528) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 25 16:00:37 devstack cinder-volume[83528]: DEBUG cinder.coordination [None req-78af963c-d8be-4f85-952f-59398b80272f tempest-VolumeDependencyTests-124298755 None] Lock "cinder-quobyte-b4fd46f1-4056-4693-ab49-dc6a5c60964a" acquired by "delete_volume" :: waited 0.012s {{(pid=83528) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 25 16:00:37 devstack cinder-volume[83528]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac3f6c20-77a4-468c-8527-9a4e5a5115aa]: (4, 'qcow2') {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 25 16:00:37 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-78af963c-d8be-4f85-952f-59398b80272f tempest-VolumeDependencyTests-124298755 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-b4fd46f1-4056-4693-ab49-dc6a5c60964a {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 25 16:00:37 devstack sudo[90760]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-b4fd46f1-4056-4693-ab49-dc6a5c60964a Feb 25 16:00:37 devstack sudo[90760]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 25 16:00:37 devstack sudo[90755]: pam_unix(sudo:session): session closed for user root Feb 25 16:00:37 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-72abe5ae-566c-4e54-aeca-13ff9fa59b1d tempest-VolumesSnapshotTestJSON-366459210 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-d23be46c-1bc9-4e71-a575-ad3fc427b14a" returned: 0 in 0.548s {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 25 16:00:37 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-72abe5ae-566c-4e54-aeca-13ff9fa59b1d tempest-VolumesSnapshotTestJSON-366459210 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-d23be46c-1bc9-4e71-a575-ad3fc427b14a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-d23be46c-1bc9-4e71-a575-ad3fc427b14a.f7f79701-a754-4a59-946b-3ffc64b30ada 1G {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 25 16:00:37 devstack sudo[90765]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-d23be46c-1bc9-4e71-a575-ad3fc427b14a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-d23be46c-1bc9-4e71-a575-ad3fc427b14a.f7f79701-a754-4a59-946b-3ffc64b30ada 1G Feb 25 16:00:37 devstack sudo[90765]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 25 16:00:38 devstack sudo[90758]: pam_unix(sudo:session): session closed for user root Feb 25 16:00:38 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-9922998c-2778-401e-ba93-6153bfa65424 tempest-VolumeDependencyTests-124298755 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85" returned: 0 in 0.473s {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 25 16:00:38 devstack cinder-volume[83528]: DEBUG cinder.manager [None req-9922998c-2778-401e-ba93-6153bfa65424 tempest-VolumeDependencyTests-124298755 None] Notifying Schedulers of capabilities ... {{(pid=83528) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 25 16:00:38 devstack cinder-volume[83528]: INFO cinder.volume.manager [None req-9922998c-2778-401e-ba93-6153bfa65424 tempest-VolumeDependencyTests-124298755 None] Deleted volume successfully. Feb 25 16:00:38 devstack cinder-volume[83528]: DEBUG cinder.coordination [None req-9922998c-2778-401e-ba93-6153bfa65424 tempest-VolumeDependencyTests-124298755 None] Lock "cinder-cb6254d4-bf9f-4bb4-8b46-a889ec2af743-delete_volume" released by "delete_volume" :: held 1.579s {{(pid=83528) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 25 16:00:38 devstack sudo[90760]: pam_unix(sudo:session): session closed for user root Feb 25 16:00:38 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-78af963c-d8be-4f85-952f-59398b80272f tempest-VolumeDependencyTests-124298755 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-b4fd46f1-4056-4693-ab49-dc6a5c60964a" returned: 0 in 0.494s {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 25 16:00:38 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-78af963c-d8be-4f85-952f-59398b80272f tempest-VolumeDependencyTests-124298755 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-b4fd46f1-4056-4693-ab49-dc6a5c60964a {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 25 16:00:38 devstack sudo[90771]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-b4fd46f1-4056-4693-ab49-dc6a5c60964a Feb 25 16:00:38 devstack sudo[90771]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 25 16:00:38 devstack sudo[90765]: pam_unix(sudo:session): session closed for user root Feb 25 16:00:38 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-72abe5ae-566c-4e54-aeca-13ff9fa59b1d tempest-VolumesSnapshotTestJSON-366459210 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-d23be46c-1bc9-4e71-a575-ad3fc427b14a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-d23be46c-1bc9-4e71-a575-ad3fc427b14a.f7f79701-a754-4a59-946b-3ffc64b30ada 1G" returned: 0 in 0.503s {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 25 16:00:38 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-72abe5ae-566c-4e54-aeca-13ff9fa59b1d tempest-VolumesSnapshotTestJSON-366459210 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d23be46c-1bc9-4e71-a575-ad3fc427b14a -F qcow2 /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-d23be46c-1bc9-4e71-a575-ad3fc427b14a.f7f79701-a754-4a59-946b-3ffc64b30ada {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 25 16:00:38 devstack sudo[90776]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d23be46c-1bc9-4e71-a575-ad3fc427b14a -F qcow2 /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-d23be46c-1bc9-4e71-a575-ad3fc427b14a.f7f79701-a754-4a59-946b-3ffc64b30ada Feb 25 16:00:38 devstack sudo[90776]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 25 16:00:38 devstack cinder-volume[83528]: DEBUG oslo_service.periodic_task [None req-d4c764ec-0ebb-4b31-b534-c9a53c1ab0dd None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=83528) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Feb 25 16:00:38 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-d4c764ec-0ebb-4b31-b534-c9a53c1ab0dd None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 25 16:00:38 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-d4c764ec-0ebb-4b31-b534-c9a53c1ab0dd None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 25 16:00:38 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.quobyte [None req-d4c764ec-0ebb-4b31-b534-c9a53c1ab0dd None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23e9d725-3e04-4cd9-bfe0-c8ef43305589': None} {{(pid=83528) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 25 16:00:38 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.quobyte [None req-d4c764ec-0ebb-4b31-b534-c9a53c1ab0dd None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23e9d725-3e04-4cd9-bfe0-c8ef43305589'] {{(pid=83528) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 25 16:00:38 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-d4c764ec-0ebb-4b31-b534-c9a53c1ab0dd None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 25 16:00:38 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-d4c764ec-0ebb-4b31-b534-c9a53c1ab0dd None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85 {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 25 16:00:38 devstack sudo[90771]: pam_unix(sudo:session): session closed for user root Feb 25 16:00:38 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-78af963c-d8be-4f85-952f-59398b80272f tempest-VolumeDependencyTests-124298755 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-b4fd46f1-4056-4693-ab49-dc6a5c60964a" returned: 0 in 0.448s {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 25 16:00:38 devstack sudo[90779]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85 Feb 25 16:00:38 devstack sudo[90779]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 25 16:00:38 devstack cinder-volume[83528]: DEBUG cinder.coordination [None req-78af963c-d8be-4f85-952f-59398b80272f tempest-VolumeDependencyTests-124298755 None] Lock "cinder-quobyte-b4fd46f1-4056-4693-ab49-dc6a5c60964a" released by "delete_volume" :: held 0.974s {{(pid=83528) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 25 16:00:38 devstack cinder-volume[83528]: DEBUG cinder.quota [None req-78af963c-d8be-4f85-952f-59398b80272f tempest-VolumeDependencyTests-124298755 None] Created reservations ['e77611fe-ad0f-4bb2-9cb7-aa540f1baeaa', '473f8999-f1f1-4328-8ba8-086a3ac71a24', '8e533f46-6933-413f-9aa9-975bad79a0ec', 'cd31c68c-5034-4843-b380-c59c6b7a8bde'] {{(pid=83528) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 25 16:00:38 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-78af963c-d8be-4f85-952f-59398b80272f tempest-VolumeDependencyTests-124298755 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 25 16:00:38 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-78af963c-d8be-4f85-952f-59398b80272f tempest-VolumeDependencyTests-124298755 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 25 16:00:38 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.quobyte [None req-78af963c-d8be-4f85-952f-59398b80272f tempest-VolumeDependencyTests-124298755 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23e9d725-3e04-4cd9-bfe0-c8ef43305589': None} {{(pid=83528) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 25 16:00:38 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.quobyte [None req-78af963c-d8be-4f85-952f-59398b80272f tempest-VolumeDependencyTests-124298755 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23e9d725-3e04-4cd9-bfe0-c8ef43305589'] {{(pid=83528) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 25 16:00:38 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-78af963c-d8be-4f85-952f-59398b80272f tempest-VolumeDependencyTests-124298755 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 25 16:00:38 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-78af963c-d8be-4f85-952f-59398b80272f tempest-VolumeDependencyTests-124298755 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85 {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 25 16:00:38 devstack sudo[90784]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85 Feb 25 16:00:38 devstack sudo[90784]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 25 16:00:38 devstack cinder-volume[83528]: DEBUG cinder.coordination [None req-752e0c97-f20d-441c-88a2-d60c4e560628 tempest-VolumeDependencyTests-124298755 None] Acquiring lock "cinder-7dcb89fe-7b49-48d7-b9cd-03e542fd1e8b-delete_volume" by "delete_volume" {{(pid=83528) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 25 16:00:38 devstack cinder-volume[83528]: DEBUG cinder.coordination [None req-752e0c97-f20d-441c-88a2-d60c4e560628 tempest-VolumeDependencyTests-124298755 None] Lock "cinder-7dcb89fe-7b49-48d7-b9cd-03e542fd1e8b-delete_volume" acquired by "delete_volume" :: waited 0.014s {{(pid=83528) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 25 16:00:38 devstack sudo[90776]: pam_unix(sudo:session): session closed for user root Feb 25 16:00:38 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-72abe5ae-566c-4e54-aeca-13ff9fa59b1d tempest-VolumesSnapshotTestJSON-366459210 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d23be46c-1bc9-4e71-a575-ad3fc427b14a -F qcow2 /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-d23be46c-1bc9-4e71-a575-ad3fc427b14a.f7f79701-a754-4a59-946b-3ffc64b30ada" returned: 0 in 0.487s {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 25 16:00:38 devstack cinder-volume[83528]: WARNING cinder.volume.drivers.remotefs [None req-72abe5ae-566c-4e54-aeca-13ff9fa59b1d tempest-VolumesSnapshotTestJSON-366459210 None] /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-d23be46c-1bc9-4e71-a575-ad3fc427b14a.f7f79701-a754-4a59-946b-3ffc64b30ada is being set with open permissions: ugo+rw Feb 25 16:00:38 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-72abe5ae-566c-4e54-aeca-13ff9fa59b1d tempest-VolumesSnapshotTestJSON-366459210 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-d23be46c-1bc9-4e71-a575-ad3fc427b14a.f7f79701-a754-4a59-946b-3ffc64b30ada {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 25 16:00:38 devstack cinder-volume[83528]: DEBUG cinder.coordination [None req-752e0c97-f20d-441c-88a2-d60c4e560628 tempest-VolumeDependencyTests-124298755 None] Acquiring lock "cinder-quobyte-7dcb89fe-7b49-48d7-b9cd-03e542fd1e8b" by "delete_volume" {{(pid=83528) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 25 16:00:38 devstack sudo[90786]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-d23be46c-1bc9-4e71-a575-ad3fc427b14a.f7f79701-a754-4a59-946b-3ffc64b30ada Feb 25 16:00:38 devstack sudo[90786]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 25 16:00:38 devstack cinder-volume[83528]: DEBUG cinder.coordination [None req-752e0c97-f20d-441c-88a2-d60c4e560628 tempest-VolumeDependencyTests-124298755 None] Lock "cinder-quobyte-7dcb89fe-7b49-48d7-b9cd-03e542fd1e8b" acquired by "delete_volume" :: waited 0.007s {{(pid=83528) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 25 16:00:39 devstack cinder-volume[83528]: DEBUG oslo.privsep.daemon [-] privsep: reply[54bf3460-c457-4488-b72c-30cb60923fbf]: (4, 'qcow2') {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 25 16:00:39 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-752e0c97-f20d-441c-88a2-d60c4e560628 tempest-VolumeDependencyTests-124298755 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-7dcb89fe-7b49-48d7-b9cd-03e542fd1e8b {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 25 16:00:39 devstack sudo[90788]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-7dcb89fe-7b49-48d7-b9cd-03e542fd1e8b Feb 25 16:00:39 devstack sudo[90788]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 25 16:00:39 devstack sudo[90779]: pam_unix(sudo:session): session closed for user root Feb 25 16:00:39 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-d4c764ec-0ebb-4b31-b534-c9a53c1ab0dd None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85" returned: 0 in 0.577s {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 25 16:00:39 devstack cinder-volume[83528]: DEBUG cinder.manager [None req-d4c764ec-0ebb-4b31-b534-c9a53c1ab0dd None None] Notifying Schedulers of capabilities ... {{(pid=83528) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 25 16:00:39 devstack sudo[90784]: pam_unix(sudo:session): session closed for user root Feb 25 16:00:39 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-78af963c-d8be-4f85-952f-59398b80272f tempest-VolumeDependencyTests-124298755 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85" returned: 0 in 0.525s {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 25 16:00:39 devstack cinder-volume[83528]: DEBUG cinder.manager [None req-78af963c-d8be-4f85-952f-59398b80272f tempest-VolumeDependencyTests-124298755 None] Notifying Schedulers of capabilities ... {{(pid=83528) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 25 16:00:39 devstack cinder-volume[83528]: INFO cinder.volume.manager [None req-78af963c-d8be-4f85-952f-59398b80272f tempest-VolumeDependencyTests-124298755 None] Deleted volume successfully. Feb 25 16:00:39 devstack cinder-volume[83528]: DEBUG cinder.coordination [None req-78af963c-d8be-4f85-952f-59398b80272f tempest-VolumeDependencyTests-124298755 None] Lock "cinder-b4fd46f1-4056-4693-ab49-dc6a5c60964a-delete_volume" released by "delete_volume" :: held 1.649s {{(pid=83528) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 25 16:00:39 devstack sudo[90786]: pam_unix(sudo:session): session closed for user root Feb 25 16:00:39 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-72abe5ae-566c-4e54-aeca-13ff9fa59b1d tempest-VolumesSnapshotTestJSON-366459210 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-d23be46c-1bc9-4e71-a575-ad3fc427b14a.f7f79701-a754-4a59-946b-3ffc64b30ada" returned: 0 in 0.527s {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 25 16:00:39 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-72abe5ae-566c-4e54-aeca-13ff9fa59b1d tempest-VolumesSnapshotTestJSON-366459210 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-d23be46c-1bc9-4e71-a575-ad3fc427b14a.info {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 25 16:00:39 devstack sudo[90793]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-d23be46c-1bc9-4e71-a575-ad3fc427b14a.info Feb 25 16:00:39 devstack sudo[90793]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 25 16:00:39 devstack sudo[90788]: pam_unix(sudo:session): session closed for user root Feb 25 16:00:39 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-752e0c97-f20d-441c-88a2-d60c4e560628 tempest-VolumeDependencyTests-124298755 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-7dcb89fe-7b49-48d7-b9cd-03e542fd1e8b" returned: 0 in 0.692s {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 25 16:00:39 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-752e0c97-f20d-441c-88a2-d60c4e560628 tempest-VolumeDependencyTests-124298755 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-7dcb89fe-7b49-48d7-b9cd-03e542fd1e8b {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 25 16:00:39 devstack sudo[90798]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-7dcb89fe-7b49-48d7-b9cd-03e542fd1e8b Feb 25 16:00:39 devstack sudo[90798]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 25 16:00:39 devstack sudo[90793]: pam_unix(sudo:session): session closed for user root Feb 25 16:00:39 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-72abe5ae-566c-4e54-aeca-13ff9fa59b1d tempest-VolumesSnapshotTestJSON-366459210 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-d23be46c-1bc9-4e71-a575-ad3fc427b14a.info" returned: 0 in 0.413s {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 25 16:00:39 devstack cinder-volume[83528]: WARNING cinder.volume.drivers.remotefs [None req-72abe5ae-566c-4e54-aeca-13ff9fa59b1d tempest-VolumesSnapshotTestJSON-366459210 None] /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-d23be46c-1bc9-4e71-a575-ad3fc427b14a.info is being set with open permissions: ugo+rw Feb 25 16:00:39 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-72abe5ae-566c-4e54-aeca-13ff9fa59b1d tempest-VolumesSnapshotTestJSON-366459210 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-d23be46c-1bc9-4e71-a575-ad3fc427b14a.info {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 25 16:00:39 devstack sudo[90801]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-d23be46c-1bc9-4e71-a575-ad3fc427b14a.info Feb 25 16:00:39 devstack sudo[90801]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 25 16:00:40 devstack sudo[90798]: pam_unix(sudo:session): session closed for user root Feb 25 16:00:40 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-752e0c97-f20d-441c-88a2-d60c4e560628 tempest-VolumeDependencyTests-124298755 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-7dcb89fe-7b49-48d7-b9cd-03e542fd1e8b" returned: 0 in 0.439s {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 25 16:00:40 devstack cinder-volume[83528]: DEBUG cinder.coordination [None req-752e0c97-f20d-441c-88a2-d60c4e560628 tempest-VolumeDependencyTests-124298755 None] Lock "cinder-quobyte-7dcb89fe-7b49-48d7-b9cd-03e542fd1e8b" released by "delete_volume" :: held 1.181s {{(pid=83528) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 25 16:00:40 devstack cinder-volume[83528]: DEBUG cinder.quota [None req-752e0c97-f20d-441c-88a2-d60c4e560628 tempest-VolumeDependencyTests-124298755 None] Created reservations ['a7f0a158-d3f6-4e07-b673-a39d9688a5ef', '7f096f5c-275f-423b-aa65-5fffea249299', '193b2376-6878-43f4-ac6c-d090376e558a', '802b42ce-cc52-4025-b9cd-29150f0d0be5'] {{(pid=83528) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 25 16:00:40 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-752e0c97-f20d-441c-88a2-d60c4e560628 tempest-VolumeDependencyTests-124298755 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 25 16:00:40 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-752e0c97-f20d-441c-88a2-d60c4e560628 tempest-VolumeDependencyTests-124298755 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 25 16:00:40 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.quobyte [None req-752e0c97-f20d-441c-88a2-d60c4e560628 tempest-VolumeDependencyTests-124298755 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23e9d725-3e04-4cd9-bfe0-c8ef43305589': None} {{(pid=83528) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 25 16:00:40 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.quobyte [None req-752e0c97-f20d-441c-88a2-d60c4e560628 tempest-VolumeDependencyTests-124298755 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23e9d725-3e04-4cd9-bfe0-c8ef43305589'] {{(pid=83528) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 25 16:00:40 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-752e0c97-f20d-441c-88a2-d60c4e560628 tempest-VolumeDependencyTests-124298755 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 25 16:00:40 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-752e0c97-f20d-441c-88a2-d60c4e560628 tempest-VolumeDependencyTests-124298755 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85 {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 25 16:00:40 devstack sudo[90804]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85 Feb 25 16:00:40 devstack sudo[90804]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 25 16:00:40 devstack sudo[90801]: pam_unix(sudo:session): session closed for user root Feb 25 16:00:40 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-72abe5ae-566c-4e54-aeca-13ff9fa59b1d tempest-VolumesSnapshotTestJSON-366459210 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-d23be46c-1bc9-4e71-a575-ad3fc427b14a.info" returned: 0 in 0.433s {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 25 16:00:40 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-72abe5ae-566c-4e54-aeca-13ff9fa59b1d tempest-VolumesSnapshotTestJSON-366459210 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.976s {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 25 16:00:40 devstack cinder-volume[83528]: INFO cinder.volume.manager [None req-72abe5ae-566c-4e54-aeca-13ff9fa59b1d tempest-VolumesSnapshotTestJSON-366459210 None] Create snapshot completed successfully Feb 25 16:00:40 devstack cinder-volume[83528]: DEBUG cinder.coordination [None req-15d752ee-4adc-4945-a942-74b836005cff tempest-VolumesSnapshotTestJSON-366459210 None] Acquiring lock "cinder-f7f79701-a754-4a59-946b-3ffc64b30ada-delete_snapshot" by "delete_snapshot" {{(pid=83528) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 25 16:00:40 devstack cinder-volume[83528]: DEBUG cinder.coordination [None req-15d752ee-4adc-4945-a942-74b836005cff tempest-VolumesSnapshotTestJSON-366459210 None] Lock "cinder-f7f79701-a754-4a59-946b-3ffc64b30ada-delete_snapshot" acquired by "delete_snapshot" :: waited 0.012s {{(pid=83528) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 25 16:00:40 devstack cinder-volume[83528]: DEBUG cinder.coordination [None req-15d752ee-4adc-4945-a942-74b836005cff tempest-VolumesSnapshotTestJSON-366459210 None] Acquiring lock "cinder-quobyte-d23be46c-1bc9-4e71-a575-ad3fc427b14a" by "delete_snapshot" {{(pid=83528) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 25 16:00:40 devstack cinder-volume[83528]: DEBUG cinder.coordination [None req-15d752ee-4adc-4945-a942-74b836005cff tempest-VolumesSnapshotTestJSON-366459210 None] Lock "cinder-quobyte-d23be46c-1bc9-4e71-a575-ad3fc427b14a" acquired by "delete_snapshot" :: waited 0.009s {{(pid=83528) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 25 16:00:40 devstack cinder-volume[83528]: DEBUG cinder.coordination [None req-15d752ee-4adc-4945-a942-74b836005cff tempest-VolumesSnapshotTestJSON-366459210 None] Acquiring lock "cinder-quobyte-f7f79701-a754-4a59-946b-3ffc64b30ada" by "_delete_snapshot" {{(pid=83528) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 25 16:00:40 devstack cinder-volume[83528]: DEBUG cinder.coordination [None req-15d752ee-4adc-4945-a942-74b836005cff tempest-VolumesSnapshotTestJSON-366459210 None] Lock "cinder-quobyte-f7f79701-a754-4a59-946b-3ffc64b30ada" acquired by "_delete_snapshot" :: waited 0.009s {{(pid=83528) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 25 16:00:40 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.remotefs [None req-15d752ee-4adc-4945-a942-74b836005cff tempest-VolumesSnapshotTestJSON-366459210 None] Deleting offline snapshot f7f79701-a754-4a59-946b-3ffc64b30ada of volume d23be46c-1bc9-4e71-a575-ad3fc427b14a {{(pid=83528) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Feb 25 16:00:40 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.remotefs [None req-15d752ee-4adc-4945-a942-74b836005cff tempest-VolumesSnapshotTestJSON-366459210 None] snapshot_file for this snap is: volume-d23be46c-1bc9-4e71-a575-ad3fc427b14a.f7f79701-a754-4a59-946b-3ffc64b30ada {{(pid=83528) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Feb 25 16:00:40 devstack cinder-volume[83528]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd889ccd-ff1f-4e32-89cf-a6837d435c3e]: (4, 'qcow2') {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 25 16:00:40 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-15d752ee-4adc-4945-a942-74b836005cff tempest-VolumesSnapshotTestJSON-366459210 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-d23be46c-1bc9-4e71-a575-ad3fc427b14a.f7f79701-a754-4a59-946b-3ffc64b30ada {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 25 16:00:40 devstack sudo[90804]: pam_unix(sudo:session): session closed for user root Feb 25 16:00:40 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-752e0c97-f20d-441c-88a2-d60c4e560628 tempest-VolumeDependencyTests-124298755 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85" returned: 0 in 0.494s {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 25 16:00:40 devstack cinder-volume[83528]: DEBUG cinder.manager [None req-752e0c97-f20d-441c-88a2-d60c4e560628 tempest-VolumeDependencyTests-124298755 None] Notifying Schedulers of capabilities ... {{(pid=83528) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 25 16:00:40 devstack cinder-volume[83528]: INFO cinder.volume.manager [None req-752e0c97-f20d-441c-88a2-d60c4e560628 tempest-VolumeDependencyTests-124298755 None] Deleted volume successfully. Feb 25 16:00:40 devstack cinder-volume[83528]: DEBUG cinder.coordination [None req-752e0c97-f20d-441c-88a2-d60c4e560628 tempest-VolumeDependencyTests-124298755 None] Lock "cinder-7dcb89fe-7b49-48d7-b9cd-03e542fd1e8b-delete_volume" released by "delete_volume" :: held 1.821s {{(pid=83528) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 25 16:00:40 devstack sudo[90808]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-d23be46c-1bc9-4e71-a575-ad3fc427b14a.f7f79701-a754-4a59-946b-3ffc64b30ada Feb 25 16:00:40 devstack sudo[90808]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 25 16:00:41 devstack sudo[90808]: pam_unix(sudo:session): session closed for user root Feb 25 16:00:41 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-15d752ee-4adc-4945-a942-74b836005cff tempest-VolumesSnapshotTestJSON-366459210 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-d23be46c-1bc9-4e71-a575-ad3fc427b14a.f7f79701-a754-4a59-946b-3ffc64b30ada" returned: 0 in 0.496s {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 25 16:00:41 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.remotefs [None req-15d752ee-4adc-4945-a942-74b836005cff tempest-VolumesSnapshotTestJSON-366459210 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d23be46c-1bc9-4e71-a575-ad3fc427b14a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83528) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Feb 25 16:00:41 devstack cinder-volume[83528]: DEBUG oslo.privsep.daemon [-] privsep: reply[27921798-0b01-43d4-95f8-3ba02c30fc2d]: (4, 'qcow2') {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 25 16:00:41 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-15d752ee-4adc-4945-a942-74b836005cff tempest-VolumesSnapshotTestJSON-366459210 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-d23be46c-1bc9-4e71-a575-ad3fc427b14a {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 25 16:00:41 devstack sudo[90813]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-d23be46c-1bc9-4e71-a575-ad3fc427b14a Feb 25 16:00:41 devstack sudo[90813]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 25 16:00:41 devstack sudo[90813]: pam_unix(sudo:session): session closed for user root Feb 25 16:00:41 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-15d752ee-4adc-4945-a942-74b836005cff tempest-VolumesSnapshotTestJSON-366459210 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-d23be46c-1bc9-4e71-a575-ad3fc427b14a" returned: 0 in 0.577s {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 25 16:00:41 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-15d752ee-4adc-4945-a942-74b836005cff tempest-VolumesSnapshotTestJSON-366459210 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-d23be46c-1bc9-4e71-a575-ad3fc427b14a.f7f79701-a754-4a59-946b-3ffc64b30ada {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 25 16:00:41 devstack sudo[90818]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-d23be46c-1bc9-4e71-a575-ad3fc427b14a.f7f79701-a754-4a59-946b-3ffc64b30ada Feb 25 16:00:41 devstack sudo[90818]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 25 16:00:42 devstack sudo[90818]: pam_unix(sudo:session): session closed for user root Feb 25 16:00:42 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-15d752ee-4adc-4945-a942-74b836005cff tempest-VolumesSnapshotTestJSON-366459210 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-d23be46c-1bc9-4e71-a575-ad3fc427b14a.f7f79701-a754-4a59-946b-3ffc64b30ada" returned: 0 in 0.491s {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 25 16:00:42 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-15d752ee-4adc-4945-a942-74b836005cff tempest-VolumesSnapshotTestJSON-366459210 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-d23be46c-1bc9-4e71-a575-ad3fc427b14a.f7f79701-a754-4a59-946b-3ffc64b30ada {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 25 16:00:42 devstack sudo[90823]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-d23be46c-1bc9-4e71-a575-ad3fc427b14a.f7f79701-a754-4a59-946b-3ffc64b30ada Feb 25 16:00:42 devstack sudo[90823]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 25 16:00:42 devstack sudo[90823]: pam_unix(sudo:session): session closed for user root Feb 25 16:00:42 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-15d752ee-4adc-4945-a942-74b836005cff tempest-VolumesSnapshotTestJSON-366459210 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-d23be46c-1bc9-4e71-a575-ad3fc427b14a.f7f79701-a754-4a59-946b-3ffc64b30ada" returned: 0 in 0.403s {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 25 16:00:42 devstack cinder-volume[83528]: DEBUG cinder.coordination [None req-15d752ee-4adc-4945-a942-74b836005cff tempest-VolumesSnapshotTestJSON-366459210 None] Lock "cinder-quobyte-f7f79701-a754-4a59-946b-3ffc64b30ada" released by "_delete_snapshot" :: held 2.034s {{(pid=83528) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 25 16:00:42 devstack cinder-volume[83528]: DEBUG cinder.coordination [None req-15d752ee-4adc-4945-a942-74b836005cff tempest-VolumesSnapshotTestJSON-366459210 None] Lock "cinder-quobyte-d23be46c-1bc9-4e71-a575-ad3fc427b14a" released by "delete_snapshot" :: held 2.048s {{(pid=83528) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 25 16:00:42 devstack cinder-volume[83528]: DEBUG cinder.quota [None req-15d752ee-4adc-4945-a942-74b836005cff tempest-VolumesSnapshotTestJSON-366459210 None] Created reservations ['e7061634-802e-47da-81f8-1b5cdda6cc6b', '9fc99baf-280e-49dc-a81d-9150222eab46', '2c8145fe-a7b3-4018-972c-7c0cc6e40b50', '8b96c335-51bc-4dd9-ba41-b8cbdf229e85'] {{(pid=83528) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 25 16:00:42 devstack cinder-volume[83528]: INFO cinder.volume.manager [None req-15d752ee-4adc-4945-a942-74b836005cff tempest-VolumesSnapshotTestJSON-366459210 None] Delete snapshot completed successfully. Feb 25 16:00:42 devstack cinder-volume[83528]: DEBUG cinder.coordination [None req-15d752ee-4adc-4945-a942-74b836005cff tempest-VolumesSnapshotTestJSON-366459210 None] Lock "cinder-f7f79701-a754-4a59-946b-3ffc64b30ada-delete_snapshot" released by "delete_snapshot" :: held 2.162s {{(pid=83528) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 25 16:00:44 devstack cinder-volume[83528]: DEBUG cinder.volume.flows.manager.create_volume [None req-1a2a469d-ca01-4a03-8ba7-78a5f79b3e95 tempest-VolumesSnapshotTestJSON-366459210 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83528) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 25 16:00:44 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-1a2a469d-ca01-4a03-8ba7-78a5f79b3e95 tempest-VolumesSnapshotTestJSON-366459210 None] Flow 'volume_create_manager' (d36989d4-eeb2-480a-8e80-113fe0fc1cc0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83528) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 25 16:00:44 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-1a2a469d-ca01-4a03-8ba7-78a5f79b3e95 tempest-VolumesSnapshotTestJSON-366459210 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b2d0784e-89bf-433f-a17e-bba46f4f6721) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 25 16:00:44 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-1a2a469d-ca01-4a03-8ba7-78a5f79b3e95 tempest-VolumesSnapshotTestJSON-366459210 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b2d0784e-89bf-433f-a17e-bba46f4f6721) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-25T15:00:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-646427760',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7c62f33c-7e54-4d33-806d-b0afc1e2ab81,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='917f8237bca44873961445fb49da5285',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-25T15:00:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-25T15:00:44Z,use_quota=True,user_id='e3b48447bee44546b9ac4b4e7514fcb6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ce71c2f9-6543-4165-9653-a1529b2ea243),volume_type_id=ce71c2f9-6543-4165-9653-a1529b2ea243)' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 25 16:00:44 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-1a2a469d-ca01-4a03-8ba7-78a5f79b3e95 tempest-VolumesSnapshotTestJSON-366459210 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3c5bdc94-c4bf-4dbd-ae47-18054052503a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 25 16:00:44 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-1a2a469d-ca01-4a03-8ba7-78a5f79b3e95 tempest-VolumesSnapshotTestJSON-366459210 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3c5bdc94-c4bf-4dbd-ae47-18054052503a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 25 16:00:44 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-1a2a469d-ca01-4a03-8ba7-78a5f79b3e95 tempest-VolumesSnapshotTestJSON-366459210 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (db9ffa58-923a-42db-ae82-f2118bb3f1b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 25 16:00:44 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-1a2a469d-ca01-4a03-8ba7-78a5f79b3e95 tempest-VolumesSnapshotTestJSON-366459210 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (db9ffa58-923a-42db-ae82-f2118bb3f1b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7c62f33c-7e54-4d33-806d-b0afc1e2ab81', 'volume_name': 'volume-7c62f33c-7e54-4d33-806d-b0afc1e2ab81', 'volume_size': 1}' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 25 16:00:44 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-1a2a469d-ca01-4a03-8ba7-78a5f79b3e95 tempest-VolumesSnapshotTestJSON-366459210 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (35af6ca6-15d2-4ddb-a1e6-cd39e5b4f1fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 25 16:00:44 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-1a2a469d-ca01-4a03-8ba7-78a5f79b3e95 tempest-VolumesSnapshotTestJSON-366459210 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (35af6ca6-15d2-4ddb-a1e6-cd39e5b4f1fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 25 16:00:44 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-1a2a469d-ca01-4a03-8ba7-78a5f79b3e95 tempest-VolumesSnapshotTestJSON-366459210 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (daa2dbf9-51e2-4d7d-8eec-09a1a3c2513a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 25 16:00:44 devstack cinder-volume[83528]: INFO cinder.volume.flows.manager.create_volume [None req-1a2a469d-ca01-4a03-8ba7-78a5f79b3e95 tempest-VolumesSnapshotTestJSON-366459210 None] Volume 7c62f33c-7e54-4d33-806d-b0afc1e2ab81: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7c62f33c-7e54-4d33-806d-b0afc1e2ab81', 'volume_size': 1} Feb 25 16:00:44 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-1a2a469d-ca01-4a03-8ba7-78a5f79b3e95 tempest-VolumesSnapshotTestJSON-366459210 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 25 16:00:44 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-1a2a469d-ca01-4a03-8ba7-78a5f79b3e95 tempest-VolumesSnapshotTestJSON-366459210 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 25 16:00:44 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.quobyte [None req-1a2a469d-ca01-4a03-8ba7-78a5f79b3e95 tempest-VolumesSnapshotTestJSON-366459210 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-25T15:00:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-646427760',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7c62f33c-7e54-4d33-806d-b0afc1e2ab81,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='917f8237bca44873961445fb49da5285',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-25T15:00:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-25T15:00:44Z,use_quota=True,user_id='e3b48447bee44546b9ac4b4e7514fcb6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ce71c2f9-6543-4165-9653-a1529b2ea243),volume_type_id=ce71c2f9-6543-4165-9653-a1529b2ea243)}" {{(pid=83528) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 25 16:00:44 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.remotefs [None req-1a2a469d-ca01-4a03-8ba7-78a5f79b3e95 tempest-VolumesSnapshotTestJSON-366459210 None] Creating volume 7c62f33c-7e54-4d33-806d-b0afc1e2ab81 {{(pid=83528) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 25 16:00:44 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-1a2a469d-ca01-4a03-8ba7-78a5f79b3e95 tempest-VolumesSnapshotTestJSON-366459210 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 25 16:00:44 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-1a2a469d-ca01-4a03-8ba7-78a5f79b3e95 tempest-VolumesSnapshotTestJSON-366459210 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 25 16:00:44 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.quobyte [None req-1a2a469d-ca01-4a03-8ba7-78a5f79b3e95 tempest-VolumesSnapshotTestJSON-366459210 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23e9d725-3e04-4cd9-bfe0-c8ef43305589': None} {{(pid=83528) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 25 16:00:44 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.quobyte [None req-1a2a469d-ca01-4a03-8ba7-78a5f79b3e95 tempest-VolumesSnapshotTestJSON-366459210 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23e9d725-3e04-4cd9-bfe0-c8ef43305589'] {{(pid=83528) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 25 16:00:44 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-1a2a469d-ca01-4a03-8ba7-78a5f79b3e95 tempest-VolumesSnapshotTestJSON-366459210 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 25 16:00:44 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.quobyte [None req-1a2a469d-ca01-4a03-8ba7-78a5f79b3e95 tempest-VolumesSnapshotTestJSON-366459210 None] Selected osci02.corp.quobyte.com/cinder-vol-23e9d725-3e04-4cd9-bfe0-c8ef43305589 as target Quobyte volume. {{(pid=83528) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 25 16:00:44 devstack cinder-volume[83528]: INFO cinder.volume.drivers.remotefs [None req-1a2a469d-ca01-4a03-8ba7-78a5f79b3e95 tempest-VolumesSnapshotTestJSON-366459210 None] casted to osci02.corp.quobyte.com/cinder-vol-23e9d725-3e04-4cd9-bfe0-c8ef43305589 Feb 25 16:00:44 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-1a2a469d-ca01-4a03-8ba7-78a5f79b3e95 tempest-VolumesSnapshotTestJSON-366459210 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-7c62f33c-7e54-4d33-806d-b0afc1e2ab81 1073741824 {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 25 16:00:44 devstack sudo[90826]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-7c62f33c-7e54-4d33-806d-b0afc1e2ab81 1073741824 Feb 25 16:00:44 devstack sudo[90826]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 25 16:00:44 devstack sudo[90826]: pam_unix(sudo:session): session closed for user root Feb 25 16:00:44 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-1a2a469d-ca01-4a03-8ba7-78a5f79b3e95 tempest-VolumesSnapshotTestJSON-366459210 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-7c62f33c-7e54-4d33-806d-b0afc1e2ab81 1073741824" returned: 0 in 0.473s {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 25 16:00:44 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-1a2a469d-ca01-4a03-8ba7-78a5f79b3e95 tempest-VolumesSnapshotTestJSON-366459210 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-7c62f33c-7e54-4d33-806d-b0afc1e2ab81 {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 25 16:00:44 devstack sudo[90832]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-7c62f33c-7e54-4d33-806d-b0afc1e2ab81 Feb 25 16:00:44 devstack sudo[90832]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 25 16:00:45 devstack sudo[90832]: pam_unix(sudo:session): session closed for user root Feb 25 16:00:45 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-1a2a469d-ca01-4a03-8ba7-78a5f79b3e95 tempest-VolumesSnapshotTestJSON-366459210 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-7c62f33c-7e54-4d33-806d-b0afc1e2ab81" returned: 0 in 0.392s {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 25 16:00:45 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.quobyte [None req-1a2a469d-ca01-4a03-8ba7-78a5f79b3e95 tempest-VolumesSnapshotTestJSON-366459210 None] <== create_volume: return (892ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-23e9d725-3e04-4cd9-bfe0-c8ef43305589'} {{(pid=83528) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 25 16:00:45 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-1a2a469d-ca01-4a03-8ba7-78a5f79b3e95 tempest-VolumesSnapshotTestJSON-366459210 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.894s {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 25 16:00:45 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-1a2a469d-ca01-4a03-8ba7-78a5f79b3e95 tempest-VolumesSnapshotTestJSON-366459210 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (daa2dbf9-51e2-4d7d-8eec-09a1a3c2513a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7c62f33c-7e54-4d33-806d-b0afc1e2ab81', 'volume_size': 1}' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 25 16:00:45 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-1a2a469d-ca01-4a03-8ba7-78a5f79b3e95 tempest-VolumesSnapshotTestJSON-366459210 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e7f58e29-1a6e-487a-9b38-b01da55baf34) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 25 16:00:45 devstack cinder-volume[83528]: INFO cinder.volume.flows.manager.create_volume [None req-1a2a469d-ca01-4a03-8ba7-78a5f79b3e95 tempest-VolumesSnapshotTestJSON-366459210 None] Volume volume-7c62f33c-7e54-4d33-806d-b0afc1e2ab81 (7c62f33c-7e54-4d33-806d-b0afc1e2ab81): created successfully Feb 25 16:00:45 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-1a2a469d-ca01-4a03-8ba7-78a5f79b3e95 tempest-VolumesSnapshotTestJSON-366459210 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e7f58e29-1a6e-487a-9b38-b01da55baf34) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 25 16:00:45 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-1a2a469d-ca01-4a03-8ba7-78a5f79b3e95 tempest-VolumesSnapshotTestJSON-366459210 None] Flow 'volume_create_manager' (d36989d4-eeb2-480a-8e80-113fe0fc1cc0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83528) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 25 16:00:45 devstack cinder-volume[83528]: INFO cinder.volume.manager [None req-1a2a469d-ca01-4a03-8ba7-78a5f79b3e95 tempest-VolumesSnapshotTestJSON-366459210 None] Created volume successfully. Feb 25 16:00:45 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-e9fbab86-b125-4060-b3d9-0cc6db2136d1 tempest-VolumesSnapshotTestJSON-366459210 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 25 16:00:45 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-e9fbab86-b125-4060-b3d9-0cc6db2136d1 tempest-VolumesSnapshotTestJSON-366459210 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 25 16:00:45 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.remotefs [None req-e9fbab86-b125-4060-b3d9-0cc6db2136d1 tempest-VolumesSnapshotTestJSON-366459210 None] Creating offline snapshot c4297d39-58a3-4870-92ea-4cc34e739fb4 of volume 7c62f33c-7e54-4d33-806d-b0afc1e2ab81 {{(pid=83528) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Feb 25 16:00:45 devstack cinder-volume[83528]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc138e52-59d0-48f9-a608-499ad0b4edb1]: (4, 'qcow2') {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 25 16:00:45 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-e9fbab86-b125-4060-b3d9-0cc6db2136d1 tempest-VolumesSnapshotTestJSON-366459210 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-7c62f33c-7e54-4d33-806d-b0afc1e2ab81 {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 25 16:00:45 devstack sudo[90835]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-7c62f33c-7e54-4d33-806d-b0afc1e2ab81 Feb 25 16:00:45 devstack sudo[90835]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 25 16:00:45 devstack sudo[90835]: pam_unix(sudo:session): session closed for user root Feb 25 16:00:45 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-e9fbab86-b125-4060-b3d9-0cc6db2136d1 tempest-VolumesSnapshotTestJSON-366459210 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-7c62f33c-7e54-4d33-806d-b0afc1e2ab81" returned: 0 in 0.485s {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 25 16:00:45 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-e9fbab86-b125-4060-b3d9-0cc6db2136d1 tempest-VolumesSnapshotTestJSON-366459210 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-7c62f33c-7e54-4d33-806d-b0afc1e2ab81,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-7c62f33c-7e54-4d33-806d-b0afc1e2ab81.c4297d39-58a3-4870-92ea-4cc34e739fb4 1G {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 25 16:00:45 devstack sudo[90840]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-7c62f33c-7e54-4d33-806d-b0afc1e2ab81,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-7c62f33c-7e54-4d33-806d-b0afc1e2ab81.c4297d39-58a3-4870-92ea-4cc34e739fb4 1G Feb 25 16:00:45 devstack sudo[90840]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 25 16:00:46 devstack sudo[90840]: pam_unix(sudo:session): session closed for user root Feb 25 16:00:46 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-e9fbab86-b125-4060-b3d9-0cc6db2136d1 tempest-VolumesSnapshotTestJSON-366459210 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-7c62f33c-7e54-4d33-806d-b0afc1e2ab81,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-7c62f33c-7e54-4d33-806d-b0afc1e2ab81.c4297d39-58a3-4870-92ea-4cc34e739fb4 1G" returned: 0 in 0.462s {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 25 16:00:46 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-e9fbab86-b125-4060-b3d9-0cc6db2136d1 tempest-VolumesSnapshotTestJSON-366459210 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7c62f33c-7e54-4d33-806d-b0afc1e2ab81 -F qcow2 /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-7c62f33c-7e54-4d33-806d-b0afc1e2ab81.c4297d39-58a3-4870-92ea-4cc34e739fb4 {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 25 16:00:46 devstack sudo[90845]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7c62f33c-7e54-4d33-806d-b0afc1e2ab81 -F qcow2 /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-7c62f33c-7e54-4d33-806d-b0afc1e2ab81.c4297d39-58a3-4870-92ea-4cc34e739fb4 Feb 25 16:00:46 devstack sudo[90845]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 25 16:00:46 devstack sudo[90845]: pam_unix(sudo:session): session closed for user root Feb 25 16:00:46 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-e9fbab86-b125-4060-b3d9-0cc6db2136d1 tempest-VolumesSnapshotTestJSON-366459210 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7c62f33c-7e54-4d33-806d-b0afc1e2ab81 -F qcow2 /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-7c62f33c-7e54-4d33-806d-b0afc1e2ab81.c4297d39-58a3-4870-92ea-4cc34e739fb4" returned: 0 in 0.427s {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 25 16:00:46 devstack cinder-volume[83528]: WARNING cinder.volume.drivers.remotefs [None req-e9fbab86-b125-4060-b3d9-0cc6db2136d1 tempest-VolumesSnapshotTestJSON-366459210 None] /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-7c62f33c-7e54-4d33-806d-b0afc1e2ab81.c4297d39-58a3-4870-92ea-4cc34e739fb4 is being set with open permissions: ugo+rw Feb 25 16:00:46 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-e9fbab86-b125-4060-b3d9-0cc6db2136d1 tempest-VolumesSnapshotTestJSON-366459210 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-7c62f33c-7e54-4d33-806d-b0afc1e2ab81.c4297d39-58a3-4870-92ea-4cc34e739fb4 {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 25 16:00:46 devstack sudo[90850]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-7c62f33c-7e54-4d33-806d-b0afc1e2ab81.c4297d39-58a3-4870-92ea-4cc34e739fb4 Feb 25 16:00:46 devstack sudo[90850]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 25 16:00:47 devstack sudo[90850]: pam_unix(sudo:session): session closed for user root Feb 25 16:00:47 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-e9fbab86-b125-4060-b3d9-0cc6db2136d1 tempest-VolumesSnapshotTestJSON-366459210 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-7c62f33c-7e54-4d33-806d-b0afc1e2ab81.c4297d39-58a3-4870-92ea-4cc34e739fb4" returned: 0 in 0.373s {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 25 16:00:47 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-e9fbab86-b125-4060-b3d9-0cc6db2136d1 tempest-VolumesSnapshotTestJSON-366459210 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-7c62f33c-7e54-4d33-806d-b0afc1e2ab81.info {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 25 16:00:47 devstack sudo[90853]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-7c62f33c-7e54-4d33-806d-b0afc1e2ab81.info Feb 25 16:00:47 devstack sudo[90853]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 25 16:00:47 devstack sudo[90853]: pam_unix(sudo:session): session closed for user root Feb 25 16:00:47 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-e9fbab86-b125-4060-b3d9-0cc6db2136d1 tempest-VolumesSnapshotTestJSON-366459210 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-7c62f33c-7e54-4d33-806d-b0afc1e2ab81.info" returned: 0 in 0.412s {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 25 16:00:47 devstack cinder-volume[83528]: WARNING cinder.volume.drivers.remotefs [None req-e9fbab86-b125-4060-b3d9-0cc6db2136d1 tempest-VolumesSnapshotTestJSON-366459210 None] /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-7c62f33c-7e54-4d33-806d-b0afc1e2ab81.info is being set with open permissions: ugo+rw Feb 25 16:00:47 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-e9fbab86-b125-4060-b3d9-0cc6db2136d1 tempest-VolumesSnapshotTestJSON-366459210 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-7c62f33c-7e54-4d33-806d-b0afc1e2ab81.info {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 25 16:00:47 devstack sudo[90856]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-7c62f33c-7e54-4d33-806d-b0afc1e2ab81.info Feb 25 16:00:47 devstack sudo[90856]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 25 16:00:47 devstack sudo[90856]: pam_unix(sudo:session): session closed for user root Feb 25 16:00:47 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-e9fbab86-b125-4060-b3d9-0cc6db2136d1 tempest-VolumesSnapshotTestJSON-366459210 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-7c62f33c-7e54-4d33-806d-b0afc1e2ab81.info" returned: 0 in 0.396s {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 25 16:00:47 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-e9fbab86-b125-4060-b3d9-0cc6db2136d1 tempest-VolumesSnapshotTestJSON-366459210 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.610s {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 25 16:00:47 devstack cinder-volume[83528]: INFO cinder.volume.manager [None req-e9fbab86-b125-4060-b3d9-0cc6db2136d1 tempest-VolumesSnapshotTestJSON-366459210 None] Create snapshot completed successfully Feb 25 16:00:48 devstack cinder-volume[83528]: DEBUG cinder.volume.flows.manager.create_volume [None req-0db45b34-427f-4d3a-ba2b-f0955bd39abb tempest-VolumesSnapshotTestJSON-366459210 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83528) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 25 16:00:48 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-0db45b34-427f-4d3a-ba2b-f0955bd39abb tempest-VolumesSnapshotTestJSON-366459210 None] Flow 'volume_create_manager' (41909436-8d19-486f-b8b8-61869ec8b93a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83528) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 25 16:00:48 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-0db45b34-427f-4d3a-ba2b-f0955bd39abb tempest-VolumesSnapshotTestJSON-366459210 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (494c0e6c-b666-462c-8395-f59270c85b7c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 25 16:00:48 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-0db45b34-427f-4d3a-ba2b-f0955bd39abb tempest-VolumesSnapshotTestJSON-366459210 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (494c0e6c-b666-462c-8395-f59270c85b7c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-25T15:00:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1755869412',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f2ae315b-2dbb-4489-94e4-e35246a05fed,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='917f8237bca44873961445fb49da5285',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-25T15:00:49Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=c4297d39-58a3-4870-92ea-4cc34e739fb4,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-25T15:00:49Z,use_quota=True,user_id='e3b48447bee44546b9ac4b4e7514fcb6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ce71c2f9-6543-4165-9653-a1529b2ea243),volume_type_id=ce71c2f9-6543-4165-9653-a1529b2ea243)' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 25 16:00:48 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-0db45b34-427f-4d3a-ba2b-f0955bd39abb tempest-VolumesSnapshotTestJSON-366459210 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (811e9b59-8717-4b8d-91dd-3573d8348fe7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 25 16:00:48 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-0db45b34-427f-4d3a-ba2b-f0955bd39abb tempest-VolumesSnapshotTestJSON-366459210 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (811e9b59-8717-4b8d-91dd-3573d8348fe7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 25 16:00:48 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-0db45b34-427f-4d3a-ba2b-f0955bd39abb tempest-VolumesSnapshotTestJSON-366459210 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (37284959-5863-4e80-b149-7693b105e1da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 25 16:00:48 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-0db45b34-427f-4d3a-ba2b-f0955bd39abb tempest-VolumesSnapshotTestJSON-366459210 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (37284959-5863-4e80-b149-7693b105e1da) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'f2ae315b-2dbb-4489-94e4-e35246a05fed', 'volume_name': 'volume-f2ae315b-2dbb-4489-94e4-e35246a05fed', 'volume_size': 2, 'snapshot_id': 'c4297d39-58a3-4870-92ea-4cc34e739fb4'}' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 25 16:00:48 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-0db45b34-427f-4d3a-ba2b-f0955bd39abb tempest-VolumesSnapshotTestJSON-366459210 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d7825f62-5d30-4781-9687-dc5176bbe350) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 25 16:00:48 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-0db45b34-427f-4d3a-ba2b-f0955bd39abb tempest-VolumesSnapshotTestJSON-366459210 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d7825f62-5d30-4781-9687-dc5176bbe350) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 25 16:00:48 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-0db45b34-427f-4d3a-ba2b-f0955bd39abb tempest-VolumesSnapshotTestJSON-366459210 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f6a3dce7-fd92-4005-89d7-28f527049d62) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 25 16:00:48 devstack cinder-volume[83528]: INFO cinder.volume.flows.manager.create_volume [None req-0db45b34-427f-4d3a-ba2b-f0955bd39abb tempest-VolumesSnapshotTestJSON-366459210 None] Volume f2ae315b-2dbb-4489-94e4-e35246a05fed: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-f2ae315b-2dbb-4489-94e4-e35246a05fed', 'volume_size': 2, 'snapshot_id': 'c4297d39-58a3-4870-92ea-4cc34e739fb4'} Feb 25 16:00:48 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-0db45b34-427f-4d3a-ba2b-f0955bd39abb tempest-VolumesSnapshotTestJSON-366459210 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 25 16:00:48 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-0db45b34-427f-4d3a-ba2b-f0955bd39abb tempest-VolumesSnapshotTestJSON-366459210 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 25 16:00:48 devstack cinder-volume[83528]: DEBUG cinder.coordination [None req-0db45b34-427f-4d3a-ba2b-f0955bd39abb tempest-VolumesSnapshotTestJSON-366459210 None] Acquiring lock "cinder-quobyte-c4297d39-58a3-4870-92ea-4cc34e739fb4-f2ae315b-2dbb-4489-94e4-e35246a05fed" by "_create_volume_from_snapshot" {{(pid=83528) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 25 16:00:48 devstack cinder-volume[83528]: DEBUG cinder.coordination [None req-0db45b34-427f-4d3a-ba2b-f0955bd39abb tempest-VolumesSnapshotTestJSON-366459210 None] Lock "cinder-quobyte-c4297d39-58a3-4870-92ea-4cc34e739fb4-f2ae315b-2dbb-4489-94e4-e35246a05fed" acquired by "_create_volume_from_snapshot" :: waited 0.007s {{(pid=83528) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 25 16:00:48 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.quobyte [None req-0db45b34-427f-4d3a-ba2b-f0955bd39abb tempest-VolumesSnapshotTestJSON-366459210 None] Creating volume f2ae315b-2dbb-4489-94e4-e35246a05fed from snapshot c4297d39-58a3-4870-92ea-4cc34e739fb4 {{(pid=83528) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Feb 25 16:00:48 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-0db45b34-427f-4d3a-ba2b-f0955bd39abb tempest-VolumesSnapshotTestJSON-366459210 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 25 16:00:48 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-0db45b34-427f-4d3a-ba2b-f0955bd39abb tempest-VolumesSnapshotTestJSON-366459210 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 25 16:00:48 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.quobyte [None req-0db45b34-427f-4d3a-ba2b-f0955bd39abb tempest-VolumesSnapshotTestJSON-366459210 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23e9d725-3e04-4cd9-bfe0-c8ef43305589': None} {{(pid=83528) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 25 16:00:48 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.quobyte [None req-0db45b34-427f-4d3a-ba2b-f0955bd39abb tempest-VolumesSnapshotTestJSON-366459210 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23e9d725-3e04-4cd9-bfe0-c8ef43305589'] {{(pid=83528) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 25 16:00:48 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-0db45b34-427f-4d3a-ba2b-f0955bd39abb tempest-VolumesSnapshotTestJSON-366459210 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 25 16:00:48 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.quobyte [None req-0db45b34-427f-4d3a-ba2b-f0955bd39abb tempest-VolumesSnapshotTestJSON-366459210 None] Selected osci02.corp.quobyte.com/cinder-vol-23e9d725-3e04-4cd9-bfe0-c8ef43305589 as target Quobyte volume. {{(pid=83528) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 25 16:00:48 devstack cinder-volume[83528]: DEBUG cinder.coordination [None req-0db45b34-427f-4d3a-ba2b-f0955bd39abb tempest-VolumesSnapshotTestJSON-366459210 None] Acquiring lock "cinder-quobyte-f2ae315b-2dbb-4489-94e4-e35246a05fed" by "_copy_volume_from_snapshot" {{(pid=83528) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 25 16:00:48 devstack cinder-volume[83528]: DEBUG cinder.coordination [None req-0db45b34-427f-4d3a-ba2b-f0955bd39abb tempest-VolumesSnapshotTestJSON-366459210 None] Lock "cinder-quobyte-f2ae315b-2dbb-4489-94e4-e35246a05fed" acquired by "_copy_volume_from_snapshot" :: waited 0.006s {{(pid=83528) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 25 16:00:48 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.quobyte [None req-0db45b34-427f-4d3a-ba2b-f0955bd39abb tempest-VolumesSnapshotTestJSON-366459210 None] snapshot: c4297d39-58a3-4870-92ea-4cc34e739fb4, volume: f2ae315b-2dbb-4489-94e4-e35246a05fed, {{(pid=83528) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Feb 25 16:00:48 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-0db45b34-427f-4d3a-ba2b-f0955bd39abb tempest-VolumesSnapshotTestJSON-366459210 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 25 16:00:48 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-0db45b34-427f-4d3a-ba2b-f0955bd39abb tempest-VolumesSnapshotTestJSON-366459210 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 25 16:00:48 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.quobyte [None req-0db45b34-427f-4d3a-ba2b-f0955bd39abb tempest-VolumesSnapshotTestJSON-366459210 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23e9d725-3e04-4cd9-bfe0-c8ef43305589': None} {{(pid=83528) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 25 16:00:48 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.quobyte [None req-0db45b34-427f-4d3a-ba2b-f0955bd39abb tempest-VolumesSnapshotTestJSON-366459210 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23e9d725-3e04-4cd9-bfe0-c8ef43305589'] {{(pid=83528) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 25 16:00:48 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-0db45b34-427f-4d3a-ba2b-f0955bd39abb tempest-VolumesSnapshotTestJSON-366459210 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 25 16:00:48 devstack cinder-volume[83528]: DEBUG oslo.privsep.daemon [-] privsep: reply[64de2b98-af24-4161-be44-754f9b1b3b79]: (4, 'qcow2') {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 25 16:00:48 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-0db45b34-427f-4d3a-ba2b-f0955bd39abb tempest-VolumesSnapshotTestJSON-366459210 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-7c62f33c-7e54-4d33-806d-b0afc1e2ab81.c4297d39-58a3-4870-92ea-4cc34e739fb4 {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 25 16:00:48 devstack sudo[90859]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-7c62f33c-7e54-4d33-806d-b0afc1e2ab81.c4297d39-58a3-4870-92ea-4cc34e739fb4 Feb 25 16:00:48 devstack sudo[90859]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 25 16:00:49 devstack sudo[90859]: pam_unix(sudo:session): session closed for user root Feb 25 16:00:49 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-0db45b34-427f-4d3a-ba2b-f0955bd39abb tempest-VolumesSnapshotTestJSON-366459210 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-7c62f33c-7e54-4d33-806d-b0afc1e2ab81.c4297d39-58a3-4870-92ea-4cc34e739fb4" returned: 0 in 0.474s {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 25 16:00:49 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.remotefs [None req-0db45b34-427f-4d3a-ba2b-f0955bd39abb tempest-VolumesSnapshotTestJSON-366459210 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7c62f33c-7e54-4d33-806d-b0afc1e2ab81(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83528) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Feb 25 16:00:49 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.quobyte [None req-0db45b34-427f-4d3a-ba2b-f0955bd39abb tempest-VolumesSnapshotTestJSON-366459210 None] will copy from snapshot at /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-7c62f33c-7e54-4d33-806d-b0afc1e2ab81 {{(pid=83528) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Feb 25 16:00:49 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.quobyte [None req-0db45b34-427f-4d3a-ba2b-f0955bd39abb tempest-VolumesSnapshotTestJSON-366459210 None] Creating direct copy from snapshot {{(pid=83528) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Feb 25 16:00:49 devstack cinder-volume[83528]: DEBUG oslo.privsep.daemon [-] privsep: reply[390e56bb-d44b-4b68-9e20-d0035de802c6]: (4, 'qcow2') {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 25 16:00:49 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-0db45b34-427f-4d3a-ba2b-f0955bd39abb tempest-VolumesSnapshotTestJSON-366459210 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-7c62f33c-7e54-4d33-806d-b0afc1e2ab81 {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 25 16:00:49 devstack sudo[90864]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-7c62f33c-7e54-4d33-806d-b0afc1e2ab81 Feb 25 16:00:49 devstack sudo[90864]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 25 16:00:49 devstack sudo[90864]: pam_unix(sudo:session): session closed for user root Feb 25 16:00:49 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-0db45b34-427f-4d3a-ba2b-f0955bd39abb tempest-VolumesSnapshotTestJSON-366459210 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-7c62f33c-7e54-4d33-806d-b0afc1e2ab81" returned: 0 in 0.486s {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 25 16:00:49 devstack cinder-volume[83528]: DEBUG cinder.utils [None req-0db45b34-427f-4d3a-ba2b-f0955bd39abb tempest-VolumesSnapshotTestJSON-366459210 None] Path /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-f2ae315b-2dbb-4489-94e4-e35246a05fed not found in is_blk_device check {{(pid=83528) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Feb 25 16:00:49 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-0db45b34-427f-4d3a-ba2b-f0955bd39abb tempest-VolumesSnapshotTestJSON-366459210 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-7c62f33c-7e54-4d33-806d-b0afc1e2ab81 /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-f2ae315b-2dbb-4489-94e4-e35246a05fed {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 25 16:00:49 devstack sudo[90869]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-7c62f33c-7e54-4d33-806d-b0afc1e2ab81 /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-f2ae315b-2dbb-4489-94e4-e35246a05fed Feb 25 16:00:49 devstack sudo[90869]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 25 16:00:51 devstack sudo[90869]: pam_unix(sudo:session): session closed for user root Feb 25 16:00:51 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-0db45b34-427f-4d3a-ba2b-f0955bd39abb tempest-VolumesSnapshotTestJSON-366459210 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-7c62f33c-7e54-4d33-806d-b0afc1e2ab81 /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-f2ae315b-2dbb-4489-94e4-e35246a05fed" returned: 0 in 1.951s {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 25 16:00:51 devstack cinder-volume[83528]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc50edb1-b5f1-4103-8b4d-925e2997c4db]: (4, 'qcow2') {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 25 16:00:51 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-0db45b34-427f-4d3a-ba2b-f0955bd39abb tempest-VolumesSnapshotTestJSON-366459210 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-7c62f33c-7e54-4d33-806d-b0afc1e2ab81 {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 25 16:00:51 devstack sudo[90881]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-7c62f33c-7e54-4d33-806d-b0afc1e2ab81 Feb 25 16:00:51 devstack sudo[90881]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 25 16:00:52 devstack sudo[90881]: pam_unix(sudo:session): session closed for user root Feb 25 16:00:52 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-0db45b34-427f-4d3a-ba2b-f0955bd39abb tempest-VolumesSnapshotTestJSON-366459210 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-7c62f33c-7e54-4d33-806d-b0afc1e2ab81" returned: 0 in 0.568s {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 25 16:00:52 devstack cinder-volume[83528]: DEBUG cinder.image.image_utils [None req-0db45b34-427f-4d3a-ba2b-f0955bd39abb tempest-VolumesSnapshotTestJSON-366459210 None] Image conversion details: src /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-7c62f33c-7e54-4d33-806d-b0afc1e2ab81, size 1024.00 MB, duration 1.95 sec, destination /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-f2ae315b-2dbb-4489-94e4-e35246a05fed {{(pid=83528) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Feb 25 16:00:52 devstack cinder-volume[83528]: INFO cinder.image.image_utils [None req-0db45b34-427f-4d3a-ba2b-f0955bd39abb tempest-VolumesSnapshotTestJSON-366459210 None] Converted 1024.00 MB image at 524.63 MB/s Feb 25 16:00:52 devstack cinder-volume[83528]: WARNING cinder.volume.drivers.remotefs [None req-0db45b34-427f-4d3a-ba2b-f0955bd39abb tempest-VolumesSnapshotTestJSON-366459210 None] /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-f2ae315b-2dbb-4489-94e4-e35246a05fed is being set with open permissions: ugo+rw Feb 25 16:00:52 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-0db45b34-427f-4d3a-ba2b-f0955bd39abb tempest-VolumesSnapshotTestJSON-366459210 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-f2ae315b-2dbb-4489-94e4-e35246a05fed {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 25 16:00:52 devstack sudo[90886]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-f2ae315b-2dbb-4489-94e4-e35246a05fed Feb 25 16:00:52 devstack sudo[90886]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 25 16:00:52 devstack sudo[90886]: pam_unix(sudo:session): session closed for user root Feb 25 16:00:52 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-0db45b34-427f-4d3a-ba2b-f0955bd39abb tempest-VolumesSnapshotTestJSON-366459210 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-f2ae315b-2dbb-4489-94e4-e35246a05fed" returned: 0 in 0.393s {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 25 16:00:52 devstack cinder-volume[83528]: DEBUG cinder.coordination [None req-0db45b34-427f-4d3a-ba2b-f0955bd39abb tempest-VolumesSnapshotTestJSON-366459210 None] Lock "cinder-quobyte-f2ae315b-2dbb-4489-94e4-e35246a05fed" released by "_copy_volume_from_snapshot" :: held 3.924s {{(pid=83528) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 25 16:00:52 devstack cinder-volume[83528]: DEBUG cinder.coordination [None req-0db45b34-427f-4d3a-ba2b-f0955bd39abb tempest-VolumesSnapshotTestJSON-366459210 None] Lock "cinder-quobyte-c4297d39-58a3-4870-92ea-4cc34e739fb4-f2ae315b-2dbb-4489-94e4-e35246a05fed" released by "_create_volume_from_snapshot" :: held 3.939s {{(pid=83528) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 25 16:00:52 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-0db45b34-427f-4d3a-ba2b-f0955bd39abb tempest-VolumesSnapshotTestJSON-366459210 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 3.947s {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 25 16:00:52 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-0db45b34-427f-4d3a-ba2b-f0955bd39abb tempest-VolumesSnapshotTestJSON-366459210 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f6a3dce7-fd92-4005-89d7-28f527049d62) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f2ae315b-2dbb-4489-94e4-e35246a05fed', 'volume_size': 2, 'snapshot_id': 'c4297d39-58a3-4870-92ea-4cc34e739fb4'}' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 25 16:00:52 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-0db45b34-427f-4d3a-ba2b-f0955bd39abb tempest-VolumesSnapshotTestJSON-366459210 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c007b92f-2795-406f-8714-d0996ac11493) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 25 16:00:52 devstack cinder-volume[83528]: INFO cinder.volume.flows.manager.create_volume [None req-0db45b34-427f-4d3a-ba2b-f0955bd39abb tempest-VolumesSnapshotTestJSON-366459210 None] Volume volume-f2ae315b-2dbb-4489-94e4-e35246a05fed (f2ae315b-2dbb-4489-94e4-e35246a05fed): created successfully Feb 25 16:00:52 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-0db45b34-427f-4d3a-ba2b-f0955bd39abb tempest-VolumesSnapshotTestJSON-366459210 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c007b92f-2795-406f-8714-d0996ac11493) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 25 16:00:52 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-0db45b34-427f-4d3a-ba2b-f0955bd39abb tempest-VolumesSnapshotTestJSON-366459210 None] Flow 'volume_create_manager' (41909436-8d19-486f-b8b8-61869ec8b93a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83528) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 25 16:00:52 devstack cinder-volume[83528]: INFO cinder.volume.manager [None req-0db45b34-427f-4d3a-ba2b-f0955bd39abb tempest-VolumesSnapshotTestJSON-366459210 None] Created volume successfully. Feb 25 16:00:52 devstack cinder-volume[83528]: DEBUG cinder.coordination [None req-a84bbe52-e22a-4ab1-bd04-bf4e3664c2a6 tempest-VolumesSnapshotTestJSON-366459210 None] Acquiring lock "cinder-f2ae315b-2dbb-4489-94e4-e35246a05fed-delete_volume" by "delete_volume" {{(pid=83528) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 25 16:00:53 devstack cinder-volume[83528]: DEBUG cinder.coordination [None req-a84bbe52-e22a-4ab1-bd04-bf4e3664c2a6 tempest-VolumesSnapshotTestJSON-366459210 None] Lock "cinder-f2ae315b-2dbb-4489-94e4-e35246a05fed-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=83528) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 25 16:00:53 devstack cinder-volume[83528]: DEBUG cinder.coordination [None req-a84bbe52-e22a-4ab1-bd04-bf4e3664c2a6 tempest-VolumesSnapshotTestJSON-366459210 None] Acquiring lock "cinder-quobyte-f2ae315b-2dbb-4489-94e4-e35246a05fed" by "delete_volume" {{(pid=83528) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 25 16:00:53 devstack cinder-volume[83528]: DEBUG cinder.coordination [None req-a84bbe52-e22a-4ab1-bd04-bf4e3664c2a6 tempest-VolumesSnapshotTestJSON-366459210 None] Lock "cinder-quobyte-f2ae315b-2dbb-4489-94e4-e35246a05fed" acquired by "delete_volume" :: waited 0.012s {{(pid=83528) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 25 16:00:53 devstack cinder-volume[83528]: DEBUG oslo.privsep.daemon [-] privsep: reply[59c02e4d-8464-4808-97ad-19dacc1b4965]: (4, 'qcow2') {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 25 16:00:53 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-a84bbe52-e22a-4ab1-bd04-bf4e3664c2a6 tempest-VolumesSnapshotTestJSON-366459210 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-f2ae315b-2dbb-4489-94e4-e35246a05fed {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 25 16:00:53 devstack sudo[90889]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-f2ae315b-2dbb-4489-94e4-e35246a05fed Feb 25 16:00:53 devstack sudo[90889]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 25 16:00:53 devstack sudo[90889]: pam_unix(sudo:session): session closed for user root Feb 25 16:00:53 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-a84bbe52-e22a-4ab1-bd04-bf4e3664c2a6 tempest-VolumesSnapshotTestJSON-366459210 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-f2ae315b-2dbb-4489-94e4-e35246a05fed" returned: 0 in 0.528s {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 25 16:00:53 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-a84bbe52-e22a-4ab1-bd04-bf4e3664c2a6 tempest-VolumesSnapshotTestJSON-366459210 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-f2ae315b-2dbb-4489-94e4-e35246a05fed {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 25 16:00:53 devstack sudo[90894]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-f2ae315b-2dbb-4489-94e4-e35246a05fed Feb 25 16:00:53 devstack sudo[90894]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 25 16:00:53 devstack sudo[90894]: pam_unix(sudo:session): session closed for user root Feb 25 16:00:53 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-a84bbe52-e22a-4ab1-bd04-bf4e3664c2a6 tempest-VolumesSnapshotTestJSON-366459210 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-f2ae315b-2dbb-4489-94e4-e35246a05fed" returned: 0 in 0.397s {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 25 16:00:53 devstack cinder-volume[83528]: DEBUG cinder.coordination [None req-a84bbe52-e22a-4ab1-bd04-bf4e3664c2a6 tempest-VolumesSnapshotTestJSON-366459210 None] Lock "cinder-quobyte-f2ae315b-2dbb-4489-94e4-e35246a05fed" released by "delete_volume" :: held 0.959s {{(pid=83528) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 25 16:00:54 devstack cinder-volume[83528]: DEBUG cinder.quota [None req-a84bbe52-e22a-4ab1-bd04-bf4e3664c2a6 tempest-VolumesSnapshotTestJSON-366459210 None] Created reservations ['52e3c7df-ed4b-4a01-be53-3b69f1127dbe', 'd26207e8-e67e-4d22-a86a-bf90dd2d7637', 'a5ae2bf0-d706-4264-8085-875c1a9e0cfd', '4f9f5a34-7195-43ab-9e83-b1e399c65d36'] {{(pid=83528) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 25 16:00:54 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-a84bbe52-e22a-4ab1-bd04-bf4e3664c2a6 tempest-VolumesSnapshotTestJSON-366459210 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 25 16:00:54 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-a84bbe52-e22a-4ab1-bd04-bf4e3664c2a6 tempest-VolumesSnapshotTestJSON-366459210 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 25 16:00:54 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.quobyte [None req-a84bbe52-e22a-4ab1-bd04-bf4e3664c2a6 tempest-VolumesSnapshotTestJSON-366459210 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23e9d725-3e04-4cd9-bfe0-c8ef43305589': None} {{(pid=83528) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 25 16:00:54 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.quobyte [None req-a84bbe52-e22a-4ab1-bd04-bf4e3664c2a6 tempest-VolumesSnapshotTestJSON-366459210 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23e9d725-3e04-4cd9-bfe0-c8ef43305589'] {{(pid=83528) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 25 16:00:54 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-a84bbe52-e22a-4ab1-bd04-bf4e3664c2a6 tempest-VolumesSnapshotTestJSON-366459210 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 25 16:00:54 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-a84bbe52-e22a-4ab1-bd04-bf4e3664c2a6 tempest-VolumesSnapshotTestJSON-366459210 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85 {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 25 16:00:54 devstack sudo[90897]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85 Feb 25 16:00:54 devstack sudo[90897]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 25 16:00:54 devstack cinder-volume[83528]: DEBUG cinder.coordination [None req-78984808-3899-483c-9169-e9ce13bd6edf tempest-VolumesSnapshotTestJSON-366459210 None] Acquiring lock "cinder-c4297d39-58a3-4870-92ea-4cc34e739fb4-delete_snapshot" by "delete_snapshot" {{(pid=83528) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 25 16:00:54 devstack cinder-volume[83528]: DEBUG cinder.coordination [None req-78984808-3899-483c-9169-e9ce13bd6edf tempest-VolumesSnapshotTestJSON-366459210 None] Lock "cinder-c4297d39-58a3-4870-92ea-4cc34e739fb4-delete_snapshot" acquired by "delete_snapshot" :: waited 0.010s {{(pid=83528) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 25 16:00:54 devstack cinder-volume[83528]: DEBUG cinder.coordination [None req-78984808-3899-483c-9169-e9ce13bd6edf tempest-VolumesSnapshotTestJSON-366459210 None] Acquiring lock "cinder-quobyte-7c62f33c-7e54-4d33-806d-b0afc1e2ab81" by "delete_snapshot" {{(pid=83528) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 25 16:00:54 devstack cinder-volume[83528]: DEBUG cinder.coordination [None req-78984808-3899-483c-9169-e9ce13bd6edf tempest-VolumesSnapshotTestJSON-366459210 None] Lock "cinder-quobyte-7c62f33c-7e54-4d33-806d-b0afc1e2ab81" acquired by "delete_snapshot" :: waited 0.007s {{(pid=83528) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 25 16:00:54 devstack cinder-volume[83528]: DEBUG cinder.coordination [None req-78984808-3899-483c-9169-e9ce13bd6edf tempest-VolumesSnapshotTestJSON-366459210 None] Acquiring lock "cinder-quobyte-c4297d39-58a3-4870-92ea-4cc34e739fb4" by "_delete_snapshot" {{(pid=83528) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 25 16:00:54 devstack cinder-volume[83528]: DEBUG cinder.coordination [None req-78984808-3899-483c-9169-e9ce13bd6edf tempest-VolumesSnapshotTestJSON-366459210 None] Lock "cinder-quobyte-c4297d39-58a3-4870-92ea-4cc34e739fb4" acquired by "_delete_snapshot" :: waited 0.006s {{(pid=83528) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 25 16:00:54 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.remotefs [None req-78984808-3899-483c-9169-e9ce13bd6edf tempest-VolumesSnapshotTestJSON-366459210 None] Deleting offline snapshot c4297d39-58a3-4870-92ea-4cc34e739fb4 of volume 7c62f33c-7e54-4d33-806d-b0afc1e2ab81 {{(pid=83528) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Feb 25 16:00:54 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.remotefs [None req-78984808-3899-483c-9169-e9ce13bd6edf tempest-VolumesSnapshotTestJSON-366459210 None] snapshot_file for this snap is: volume-7c62f33c-7e54-4d33-806d-b0afc1e2ab81.c4297d39-58a3-4870-92ea-4cc34e739fb4 {{(pid=83528) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Feb 25 16:00:54 devstack cinder-volume[83528]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6a8e257-b15a-411e-8365-87c5607b2d77]: (4, 'qcow2') {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 25 16:00:54 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-78984808-3899-483c-9169-e9ce13bd6edf tempest-VolumesSnapshotTestJSON-366459210 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-7c62f33c-7e54-4d33-806d-b0afc1e2ab81.c4297d39-58a3-4870-92ea-4cc34e739fb4 {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 25 16:00:54 devstack sudo[90899]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-7c62f33c-7e54-4d33-806d-b0afc1e2ab81.c4297d39-58a3-4870-92ea-4cc34e739fb4 Feb 25 16:00:54 devstack sudo[90899]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 25 16:00:54 devstack sudo[90897]: pam_unix(sudo:session): session closed for user root Feb 25 16:00:54 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-a84bbe52-e22a-4ab1-bd04-bf4e3664c2a6 tempest-VolumesSnapshotTestJSON-366459210 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85" returned: 0 in 0.421s {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 25 16:00:54 devstack cinder-volume[83528]: DEBUG cinder.manager [None req-a84bbe52-e22a-4ab1-bd04-bf4e3664c2a6 tempest-VolumesSnapshotTestJSON-366459210 None] Notifying Schedulers of capabilities ... {{(pid=83528) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 25 16:00:54 devstack cinder-volume[83528]: INFO cinder.volume.manager [None req-a84bbe52-e22a-4ab1-bd04-bf4e3664c2a6 tempest-VolumesSnapshotTestJSON-366459210 None] Deleted volume successfully. Feb 25 16:00:54 devstack cinder-volume[83528]: DEBUG cinder.coordination [None req-a84bbe52-e22a-4ab1-bd04-bf4e3664c2a6 tempest-VolumesSnapshotTestJSON-366459210 None] Lock "cinder-f2ae315b-2dbb-4489-94e4-e35246a05fed-delete_volume" released by "delete_volume" :: held 1.550s {{(pid=83528) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 25 16:00:54 devstack sudo[90899]: pam_unix(sudo:session): session closed for user root Feb 25 16:00:54 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-78984808-3899-483c-9169-e9ce13bd6edf tempest-VolumesSnapshotTestJSON-366459210 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-7c62f33c-7e54-4d33-806d-b0afc1e2ab81.c4297d39-58a3-4870-92ea-4cc34e739fb4" returned: 0 in 0.494s {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 25 16:00:54 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.remotefs [None req-78984808-3899-483c-9169-e9ce13bd6edf tempest-VolumesSnapshotTestJSON-366459210 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7c62f33c-7e54-4d33-806d-b0afc1e2ab81(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83528) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Feb 25 16:00:54 devstack cinder-volume[83528]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2006b69-1c07-4a25-9c7c-3d1cdd55d08b]: (4, 'qcow2') {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 25 16:00:54 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-78984808-3899-483c-9169-e9ce13bd6edf tempest-VolumesSnapshotTestJSON-366459210 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-7c62f33c-7e54-4d33-806d-b0afc1e2ab81 {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 25 16:00:54 devstack sudo[90906]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-7c62f33c-7e54-4d33-806d-b0afc1e2ab81 Feb 25 16:00:54 devstack sudo[90906]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 25 16:00:55 devstack sudo[90906]: pam_unix(sudo:session): session closed for user root Feb 25 16:00:55 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-78984808-3899-483c-9169-e9ce13bd6edf tempest-VolumesSnapshotTestJSON-366459210 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-7c62f33c-7e54-4d33-806d-b0afc1e2ab81" returned: 0 in 0.447s {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 25 16:00:55 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-78984808-3899-483c-9169-e9ce13bd6edf tempest-VolumesSnapshotTestJSON-366459210 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-7c62f33c-7e54-4d33-806d-b0afc1e2ab81.c4297d39-58a3-4870-92ea-4cc34e739fb4 {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 25 16:00:55 devstack sudo[90911]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-7c62f33c-7e54-4d33-806d-b0afc1e2ab81.c4297d39-58a3-4870-92ea-4cc34e739fb4 Feb 25 16:00:55 devstack sudo[90911]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 25 16:00:55 devstack sudo[90911]: pam_unix(sudo:session): session closed for user root Feb 25 16:00:55 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-78984808-3899-483c-9169-e9ce13bd6edf tempest-VolumesSnapshotTestJSON-366459210 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-7c62f33c-7e54-4d33-806d-b0afc1e2ab81.c4297d39-58a3-4870-92ea-4cc34e739fb4" returned: 0 in 0.456s {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 25 16:00:55 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-78984808-3899-483c-9169-e9ce13bd6edf tempest-VolumesSnapshotTestJSON-366459210 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-7c62f33c-7e54-4d33-806d-b0afc1e2ab81.c4297d39-58a3-4870-92ea-4cc34e739fb4 {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 25 16:00:55 devstack sudo[90916]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-7c62f33c-7e54-4d33-806d-b0afc1e2ab81.c4297d39-58a3-4870-92ea-4cc34e739fb4 Feb 25 16:00:55 devstack sudo[90916]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 25 16:00:56 devstack sudo[90916]: pam_unix(sudo:session): session closed for user root Feb 25 16:00:56 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-78984808-3899-483c-9169-e9ce13bd6edf tempest-VolumesSnapshotTestJSON-366459210 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-7c62f33c-7e54-4d33-806d-b0afc1e2ab81.c4297d39-58a3-4870-92ea-4cc34e739fb4" returned: 0 in 0.409s {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 25 16:00:56 devstack cinder-volume[83528]: DEBUG cinder.coordination [None req-78984808-3899-483c-9169-e9ce13bd6edf tempest-VolumesSnapshotTestJSON-366459210 None] Lock "cinder-quobyte-c4297d39-58a3-4870-92ea-4cc34e739fb4" released by "_delete_snapshot" :: held 1.877s {{(pid=83528) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 25 16:00:56 devstack cinder-volume[83528]: DEBUG cinder.coordination [None req-78984808-3899-483c-9169-e9ce13bd6edf tempest-VolumesSnapshotTestJSON-366459210 None] Lock "cinder-quobyte-7c62f33c-7e54-4d33-806d-b0afc1e2ab81" released by "delete_snapshot" :: held 1.888s {{(pid=83528) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 25 16:00:56 devstack cinder-volume[83528]: DEBUG cinder.quota [None req-78984808-3899-483c-9169-e9ce13bd6edf tempest-VolumesSnapshotTestJSON-366459210 None] Created reservations ['1233f6ba-fe83-468e-8243-96105ccc0241', 'b9ed5429-b86d-4076-92fb-c3dbfcb85d43', 'fab1877d-6a2a-4397-9aad-413487940492', '7737531d-aa0e-4275-b5ff-f2710c82ec83'] {{(pid=83528) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 25 16:00:56 devstack cinder-volume[83528]: INFO cinder.volume.manager [None req-78984808-3899-483c-9169-e9ce13bd6edf tempest-VolumesSnapshotTestJSON-366459210 None] Delete snapshot completed successfully. Feb 25 16:00:56 devstack cinder-volume[83528]: DEBUG cinder.coordination [None req-78984808-3899-483c-9169-e9ce13bd6edf tempest-VolumesSnapshotTestJSON-366459210 None] Lock "cinder-c4297d39-58a3-4870-92ea-4cc34e739fb4-delete_snapshot" released by "delete_snapshot" :: held 1.971s {{(pid=83528) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 25 16:00:56 devstack cinder-volume[83528]: DEBUG cinder.coordination [None req-a10fa0a0-ec4c-4c3f-a205-29540e13296e tempest-VolumesSnapshotTestJSON-366459210 None] Acquiring lock "cinder-7c62f33c-7e54-4d33-806d-b0afc1e2ab81-delete_volume" by "delete_volume" {{(pid=83528) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 25 16:00:56 devstack cinder-volume[83528]: DEBUG cinder.coordination [None req-a10fa0a0-ec4c-4c3f-a205-29540e13296e tempest-VolumesSnapshotTestJSON-366459210 None] Lock "cinder-7c62f33c-7e54-4d33-806d-b0afc1e2ab81-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=83528) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 25 16:00:56 devstack cinder-volume[83528]: DEBUG cinder.coordination [None req-a10fa0a0-ec4c-4c3f-a205-29540e13296e tempest-VolumesSnapshotTestJSON-366459210 None] Acquiring lock "cinder-quobyte-7c62f33c-7e54-4d33-806d-b0afc1e2ab81" by "delete_volume" {{(pid=83528) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 25 16:00:56 devstack cinder-volume[83528]: DEBUG cinder.coordination [None req-a10fa0a0-ec4c-4c3f-a205-29540e13296e tempest-VolumesSnapshotTestJSON-366459210 None] Lock "cinder-quobyte-7c62f33c-7e54-4d33-806d-b0afc1e2ab81" acquired by "delete_volume" :: waited 0.010s {{(pid=83528) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 25 16:00:56 devstack cinder-volume[83528]: DEBUG oslo.privsep.daemon [-] privsep: reply[de7ab618-63c0-428e-9f10-d72a84e1855c]: (4, 'qcow2') {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 25 16:00:56 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-a10fa0a0-ec4c-4c3f-a205-29540e13296e tempest-VolumesSnapshotTestJSON-366459210 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-7c62f33c-7e54-4d33-806d-b0afc1e2ab81 {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 25 16:00:56 devstack sudo[90919]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-7c62f33c-7e54-4d33-806d-b0afc1e2ab81 Feb 25 16:00:56 devstack sudo[90919]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 25 16:00:56 devstack sudo[90919]: pam_unix(sudo:session): session closed for user root Feb 25 16:00:56 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-a10fa0a0-ec4c-4c3f-a205-29540e13296e tempest-VolumesSnapshotTestJSON-366459210 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-7c62f33c-7e54-4d33-806d-b0afc1e2ab81" returned: 0 in 0.468s {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 25 16:00:56 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-a10fa0a0-ec4c-4c3f-a205-29540e13296e tempest-VolumesSnapshotTestJSON-366459210 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-7c62f33c-7e54-4d33-806d-b0afc1e2ab81 {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 25 16:00:56 devstack sudo[90924]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-7c62f33c-7e54-4d33-806d-b0afc1e2ab81 Feb 25 16:00:56 devstack sudo[90924]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 25 16:00:57 devstack sudo[90924]: pam_unix(sudo:session): session closed for user root Feb 25 16:00:57 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-a10fa0a0-ec4c-4c3f-a205-29540e13296e tempest-VolumesSnapshotTestJSON-366459210 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-7c62f33c-7e54-4d33-806d-b0afc1e2ab81" returned: 0 in 0.388s {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 25 16:00:57 devstack cinder-volume[83528]: DEBUG cinder.coordination [None req-a10fa0a0-ec4c-4c3f-a205-29540e13296e tempest-VolumesSnapshotTestJSON-366459210 None] Lock "cinder-quobyte-7c62f33c-7e54-4d33-806d-b0afc1e2ab81" released by "delete_volume" :: held 0.889s {{(pid=83528) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 25 16:00:57 devstack cinder-volume[83528]: DEBUG cinder.quota [None req-a10fa0a0-ec4c-4c3f-a205-29540e13296e tempest-VolumesSnapshotTestJSON-366459210 None] Created reservations ['024100c7-c343-4007-b50c-96f6d1b893b7', '43635e8e-8d63-41f4-a88d-5117e8488495', '38e69258-87fe-42a2-8aa6-66a5b41d4a2e', 'b885c69c-f449-4b16-8363-db2a79a4345a'] {{(pid=83528) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 25 16:00:57 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-a10fa0a0-ec4c-4c3f-a205-29540e13296e tempest-VolumesSnapshotTestJSON-366459210 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 25 16:00:57 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-a10fa0a0-ec4c-4c3f-a205-29540e13296e tempest-VolumesSnapshotTestJSON-366459210 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 25 16:00:57 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.quobyte [None req-a10fa0a0-ec4c-4c3f-a205-29540e13296e tempest-VolumesSnapshotTestJSON-366459210 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23e9d725-3e04-4cd9-bfe0-c8ef43305589': None} {{(pid=83528) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 25 16:00:57 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.quobyte [None req-a10fa0a0-ec4c-4c3f-a205-29540e13296e tempest-VolumesSnapshotTestJSON-366459210 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23e9d725-3e04-4cd9-bfe0-c8ef43305589'] {{(pid=83528) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 25 16:00:57 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-a10fa0a0-ec4c-4c3f-a205-29540e13296e tempest-VolumesSnapshotTestJSON-366459210 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 25 16:00:57 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-a10fa0a0-ec4c-4c3f-a205-29540e13296e tempest-VolumesSnapshotTestJSON-366459210 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85 {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 25 16:00:57 devstack sudo[90927]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85 Feb 25 16:00:57 devstack sudo[90927]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 25 16:00:57 devstack cinder-volume[83528]: DEBUG cinder.volume.flows.manager.create_volume [None req-22d642a1-7241-4be5-bb3f-d11acc179c41 tempest-VolumesSnapshotTestJSON-366459210 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83528) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 25 16:00:57 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-22d642a1-7241-4be5-bb3f-d11acc179c41 tempest-VolumesSnapshotTestJSON-366459210 None] Flow 'volume_create_manager' (56a4b04b-1967-48b3-9887-7a0b53bedbcf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83528) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 25 16:00:57 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-22d642a1-7241-4be5-bb3f-d11acc179c41 tempest-VolumesSnapshotTestJSON-366459210 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9405f85c-7513-44bc-8760-787a06b1c470) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 25 16:00:57 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-22d642a1-7241-4be5-bb3f-d11acc179c41 tempest-VolumesSnapshotTestJSON-366459210 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9405f85c-7513-44bc-8760-787a06b1c470) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-25T15:00:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-782993798',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ab1f4ef7-f652-4d25-852a-50623c94ab11,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='917f8237bca44873961445fb49da5285',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-25T15:00:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-25T15:00:58Z,use_quota=True,user_id='e3b48447bee44546b9ac4b4e7514fcb6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ce71c2f9-6543-4165-9653-a1529b2ea243),volume_type_id=ce71c2f9-6543-4165-9653-a1529b2ea243)' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 25 16:00:57 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-22d642a1-7241-4be5-bb3f-d11acc179c41 tempest-VolumesSnapshotTestJSON-366459210 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0d4f6bfc-106d-47b6-84fb-c78d42a822a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 25 16:00:57 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-22d642a1-7241-4be5-bb3f-d11acc179c41 tempest-VolumesSnapshotTestJSON-366459210 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0d4f6bfc-106d-47b6-84fb-c78d42a822a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 25 16:00:57 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-22d642a1-7241-4be5-bb3f-d11acc179c41 tempest-VolumesSnapshotTestJSON-366459210 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (09dcb88c-787d-4a0e-8171-cbe85edb4a6f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 25 16:00:57 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-22d642a1-7241-4be5-bb3f-d11acc179c41 tempest-VolumesSnapshotTestJSON-366459210 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (09dcb88c-787d-4a0e-8171-cbe85edb4a6f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ab1f4ef7-f652-4d25-852a-50623c94ab11', 'volume_name': 'volume-ab1f4ef7-f652-4d25-852a-50623c94ab11', 'volume_size': 1}' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 25 16:00:57 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-22d642a1-7241-4be5-bb3f-d11acc179c41 tempest-VolumesSnapshotTestJSON-366459210 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ef24d478-e7c2-48e5-be65-9effe08ad19f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 25 16:00:57 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-22d642a1-7241-4be5-bb3f-d11acc179c41 tempest-VolumesSnapshotTestJSON-366459210 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ef24d478-e7c2-48e5-be65-9effe08ad19f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 25 16:00:57 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-22d642a1-7241-4be5-bb3f-d11acc179c41 tempest-VolumesSnapshotTestJSON-366459210 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fa13aa58-df5c-465d-8a71-9e22f87ec2a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 25 16:00:57 devstack cinder-volume[83528]: INFO cinder.volume.flows.manager.create_volume [None req-22d642a1-7241-4be5-bb3f-d11acc179c41 tempest-VolumesSnapshotTestJSON-366459210 None] Volume ab1f4ef7-f652-4d25-852a-50623c94ab11: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ab1f4ef7-f652-4d25-852a-50623c94ab11', 'volume_size': 1} Feb 25 16:00:57 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-22d642a1-7241-4be5-bb3f-d11acc179c41 tempest-VolumesSnapshotTestJSON-366459210 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 25 16:00:57 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-22d642a1-7241-4be5-bb3f-d11acc179c41 tempest-VolumesSnapshotTestJSON-366459210 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 25 16:00:57 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.quobyte [None req-22d642a1-7241-4be5-bb3f-d11acc179c41 tempest-VolumesSnapshotTestJSON-366459210 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-25T15:00:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-782993798',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ab1f4ef7-f652-4d25-852a-50623c94ab11,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='917f8237bca44873961445fb49da5285',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-25T15:00:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-25T15:00:58Z,use_quota=True,user_id='e3b48447bee44546b9ac4b4e7514fcb6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ce71c2f9-6543-4165-9653-a1529b2ea243),volume_type_id=ce71c2f9-6543-4165-9653-a1529b2ea243)}" {{(pid=83528) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 25 16:00:57 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.remotefs [None req-22d642a1-7241-4be5-bb3f-d11acc179c41 tempest-VolumesSnapshotTestJSON-366459210 None] Creating volume ab1f4ef7-f652-4d25-852a-50623c94ab11 {{(pid=83528) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 25 16:00:57 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-22d642a1-7241-4be5-bb3f-d11acc179c41 tempest-VolumesSnapshotTestJSON-366459210 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 25 16:00:57 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-22d642a1-7241-4be5-bb3f-d11acc179c41 tempest-VolumesSnapshotTestJSON-366459210 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 25 16:00:57 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.quobyte [None req-22d642a1-7241-4be5-bb3f-d11acc179c41 tempest-VolumesSnapshotTestJSON-366459210 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23e9d725-3e04-4cd9-bfe0-c8ef43305589': None} {{(pid=83528) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 25 16:00:57 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.quobyte [None req-22d642a1-7241-4be5-bb3f-d11acc179c41 tempest-VolumesSnapshotTestJSON-366459210 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23e9d725-3e04-4cd9-bfe0-c8ef43305589'] {{(pid=83528) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 25 16:00:57 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-22d642a1-7241-4be5-bb3f-d11acc179c41 tempest-VolumesSnapshotTestJSON-366459210 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 25 16:00:57 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.quobyte [None req-22d642a1-7241-4be5-bb3f-d11acc179c41 tempest-VolumesSnapshotTestJSON-366459210 None] Selected osci02.corp.quobyte.com/cinder-vol-23e9d725-3e04-4cd9-bfe0-c8ef43305589 as target Quobyte volume. {{(pid=83528) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 25 16:00:57 devstack cinder-volume[83528]: INFO cinder.volume.drivers.remotefs [None req-22d642a1-7241-4be5-bb3f-d11acc179c41 tempest-VolumesSnapshotTestJSON-366459210 None] casted to osci02.corp.quobyte.com/cinder-vol-23e9d725-3e04-4cd9-bfe0-c8ef43305589 Feb 25 16:00:57 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-22d642a1-7241-4be5-bb3f-d11acc179c41 tempest-VolumesSnapshotTestJSON-366459210 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-ab1f4ef7-f652-4d25-852a-50623c94ab11 1073741824 {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 25 16:00:57 devstack sudo[90930]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-ab1f4ef7-f652-4d25-852a-50623c94ab11 1073741824 Feb 25 16:00:57 devstack sudo[90930]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 25 16:00:57 devstack sudo[90927]: pam_unix(sudo:session): session closed for user root Feb 25 16:00:57 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-a10fa0a0-ec4c-4c3f-a205-29540e13296e tempest-VolumesSnapshotTestJSON-366459210 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85" returned: 0 in 0.490s {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 25 16:00:57 devstack cinder-volume[83528]: DEBUG cinder.manager [None req-a10fa0a0-ec4c-4c3f-a205-29540e13296e tempest-VolumesSnapshotTestJSON-366459210 None] Notifying Schedulers of capabilities ... {{(pid=83528) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 25 16:00:57 devstack cinder-volume[83528]: INFO cinder.volume.manager [None req-a10fa0a0-ec4c-4c3f-a205-29540e13296e tempest-VolumesSnapshotTestJSON-366459210 None] Deleted volume successfully. Feb 25 16:00:57 devstack cinder-volume[83528]: DEBUG cinder.coordination [None req-a10fa0a0-ec4c-4c3f-a205-29540e13296e tempest-VolumesSnapshotTestJSON-366459210 None] Lock "cinder-7c62f33c-7e54-4d33-806d-b0afc1e2ab81-delete_volume" released by "delete_volume" :: held 1.529s {{(pid=83528) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 25 16:00:58 devstack sudo[90930]: pam_unix(sudo:session): session closed for user root Feb 25 16:00:58 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-22d642a1-7241-4be5-bb3f-d11acc179c41 tempest-VolumesSnapshotTestJSON-366459210 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-ab1f4ef7-f652-4d25-852a-50623c94ab11 1073741824" returned: 0 in 0.509s {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 25 16:00:58 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-22d642a1-7241-4be5-bb3f-d11acc179c41 tempest-VolumesSnapshotTestJSON-366459210 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-ab1f4ef7-f652-4d25-852a-50623c94ab11 {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 25 16:00:58 devstack sudo[90935]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-ab1f4ef7-f652-4d25-852a-50623c94ab11 Feb 25 16:00:58 devstack sudo[90935]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 25 16:00:58 devstack sudo[90935]: pam_unix(sudo:session): session closed for user root Feb 25 16:00:58 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-22d642a1-7241-4be5-bb3f-d11acc179c41 tempest-VolumesSnapshotTestJSON-366459210 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-ab1f4ef7-f652-4d25-852a-50623c94ab11" returned: 0 in 0.416s {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 25 16:00:58 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.quobyte [None req-22d642a1-7241-4be5-bb3f-d11acc179c41 tempest-VolumesSnapshotTestJSON-366459210 None] <== create_volume: return (950ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-23e9d725-3e04-4cd9-bfe0-c8ef43305589'} {{(pid=83528) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 25 16:00:58 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-22d642a1-7241-4be5-bb3f-d11acc179c41 tempest-VolumesSnapshotTestJSON-366459210 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.953s {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 25 16:00:58 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-22d642a1-7241-4be5-bb3f-d11acc179c41 tempest-VolumesSnapshotTestJSON-366459210 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fa13aa58-df5c-465d-8a71-9e22f87ec2a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ab1f4ef7-f652-4d25-852a-50623c94ab11', 'volume_size': 1}' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 25 16:00:58 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-22d642a1-7241-4be5-bb3f-d11acc179c41 tempest-VolumesSnapshotTestJSON-366459210 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9f27bb43-cb24-4526-bf4e-90e22b9c342a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 25 16:00:58 devstack cinder-volume[83528]: INFO cinder.volume.flows.manager.create_volume [None req-22d642a1-7241-4be5-bb3f-d11acc179c41 tempest-VolumesSnapshotTestJSON-366459210 None] Volume volume-ab1f4ef7-f652-4d25-852a-50623c94ab11 (ab1f4ef7-f652-4d25-852a-50623c94ab11): created successfully Feb 25 16:00:58 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-22d642a1-7241-4be5-bb3f-d11acc179c41 tempest-VolumesSnapshotTestJSON-366459210 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9f27bb43-cb24-4526-bf4e-90e22b9c342a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 25 16:00:58 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-22d642a1-7241-4be5-bb3f-d11acc179c41 tempest-VolumesSnapshotTestJSON-366459210 None] Flow 'volume_create_manager' (56a4b04b-1967-48b3-9887-7a0b53bedbcf) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83528) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 25 16:00:58 devstack cinder-volume[83528]: INFO cinder.volume.manager [None req-22d642a1-7241-4be5-bb3f-d11acc179c41 tempest-VolumesSnapshotTestJSON-366459210 None] Created volume successfully. Feb 25 16:00:59 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-108564ff-cf3e-4626-a453-6ed0319a0e92 tempest-VolumesSnapshotTestJSON-366459210 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 25 16:00:59 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-108564ff-cf3e-4626-a453-6ed0319a0e92 tempest-VolumesSnapshotTestJSON-366459210 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 25 16:00:59 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.remotefs [None req-108564ff-cf3e-4626-a453-6ed0319a0e92 tempest-VolumesSnapshotTestJSON-366459210 None] Creating offline snapshot 43adb6a3-1353-4860-b1be-374fe78b83bd of volume ab1f4ef7-f652-4d25-852a-50623c94ab11 {{(pid=83528) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Feb 25 16:01:00 devstack cinder-volume[83528]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea09fcf1-81f5-4ddc-9f7b-bcd724b3f679]: (4, 'qcow2') {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 25 16:01:00 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-108564ff-cf3e-4626-a453-6ed0319a0e92 tempest-VolumesSnapshotTestJSON-366459210 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-ab1f4ef7-f652-4d25-852a-50623c94ab11 {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 25 16:01:00 devstack sudo[90938]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-ab1f4ef7-f652-4d25-852a-50623c94ab11 Feb 25 16:01:00 devstack sudo[90938]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 25 16:01:00 devstack sudo[90938]: pam_unix(sudo:session): session closed for user root Feb 25 16:01:00 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-108564ff-cf3e-4626-a453-6ed0319a0e92 tempest-VolumesSnapshotTestJSON-366459210 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-ab1f4ef7-f652-4d25-852a-50623c94ab11" returned: 0 in 0.488s {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 25 16:01:00 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-108564ff-cf3e-4626-a453-6ed0319a0e92 tempest-VolumesSnapshotTestJSON-366459210 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-ab1f4ef7-f652-4d25-852a-50623c94ab11,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-ab1f4ef7-f652-4d25-852a-50623c94ab11.43adb6a3-1353-4860-b1be-374fe78b83bd 1G {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 25 16:01:00 devstack sudo[90943]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-ab1f4ef7-f652-4d25-852a-50623c94ab11,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-ab1f4ef7-f652-4d25-852a-50623c94ab11.43adb6a3-1353-4860-b1be-374fe78b83bd 1G Feb 25 16:01:00 devstack sudo[90943]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 25 16:01:00 devstack sudo[90943]: pam_unix(sudo:session): session closed for user root Feb 25 16:01:00 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-108564ff-cf3e-4626-a453-6ed0319a0e92 tempest-VolumesSnapshotTestJSON-366459210 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-ab1f4ef7-f652-4d25-852a-50623c94ab11,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-ab1f4ef7-f652-4d25-852a-50623c94ab11.43adb6a3-1353-4860-b1be-374fe78b83bd 1G" returned: 0 in 0.482s {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 25 16:01:00 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-108564ff-cf3e-4626-a453-6ed0319a0e92 tempest-VolumesSnapshotTestJSON-366459210 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ab1f4ef7-f652-4d25-852a-50623c94ab11 -F qcow2 /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-ab1f4ef7-f652-4d25-852a-50623c94ab11.43adb6a3-1353-4860-b1be-374fe78b83bd {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 25 16:01:00 devstack sudo[90948]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ab1f4ef7-f652-4d25-852a-50623c94ab11 -F qcow2 /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-ab1f4ef7-f652-4d25-852a-50623c94ab11.43adb6a3-1353-4860-b1be-374fe78b83bd Feb 25 16:01:01 devstack sudo[90948]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 25 16:01:01 devstack sudo[90948]: pam_unix(sudo:session): session closed for user root Feb 25 16:01:01 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-108564ff-cf3e-4626-a453-6ed0319a0e92 tempest-VolumesSnapshotTestJSON-366459210 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ab1f4ef7-f652-4d25-852a-50623c94ab11 -F qcow2 /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-ab1f4ef7-f652-4d25-852a-50623c94ab11.43adb6a3-1353-4860-b1be-374fe78b83bd" returned: 0 in 0.449s {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 25 16:01:01 devstack cinder-volume[83528]: WARNING cinder.volume.drivers.remotefs [None req-108564ff-cf3e-4626-a453-6ed0319a0e92 tempest-VolumesSnapshotTestJSON-366459210 None] /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-ab1f4ef7-f652-4d25-852a-50623c94ab11.43adb6a3-1353-4860-b1be-374fe78b83bd is being set with open permissions: ugo+rw Feb 25 16:01:01 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-108564ff-cf3e-4626-a453-6ed0319a0e92 tempest-VolumesSnapshotTestJSON-366459210 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-ab1f4ef7-f652-4d25-852a-50623c94ab11.43adb6a3-1353-4860-b1be-374fe78b83bd {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 25 16:01:01 devstack sudo[90953]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-ab1f4ef7-f652-4d25-852a-50623c94ab11.43adb6a3-1353-4860-b1be-374fe78b83bd Feb 25 16:01:01 devstack sudo[90953]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 25 16:01:01 devstack sudo[90953]: pam_unix(sudo:session): session closed for user root Feb 25 16:01:01 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-108564ff-cf3e-4626-a453-6ed0319a0e92 tempest-VolumesSnapshotTestJSON-366459210 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-ab1f4ef7-f652-4d25-852a-50623c94ab11.43adb6a3-1353-4860-b1be-374fe78b83bd" returned: 0 in 0.415s {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 25 16:01:01 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-108564ff-cf3e-4626-a453-6ed0319a0e92 tempest-VolumesSnapshotTestJSON-366459210 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-ab1f4ef7-f652-4d25-852a-50623c94ab11.info {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 25 16:01:01 devstack sudo[90956]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-ab1f4ef7-f652-4d25-852a-50623c94ab11.info Feb 25 16:01:01 devstack sudo[90956]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 25 16:01:02 devstack sudo[90956]: pam_unix(sudo:session): session closed for user root Feb 25 16:01:02 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-108564ff-cf3e-4626-a453-6ed0319a0e92 tempest-VolumesSnapshotTestJSON-366459210 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-ab1f4ef7-f652-4d25-852a-50623c94ab11.info" returned: 0 in 0.420s {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 25 16:01:02 devstack cinder-volume[83528]: WARNING cinder.volume.drivers.remotefs [None req-108564ff-cf3e-4626-a453-6ed0319a0e92 tempest-VolumesSnapshotTestJSON-366459210 None] /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-ab1f4ef7-f652-4d25-852a-50623c94ab11.info is being set with open permissions: ugo+rw Feb 25 16:01:02 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-108564ff-cf3e-4626-a453-6ed0319a0e92 tempest-VolumesSnapshotTestJSON-366459210 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-ab1f4ef7-f652-4d25-852a-50623c94ab11.info {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 25 16:01:02 devstack sudo[90959]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-ab1f4ef7-f652-4d25-852a-50623c94ab11.info Feb 25 16:01:02 devstack sudo[90959]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 25 16:01:02 devstack sudo[90959]: pam_unix(sudo:session): session closed for user root Feb 25 16:01:02 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-108564ff-cf3e-4626-a453-6ed0319a0e92 tempest-VolumesSnapshotTestJSON-366459210 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-ab1f4ef7-f652-4d25-852a-50623c94ab11.info" returned: 0 in 0.443s {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 25 16:01:02 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-108564ff-cf3e-4626-a453-6ed0319a0e92 tempest-VolumesSnapshotTestJSON-366459210 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.757s {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 25 16:01:02 devstack cinder-volume[83528]: INFO cinder.volume.manager [None req-108564ff-cf3e-4626-a453-6ed0319a0e92 tempest-VolumesSnapshotTestJSON-366459210 None] Create snapshot completed successfully Feb 25 16:01:03 devstack cinder-volume[83528]: DEBUG cinder.volume.flows.manager.create_volume [None req-7e1e3d54-bda3-425a-a9da-03738d4b4804 tempest-VolumesSnapshotTestJSON-366459210 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83528) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 25 16:01:03 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-7e1e3d54-bda3-425a-a9da-03738d4b4804 tempest-VolumesSnapshotTestJSON-366459210 None] Flow 'volume_create_manager' (9065c0fc-b18f-4016-8cbf-62cd71bc5e84) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83528) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 25 16:01:03 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-7e1e3d54-bda3-425a-a9da-03738d4b4804 tempest-VolumesSnapshotTestJSON-366459210 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (69e187f7-c8f5-4f8b-8aa8-bc81f043fbad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 25 16:01:03 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-7e1e3d54-bda3-425a-a9da-03738d4b4804 tempest-VolumesSnapshotTestJSON-366459210 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (69e187f7-c8f5-4f8b-8aa8-bc81f043fbad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-25T15:01:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1897813532',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=39d4c648-859e-42ef-b043-975857102240,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='917f8237bca44873961445fb49da5285',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-25T15:01:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=43adb6a3-1353-4860-b1be-374fe78b83bd,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-25T15:01:03Z,use_quota=True,user_id='e3b48447bee44546b9ac4b4e7514fcb6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ce71c2f9-6543-4165-9653-a1529b2ea243),volume_type_id=ce71c2f9-6543-4165-9653-a1529b2ea243)' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 25 16:01:03 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-7e1e3d54-bda3-425a-a9da-03738d4b4804 tempest-VolumesSnapshotTestJSON-366459210 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (950ab9b6-6e37-4757-a196-872f0273076f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 25 16:01:03 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-7e1e3d54-bda3-425a-a9da-03738d4b4804 tempest-VolumesSnapshotTestJSON-366459210 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (950ab9b6-6e37-4757-a196-872f0273076f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 25 16:01:03 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-7e1e3d54-bda3-425a-a9da-03738d4b4804 tempest-VolumesSnapshotTestJSON-366459210 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2cc97def-0d45-43c5-84d0-fab35df5402b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 25 16:01:03 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-7e1e3d54-bda3-425a-a9da-03738d4b4804 tempest-VolumesSnapshotTestJSON-366459210 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2cc97def-0d45-43c5-84d0-fab35df5402b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '39d4c648-859e-42ef-b043-975857102240', 'volume_name': 'volume-39d4c648-859e-42ef-b043-975857102240', 'volume_size': 1, 'snapshot_id': '43adb6a3-1353-4860-b1be-374fe78b83bd'}' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 25 16:01:03 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-7e1e3d54-bda3-425a-a9da-03738d4b4804 tempest-VolumesSnapshotTestJSON-366459210 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (37abfcd5-f460-46e4-901d-b46ad2a95438) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 25 16:01:03 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-7e1e3d54-bda3-425a-a9da-03738d4b4804 tempest-VolumesSnapshotTestJSON-366459210 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (37abfcd5-f460-46e4-901d-b46ad2a95438) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 25 16:01:03 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-7e1e3d54-bda3-425a-a9da-03738d4b4804 tempest-VolumesSnapshotTestJSON-366459210 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (85d113e5-953e-4282-a15d-35d7372f023f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 25 16:01:03 devstack cinder-volume[83528]: INFO cinder.volume.flows.manager.create_volume [None req-7e1e3d54-bda3-425a-a9da-03738d4b4804 tempest-VolumesSnapshotTestJSON-366459210 None] Volume 39d4c648-859e-42ef-b043-975857102240: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-39d4c648-859e-42ef-b043-975857102240', 'volume_size': 1, 'snapshot_id': '43adb6a3-1353-4860-b1be-374fe78b83bd'} Feb 25 16:01:03 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-7e1e3d54-bda3-425a-a9da-03738d4b4804 tempest-VolumesSnapshotTestJSON-366459210 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 25 16:01:03 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-7e1e3d54-bda3-425a-a9da-03738d4b4804 tempest-VolumesSnapshotTestJSON-366459210 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 25 16:01:03 devstack cinder-volume[83528]: DEBUG cinder.coordination [None req-7e1e3d54-bda3-425a-a9da-03738d4b4804 tempest-VolumesSnapshotTestJSON-366459210 None] Acquiring lock "cinder-quobyte-43adb6a3-1353-4860-b1be-374fe78b83bd-39d4c648-859e-42ef-b043-975857102240" by "_create_volume_from_snapshot" {{(pid=83528) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 25 16:01:03 devstack cinder-volume[83528]: DEBUG cinder.coordination [None req-7e1e3d54-bda3-425a-a9da-03738d4b4804 tempest-VolumesSnapshotTestJSON-366459210 None] Lock "cinder-quobyte-43adb6a3-1353-4860-b1be-374fe78b83bd-39d4c648-859e-42ef-b043-975857102240" acquired by "_create_volume_from_snapshot" :: waited 0.007s {{(pid=83528) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 25 16:01:03 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.quobyte [None req-7e1e3d54-bda3-425a-a9da-03738d4b4804 tempest-VolumesSnapshotTestJSON-366459210 None] Creating volume 39d4c648-859e-42ef-b043-975857102240 from snapshot 43adb6a3-1353-4860-b1be-374fe78b83bd {{(pid=83528) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Feb 25 16:01:03 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-7e1e3d54-bda3-425a-a9da-03738d4b4804 tempest-VolumesSnapshotTestJSON-366459210 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 25 16:01:03 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-7e1e3d54-bda3-425a-a9da-03738d4b4804 tempest-VolumesSnapshotTestJSON-366459210 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 25 16:01:03 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.quobyte [None req-7e1e3d54-bda3-425a-a9da-03738d4b4804 tempest-VolumesSnapshotTestJSON-366459210 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23e9d725-3e04-4cd9-bfe0-c8ef43305589': None} {{(pid=83528) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 25 16:01:03 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.quobyte [None req-7e1e3d54-bda3-425a-a9da-03738d4b4804 tempest-VolumesSnapshotTestJSON-366459210 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23e9d725-3e04-4cd9-bfe0-c8ef43305589'] {{(pid=83528) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 25 16:01:03 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-7e1e3d54-bda3-425a-a9da-03738d4b4804 tempest-VolumesSnapshotTestJSON-366459210 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 25 16:01:03 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.quobyte [None req-7e1e3d54-bda3-425a-a9da-03738d4b4804 tempest-VolumesSnapshotTestJSON-366459210 None] Selected osci02.corp.quobyte.com/cinder-vol-23e9d725-3e04-4cd9-bfe0-c8ef43305589 as target Quobyte volume. {{(pid=83528) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 25 16:01:03 devstack cinder-volume[83528]: DEBUG cinder.coordination [None req-7e1e3d54-bda3-425a-a9da-03738d4b4804 tempest-VolumesSnapshotTestJSON-366459210 None] Acquiring lock "cinder-quobyte-39d4c648-859e-42ef-b043-975857102240" by "_copy_volume_from_snapshot" {{(pid=83528) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 25 16:01:03 devstack cinder-volume[83528]: DEBUG cinder.coordination [None req-7e1e3d54-bda3-425a-a9da-03738d4b4804 tempest-VolumesSnapshotTestJSON-366459210 None] Lock "cinder-quobyte-39d4c648-859e-42ef-b043-975857102240" acquired by "_copy_volume_from_snapshot" :: waited 0.007s {{(pid=83528) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 25 16:01:03 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.quobyte [None req-7e1e3d54-bda3-425a-a9da-03738d4b4804 tempest-VolumesSnapshotTestJSON-366459210 None] snapshot: 43adb6a3-1353-4860-b1be-374fe78b83bd, volume: 39d4c648-859e-42ef-b043-975857102240, {{(pid=83528) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Feb 25 16:01:03 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-7e1e3d54-bda3-425a-a9da-03738d4b4804 tempest-VolumesSnapshotTestJSON-366459210 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 25 16:01:03 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-7e1e3d54-bda3-425a-a9da-03738d4b4804 tempest-VolumesSnapshotTestJSON-366459210 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 25 16:01:03 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.quobyte [None req-7e1e3d54-bda3-425a-a9da-03738d4b4804 tempest-VolumesSnapshotTestJSON-366459210 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23e9d725-3e04-4cd9-bfe0-c8ef43305589': None} {{(pid=83528) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 25 16:01:03 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.quobyte [None req-7e1e3d54-bda3-425a-a9da-03738d4b4804 tempest-VolumesSnapshotTestJSON-366459210 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23e9d725-3e04-4cd9-bfe0-c8ef43305589'] {{(pid=83528) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 25 16:01:03 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-7e1e3d54-bda3-425a-a9da-03738d4b4804 tempest-VolumesSnapshotTestJSON-366459210 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 25 16:01:03 devstack cinder-volume[83528]: DEBUG oslo.privsep.daemon [-] privsep: reply[409a7fad-9466-4295-9ded-582b077a573a]: (4, 'qcow2') {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 25 16:01:03 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-7e1e3d54-bda3-425a-a9da-03738d4b4804 tempest-VolumesSnapshotTestJSON-366459210 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-ab1f4ef7-f652-4d25-852a-50623c94ab11.43adb6a3-1353-4860-b1be-374fe78b83bd {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 25 16:01:03 devstack sudo[90962]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-ab1f4ef7-f652-4d25-852a-50623c94ab11.43adb6a3-1353-4860-b1be-374fe78b83bd Feb 25 16:01:03 devstack sudo[90962]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 25 16:01:04 devstack sudo[90962]: pam_unix(sudo:session): session closed for user root Feb 25 16:01:04 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-7e1e3d54-bda3-425a-a9da-03738d4b4804 tempest-VolumesSnapshotTestJSON-366459210 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-ab1f4ef7-f652-4d25-852a-50623c94ab11.43adb6a3-1353-4860-b1be-374fe78b83bd" returned: 0 in 0.489s {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 25 16:01:04 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.remotefs [None req-7e1e3d54-bda3-425a-a9da-03738d4b4804 tempest-VolumesSnapshotTestJSON-366459210 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ab1f4ef7-f652-4d25-852a-50623c94ab11(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83528) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Feb 25 16:01:04 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.quobyte [None req-7e1e3d54-bda3-425a-a9da-03738d4b4804 tempest-VolumesSnapshotTestJSON-366459210 None] will copy from snapshot at /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-ab1f4ef7-f652-4d25-852a-50623c94ab11 {{(pid=83528) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Feb 25 16:01:04 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.quobyte [None req-7e1e3d54-bda3-425a-a9da-03738d4b4804 tempest-VolumesSnapshotTestJSON-366459210 None] Creating direct copy from snapshot {{(pid=83528) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Feb 25 16:01:04 devstack cinder-volume[83528]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6448c48-d63c-425a-bbe7-9f6c58251ade]: (4, 'qcow2') {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 25 16:01:04 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-7e1e3d54-bda3-425a-a9da-03738d4b4804 tempest-VolumesSnapshotTestJSON-366459210 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-ab1f4ef7-f652-4d25-852a-50623c94ab11 {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 25 16:01:04 devstack sudo[90967]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-ab1f4ef7-f652-4d25-852a-50623c94ab11 Feb 25 16:01:04 devstack sudo[90967]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 25 16:01:04 devstack sudo[90967]: pam_unix(sudo:session): session closed for user root Feb 25 16:01:04 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-7e1e3d54-bda3-425a-a9da-03738d4b4804 tempest-VolumesSnapshotTestJSON-366459210 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-ab1f4ef7-f652-4d25-852a-50623c94ab11" returned: 0 in 0.513s {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 25 16:01:04 devstack cinder-volume[83528]: DEBUG cinder.utils [None req-7e1e3d54-bda3-425a-a9da-03738d4b4804 tempest-VolumesSnapshotTestJSON-366459210 None] Path /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-39d4c648-859e-42ef-b043-975857102240 not found in is_blk_device check {{(pid=83528) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Feb 25 16:01:04 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-7e1e3d54-bda3-425a-a9da-03738d4b4804 tempest-VolumesSnapshotTestJSON-366459210 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-ab1f4ef7-f652-4d25-852a-50623c94ab11 /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-39d4c648-859e-42ef-b043-975857102240 {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 25 16:01:04 devstack sudo[90972]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-ab1f4ef7-f652-4d25-852a-50623c94ab11 /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-39d4c648-859e-42ef-b043-975857102240 Feb 25 16:01:04 devstack sudo[90972]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 25 16:01:06 devstack sudo[90972]: pam_unix(sudo:session): session closed for user root Feb 25 16:01:06 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-7e1e3d54-bda3-425a-a9da-03738d4b4804 tempest-VolumesSnapshotTestJSON-366459210 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-ab1f4ef7-f652-4d25-852a-50623c94ab11 /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-39d4c648-859e-42ef-b043-975857102240" returned: 0 in 2.311s {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 25 16:01:06 devstack cinder-volume[83528]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f11a004-a812-4282-a44a-6a59c52491c1]: (4, 'qcow2') {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 25 16:01:06 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-7e1e3d54-bda3-425a-a9da-03738d4b4804 tempest-VolumesSnapshotTestJSON-366459210 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-ab1f4ef7-f652-4d25-852a-50623c94ab11 {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 25 16:01:06 devstack sudo[90985]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-ab1f4ef7-f652-4d25-852a-50623c94ab11 Feb 25 16:01:06 devstack sudo[90985]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 25 16:01:07 devstack sudo[90985]: pam_unix(sudo:session): session closed for user root Feb 25 16:01:07 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-7e1e3d54-bda3-425a-a9da-03738d4b4804 tempest-VolumesSnapshotTestJSON-366459210 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-ab1f4ef7-f652-4d25-852a-50623c94ab11" returned: 0 in 0.592s {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 25 16:01:07 devstack cinder-volume[83528]: DEBUG cinder.image.image_utils [None req-7e1e3d54-bda3-425a-a9da-03738d4b4804 tempest-VolumesSnapshotTestJSON-366459210 None] Image conversion details: src /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-ab1f4ef7-f652-4d25-852a-50623c94ab11, size 1024.00 MB, duration 2.31 sec, destination /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-39d4c648-859e-42ef-b043-975857102240 {{(pid=83528) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Feb 25 16:01:07 devstack cinder-volume[83528]: INFO cinder.image.image_utils [None req-7e1e3d54-bda3-425a-a9da-03738d4b4804 tempest-VolumesSnapshotTestJSON-366459210 None] Converted 1024.00 MB image at 442.81 MB/s Feb 25 16:01:07 devstack cinder-volume[83528]: WARNING cinder.volume.drivers.remotefs [None req-7e1e3d54-bda3-425a-a9da-03738d4b4804 tempest-VolumesSnapshotTestJSON-366459210 None] /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-39d4c648-859e-42ef-b043-975857102240 is being set with open permissions: ugo+rw Feb 25 16:01:07 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-7e1e3d54-bda3-425a-a9da-03738d4b4804 tempest-VolumesSnapshotTestJSON-366459210 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-39d4c648-859e-42ef-b043-975857102240 {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 25 16:01:07 devstack sudo[90990]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-39d4c648-859e-42ef-b043-975857102240 Feb 25 16:01:07 devstack sudo[90990]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 25 16:01:07 devstack sudo[90990]: pam_unix(sudo:session): session closed for user root Feb 25 16:01:07 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-7e1e3d54-bda3-425a-a9da-03738d4b4804 tempest-VolumesSnapshotTestJSON-366459210 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-39d4c648-859e-42ef-b043-975857102240" returned: 0 in 0.402s {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 25 16:01:07 devstack cinder-volume[83528]: DEBUG cinder.coordination [None req-7e1e3d54-bda3-425a-a9da-03738d4b4804 tempest-VolumesSnapshotTestJSON-366459210 None] Lock "cinder-quobyte-39d4c648-859e-42ef-b043-975857102240" released by "_copy_volume_from_snapshot" :: held 4.366s {{(pid=83528) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 25 16:01:07 devstack cinder-volume[83528]: DEBUG cinder.coordination [None req-7e1e3d54-bda3-425a-a9da-03738d4b4804 tempest-VolumesSnapshotTestJSON-366459210 None] Lock "cinder-quobyte-43adb6a3-1353-4860-b1be-374fe78b83bd-39d4c648-859e-42ef-b043-975857102240" released by "_create_volume_from_snapshot" :: held 4.383s {{(pid=83528) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 25 16:01:07 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-7e1e3d54-bda3-425a-a9da-03738d4b4804 tempest-VolumesSnapshotTestJSON-366459210 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 4.391s {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 25 16:01:07 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-7e1e3d54-bda3-425a-a9da-03738d4b4804 tempest-VolumesSnapshotTestJSON-366459210 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (85d113e5-953e-4282-a15d-35d7372f023f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-39d4c648-859e-42ef-b043-975857102240', 'volume_size': 1, 'snapshot_id': '43adb6a3-1353-4860-b1be-374fe78b83bd'}' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 25 16:01:07 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-7e1e3d54-bda3-425a-a9da-03738d4b4804 tempest-VolumesSnapshotTestJSON-366459210 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0bbad98f-7a2e-444a-90df-3016fc956467) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 25 16:01:07 devstack cinder-volume[83528]: INFO cinder.volume.flows.manager.create_volume [None req-7e1e3d54-bda3-425a-a9da-03738d4b4804 tempest-VolumesSnapshotTestJSON-366459210 None] Volume volume-39d4c648-859e-42ef-b043-975857102240 (39d4c648-859e-42ef-b043-975857102240): created successfully Feb 25 16:01:07 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-7e1e3d54-bda3-425a-a9da-03738d4b4804 tempest-VolumesSnapshotTestJSON-366459210 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0bbad98f-7a2e-444a-90df-3016fc956467) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 25 16:01:07 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-7e1e3d54-bda3-425a-a9da-03738d4b4804 tempest-VolumesSnapshotTestJSON-366459210 None] Flow 'volume_create_manager' (9065c0fc-b18f-4016-8cbf-62cd71bc5e84) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83528) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 25 16:01:07 devstack cinder-volume[83528]: INFO cinder.volume.manager [None req-7e1e3d54-bda3-425a-a9da-03738d4b4804 tempest-VolumesSnapshotTestJSON-366459210 None] Created volume successfully. Feb 25 16:01:08 devstack cinder-volume[83528]: DEBUG cinder.coordination [None req-cf77ac76-a761-43d0-8fad-73846cf8cef9 tempest-VolumesSnapshotTestJSON-366459210 None] Acquiring lock "cinder-39d4c648-859e-42ef-b043-975857102240-delete_volume" by "delete_volume" {{(pid=83528) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 25 16:01:08 devstack cinder-volume[83528]: DEBUG cinder.coordination [None req-cf77ac76-a761-43d0-8fad-73846cf8cef9 tempest-VolumesSnapshotTestJSON-366459210 None] Lock "cinder-39d4c648-859e-42ef-b043-975857102240-delete_volume" acquired by "delete_volume" :: waited 0.012s {{(pid=83528) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 25 16:01:09 devstack cinder-volume[83528]: DEBUG cinder.coordination [None req-cf77ac76-a761-43d0-8fad-73846cf8cef9 tempest-VolumesSnapshotTestJSON-366459210 None] Acquiring lock "cinder-quobyte-39d4c648-859e-42ef-b043-975857102240" by "delete_volume" {{(pid=83528) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 25 16:01:09 devstack cinder-volume[83528]: DEBUG cinder.coordination [None req-cf77ac76-a761-43d0-8fad-73846cf8cef9 tempest-VolumesSnapshotTestJSON-366459210 None] Lock "cinder-quobyte-39d4c648-859e-42ef-b043-975857102240" acquired by "delete_volume" :: waited 0.008s {{(pid=83528) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 25 16:01:09 devstack cinder-volume[83528]: DEBUG oslo.privsep.daemon [-] privsep: reply[38289c08-40a5-4b4a-8c23-0880a63012ea]: (4, 'qcow2') {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 25 16:01:09 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-cf77ac76-a761-43d0-8fad-73846cf8cef9 tempest-VolumesSnapshotTestJSON-366459210 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-39d4c648-859e-42ef-b043-975857102240 {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 25 16:01:09 devstack sudo[90993]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-39d4c648-859e-42ef-b043-975857102240 Feb 25 16:01:09 devstack sudo[90993]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 25 16:01:09 devstack sudo[90993]: pam_unix(sudo:session): session closed for user root Feb 25 16:01:09 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-cf77ac76-a761-43d0-8fad-73846cf8cef9 tempest-VolumesSnapshotTestJSON-366459210 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-39d4c648-859e-42ef-b043-975857102240" returned: 0 in 0.474s {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 25 16:01:09 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-cf77ac76-a761-43d0-8fad-73846cf8cef9 tempest-VolumesSnapshotTestJSON-366459210 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-39d4c648-859e-42ef-b043-975857102240 {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 25 16:01:09 devstack sudo[90998]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-39d4c648-859e-42ef-b043-975857102240 Feb 25 16:01:09 devstack sudo[90998]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 25 16:01:09 devstack sudo[90998]: pam_unix(sudo:session): session closed for user root Feb 25 16:01:09 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-cf77ac76-a761-43d0-8fad-73846cf8cef9 tempest-VolumesSnapshotTestJSON-366459210 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-39d4c648-859e-42ef-b043-975857102240" returned: 0 in 0.417s {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 25 16:01:09 devstack cinder-volume[83528]: DEBUG cinder.coordination [None req-cf77ac76-a761-43d0-8fad-73846cf8cef9 tempest-VolumesSnapshotTestJSON-366459210 None] Lock "cinder-quobyte-39d4c648-859e-42ef-b043-975857102240" released by "delete_volume" :: held 0.921s {{(pid=83528) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 25 16:01:09 devstack cinder-volume[83528]: DEBUG cinder.quota [None req-cf77ac76-a761-43d0-8fad-73846cf8cef9 tempest-VolumesSnapshotTestJSON-366459210 None] Created reservations ['23e7c40b-cd59-4b72-95d0-1b0221f88aa0', 'ff4041dc-91b1-440c-91d8-2e371610984c', '58298263-fd03-437c-b5da-1027ef32d150', 'e22a8116-6764-4558-8464-b177e52c3a02'] {{(pid=83528) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 25 16:01:10 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-cf77ac76-a761-43d0-8fad-73846cf8cef9 tempest-VolumesSnapshotTestJSON-366459210 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 25 16:01:10 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-cf77ac76-a761-43d0-8fad-73846cf8cef9 tempest-VolumesSnapshotTestJSON-366459210 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 25 16:01:10 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.quobyte [None req-cf77ac76-a761-43d0-8fad-73846cf8cef9 tempest-VolumesSnapshotTestJSON-366459210 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23e9d725-3e04-4cd9-bfe0-c8ef43305589': None} {{(pid=83528) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 25 16:01:10 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.quobyte [None req-cf77ac76-a761-43d0-8fad-73846cf8cef9 tempest-VolumesSnapshotTestJSON-366459210 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23e9d725-3e04-4cd9-bfe0-c8ef43305589'] {{(pid=83528) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 25 16:01:10 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-cf77ac76-a761-43d0-8fad-73846cf8cef9 tempest-VolumesSnapshotTestJSON-366459210 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 25 16:01:10 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-cf77ac76-a761-43d0-8fad-73846cf8cef9 tempest-VolumesSnapshotTestJSON-366459210 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85 {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 25 16:01:10 devstack sudo[91001]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85 Feb 25 16:01:10 devstack sudo[91001]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 25 16:01:10 devstack cinder-volume[83528]: DEBUG cinder.coordination [None req-bd96c4db-90f0-4233-8367-68a4def3cc7f tempest-VolumesSnapshotTestJSON-366459210 None] Acquiring lock "cinder-43adb6a3-1353-4860-b1be-374fe78b83bd-delete_snapshot" by "delete_snapshot" {{(pid=83528) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 25 16:01:10 devstack cinder-volume[83528]: DEBUG cinder.coordination [None req-bd96c4db-90f0-4233-8367-68a4def3cc7f tempest-VolumesSnapshotTestJSON-366459210 None] Lock "cinder-43adb6a3-1353-4860-b1be-374fe78b83bd-delete_snapshot" acquired by "delete_snapshot" :: waited 0.016s {{(pid=83528) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 25 16:01:10 devstack cinder-volume[83528]: DEBUG cinder.coordination [None req-bd96c4db-90f0-4233-8367-68a4def3cc7f tempest-VolumesSnapshotTestJSON-366459210 None] Acquiring lock "cinder-quobyte-ab1f4ef7-f652-4d25-852a-50623c94ab11" by "delete_snapshot" {{(pid=83528) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 25 16:01:10 devstack cinder-volume[83528]: DEBUG cinder.coordination [None req-bd96c4db-90f0-4233-8367-68a4def3cc7f tempest-VolumesSnapshotTestJSON-366459210 None] Lock "cinder-quobyte-ab1f4ef7-f652-4d25-852a-50623c94ab11" acquired by "delete_snapshot" :: waited 0.015s {{(pid=83528) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 25 16:01:10 devstack cinder-volume[83528]: DEBUG cinder.coordination [None req-bd96c4db-90f0-4233-8367-68a4def3cc7f tempest-VolumesSnapshotTestJSON-366459210 None] Acquiring lock "cinder-quobyte-43adb6a3-1353-4860-b1be-374fe78b83bd" by "_delete_snapshot" {{(pid=83528) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 25 16:01:10 devstack cinder-volume[83528]: DEBUG cinder.coordination [None req-bd96c4db-90f0-4233-8367-68a4def3cc7f tempest-VolumesSnapshotTestJSON-366459210 None] Lock "cinder-quobyte-43adb6a3-1353-4860-b1be-374fe78b83bd" acquired by "_delete_snapshot" :: waited 0.007s {{(pid=83528) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 25 16:01:10 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.remotefs [None req-bd96c4db-90f0-4233-8367-68a4def3cc7f tempest-VolumesSnapshotTestJSON-366459210 None] Deleting offline snapshot 43adb6a3-1353-4860-b1be-374fe78b83bd of volume ab1f4ef7-f652-4d25-852a-50623c94ab11 {{(pid=83528) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Feb 25 16:01:10 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.remotefs [None req-bd96c4db-90f0-4233-8367-68a4def3cc7f tempest-VolumesSnapshotTestJSON-366459210 None] snapshot_file for this snap is: volume-ab1f4ef7-f652-4d25-852a-50623c94ab11.43adb6a3-1353-4860-b1be-374fe78b83bd {{(pid=83528) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Feb 25 16:01:10 devstack cinder-volume[83528]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a6c9b3e-3d55-497b-a59b-8759379f70fe]: (4, 'qcow2') {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 25 16:01:10 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-bd96c4db-90f0-4233-8367-68a4def3cc7f tempest-VolumesSnapshotTestJSON-366459210 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-ab1f4ef7-f652-4d25-852a-50623c94ab11.43adb6a3-1353-4860-b1be-374fe78b83bd {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 25 16:01:10 devstack sudo[91003]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-ab1f4ef7-f652-4d25-852a-50623c94ab11.43adb6a3-1353-4860-b1be-374fe78b83bd Feb 25 16:01:10 devstack sudo[91003]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 25 16:01:10 devstack sudo[91001]: pam_unix(sudo:session): session closed for user root Feb 25 16:01:10 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-cf77ac76-a761-43d0-8fad-73846cf8cef9 tempest-VolumesSnapshotTestJSON-366459210 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85" returned: 0 in 0.427s {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 25 16:01:10 devstack cinder-volume[83528]: DEBUG cinder.manager [None req-cf77ac76-a761-43d0-8fad-73846cf8cef9 tempest-VolumesSnapshotTestJSON-366459210 None] Notifying Schedulers of capabilities ... {{(pid=83528) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 25 16:01:10 devstack cinder-volume[83528]: INFO cinder.volume.manager [None req-cf77ac76-a761-43d0-8fad-73846cf8cef9 tempest-VolumesSnapshotTestJSON-366459210 None] Deleted volume successfully. Feb 25 16:01:10 devstack cinder-volume[83528]: DEBUG cinder.coordination [None req-cf77ac76-a761-43d0-8fad-73846cf8cef9 tempest-VolumesSnapshotTestJSON-366459210 None] Lock "cinder-39d4c648-859e-42ef-b043-975857102240-delete_volume" released by "delete_volume" :: held 1.504s {{(pid=83528) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 25 16:01:10 devstack sudo[91003]: pam_unix(sudo:session): session closed for user root Feb 25 16:01:10 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-bd96c4db-90f0-4233-8367-68a4def3cc7f tempest-VolumesSnapshotTestJSON-366459210 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-ab1f4ef7-f652-4d25-852a-50623c94ab11.43adb6a3-1353-4860-b1be-374fe78b83bd" returned: 0 in 0.523s {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 25 16:01:10 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.remotefs [None req-bd96c4db-90f0-4233-8367-68a4def3cc7f tempest-VolumesSnapshotTestJSON-366459210 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ab1f4ef7-f652-4d25-852a-50623c94ab11(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83528) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Feb 25 16:01:10 devstack cinder-volume[83528]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8bacbf9-03f9-4670-af8d-fa45fa07145e]: (4, 'qcow2') {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 25 16:01:10 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-bd96c4db-90f0-4233-8367-68a4def3cc7f tempest-VolumesSnapshotTestJSON-366459210 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-ab1f4ef7-f652-4d25-852a-50623c94ab11 {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 25 16:01:10 devstack sudo[91009]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-ab1f4ef7-f652-4d25-852a-50623c94ab11 Feb 25 16:01:10 devstack sudo[91009]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 25 16:01:11 devstack sudo[91009]: pam_unix(sudo:session): session closed for user root Feb 25 16:01:11 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-bd96c4db-90f0-4233-8367-68a4def3cc7f tempest-VolumesSnapshotTestJSON-366459210 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-ab1f4ef7-f652-4d25-852a-50623c94ab11" returned: 0 in 0.457s {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 25 16:01:11 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-bd96c4db-90f0-4233-8367-68a4def3cc7f tempest-VolumesSnapshotTestJSON-366459210 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-ab1f4ef7-f652-4d25-852a-50623c94ab11.43adb6a3-1353-4860-b1be-374fe78b83bd {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 25 16:01:11 devstack sudo[91014]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-ab1f4ef7-f652-4d25-852a-50623c94ab11.43adb6a3-1353-4860-b1be-374fe78b83bd Feb 25 16:01:11 devstack sudo[91014]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 25 16:01:11 devstack sudo[91014]: pam_unix(sudo:session): session closed for user root Feb 25 16:01:11 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-bd96c4db-90f0-4233-8367-68a4def3cc7f tempest-VolumesSnapshotTestJSON-366459210 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-ab1f4ef7-f652-4d25-852a-50623c94ab11.43adb6a3-1353-4860-b1be-374fe78b83bd" returned: 0 in 0.432s {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 25 16:01:11 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-bd96c4db-90f0-4233-8367-68a4def3cc7f tempest-VolumesSnapshotTestJSON-366459210 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-ab1f4ef7-f652-4d25-852a-50623c94ab11.43adb6a3-1353-4860-b1be-374fe78b83bd {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 25 16:01:11 devstack sudo[91019]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-ab1f4ef7-f652-4d25-852a-50623c94ab11.43adb6a3-1353-4860-b1be-374fe78b83bd Feb 25 16:01:11 devstack sudo[91019]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 25 16:01:12 devstack sudo[91019]: pam_unix(sudo:session): session closed for user root Feb 25 16:01:12 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-bd96c4db-90f0-4233-8367-68a4def3cc7f tempest-VolumesSnapshotTestJSON-366459210 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-ab1f4ef7-f652-4d25-852a-50623c94ab11.43adb6a3-1353-4860-b1be-374fe78b83bd" returned: 0 in 0.382s {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 25 16:01:12 devstack cinder-volume[83528]: DEBUG cinder.coordination [None req-bd96c4db-90f0-4233-8367-68a4def3cc7f tempest-VolumesSnapshotTestJSON-366459210 None] Lock "cinder-quobyte-43adb6a3-1353-4860-b1be-374fe78b83bd" released by "_delete_snapshot" :: held 1.848s {{(pid=83528) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 25 16:01:12 devstack cinder-volume[83528]: DEBUG cinder.coordination [None req-bd96c4db-90f0-4233-8367-68a4def3cc7f tempest-VolumesSnapshotTestJSON-366459210 None] Lock "cinder-quobyte-ab1f4ef7-f652-4d25-852a-50623c94ab11" released by "delete_snapshot" :: held 1.859s {{(pid=83528) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 25 16:01:12 devstack cinder-volume[83528]: DEBUG cinder.quota [None req-bd96c4db-90f0-4233-8367-68a4def3cc7f tempest-VolumesSnapshotTestJSON-366459210 None] Created reservations ['2cad25df-1cc1-457e-b223-c249204974fb', 'c0c2f324-88e2-4e45-95df-299e4f5c3575', '132f39e0-7020-4b03-aa9d-4ff48d3f7289', '428055c0-4973-4776-b0e5-fb55507311af'] {{(pid=83528) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 25 16:01:12 devstack cinder-volume[83528]: INFO cinder.volume.manager [None req-bd96c4db-90f0-4233-8367-68a4def3cc7f tempest-VolumesSnapshotTestJSON-366459210 None] Delete snapshot completed successfully. Feb 25 16:01:12 devstack cinder-volume[83528]: DEBUG cinder.coordination [None req-bd96c4db-90f0-4233-8367-68a4def3cc7f tempest-VolumesSnapshotTestJSON-366459210 None] Lock "cinder-43adb6a3-1353-4860-b1be-374fe78b83bd-delete_snapshot" released by "delete_snapshot" :: held 1.941s {{(pid=83528) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 25 16:01:12 devstack cinder-volume[83528]: DEBUG cinder.coordination [None req-f6ab7656-6155-4fea-b660-66944f39942a tempest-VolumesSnapshotTestJSON-366459210 None] Acquiring lock "cinder-ab1f4ef7-f652-4d25-852a-50623c94ab11-delete_volume" by "delete_volume" {{(pid=83528) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 25 16:01:12 devstack cinder-volume[83528]: DEBUG cinder.coordination [None req-f6ab7656-6155-4fea-b660-66944f39942a tempest-VolumesSnapshotTestJSON-366459210 None] Lock "cinder-ab1f4ef7-f652-4d25-852a-50623c94ab11-delete_volume" acquired by "delete_volume" :: waited 0.009s {{(pid=83528) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 25 16:01:12 devstack cinder-volume[83528]: DEBUG cinder.coordination [None req-f6ab7656-6155-4fea-b660-66944f39942a tempest-VolumesSnapshotTestJSON-366459210 None] Acquiring lock "cinder-quobyte-ab1f4ef7-f652-4d25-852a-50623c94ab11" by "delete_volume" {{(pid=83528) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 25 16:01:12 devstack cinder-volume[83528]: DEBUG cinder.coordination [None req-f6ab7656-6155-4fea-b660-66944f39942a tempest-VolumesSnapshotTestJSON-366459210 None] Lock "cinder-quobyte-ab1f4ef7-f652-4d25-852a-50623c94ab11" acquired by "delete_volume" :: waited 0.007s {{(pid=83528) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 25 16:01:12 devstack cinder-volume[83528]: DEBUG oslo.privsep.daemon [-] privsep: reply[577452c6-79e5-4570-9346-bd46f9f25543]: (4, 'qcow2') {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 25 16:01:12 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-f6ab7656-6155-4fea-b660-66944f39942a tempest-VolumesSnapshotTestJSON-366459210 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-ab1f4ef7-f652-4d25-852a-50623c94ab11 {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 25 16:01:12 devstack sudo[91022]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-ab1f4ef7-f652-4d25-852a-50623c94ab11 Feb 25 16:01:12 devstack sudo[91022]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 25 16:01:12 devstack sudo[91022]: pam_unix(sudo:session): session closed for user root Feb 25 16:01:12 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-f6ab7656-6155-4fea-b660-66944f39942a tempest-VolumesSnapshotTestJSON-366459210 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-ab1f4ef7-f652-4d25-852a-50623c94ab11" returned: 0 in 0.475s {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 25 16:01:12 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-f6ab7656-6155-4fea-b660-66944f39942a tempest-VolumesSnapshotTestJSON-366459210 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-ab1f4ef7-f652-4d25-852a-50623c94ab11 {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 25 16:01:12 devstack sudo[91027]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-ab1f4ef7-f652-4d25-852a-50623c94ab11 Feb 25 16:01:12 devstack sudo[91027]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 25 16:01:13 devstack sudo[91027]: pam_unix(sudo:session): session closed for user root Feb 25 16:01:13 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-f6ab7656-6155-4fea-b660-66944f39942a tempest-VolumesSnapshotTestJSON-366459210 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-ab1f4ef7-f652-4d25-852a-50623c94ab11" returned: 0 in 0.420s {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 25 16:01:13 devstack cinder-volume[83528]: DEBUG cinder.coordination [None req-f6ab7656-6155-4fea-b660-66944f39942a tempest-VolumesSnapshotTestJSON-366459210 None] Lock "cinder-quobyte-ab1f4ef7-f652-4d25-852a-50623c94ab11" released by "delete_volume" :: held 0.924s {{(pid=83528) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 25 16:01:13 devstack cinder-volume[83528]: DEBUG cinder.quota [None req-f6ab7656-6155-4fea-b660-66944f39942a tempest-VolumesSnapshotTestJSON-366459210 None] Created reservations ['699b9f28-d7ba-4c10-a801-838d22b05cf8', '2dd8dc3e-a77c-481b-b6c1-9b4e50ac3d51', 'b9755aec-8cf9-4eb0-b8b8-db7291ca0576', 'bda4b5c7-aab6-4f31-9c09-0b8e19baea5f'] {{(pid=83528) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 25 16:01:13 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-f6ab7656-6155-4fea-b660-66944f39942a tempest-VolumesSnapshotTestJSON-366459210 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 25 16:01:13 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-f6ab7656-6155-4fea-b660-66944f39942a tempest-VolumesSnapshotTestJSON-366459210 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 25 16:01:13 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.quobyte [None req-f6ab7656-6155-4fea-b660-66944f39942a tempest-VolumesSnapshotTestJSON-366459210 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23e9d725-3e04-4cd9-bfe0-c8ef43305589': None} {{(pid=83528) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 25 16:01:13 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.quobyte [None req-f6ab7656-6155-4fea-b660-66944f39942a tempest-VolumesSnapshotTestJSON-366459210 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23e9d725-3e04-4cd9-bfe0-c8ef43305589'] {{(pid=83528) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 25 16:01:13 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-f6ab7656-6155-4fea-b660-66944f39942a tempest-VolumesSnapshotTestJSON-366459210 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 25 16:01:13 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-f6ab7656-6155-4fea-b660-66944f39942a tempest-VolumesSnapshotTestJSON-366459210 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85 {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 25 16:01:13 devstack sudo[91070]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85 Feb 25 16:01:13 devstack sudo[91070]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 25 16:01:13 devstack cinder-volume[83528]: DEBUG cinder.coordination [None req-5f50e6d6-4cbd-473d-b8dd-691e80d454c6 tempest-VolumesSnapshotTestJSON-366459210 None] Acquiring lock "cinder-d23be46c-1bc9-4e71-a575-ad3fc427b14a-delete_volume" by "delete_volume" {{(pid=83528) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 25 16:01:13 devstack cinder-volume[83528]: DEBUG cinder.coordination [None req-5f50e6d6-4cbd-473d-b8dd-691e80d454c6 tempest-VolumesSnapshotTestJSON-366459210 None] Lock "cinder-d23be46c-1bc9-4e71-a575-ad3fc427b14a-delete_volume" acquired by "delete_volume" :: waited 0.009s {{(pid=83528) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 25 16:01:13 devstack cinder-volume[83528]: DEBUG cinder.coordination [None req-5f50e6d6-4cbd-473d-b8dd-691e80d454c6 tempest-VolumesSnapshotTestJSON-366459210 None] Acquiring lock "cinder-quobyte-d23be46c-1bc9-4e71-a575-ad3fc427b14a" by "delete_volume" {{(pid=83528) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 25 16:01:13 devstack cinder-volume[83528]: DEBUG cinder.coordination [None req-5f50e6d6-4cbd-473d-b8dd-691e80d454c6 tempest-VolumesSnapshotTestJSON-366459210 None] Lock "cinder-quobyte-d23be46c-1bc9-4e71-a575-ad3fc427b14a" acquired by "delete_volume" :: waited 0.016s {{(pid=83528) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 25 16:01:13 devstack cinder-volume[83528]: DEBUG oslo.privsep.daemon [-] privsep: reply[c840c2ce-5e4b-4363-bb18-921ae8c2837b]: (4, 'qcow2') {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 25 16:01:13 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-5f50e6d6-4cbd-473d-b8dd-691e80d454c6 tempest-VolumesSnapshotTestJSON-366459210 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-d23be46c-1bc9-4e71-a575-ad3fc427b14a {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 25 16:01:13 devstack sudo[91072]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-d23be46c-1bc9-4e71-a575-ad3fc427b14a Feb 25 16:01:13 devstack sudo[91072]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 25 16:01:13 devstack sudo[91070]: pam_unix(sudo:session): session closed for user root Feb 25 16:01:13 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-f6ab7656-6155-4fea-b660-66944f39942a tempest-VolumesSnapshotTestJSON-366459210 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85" returned: 0 in 0.451s {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 25 16:01:13 devstack cinder-volume[83528]: DEBUG cinder.manager [None req-f6ab7656-6155-4fea-b660-66944f39942a tempest-VolumesSnapshotTestJSON-366459210 None] Notifying Schedulers of capabilities ... {{(pid=83528) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 25 16:01:13 devstack cinder-volume[83528]: INFO cinder.volume.manager [None req-f6ab7656-6155-4fea-b660-66944f39942a tempest-VolumesSnapshotTestJSON-366459210 None] Deleted volume successfully. Feb 25 16:01:13 devstack cinder-volume[83528]: DEBUG cinder.coordination [None req-f6ab7656-6155-4fea-b660-66944f39942a tempest-VolumesSnapshotTestJSON-366459210 None] Lock "cinder-ab1f4ef7-f652-4d25-852a-50623c94ab11-delete_volume" released by "delete_volume" :: held 1.553s {{(pid=83528) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 25 16:01:14 devstack sudo[91072]: pam_unix(sudo:session): session closed for user root Feb 25 16:01:14 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-5f50e6d6-4cbd-473d-b8dd-691e80d454c6 tempest-VolumesSnapshotTestJSON-366459210 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-d23be46c-1bc9-4e71-a575-ad3fc427b14a" returned: 0 in 0.478s {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 25 16:01:14 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-5f50e6d6-4cbd-473d-b8dd-691e80d454c6 tempest-VolumesSnapshotTestJSON-366459210 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-d23be46c-1bc9-4e71-a575-ad3fc427b14a {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 25 16:01:14 devstack sudo[91078]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-d23be46c-1bc9-4e71-a575-ad3fc427b14a Feb 25 16:01:14 devstack sudo[91078]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 25 16:01:14 devstack sudo[91078]: pam_unix(sudo:session): session closed for user root Feb 25 16:01:14 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-5f50e6d6-4cbd-473d-b8dd-691e80d454c6 tempest-VolumesSnapshotTestJSON-366459210 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-d23be46c-1bc9-4e71-a575-ad3fc427b14a" returned: 0 in 0.434s {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 25 16:01:14 devstack cinder-volume[83528]: DEBUG cinder.coordination [None req-5f50e6d6-4cbd-473d-b8dd-691e80d454c6 tempest-VolumesSnapshotTestJSON-366459210 None] Lock "cinder-quobyte-d23be46c-1bc9-4e71-a575-ad3fc427b14a" released by "delete_volume" :: held 0.939s {{(pid=83528) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 25 16:01:14 devstack cinder-volume[83528]: DEBUG cinder.quota [None req-5f50e6d6-4cbd-473d-b8dd-691e80d454c6 tempest-VolumesSnapshotTestJSON-366459210 None] Created reservations ['630deed7-3961-41ae-8459-d49dca61da8b', '0c8df51c-9810-4db6-8550-07518969388d', '91fa5d7d-3a5b-40d8-aff6-ce72c92160ea', 'db23449b-d5e9-408b-8fbd-c921657fbbae'] {{(pid=83528) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 25 16:01:14 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-5f50e6d6-4cbd-473d-b8dd-691e80d454c6 tempest-VolumesSnapshotTestJSON-366459210 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 25 16:01:14 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-5f50e6d6-4cbd-473d-b8dd-691e80d454c6 tempest-VolumesSnapshotTestJSON-366459210 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 25 16:01:14 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.quobyte [None req-5f50e6d6-4cbd-473d-b8dd-691e80d454c6 tempest-VolumesSnapshotTestJSON-366459210 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23e9d725-3e04-4cd9-bfe0-c8ef43305589': None} {{(pid=83528) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 25 16:01:14 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.quobyte [None req-5f50e6d6-4cbd-473d-b8dd-691e80d454c6 tempest-VolumesSnapshotTestJSON-366459210 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23e9d725-3e04-4cd9-bfe0-c8ef43305589'] {{(pid=83528) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 25 16:01:14 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-5f50e6d6-4cbd-473d-b8dd-691e80d454c6 tempest-VolumesSnapshotTestJSON-366459210 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 25 16:01:14 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-5f50e6d6-4cbd-473d-b8dd-691e80d454c6 tempest-VolumesSnapshotTestJSON-366459210 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85 {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 25 16:01:14 devstack sudo[91081]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85 Feb 25 16:01:14 devstack sudo[91081]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 25 16:01:14 devstack sudo[91081]: pam_unix(sudo:session): session closed for user root Feb 25 16:01:14 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-5f50e6d6-4cbd-473d-b8dd-691e80d454c6 tempest-VolumesSnapshotTestJSON-366459210 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85" returned: 0 in 0.439s {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 25 16:01:14 devstack cinder-volume[83528]: DEBUG cinder.manager [None req-5f50e6d6-4cbd-473d-b8dd-691e80d454c6 tempest-VolumesSnapshotTestJSON-366459210 None] Notifying Schedulers of capabilities ... {{(pid=83528) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 25 16:01:14 devstack cinder-volume[83528]: INFO cinder.volume.manager [None req-5f50e6d6-4cbd-473d-b8dd-691e80d454c6 tempest-VolumesSnapshotTestJSON-366459210 None] Deleted volume successfully. Feb 25 16:01:15 devstack cinder-volume[83528]: DEBUG cinder.coordination [None req-5f50e6d6-4cbd-473d-b8dd-691e80d454c6 tempest-VolumesSnapshotTestJSON-366459210 None] Lock "cinder-d23be46c-1bc9-4e71-a575-ad3fc427b14a-delete_volume" released by "delete_volume" :: held 1.512s {{(pid=83528) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 25 16:01:18 devstack cinder-volume[83528]: DEBUG cinder.volume.flows.manager.create_volume [None req-10402ab8-682a-403c-aa08-0935c1aced90 tempest-CreateVolumesFromSourceVolumeTest-266281004 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83528) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 25 16:01:18 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-10402ab8-682a-403c-aa08-0935c1aced90 tempest-CreateVolumesFromSourceVolumeTest-266281004 None] Flow 'volume_create_manager' (17d0d44b-2274-461f-987d-131eb44326f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83528) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 25 16:01:18 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-10402ab8-682a-403c-aa08-0935c1aced90 tempest-CreateVolumesFromSourceVolumeTest-266281004 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (195af475-f4b4-4736-a79a-1acb9c1dc469) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 25 16:01:18 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-10402ab8-682a-403c-aa08-0935c1aced90 tempest-CreateVolumesFromSourceVolumeTest-266281004 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (195af475-f4b4-4736-a79a-1acb9c1dc469) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-25T15:01:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1124316007',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d96f7e72-999b-4a90-b9dd-4bebfe18f31a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='106ab724005248ae9d000e2eb8d4549b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-25T15:01:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-25T15:01:18Z,use_quota=True,user_id='cbb515bf1fc24caca5ba844f1cfafe36',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ce71c2f9-6543-4165-9653-a1529b2ea243),volume_type_id=ce71c2f9-6543-4165-9653-a1529b2ea243)' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 25 16:01:18 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-10402ab8-682a-403c-aa08-0935c1aced90 tempest-CreateVolumesFromSourceVolumeTest-266281004 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fce86ea1-c75e-4fe2-9a4a-27ed133d32a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 25 16:01:18 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-10402ab8-682a-403c-aa08-0935c1aced90 tempest-CreateVolumesFromSourceVolumeTest-266281004 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fce86ea1-c75e-4fe2-9a4a-27ed133d32a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 25 16:01:18 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-10402ab8-682a-403c-aa08-0935c1aced90 tempest-CreateVolumesFromSourceVolumeTest-266281004 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (59e076d8-d9af-4ee1-bd31-f719d15dcb53) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 25 16:01:18 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-10402ab8-682a-403c-aa08-0935c1aced90 tempest-CreateVolumesFromSourceVolumeTest-266281004 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (59e076d8-d9af-4ee1-bd31-f719d15dcb53) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd96f7e72-999b-4a90-b9dd-4bebfe18f31a', 'volume_name': 'volume-d96f7e72-999b-4a90-b9dd-4bebfe18f31a', 'volume_size': 1}' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 25 16:01:18 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-10402ab8-682a-403c-aa08-0935c1aced90 tempest-CreateVolumesFromSourceVolumeTest-266281004 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (407565cf-c074-4836-98f9-b92cee95c5e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 25 16:01:18 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-10402ab8-682a-403c-aa08-0935c1aced90 tempest-CreateVolumesFromSourceVolumeTest-266281004 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (407565cf-c074-4836-98f9-b92cee95c5e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 25 16:01:18 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-10402ab8-682a-403c-aa08-0935c1aced90 tempest-CreateVolumesFromSourceVolumeTest-266281004 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (56c431bd-0bfb-4b4f-bd5f-1ad0c27c3451) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 25 16:01:18 devstack cinder-volume[83528]: INFO cinder.volume.flows.manager.create_volume [None req-10402ab8-682a-403c-aa08-0935c1aced90 tempest-CreateVolumesFromSourceVolumeTest-266281004 None] Volume d96f7e72-999b-4a90-b9dd-4bebfe18f31a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d96f7e72-999b-4a90-b9dd-4bebfe18f31a', 'volume_size': 1} Feb 25 16:01:18 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-10402ab8-682a-403c-aa08-0935c1aced90 tempest-CreateVolumesFromSourceVolumeTest-266281004 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 25 16:01:18 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-10402ab8-682a-403c-aa08-0935c1aced90 tempest-CreateVolumesFromSourceVolumeTest-266281004 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 25 16:01:18 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.quobyte [None req-10402ab8-682a-403c-aa08-0935c1aced90 tempest-CreateVolumesFromSourceVolumeTest-266281004 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-25T15:01:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1124316007',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d96f7e72-999b-4a90-b9dd-4bebfe18f31a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='106ab724005248ae9d000e2eb8d4549b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-25T15:01:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-25T15:01:18Z,use_quota=True,user_id='cbb515bf1fc24caca5ba844f1cfafe36',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ce71c2f9-6543-4165-9653-a1529b2ea243),volume_type_id=ce71c2f9-6543-4165-9653-a1529b2ea243)}" {{(pid=83528) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 25 16:01:18 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.remotefs [None req-10402ab8-682a-403c-aa08-0935c1aced90 tempest-CreateVolumesFromSourceVolumeTest-266281004 None] Creating volume d96f7e72-999b-4a90-b9dd-4bebfe18f31a {{(pid=83528) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 25 16:01:18 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-10402ab8-682a-403c-aa08-0935c1aced90 tempest-CreateVolumesFromSourceVolumeTest-266281004 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 25 16:01:18 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-10402ab8-682a-403c-aa08-0935c1aced90 tempest-CreateVolumesFromSourceVolumeTest-266281004 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 25 16:01:18 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.quobyte [None req-10402ab8-682a-403c-aa08-0935c1aced90 tempest-CreateVolumesFromSourceVolumeTest-266281004 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23e9d725-3e04-4cd9-bfe0-c8ef43305589': None} {{(pid=83528) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 25 16:01:18 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.quobyte [None req-10402ab8-682a-403c-aa08-0935c1aced90 tempest-CreateVolumesFromSourceVolumeTest-266281004 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23e9d725-3e04-4cd9-bfe0-c8ef43305589'] {{(pid=83528) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 25 16:01:18 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-10402ab8-682a-403c-aa08-0935c1aced90 tempest-CreateVolumesFromSourceVolumeTest-266281004 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 25 16:01:18 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.quobyte [None req-10402ab8-682a-403c-aa08-0935c1aced90 tempest-CreateVolumesFromSourceVolumeTest-266281004 None] Selected osci02.corp.quobyte.com/cinder-vol-23e9d725-3e04-4cd9-bfe0-c8ef43305589 as target Quobyte volume. {{(pid=83528) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 25 16:01:18 devstack cinder-volume[83528]: INFO cinder.volume.drivers.remotefs [None req-10402ab8-682a-403c-aa08-0935c1aced90 tempest-CreateVolumesFromSourceVolumeTest-266281004 None] casted to osci02.corp.quobyte.com/cinder-vol-23e9d725-3e04-4cd9-bfe0-c8ef43305589 Feb 25 16:01:18 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-10402ab8-682a-403c-aa08-0935c1aced90 tempest-CreateVolumesFromSourceVolumeTest-266281004 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-d96f7e72-999b-4a90-b9dd-4bebfe18f31a 1073741824 {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 25 16:01:18 devstack sudo[91089]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-d96f7e72-999b-4a90-b9dd-4bebfe18f31a 1073741824 Feb 25 16:01:18 devstack sudo[91089]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 25 16:01:18 devstack sudo[91089]: pam_unix(sudo:session): session closed for user root Feb 25 16:01:18 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-10402ab8-682a-403c-aa08-0935c1aced90 tempest-CreateVolumesFromSourceVolumeTest-266281004 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-d96f7e72-999b-4a90-b9dd-4bebfe18f31a 1073741824" returned: 0 in 0.528s {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 25 16:01:19 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-10402ab8-682a-403c-aa08-0935c1aced90 tempest-CreateVolumesFromSourceVolumeTest-266281004 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-d96f7e72-999b-4a90-b9dd-4bebfe18f31a {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 25 16:01:19 devstack sudo[91094]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-d96f7e72-999b-4a90-b9dd-4bebfe18f31a Feb 25 16:01:19 devstack sudo[91094]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 25 16:01:19 devstack sudo[91094]: pam_unix(sudo:session): session closed for user root Feb 25 16:01:19 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-10402ab8-682a-403c-aa08-0935c1aced90 tempest-CreateVolumesFromSourceVolumeTest-266281004 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-d96f7e72-999b-4a90-b9dd-4bebfe18f31a" returned: 0 in 0.434s {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 25 16:01:19 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.quobyte [None req-10402ab8-682a-403c-aa08-0935c1aced90 tempest-CreateVolumesFromSourceVolumeTest-266281004 None] <== create_volume: return (992ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-23e9d725-3e04-4cd9-bfe0-c8ef43305589'} {{(pid=83528) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 25 16:01:19 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-10402ab8-682a-403c-aa08-0935c1aced90 tempest-CreateVolumesFromSourceVolumeTest-266281004 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.994s {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 25 16:01:19 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-10402ab8-682a-403c-aa08-0935c1aced90 tempest-CreateVolumesFromSourceVolumeTest-266281004 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (56c431bd-0bfb-4b4f-bd5f-1ad0c27c3451) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d96f7e72-999b-4a90-b9dd-4bebfe18f31a', 'volume_size': 1}' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 25 16:01:19 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-10402ab8-682a-403c-aa08-0935c1aced90 tempest-CreateVolumesFromSourceVolumeTest-266281004 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (04d109d5-d143-4199-b763-b91eba228424) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 25 16:01:19 devstack cinder-volume[83528]: INFO cinder.volume.flows.manager.create_volume [None req-10402ab8-682a-403c-aa08-0935c1aced90 tempest-CreateVolumesFromSourceVolumeTest-266281004 None] Volume volume-d96f7e72-999b-4a90-b9dd-4bebfe18f31a (d96f7e72-999b-4a90-b9dd-4bebfe18f31a): created successfully Feb 25 16:01:19 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-10402ab8-682a-403c-aa08-0935c1aced90 tempest-CreateVolumesFromSourceVolumeTest-266281004 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (04d109d5-d143-4199-b763-b91eba228424) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 25 16:01:19 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-10402ab8-682a-403c-aa08-0935c1aced90 tempest-CreateVolumesFromSourceVolumeTest-266281004 None] Flow 'volume_create_manager' (17d0d44b-2274-461f-987d-131eb44326f2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83528) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 25 16:01:19 devstack cinder-volume[83528]: INFO cinder.volume.manager [None req-10402ab8-682a-403c-aa08-0935c1aced90 tempest-CreateVolumesFromSourceVolumeTest-266281004 None] Created volume successfully. Feb 25 16:01:20 devstack cinder-volume[83528]: DEBUG cinder.volume.flows.manager.create_volume [None req-18f72e6c-395d-4d39-80bc-c3e7cad44098 tempest-CreateVolumesFromSourceVolumeTest-266281004 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83528) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 25 16:01:20 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-18f72e6c-395d-4d39-80bc-c3e7cad44098 tempest-CreateVolumesFromSourceVolumeTest-266281004 None] Flow 'volume_create_manager' (2ab81f34-b53c-4dbd-a480-5138186d0813) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83528) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 25 16:01:20 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-18f72e6c-395d-4d39-80bc-c3e7cad44098 tempest-CreateVolumesFromSourceVolumeTest-266281004 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d6016859-280b-4cd1-8280-28e9e815261b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 25 16:01:20 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-18f72e6c-395d-4d39-80bc-c3e7cad44098 tempest-CreateVolumesFromSourceVolumeTest-266281004 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d6016859-280b-4cd1-8280-28e9e815261b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-25T15:01:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-393437063',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7c9943d0-c4cb-4aa5-9c9e-4c5d97989a47,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='106ab724005248ae9d000e2eb8d4549b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-25T15:01:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-25T15:01:21Z,use_quota=True,user_id='cbb515bf1fc24caca5ba844f1cfafe36',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ce71c2f9-6543-4165-9653-a1529b2ea243),volume_type_id=ce71c2f9-6543-4165-9653-a1529b2ea243)' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 25 16:01:20 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-18f72e6c-395d-4d39-80bc-c3e7cad44098 tempest-CreateVolumesFromSourceVolumeTest-266281004 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (93730256-37f4-4f47-83f7-84cb7aeb42c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 25 16:01:20 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-18f72e6c-395d-4d39-80bc-c3e7cad44098 tempest-CreateVolumesFromSourceVolumeTest-266281004 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (93730256-37f4-4f47-83f7-84cb7aeb42c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 25 16:01:20 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-18f72e6c-395d-4d39-80bc-c3e7cad44098 tempest-CreateVolumesFromSourceVolumeTest-266281004 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (adfdabbc-2062-4b2d-98ab-4cc484b6ad88) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 25 16:01:20 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-18f72e6c-395d-4d39-80bc-c3e7cad44098 tempest-CreateVolumesFromSourceVolumeTest-266281004 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (adfdabbc-2062-4b2d-98ab-4cc484b6ad88) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7c9943d0-c4cb-4aa5-9c9e-4c5d97989a47', 'volume_name': 'volume-7c9943d0-c4cb-4aa5-9c9e-4c5d97989a47', 'volume_size': 1}' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 25 16:01:20 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-18f72e6c-395d-4d39-80bc-c3e7cad44098 tempest-CreateVolumesFromSourceVolumeTest-266281004 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f388a550-e2e5-470e-b56f-a24732a71397) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 25 16:01:20 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-18f72e6c-395d-4d39-80bc-c3e7cad44098 tempest-CreateVolumesFromSourceVolumeTest-266281004 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f388a550-e2e5-470e-b56f-a24732a71397) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 25 16:01:20 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-18f72e6c-395d-4d39-80bc-c3e7cad44098 tempest-CreateVolumesFromSourceVolumeTest-266281004 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c8171775-a4a4-4408-9ee5-b44ef05537d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 25 16:01:20 devstack cinder-volume[83528]: INFO cinder.volume.flows.manager.create_volume [None req-18f72e6c-395d-4d39-80bc-c3e7cad44098 tempest-CreateVolumesFromSourceVolumeTest-266281004 None] Volume 7c9943d0-c4cb-4aa5-9c9e-4c5d97989a47: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7c9943d0-c4cb-4aa5-9c9e-4c5d97989a47', 'volume_size': 1} Feb 25 16:01:20 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-18f72e6c-395d-4d39-80bc-c3e7cad44098 tempest-CreateVolumesFromSourceVolumeTest-266281004 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 25 16:01:20 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-18f72e6c-395d-4d39-80bc-c3e7cad44098 tempest-CreateVolumesFromSourceVolumeTest-266281004 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 25 16:01:20 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.quobyte [None req-18f72e6c-395d-4d39-80bc-c3e7cad44098 tempest-CreateVolumesFromSourceVolumeTest-266281004 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-25T15:01:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-393437063',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7c9943d0-c4cb-4aa5-9c9e-4c5d97989a47,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='106ab724005248ae9d000e2eb8d4549b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-25T15:01:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-25T15:01:21Z,use_quota=True,user_id='cbb515bf1fc24caca5ba844f1cfafe36',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ce71c2f9-6543-4165-9653-a1529b2ea243),volume_type_id=ce71c2f9-6543-4165-9653-a1529b2ea243)}" {{(pid=83528) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 25 16:01:20 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.remotefs [None req-18f72e6c-395d-4d39-80bc-c3e7cad44098 tempest-CreateVolumesFromSourceVolumeTest-266281004 None] Creating volume 7c9943d0-c4cb-4aa5-9c9e-4c5d97989a47 {{(pid=83528) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 25 16:01:20 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-18f72e6c-395d-4d39-80bc-c3e7cad44098 tempest-CreateVolumesFromSourceVolumeTest-266281004 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 25 16:01:20 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-18f72e6c-395d-4d39-80bc-c3e7cad44098 tempest-CreateVolumesFromSourceVolumeTest-266281004 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 25 16:01:20 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.quobyte [None req-18f72e6c-395d-4d39-80bc-c3e7cad44098 tempest-CreateVolumesFromSourceVolumeTest-266281004 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23e9d725-3e04-4cd9-bfe0-c8ef43305589': None} {{(pid=83528) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 25 16:01:20 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.quobyte [None req-18f72e6c-395d-4d39-80bc-c3e7cad44098 tempest-CreateVolumesFromSourceVolumeTest-266281004 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23e9d725-3e04-4cd9-bfe0-c8ef43305589'] {{(pid=83528) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 25 16:01:20 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-18f72e6c-395d-4d39-80bc-c3e7cad44098 tempest-CreateVolumesFromSourceVolumeTest-266281004 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 25 16:01:20 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.quobyte [None req-18f72e6c-395d-4d39-80bc-c3e7cad44098 tempest-CreateVolumesFromSourceVolumeTest-266281004 None] Selected osci02.corp.quobyte.com/cinder-vol-23e9d725-3e04-4cd9-bfe0-c8ef43305589 as target Quobyte volume. {{(pid=83528) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 25 16:01:20 devstack cinder-volume[83528]: INFO cinder.volume.drivers.remotefs [None req-18f72e6c-395d-4d39-80bc-c3e7cad44098 tempest-CreateVolumesFromSourceVolumeTest-266281004 None] casted to osci02.corp.quobyte.com/cinder-vol-23e9d725-3e04-4cd9-bfe0-c8ef43305589 Feb 25 16:01:20 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-18f72e6c-395d-4d39-80bc-c3e7cad44098 tempest-CreateVolumesFromSourceVolumeTest-266281004 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-7c9943d0-c4cb-4aa5-9c9e-4c5d97989a47 1073741824 {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 25 16:01:20 devstack sudo[91097]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-7c9943d0-c4cb-4aa5-9c9e-4c5d97989a47 1073741824 Feb 25 16:01:20 devstack sudo[91097]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 25 16:01:20 devstack cinder-volume[83528]: DEBUG cinder.volume.flows.manager.create_volume [None req-b723c7da-b543-463b-8478-92993d42c1c0 tempest-CreateVolumesFromSourceVolumeTest-266281004 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83528) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 25 16:01:21 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-b723c7da-b543-463b-8478-92993d42c1c0 tempest-CreateVolumesFromSourceVolumeTest-266281004 None] Flow 'volume_create_manager' (b08dc89a-1a94-4d6d-941a-8630470314e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83528) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 25 16:01:21 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-b723c7da-b543-463b-8478-92993d42c1c0 tempest-CreateVolumesFromSourceVolumeTest-266281004 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3152a41a-e01e-4235-a8a2-04554799b2fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 25 16:01:21 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-b723c7da-b543-463b-8478-92993d42c1c0 tempest-CreateVolumesFromSourceVolumeTest-266281004 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3152a41a-e01e-4235-a8a2-04554799b2fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-25T15:01:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-995452135',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=550cb990-4941-4eb2-9c48-a8cdd7d86546,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='106ab724005248ae9d000e2eb8d4549b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-25T15:01:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-25T15:01:21Z,use_quota=True,user_id='cbb515bf1fc24caca5ba844f1cfafe36',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ce71c2f9-6543-4165-9653-a1529b2ea243),volume_type_id=ce71c2f9-6543-4165-9653-a1529b2ea243)' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 25 16:01:21 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-b723c7da-b543-463b-8478-92993d42c1c0 tempest-CreateVolumesFromSourceVolumeTest-266281004 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4c188fc1-2f24-4f54-b6ea-a09274b3c21c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 25 16:01:21 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-b723c7da-b543-463b-8478-92993d42c1c0 tempest-CreateVolumesFromSourceVolumeTest-266281004 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4c188fc1-2f24-4f54-b6ea-a09274b3c21c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 25 16:01:21 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-b723c7da-b543-463b-8478-92993d42c1c0 tempest-CreateVolumesFromSourceVolumeTest-266281004 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3ae43207-f3af-4ed1-b2dd-52902c22d334) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 25 16:01:21 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-b723c7da-b543-463b-8478-92993d42c1c0 tempest-CreateVolumesFromSourceVolumeTest-266281004 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3ae43207-f3af-4ed1-b2dd-52902c22d334) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '550cb990-4941-4eb2-9c48-a8cdd7d86546', 'volume_name': 'volume-550cb990-4941-4eb2-9c48-a8cdd7d86546', 'volume_size': 1}' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 25 16:01:21 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-b723c7da-b543-463b-8478-92993d42c1c0 tempest-CreateVolumesFromSourceVolumeTest-266281004 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (35f7ca59-7665-4913-a93f-a07e364a48ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 25 16:01:21 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-b723c7da-b543-463b-8478-92993d42c1c0 tempest-CreateVolumesFromSourceVolumeTest-266281004 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (35f7ca59-7665-4913-a93f-a07e364a48ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 25 16:01:21 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-b723c7da-b543-463b-8478-92993d42c1c0 tempest-CreateVolumesFromSourceVolumeTest-266281004 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (deb97f15-d65c-43e0-9354-aa084825df65) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 25 16:01:21 devstack cinder-volume[83528]: INFO cinder.volume.flows.manager.create_volume [None req-b723c7da-b543-463b-8478-92993d42c1c0 tempest-CreateVolumesFromSourceVolumeTest-266281004 None] Volume 550cb990-4941-4eb2-9c48-a8cdd7d86546: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-550cb990-4941-4eb2-9c48-a8cdd7d86546', 'volume_size': 1} Feb 25 16:01:21 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-b723c7da-b543-463b-8478-92993d42c1c0 tempest-CreateVolumesFromSourceVolumeTest-266281004 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 25 16:01:21 devstack cinder-volume[83528]: DEBUG cinder.volume.flows.manager.create_volume [None req-7df86ea8-aee7-4a2d-9ab7-a292fcf47190 tempest-CreateVolumesFromSourceVolumeTest-266281004 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83528) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 25 16:01:21 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-7df86ea8-aee7-4a2d-9ab7-a292fcf47190 tempest-CreateVolumesFromSourceVolumeTest-266281004 None] Flow 'volume_create_manager' (90daf1af-2971-4ff1-b4c0-7f975dd3b776) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83528) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 25 16:01:21 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-7df86ea8-aee7-4a2d-9ab7-a292fcf47190 tempest-CreateVolumesFromSourceVolumeTest-266281004 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9c5d45f3-3e17-4694-99e9-7aed582eabac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 25 16:01:21 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-7df86ea8-aee7-4a2d-9ab7-a292fcf47190 tempest-CreateVolumesFromSourceVolumeTest-266281004 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9c5d45f3-3e17-4694-99e9-7aed582eabac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-25T15:01:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-2091542927',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=105b0a56-9983-488e-ac6b-e2e3ab295692,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='106ab724005248ae9d000e2eb8d4549b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-25T15:01:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-25T15:01:21Z,use_quota=True,user_id='cbb515bf1fc24caca5ba844f1cfafe36',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ce71c2f9-6543-4165-9653-a1529b2ea243),volume_type_id=ce71c2f9-6543-4165-9653-a1529b2ea243)' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 25 16:01:21 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-7df86ea8-aee7-4a2d-9ab7-a292fcf47190 tempest-CreateVolumesFromSourceVolumeTest-266281004 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (19ede9a1-0f19-4445-bdfb-9657c849b07e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 25 16:01:21 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-7df86ea8-aee7-4a2d-9ab7-a292fcf47190 tempest-CreateVolumesFromSourceVolumeTest-266281004 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (19ede9a1-0f19-4445-bdfb-9657c849b07e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 25 16:01:21 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-7df86ea8-aee7-4a2d-9ab7-a292fcf47190 tempest-CreateVolumesFromSourceVolumeTest-266281004 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0ae7179b-5c80-499e-a0e4-e84a3dc542bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 25 16:01:21 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-7df86ea8-aee7-4a2d-9ab7-a292fcf47190 tempest-CreateVolumesFromSourceVolumeTest-266281004 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0ae7179b-5c80-499e-a0e4-e84a3dc542bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '105b0a56-9983-488e-ac6b-e2e3ab295692', 'volume_name': 'volume-105b0a56-9983-488e-ac6b-e2e3ab295692', 'volume_size': 1}' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 25 16:01:21 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-7df86ea8-aee7-4a2d-9ab7-a292fcf47190 tempest-CreateVolumesFromSourceVolumeTest-266281004 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (389e06d4-a422-4f12-b66e-584b7d563a66) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 25 16:01:21 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-7df86ea8-aee7-4a2d-9ab7-a292fcf47190 tempest-CreateVolumesFromSourceVolumeTest-266281004 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (389e06d4-a422-4f12-b66e-584b7d563a66) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 25 16:01:21 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-7df86ea8-aee7-4a2d-9ab7-a292fcf47190 tempest-CreateVolumesFromSourceVolumeTest-266281004 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c040d089-de6e-4cb0-8dcc-850fdd5ca9e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 25 16:01:21 devstack cinder-volume[83528]: INFO cinder.volume.flows.manager.create_volume [None req-7df86ea8-aee7-4a2d-9ab7-a292fcf47190 tempest-CreateVolumesFromSourceVolumeTest-266281004 None] Volume 105b0a56-9983-488e-ac6b-e2e3ab295692: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-105b0a56-9983-488e-ac6b-e2e3ab295692', 'volume_size': 1} Feb 25 16:01:21 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-7df86ea8-aee7-4a2d-9ab7-a292fcf47190 tempest-CreateVolumesFromSourceVolumeTest-266281004 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 25 16:01:21 devstack cinder-volume[83528]: DEBUG cinder.volume.flows.manager.create_volume [None req-5664037a-f92d-4dea-8fa6-6ae3db3169c8 tempest-CreateVolumesFromSourceVolumeTest-266281004 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83528) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 25 16:01:21 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-5664037a-f92d-4dea-8fa6-6ae3db3169c8 tempest-CreateVolumesFromSourceVolumeTest-266281004 None] Flow 'volume_create_manager' (458aa90a-8f06-491e-bc7f-6d815267d03b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83528) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 25 16:01:21 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-5664037a-f92d-4dea-8fa6-6ae3db3169c8 tempest-CreateVolumesFromSourceVolumeTest-266281004 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c7dfb560-bb7d-4b47-a848-da0004aa595c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 25 16:01:21 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-5664037a-f92d-4dea-8fa6-6ae3db3169c8 tempest-CreateVolumesFromSourceVolumeTest-266281004 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c7dfb560-bb7d-4b47-a848-da0004aa595c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-25T15:01:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-79128301',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e6034794-3ad3-4c58-956f-994547e1e8ca,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='106ab724005248ae9d000e2eb8d4549b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-25T15:01:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-25T15:01:21Z,use_quota=True,user_id='cbb515bf1fc24caca5ba844f1cfafe36',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ce71c2f9-6543-4165-9653-a1529b2ea243),volume_type_id=ce71c2f9-6543-4165-9653-a1529b2ea243)' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 25 16:01:21 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-5664037a-f92d-4dea-8fa6-6ae3db3169c8 tempest-CreateVolumesFromSourceVolumeTest-266281004 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d9a77d7e-cc50-4a8e-a898-765efb94676f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 25 16:01:21 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-5664037a-f92d-4dea-8fa6-6ae3db3169c8 tempest-CreateVolumesFromSourceVolumeTest-266281004 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d9a77d7e-cc50-4a8e-a898-765efb94676f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 25 16:01:21 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-5664037a-f92d-4dea-8fa6-6ae3db3169c8 tempest-CreateVolumesFromSourceVolumeTest-266281004 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4aa6484d-55dd-4d5b-8000-39a24aababb1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 25 16:01:21 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-5664037a-f92d-4dea-8fa6-6ae3db3169c8 tempest-CreateVolumesFromSourceVolumeTest-266281004 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4aa6484d-55dd-4d5b-8000-39a24aababb1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e6034794-3ad3-4c58-956f-994547e1e8ca', 'volume_name': 'volume-e6034794-3ad3-4c58-956f-994547e1e8ca', 'volume_size': 1}' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 25 16:01:21 devstack sudo[91097]: pam_unix(sudo:session): session closed for user root Feb 25 16:01:21 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-5664037a-f92d-4dea-8fa6-6ae3db3169c8 tempest-CreateVolumesFromSourceVolumeTest-266281004 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6519e13f-c404-425c-9c27-b56febcf53f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 25 16:01:21 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-5664037a-f92d-4dea-8fa6-6ae3db3169c8 tempest-CreateVolumesFromSourceVolumeTest-266281004 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6519e13f-c404-425c-9c27-b56febcf53f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 25 16:01:21 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-5664037a-f92d-4dea-8fa6-6ae3db3169c8 tempest-CreateVolumesFromSourceVolumeTest-266281004 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2072b5f8-d945-45d5-b70e-875e577f93ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 25 16:01:21 devstack cinder-volume[83528]: INFO cinder.volume.flows.manager.create_volume [None req-5664037a-f92d-4dea-8fa6-6ae3db3169c8 tempest-CreateVolumesFromSourceVolumeTest-266281004 None] Volume e6034794-3ad3-4c58-956f-994547e1e8ca: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e6034794-3ad3-4c58-956f-994547e1e8ca', 'volume_size': 1} Feb 25 16:01:21 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-5664037a-f92d-4dea-8fa6-6ae3db3169c8 tempest-CreateVolumesFromSourceVolumeTest-266281004 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 25 16:01:21 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-18f72e6c-395d-4d39-80bc-c3e7cad44098 tempest-CreateVolumesFromSourceVolumeTest-266281004 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-7c9943d0-c4cb-4aa5-9c9e-4c5d97989a47 1073741824" returned: 0 in 0.646s {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 25 16:01:21 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-18f72e6c-395d-4d39-80bc-c3e7cad44098 tempest-CreateVolumesFromSourceVolumeTest-266281004 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-7c9943d0-c4cb-4aa5-9c9e-4c5d97989a47 {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 25 16:01:21 devstack sudo[91102]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-7c9943d0-c4cb-4aa5-9c9e-4c5d97989a47 Feb 25 16:01:21 devstack sudo[91102]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 25 16:01:21 devstack cinder-volume[83528]: DEBUG cinder.volume.flows.manager.create_volume [None req-7bb2c9ca-d9a0-4560-b782-e102b77f4ef5 tempest-CreateVolumesFromSourceVolumeTest-266281004 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83528) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 25 16:01:21 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-7bb2c9ca-d9a0-4560-b782-e102b77f4ef5 tempest-CreateVolumesFromSourceVolumeTest-266281004 None] Flow 'volume_create_manager' (2cf00563-d50f-4365-b417-e6eaccf421c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83528) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 25 16:01:21 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-7bb2c9ca-d9a0-4560-b782-e102b77f4ef5 tempest-CreateVolumesFromSourceVolumeTest-266281004 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e559b9c2-1e5e-40f7-b731-32e9576ef1a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 25 16:01:21 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-7bb2c9ca-d9a0-4560-b782-e102b77f4ef5 tempest-CreateVolumesFromSourceVolumeTest-266281004 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e559b9c2-1e5e-40f7-b731-32e9576ef1a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-25T15:01:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1845902354',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a32b5ff5-ce20-4ddb-9443-ddbf66a88f9d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='106ab724005248ae9d000e2eb8d4549b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-25T15:01:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-25T15:01:22Z,use_quota=True,user_id='cbb515bf1fc24caca5ba844f1cfafe36',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ce71c2f9-6543-4165-9653-a1529b2ea243),volume_type_id=ce71c2f9-6543-4165-9653-a1529b2ea243)' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 25 16:01:21 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-7bb2c9ca-d9a0-4560-b782-e102b77f4ef5 tempest-CreateVolumesFromSourceVolumeTest-266281004 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d4b0db7a-cc19-4a74-b722-416cd6bb65f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 25 16:01:21 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-7bb2c9ca-d9a0-4560-b782-e102b77f4ef5 tempest-CreateVolumesFromSourceVolumeTest-266281004 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d4b0db7a-cc19-4a74-b722-416cd6bb65f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 25 16:01:21 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-7bb2c9ca-d9a0-4560-b782-e102b77f4ef5 tempest-CreateVolumesFromSourceVolumeTest-266281004 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ed7fd1c8-06ca-4cbf-ad08-566c66990b80) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 25 16:01:21 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-7bb2c9ca-d9a0-4560-b782-e102b77f4ef5 tempest-CreateVolumesFromSourceVolumeTest-266281004 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ed7fd1c8-06ca-4cbf-ad08-566c66990b80) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a32b5ff5-ce20-4ddb-9443-ddbf66a88f9d', 'volume_name': 'volume-a32b5ff5-ce20-4ddb-9443-ddbf66a88f9d', 'volume_size': 1}' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 25 16:01:21 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-7bb2c9ca-d9a0-4560-b782-e102b77f4ef5 tempest-CreateVolumesFromSourceVolumeTest-266281004 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (897cd866-1c05-4488-a2ef-92db2eb01c63) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 25 16:01:21 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-7bb2c9ca-d9a0-4560-b782-e102b77f4ef5 tempest-CreateVolumesFromSourceVolumeTest-266281004 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (897cd866-1c05-4488-a2ef-92db2eb01c63) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 25 16:01:21 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-7bb2c9ca-d9a0-4560-b782-e102b77f4ef5 tempest-CreateVolumesFromSourceVolumeTest-266281004 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e11fc7ec-1913-410d-a6f3-f82d4a9c38e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 25 16:01:21 devstack cinder-volume[83528]: INFO cinder.volume.flows.manager.create_volume [None req-7bb2c9ca-d9a0-4560-b782-e102b77f4ef5 tempest-CreateVolumesFromSourceVolumeTest-266281004 None] Volume a32b5ff5-ce20-4ddb-9443-ddbf66a88f9d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a32b5ff5-ce20-4ddb-9443-ddbf66a88f9d', 'volume_size': 1} Feb 25 16:01:21 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-7bb2c9ca-d9a0-4560-b782-e102b77f4ef5 tempest-CreateVolumesFromSourceVolumeTest-266281004 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 25 16:01:21 devstack sudo[91102]: pam_unix(sudo:session): session closed for user root Feb 25 16:01:21 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-18f72e6c-395d-4d39-80bc-c3e7cad44098 tempest-CreateVolumesFromSourceVolumeTest-266281004 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-7c9943d0-c4cb-4aa5-9c9e-4c5d97989a47" returned: 0 in 0.410s {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 25 16:01:21 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.quobyte [None req-18f72e6c-395d-4d39-80bc-c3e7cad44098 tempest-CreateVolumesFromSourceVolumeTest-266281004 None] <== create_volume: return (1090ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-23e9d725-3e04-4cd9-bfe0-c8ef43305589'} {{(pid=83528) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 25 16:01:21 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-18f72e6c-395d-4d39-80bc-c3e7cad44098 tempest-CreateVolumesFromSourceVolumeTest-266281004 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.093s {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 25 16:01:21 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-b723c7da-b543-463b-8478-92993d42c1c0 tempest-CreateVolumesFromSourceVolumeTest-266281004 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.893s {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 25 16:01:21 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.quobyte [None req-b723c7da-b543-463b-8478-92993d42c1c0 tempest-CreateVolumesFromSourceVolumeTest-266281004 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-25T15:01:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-995452135',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=550cb990-4941-4eb2-9c48-a8cdd7d86546,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='106ab724005248ae9d000e2eb8d4549b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-25T15:01:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-25T15:01:21Z,use_quota=True,user_id='cbb515bf1fc24caca5ba844f1cfafe36',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ce71c2f9-6543-4165-9653-a1529b2ea243),volume_type_id=ce71c2f9-6543-4165-9653-a1529b2ea243)}" {{(pid=83528) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 25 16:01:21 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.remotefs [None req-b723c7da-b543-463b-8478-92993d42c1c0 tempest-CreateVolumesFromSourceVolumeTest-266281004 None] Creating volume 550cb990-4941-4eb2-9c48-a8cdd7d86546 {{(pid=83528) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 25 16:01:21 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-b723c7da-b543-463b-8478-92993d42c1c0 tempest-CreateVolumesFromSourceVolumeTest-266281004 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 25 16:01:21 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-b723c7da-b543-463b-8478-92993d42c1c0 tempest-CreateVolumesFromSourceVolumeTest-266281004 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 25 16:01:21 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.quobyte [None req-b723c7da-b543-463b-8478-92993d42c1c0 tempest-CreateVolumesFromSourceVolumeTest-266281004 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23e9d725-3e04-4cd9-bfe0-c8ef43305589': None} {{(pid=83528) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 25 16:01:21 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.quobyte [None req-b723c7da-b543-463b-8478-92993d42c1c0 tempest-CreateVolumesFromSourceVolumeTest-266281004 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23e9d725-3e04-4cd9-bfe0-c8ef43305589'] {{(pid=83528) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 25 16:01:21 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-b723c7da-b543-463b-8478-92993d42c1c0 tempest-CreateVolumesFromSourceVolumeTest-266281004 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 25 16:01:21 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.quobyte [None req-b723c7da-b543-463b-8478-92993d42c1c0 tempest-CreateVolumesFromSourceVolumeTest-266281004 None] Selected osci02.corp.quobyte.com/cinder-vol-23e9d725-3e04-4cd9-bfe0-c8ef43305589 as target Quobyte volume. {{(pid=83528) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 25 16:01:21 devstack cinder-volume[83528]: INFO cinder.volume.drivers.remotefs [None req-b723c7da-b543-463b-8478-92993d42c1c0 tempest-CreateVolumesFromSourceVolumeTest-266281004 None] casted to osci02.corp.quobyte.com/cinder-vol-23e9d725-3e04-4cd9-bfe0-c8ef43305589 Feb 25 16:01:21 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-b723c7da-b543-463b-8478-92993d42c1c0 tempest-CreateVolumesFromSourceVolumeTest-266281004 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-550cb990-4941-4eb2-9c48-a8cdd7d86546 1073741824 {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 25 16:01:21 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-18f72e6c-395d-4d39-80bc-c3e7cad44098 tempest-CreateVolumesFromSourceVolumeTest-266281004 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c8171775-a4a4-4408-9ee5-b44ef05537d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7c9943d0-c4cb-4aa5-9c9e-4c5d97989a47', 'volume_size': 1}' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 25 16:01:21 devstack sudo[91105]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-550cb990-4941-4eb2-9c48-a8cdd7d86546 1073741824 Feb 25 16:01:21 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-18f72e6c-395d-4d39-80bc-c3e7cad44098 tempest-CreateVolumesFromSourceVolumeTest-266281004 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d64b0c9c-68e2-4e2c-b858-eac30d5197c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 25 16:01:21 devstack sudo[91105]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 25 16:01:21 devstack cinder-volume[83528]: INFO cinder.volume.flows.manager.create_volume [None req-18f72e6c-395d-4d39-80bc-c3e7cad44098 tempest-CreateVolumesFromSourceVolumeTest-266281004 None] Volume volume-7c9943d0-c4cb-4aa5-9c9e-4c5d97989a47 (7c9943d0-c4cb-4aa5-9c9e-4c5d97989a47): created successfully Feb 25 16:01:22 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-18f72e6c-395d-4d39-80bc-c3e7cad44098 tempest-CreateVolumesFromSourceVolumeTest-266281004 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d64b0c9c-68e2-4e2c-b858-eac30d5197c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 25 16:01:22 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-18f72e6c-395d-4d39-80bc-c3e7cad44098 tempest-CreateVolumesFromSourceVolumeTest-266281004 None] Flow 'volume_create_manager' (2ab81f34-b53c-4dbd-a480-5138186d0813) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83528) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 25 16:01:22 devstack cinder-volume[83528]: INFO cinder.volume.manager [None req-18f72e6c-395d-4d39-80bc-c3e7cad44098 tempest-CreateVolumesFromSourceVolumeTest-266281004 None] Created volume successfully. Feb 25 16:01:22 devstack sudo[91105]: pam_unix(sudo:session): session closed for user root Feb 25 16:01:22 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-b723c7da-b543-463b-8478-92993d42c1c0 tempest-CreateVolumesFromSourceVolumeTest-266281004 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-550cb990-4941-4eb2-9c48-a8cdd7d86546 1073741824" returned: 0 in 0.522s {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 25 16:01:22 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-b723c7da-b543-463b-8478-92993d42c1c0 tempest-CreateVolumesFromSourceVolumeTest-266281004 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-550cb990-4941-4eb2-9c48-a8cdd7d86546 {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 25 16:01:22 devstack sudo[91110]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-550cb990-4941-4eb2-9c48-a8cdd7d86546 Feb 25 16:01:22 devstack sudo[91110]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 25 16:01:22 devstack sudo[91110]: pam_unix(sudo:session): session closed for user root Feb 25 16:01:22 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-b723c7da-b543-463b-8478-92993d42c1c0 tempest-CreateVolumesFromSourceVolumeTest-266281004 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-550cb990-4941-4eb2-9c48-a8cdd7d86546" returned: 0 in 0.429s {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 25 16:01:22 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.quobyte [None req-b723c7da-b543-463b-8478-92993d42c1c0 tempest-CreateVolumesFromSourceVolumeTest-266281004 None] <== create_volume: return (982ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-23e9d725-3e04-4cd9-bfe0-c8ef43305589'} {{(pid=83528) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 25 16:01:22 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-b723c7da-b543-463b-8478-92993d42c1c0 tempest-CreateVolumesFromSourceVolumeTest-266281004 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.984s {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 25 16:01:22 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-7df86ea8-aee7-4a2d-9ab7-a292fcf47190 tempest-CreateVolumesFromSourceVolumeTest-266281004 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.676s {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 25 16:01:22 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.quobyte [None req-7df86ea8-aee7-4a2d-9ab7-a292fcf47190 tempest-CreateVolumesFromSourceVolumeTest-266281004 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-25T15:01:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-2091542927',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=105b0a56-9983-488e-ac6b-e2e3ab295692,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='106ab724005248ae9d000e2eb8d4549b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-25T15:01:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-25T15:01:21Z,use_quota=True,user_id='cbb515bf1fc24caca5ba844f1cfafe36',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ce71c2f9-6543-4165-9653-a1529b2ea243),volume_type_id=ce71c2f9-6543-4165-9653-a1529b2ea243)}" {{(pid=83528) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 25 16:01:22 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.remotefs [None req-7df86ea8-aee7-4a2d-9ab7-a292fcf47190 tempest-CreateVolumesFromSourceVolumeTest-266281004 None] Creating volume 105b0a56-9983-488e-ac6b-e2e3ab295692 {{(pid=83528) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 25 16:01:22 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-7df86ea8-aee7-4a2d-9ab7-a292fcf47190 tempest-CreateVolumesFromSourceVolumeTest-266281004 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 25 16:01:22 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-7df86ea8-aee7-4a2d-9ab7-a292fcf47190 tempest-CreateVolumesFromSourceVolumeTest-266281004 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 25 16:01:22 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.quobyte [None req-7df86ea8-aee7-4a2d-9ab7-a292fcf47190 tempest-CreateVolumesFromSourceVolumeTest-266281004 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23e9d725-3e04-4cd9-bfe0-c8ef43305589': None} {{(pid=83528) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 25 16:01:22 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.quobyte [None req-7df86ea8-aee7-4a2d-9ab7-a292fcf47190 tempest-CreateVolumesFromSourceVolumeTest-266281004 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23e9d725-3e04-4cd9-bfe0-c8ef43305589'] {{(pid=83528) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 25 16:01:22 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-7df86ea8-aee7-4a2d-9ab7-a292fcf47190 tempest-CreateVolumesFromSourceVolumeTest-266281004 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 25 16:01:22 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.quobyte [None req-7df86ea8-aee7-4a2d-9ab7-a292fcf47190 tempest-CreateVolumesFromSourceVolumeTest-266281004 None] Selected osci02.corp.quobyte.com/cinder-vol-23e9d725-3e04-4cd9-bfe0-c8ef43305589 as target Quobyte volume. {{(pid=83528) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 25 16:01:22 devstack cinder-volume[83528]: INFO cinder.volume.drivers.remotefs [None req-7df86ea8-aee7-4a2d-9ab7-a292fcf47190 tempest-CreateVolumesFromSourceVolumeTest-266281004 None] casted to osci02.corp.quobyte.com/cinder-vol-23e9d725-3e04-4cd9-bfe0-c8ef43305589 Feb 25 16:01:22 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-7df86ea8-aee7-4a2d-9ab7-a292fcf47190 tempest-CreateVolumesFromSourceVolumeTest-266281004 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-105b0a56-9983-488e-ac6b-e2e3ab295692 1073741824 {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 25 16:01:22 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-b723c7da-b543-463b-8478-92993d42c1c0 tempest-CreateVolumesFromSourceVolumeTest-266281004 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (deb97f15-d65c-43e0-9354-aa084825df65) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-550cb990-4941-4eb2-9c48-a8cdd7d86546', 'volume_size': 1}' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 25 16:01:22 devstack sudo[91113]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-105b0a56-9983-488e-ac6b-e2e3ab295692 1073741824 Feb 25 16:01:22 devstack sudo[91113]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 25 16:01:22 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-b723c7da-b543-463b-8478-92993d42c1c0 tempest-CreateVolumesFromSourceVolumeTest-266281004 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3a2a2833-41f9-46e8-b876-5f23cd5433e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 25 16:01:22 devstack cinder-volume[83528]: INFO cinder.volume.flows.manager.create_volume [None req-b723c7da-b543-463b-8478-92993d42c1c0 tempest-CreateVolumesFromSourceVolumeTest-266281004 None] Volume volume-550cb990-4941-4eb2-9c48-a8cdd7d86546 (550cb990-4941-4eb2-9c48-a8cdd7d86546): created successfully Feb 25 16:01:22 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-b723c7da-b543-463b-8478-92993d42c1c0 tempest-CreateVolumesFromSourceVolumeTest-266281004 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3a2a2833-41f9-46e8-b876-5f23cd5433e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 25 16:01:23 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-b723c7da-b543-463b-8478-92993d42c1c0 tempest-CreateVolumesFromSourceVolumeTest-266281004 None] Flow 'volume_create_manager' (b08dc89a-1a94-4d6d-941a-8630470314e7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83528) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 25 16:01:23 devstack cinder-volume[83528]: INFO cinder.volume.manager [None req-b723c7da-b543-463b-8478-92993d42c1c0 tempest-CreateVolumesFromSourceVolumeTest-266281004 None] Created volume successfully. Feb 25 16:01:23 devstack sudo[91113]: pam_unix(sudo:session): session closed for user root Feb 25 16:01:23 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-7df86ea8-aee7-4a2d-9ab7-a292fcf47190 tempest-CreateVolumesFromSourceVolumeTest-266281004 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-105b0a56-9983-488e-ac6b-e2e3ab295692 1073741824" returned: 0 in 0.598s {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 25 16:01:23 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-7df86ea8-aee7-4a2d-9ab7-a292fcf47190 tempest-CreateVolumesFromSourceVolumeTest-266281004 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-105b0a56-9983-488e-ac6b-e2e3ab295692 {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 25 16:01:23 devstack sudo[91118]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-105b0a56-9983-488e-ac6b-e2e3ab295692 Feb 25 16:01:23 devstack sudo[91118]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 25 16:01:24 devstack sudo[91118]: pam_unix(sudo:session): session closed for user root Feb 25 16:01:24 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-7df86ea8-aee7-4a2d-9ab7-a292fcf47190 tempest-CreateVolumesFromSourceVolumeTest-266281004 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-105b0a56-9983-488e-ac6b-e2e3ab295692" returned: 0 in 0.480s {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 25 16:01:24 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.quobyte [None req-7df86ea8-aee7-4a2d-9ab7-a292fcf47190 tempest-CreateVolumesFromSourceVolumeTest-266281004 None] <== create_volume: return (1111ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-23e9d725-3e04-4cd9-bfe0-c8ef43305589'} {{(pid=83528) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 25 16:01:24 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-7df86ea8-aee7-4a2d-9ab7-a292fcf47190 tempest-CreateVolumesFromSourceVolumeTest-266281004 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.114s {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 25 16:01:24 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-5664037a-f92d-4dea-8fa6-6ae3db3169c8 tempest-CreateVolumesFromSourceVolumeTest-266281004 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.557s {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 25 16:01:24 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.quobyte [None req-5664037a-f92d-4dea-8fa6-6ae3db3169c8 tempest-CreateVolumesFromSourceVolumeTest-266281004 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-25T15:01:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-79128301',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e6034794-3ad3-4c58-956f-994547e1e8ca,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='106ab724005248ae9d000e2eb8d4549b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-25T15:01:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-25T15:01:21Z,use_quota=True,user_id='cbb515bf1fc24caca5ba844f1cfafe36',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ce71c2f9-6543-4165-9653-a1529b2ea243),volume_type_id=ce71c2f9-6543-4165-9653-a1529b2ea243)}" {{(pid=83528) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 25 16:01:24 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.remotefs [None req-5664037a-f92d-4dea-8fa6-6ae3db3169c8 tempest-CreateVolumesFromSourceVolumeTest-266281004 None] Creating volume e6034794-3ad3-4c58-956f-994547e1e8ca {{(pid=83528) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 25 16:01:24 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-5664037a-f92d-4dea-8fa6-6ae3db3169c8 tempest-CreateVolumesFromSourceVolumeTest-266281004 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 25 16:01:24 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-5664037a-f92d-4dea-8fa6-6ae3db3169c8 tempest-CreateVolumesFromSourceVolumeTest-266281004 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 25 16:01:24 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.quobyte [None req-5664037a-f92d-4dea-8fa6-6ae3db3169c8 tempest-CreateVolumesFromSourceVolumeTest-266281004 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23e9d725-3e04-4cd9-bfe0-c8ef43305589': None} {{(pid=83528) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 25 16:01:24 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.quobyte [None req-5664037a-f92d-4dea-8fa6-6ae3db3169c8 tempest-CreateVolumesFromSourceVolumeTest-266281004 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23e9d725-3e04-4cd9-bfe0-c8ef43305589'] {{(pid=83528) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 25 16:01:24 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-5664037a-f92d-4dea-8fa6-6ae3db3169c8 tempest-CreateVolumesFromSourceVolumeTest-266281004 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 25 16:01:24 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.quobyte [None req-5664037a-f92d-4dea-8fa6-6ae3db3169c8 tempest-CreateVolumesFromSourceVolumeTest-266281004 None] Selected osci02.corp.quobyte.com/cinder-vol-23e9d725-3e04-4cd9-bfe0-c8ef43305589 as target Quobyte volume. {{(pid=83528) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 25 16:01:24 devstack cinder-volume[83528]: INFO cinder.volume.drivers.remotefs [None req-5664037a-f92d-4dea-8fa6-6ae3db3169c8 tempest-CreateVolumesFromSourceVolumeTest-266281004 None] casted to osci02.corp.quobyte.com/cinder-vol-23e9d725-3e04-4cd9-bfe0-c8ef43305589 Feb 25 16:01:24 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-5664037a-f92d-4dea-8fa6-6ae3db3169c8 tempest-CreateVolumesFromSourceVolumeTest-266281004 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-e6034794-3ad3-4c58-956f-994547e1e8ca 1073741824 {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 25 16:01:24 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-7df86ea8-aee7-4a2d-9ab7-a292fcf47190 tempest-CreateVolumesFromSourceVolumeTest-266281004 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c040d089-de6e-4cb0-8dcc-850fdd5ca9e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-105b0a56-9983-488e-ac6b-e2e3ab295692', 'volume_size': 1}' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 25 16:01:24 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-7df86ea8-aee7-4a2d-9ab7-a292fcf47190 tempest-CreateVolumesFromSourceVolumeTest-266281004 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (33d4df3f-bee2-4fcd-9459-d41f5075a266) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 25 16:01:24 devstack sudo[91121]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-e6034794-3ad3-4c58-956f-994547e1e8ca 1073741824 Feb 25 16:01:24 devstack sudo[91121]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 25 16:01:24 devstack cinder-volume[83528]: INFO cinder.volume.flows.manager.create_volume [None req-7df86ea8-aee7-4a2d-9ab7-a292fcf47190 tempest-CreateVolumesFromSourceVolumeTest-266281004 None] Volume volume-105b0a56-9983-488e-ac6b-e2e3ab295692 (105b0a56-9983-488e-ac6b-e2e3ab295692): created successfully Feb 25 16:01:24 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-7df86ea8-aee7-4a2d-9ab7-a292fcf47190 tempest-CreateVolumesFromSourceVolumeTest-266281004 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (33d4df3f-bee2-4fcd-9459-d41f5075a266) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 25 16:01:24 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-7df86ea8-aee7-4a2d-9ab7-a292fcf47190 tempest-CreateVolumesFromSourceVolumeTest-266281004 None] Flow 'volume_create_manager' (90daf1af-2971-4ff1-b4c0-7f975dd3b776) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83528) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 25 16:01:24 devstack cinder-volume[83528]: INFO cinder.volume.manager [None req-7df86ea8-aee7-4a2d-9ab7-a292fcf47190 tempest-CreateVolumesFromSourceVolumeTest-266281004 None] Created volume successfully. Feb 25 16:01:24 devstack sudo[91121]: pam_unix(sudo:session): session closed for user root Feb 25 16:01:24 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-5664037a-f92d-4dea-8fa6-6ae3db3169c8 tempest-CreateVolumesFromSourceVolumeTest-266281004 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-e6034794-3ad3-4c58-956f-994547e1e8ca 1073741824" returned: 0 in 0.507s {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 25 16:01:24 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-5664037a-f92d-4dea-8fa6-6ae3db3169c8 tempest-CreateVolumesFromSourceVolumeTest-266281004 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-e6034794-3ad3-4c58-956f-994547e1e8ca {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 25 16:01:24 devstack sudo[91126]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-e6034794-3ad3-4c58-956f-994547e1e8ca Feb 25 16:01:24 devstack sudo[91126]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 25 16:01:25 devstack sudo[91126]: pam_unix(sudo:session): session closed for user root Feb 25 16:01:25 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-5664037a-f92d-4dea-8fa6-6ae3db3169c8 tempest-CreateVolumesFromSourceVolumeTest-266281004 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-e6034794-3ad3-4c58-956f-994547e1e8ca" returned: 0 in 0.403s {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 25 16:01:25 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.quobyte [None req-5664037a-f92d-4dea-8fa6-6ae3db3169c8 tempest-CreateVolumesFromSourceVolumeTest-266281004 None] <== create_volume: return (939ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-23e9d725-3e04-4cd9-bfe0-c8ef43305589'} {{(pid=83528) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 25 16:01:25 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-5664037a-f92d-4dea-8fa6-6ae3db3169c8 tempest-CreateVolumesFromSourceVolumeTest-266281004 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.943s {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 25 16:01:25 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-7bb2c9ca-d9a0-4560-b782-e102b77f4ef5 tempest-CreateVolumesFromSourceVolumeTest-266281004 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.317s {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 25 16:01:25 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.quobyte [None req-7bb2c9ca-d9a0-4560-b782-e102b77f4ef5 tempest-CreateVolumesFromSourceVolumeTest-266281004 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-25T15:01:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1845902354',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a32b5ff5-ce20-4ddb-9443-ddbf66a88f9d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='106ab724005248ae9d000e2eb8d4549b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-25T15:01:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-25T15:01:22Z,use_quota=True,user_id='cbb515bf1fc24caca5ba844f1cfafe36',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ce71c2f9-6543-4165-9653-a1529b2ea243),volume_type_id=ce71c2f9-6543-4165-9653-a1529b2ea243)}" {{(pid=83528) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 25 16:01:25 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.remotefs [None req-7bb2c9ca-d9a0-4560-b782-e102b77f4ef5 tempest-CreateVolumesFromSourceVolumeTest-266281004 None] Creating volume a32b5ff5-ce20-4ddb-9443-ddbf66a88f9d {{(pid=83528) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 25 16:01:25 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-7bb2c9ca-d9a0-4560-b782-e102b77f4ef5 tempest-CreateVolumesFromSourceVolumeTest-266281004 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 25 16:01:25 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-7bb2c9ca-d9a0-4560-b782-e102b77f4ef5 tempest-CreateVolumesFromSourceVolumeTest-266281004 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 25 16:01:25 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.quobyte [None req-7bb2c9ca-d9a0-4560-b782-e102b77f4ef5 tempest-CreateVolumesFromSourceVolumeTest-266281004 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23e9d725-3e04-4cd9-bfe0-c8ef43305589': None} {{(pid=83528) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 25 16:01:25 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.quobyte [None req-7bb2c9ca-d9a0-4560-b782-e102b77f4ef5 tempest-CreateVolumesFromSourceVolumeTest-266281004 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23e9d725-3e04-4cd9-bfe0-c8ef43305589'] {{(pid=83528) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 25 16:01:25 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-7bb2c9ca-d9a0-4560-b782-e102b77f4ef5 tempest-CreateVolumesFromSourceVolumeTest-266281004 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 25 16:01:25 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.quobyte [None req-7bb2c9ca-d9a0-4560-b782-e102b77f4ef5 tempest-CreateVolumesFromSourceVolumeTest-266281004 None] Selected osci02.corp.quobyte.com/cinder-vol-23e9d725-3e04-4cd9-bfe0-c8ef43305589 as target Quobyte volume. {{(pid=83528) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 25 16:01:25 devstack cinder-volume[83528]: INFO cinder.volume.drivers.remotefs [None req-7bb2c9ca-d9a0-4560-b782-e102b77f4ef5 tempest-CreateVolumesFromSourceVolumeTest-266281004 None] casted to osci02.corp.quobyte.com/cinder-vol-23e9d725-3e04-4cd9-bfe0-c8ef43305589 Feb 25 16:01:25 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-7bb2c9ca-d9a0-4560-b782-e102b77f4ef5 tempest-CreateVolumesFromSourceVolumeTest-266281004 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-a32b5ff5-ce20-4ddb-9443-ddbf66a88f9d 1073741824 {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 25 16:01:25 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-5664037a-f92d-4dea-8fa6-6ae3db3169c8 tempest-CreateVolumesFromSourceVolumeTest-266281004 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2072b5f8-d945-45d5-b70e-875e577f93ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e6034794-3ad3-4c58-956f-994547e1e8ca', 'volume_size': 1}' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 25 16:01:25 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-5664037a-f92d-4dea-8fa6-6ae3db3169c8 tempest-CreateVolumesFromSourceVolumeTest-266281004 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b4f94710-7654-4a1f-86d7-7d6cee6dbd3e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 25 16:01:25 devstack sudo[91130]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-a32b5ff5-ce20-4ddb-9443-ddbf66a88f9d 1073741824 Feb 25 16:01:25 devstack sudo[91130]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 25 16:01:25 devstack cinder-volume[83528]: INFO cinder.volume.flows.manager.create_volume [None req-5664037a-f92d-4dea-8fa6-6ae3db3169c8 tempest-CreateVolumesFromSourceVolumeTest-266281004 None] Volume volume-e6034794-3ad3-4c58-956f-994547e1e8ca (e6034794-3ad3-4c58-956f-994547e1e8ca): created successfully Feb 25 16:01:25 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-5664037a-f92d-4dea-8fa6-6ae3db3169c8 tempest-CreateVolumesFromSourceVolumeTest-266281004 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b4f94710-7654-4a1f-86d7-7d6cee6dbd3e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 25 16:01:25 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-5664037a-f92d-4dea-8fa6-6ae3db3169c8 tempest-CreateVolumesFromSourceVolumeTest-266281004 None] Flow 'volume_create_manager' (458aa90a-8f06-491e-bc7f-6d815267d03b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83528) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 25 16:01:25 devstack cinder-volume[83528]: INFO cinder.volume.manager [None req-5664037a-f92d-4dea-8fa6-6ae3db3169c8 tempest-CreateVolumesFromSourceVolumeTest-266281004 None] Created volume successfully. Feb 25 16:01:25 devstack sudo[91130]: pam_unix(sudo:session): session closed for user root Feb 25 16:01:25 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-7bb2c9ca-d9a0-4560-b782-e102b77f4ef5 tempest-CreateVolumesFromSourceVolumeTest-266281004 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-a32b5ff5-ce20-4ddb-9443-ddbf66a88f9d 1073741824" returned: 0 in 0.505s {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 25 16:01:25 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-7bb2c9ca-d9a0-4560-b782-e102b77f4ef5 tempest-CreateVolumesFromSourceVolumeTest-266281004 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-a32b5ff5-ce20-4ddb-9443-ddbf66a88f9d {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 25 16:01:25 devstack sudo[91135]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-a32b5ff5-ce20-4ddb-9443-ddbf66a88f9d Feb 25 16:01:25 devstack sudo[91135]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 25 16:01:25 devstack sudo[91135]: pam_unix(sudo:session): session closed for user root Feb 25 16:01:25 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-7bb2c9ca-d9a0-4560-b782-e102b77f4ef5 tempest-CreateVolumesFromSourceVolumeTest-266281004 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-a32b5ff5-ce20-4ddb-9443-ddbf66a88f9d" returned: 0 in 0.381s {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 25 16:01:25 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.quobyte [None req-7bb2c9ca-d9a0-4560-b782-e102b77f4ef5 tempest-CreateVolumesFromSourceVolumeTest-266281004 None] <== create_volume: return (913ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-23e9d725-3e04-4cd9-bfe0-c8ef43305589'} {{(pid=83528) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 25 16:01:25 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-7bb2c9ca-d9a0-4560-b782-e102b77f4ef5 tempest-CreateVolumesFromSourceVolumeTest-266281004 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.917s {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 25 16:01:25 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-7bb2c9ca-d9a0-4560-b782-e102b77f4ef5 tempest-CreateVolumesFromSourceVolumeTest-266281004 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e11fc7ec-1913-410d-a6f3-f82d4a9c38e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a32b5ff5-ce20-4ddb-9443-ddbf66a88f9d', 'volume_size': 1}' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 25 16:01:25 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-7bb2c9ca-d9a0-4560-b782-e102b77f4ef5 tempest-CreateVolumesFromSourceVolumeTest-266281004 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (efba48c3-a7df-423d-99f4-0edcc09b181c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 25 16:01:25 devstack cinder-volume[83528]: INFO cinder.volume.flows.manager.create_volume [None req-7bb2c9ca-d9a0-4560-b782-e102b77f4ef5 tempest-CreateVolumesFromSourceVolumeTest-266281004 None] Volume volume-a32b5ff5-ce20-4ddb-9443-ddbf66a88f9d (a32b5ff5-ce20-4ddb-9443-ddbf66a88f9d): created successfully Feb 25 16:01:25 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-7bb2c9ca-d9a0-4560-b782-e102b77f4ef5 tempest-CreateVolumesFromSourceVolumeTest-266281004 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (efba48c3-a7df-423d-99f4-0edcc09b181c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 25 16:01:25 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-7bb2c9ca-d9a0-4560-b782-e102b77f4ef5 tempest-CreateVolumesFromSourceVolumeTest-266281004 None] Flow 'volume_create_manager' (2cf00563-d50f-4365-b417-e6eaccf421c6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83528) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 25 16:01:25 devstack cinder-volume[83528]: INFO cinder.volume.manager [None req-7bb2c9ca-d9a0-4560-b782-e102b77f4ef5 tempest-CreateVolumesFromSourceVolumeTest-266281004 None] Created volume successfully. Feb 25 16:01:26 devstack cinder-volume[83528]: DEBUG cinder.coordination [None req-e8284d65-8763-4f81-ac3a-3d7da1dec618 tempest-CreateVolumesFromSourceVolumeTest-266281004 None] Acquiring lock "cinder-a32b5ff5-ce20-4ddb-9443-ddbf66a88f9d-delete_volume" by "delete_volume" {{(pid=83528) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 25 16:01:26 devstack cinder-volume[83528]: DEBUG cinder.coordination [None req-e8284d65-8763-4f81-ac3a-3d7da1dec618 tempest-CreateVolumesFromSourceVolumeTest-266281004 None] Lock "cinder-a32b5ff5-ce20-4ddb-9443-ddbf66a88f9d-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=83528) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 25 16:01:26 devstack cinder-volume[83528]: DEBUG cinder.coordination [None req-e8284d65-8763-4f81-ac3a-3d7da1dec618 tempest-CreateVolumesFromSourceVolumeTest-266281004 None] Acquiring lock "cinder-quobyte-a32b5ff5-ce20-4ddb-9443-ddbf66a88f9d" by "delete_volume" {{(pid=83528) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 25 16:01:26 devstack cinder-volume[83528]: DEBUG cinder.coordination [None req-e8284d65-8763-4f81-ac3a-3d7da1dec618 tempest-CreateVolumesFromSourceVolumeTest-266281004 None] Lock "cinder-quobyte-a32b5ff5-ce20-4ddb-9443-ddbf66a88f9d" acquired by "delete_volume" :: waited 0.011s {{(pid=83528) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 25 16:01:26 devstack cinder-volume[83528]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f9d11cc-832e-439f-b6d6-e1a4223e5ba6]: (4, 'qcow2') {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 25 16:01:26 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-e8284d65-8763-4f81-ac3a-3d7da1dec618 tempest-CreateVolumesFromSourceVolumeTest-266281004 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-a32b5ff5-ce20-4ddb-9443-ddbf66a88f9d {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 25 16:01:26 devstack sudo[91138]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-a32b5ff5-ce20-4ddb-9443-ddbf66a88f9d Feb 25 16:01:26 devstack sudo[91138]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 25 16:01:26 devstack sudo[91138]: pam_unix(sudo:session): session closed for user root Feb 25 16:01:26 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-e8284d65-8763-4f81-ac3a-3d7da1dec618 tempest-CreateVolumesFromSourceVolumeTest-266281004 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-a32b5ff5-ce20-4ddb-9443-ddbf66a88f9d" returned: 0 in 0.454s {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 25 16:01:26 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-e8284d65-8763-4f81-ac3a-3d7da1dec618 tempest-CreateVolumesFromSourceVolumeTest-266281004 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-a32b5ff5-ce20-4ddb-9443-ddbf66a88f9d {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 25 16:01:26 devstack sudo[91143]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-a32b5ff5-ce20-4ddb-9443-ddbf66a88f9d Feb 25 16:01:26 devstack sudo[91143]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 25 16:01:26 devstack sudo[91143]: pam_unix(sudo:session): session closed for user root Feb 25 16:01:26 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-e8284d65-8763-4f81-ac3a-3d7da1dec618 tempest-CreateVolumesFromSourceVolumeTest-266281004 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-a32b5ff5-ce20-4ddb-9443-ddbf66a88f9d" returned: 0 in 0.403s {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 25 16:01:26 devstack cinder-volume[83528]: DEBUG cinder.coordination [None req-e8284d65-8763-4f81-ac3a-3d7da1dec618 tempest-CreateVolumesFromSourceVolumeTest-266281004 None] Lock "cinder-quobyte-a32b5ff5-ce20-4ddb-9443-ddbf66a88f9d" released by "delete_volume" :: held 0.888s {{(pid=83528) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 25 16:01:27 devstack cinder-volume[83528]: DEBUG cinder.quota [None req-e8284d65-8763-4f81-ac3a-3d7da1dec618 tempest-CreateVolumesFromSourceVolumeTest-266281004 None] Created reservations ['275e8e4c-e7c9-4744-9cdb-742d62b12039', 'dd76bf2e-cca0-4a56-bf45-7b19952a6c92', '3a92834c-7889-460e-8a6f-2468e7ad9913', 'd428a6c9-b259-4be3-a18b-210fd2b344a4'] {{(pid=83528) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 25 16:01:27 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-e8284d65-8763-4f81-ac3a-3d7da1dec618 tempest-CreateVolumesFromSourceVolumeTest-266281004 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 25 16:01:27 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-e8284d65-8763-4f81-ac3a-3d7da1dec618 tempest-CreateVolumesFromSourceVolumeTest-266281004 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 25 16:01:27 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.quobyte [None req-e8284d65-8763-4f81-ac3a-3d7da1dec618 tempest-CreateVolumesFromSourceVolumeTest-266281004 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23e9d725-3e04-4cd9-bfe0-c8ef43305589': None} {{(pid=83528) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 25 16:01:27 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.quobyte [None req-e8284d65-8763-4f81-ac3a-3d7da1dec618 tempest-CreateVolumesFromSourceVolumeTest-266281004 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23e9d725-3e04-4cd9-bfe0-c8ef43305589'] {{(pid=83528) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 25 16:01:27 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-e8284d65-8763-4f81-ac3a-3d7da1dec618 tempest-CreateVolumesFromSourceVolumeTest-266281004 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 25 16:01:27 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-e8284d65-8763-4f81-ac3a-3d7da1dec618 tempest-CreateVolumesFromSourceVolumeTest-266281004 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85 {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 25 16:01:27 devstack sudo[91146]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85 Feb 25 16:01:27 devstack sudo[91146]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 25 16:01:27 devstack cinder-volume[83528]: DEBUG cinder.coordination [None req-382f87fe-61bc-4977-8c1f-a61d97afd59c tempest-CreateVolumesFromSourceVolumeTest-266281004 None] Acquiring lock "cinder-e6034794-3ad3-4c58-956f-994547e1e8ca-delete_volume" by "delete_volume" {{(pid=83528) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 25 16:01:27 devstack cinder-volume[83528]: DEBUG cinder.coordination [None req-382f87fe-61bc-4977-8c1f-a61d97afd59c tempest-CreateVolumesFromSourceVolumeTest-266281004 None] Lock "cinder-e6034794-3ad3-4c58-956f-994547e1e8ca-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=83528) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 25 16:01:27 devstack cinder-volume[83528]: DEBUG cinder.coordination [None req-382f87fe-61bc-4977-8c1f-a61d97afd59c tempest-CreateVolumesFromSourceVolumeTest-266281004 None] Acquiring lock "cinder-quobyte-e6034794-3ad3-4c58-956f-994547e1e8ca" by "delete_volume" {{(pid=83528) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 25 16:01:27 devstack cinder-volume[83528]: DEBUG cinder.coordination [None req-382f87fe-61bc-4977-8c1f-a61d97afd59c tempest-CreateVolumesFromSourceVolumeTest-266281004 None] Lock "cinder-quobyte-e6034794-3ad3-4c58-956f-994547e1e8ca" acquired by "delete_volume" :: waited 0.009s {{(pid=83528) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 25 16:01:27 devstack cinder-volume[83528]: DEBUG oslo.privsep.daemon [-] privsep: reply[c52838d3-3f3d-4c0d-8f39-8a5ae1b556e1]: (4, 'qcow2') {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 25 16:01:27 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-382f87fe-61bc-4977-8c1f-a61d97afd59c tempest-CreateVolumesFromSourceVolumeTest-266281004 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-e6034794-3ad3-4c58-956f-994547e1e8ca {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 25 16:01:27 devstack sudo[91148]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-e6034794-3ad3-4c58-956f-994547e1e8ca Feb 25 16:01:27 devstack sudo[91148]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 25 16:01:27 devstack sudo[91146]: pam_unix(sudo:session): session closed for user root Feb 25 16:01:27 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-e8284d65-8763-4f81-ac3a-3d7da1dec618 tempest-CreateVolumesFromSourceVolumeTest-266281004 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85" returned: 0 in 0.457s {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 25 16:01:27 devstack cinder-volume[83528]: DEBUG cinder.manager [None req-e8284d65-8763-4f81-ac3a-3d7da1dec618 tempest-CreateVolumesFromSourceVolumeTest-266281004 None] Notifying Schedulers of capabilities ... {{(pid=83528) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 25 16:01:27 devstack cinder-volume[83528]: INFO cinder.volume.manager [None req-e8284d65-8763-4f81-ac3a-3d7da1dec618 tempest-CreateVolumesFromSourceVolumeTest-266281004 None] Deleted volume successfully. Feb 25 16:01:27 devstack cinder-volume[83528]: DEBUG cinder.coordination [None req-e8284d65-8763-4f81-ac3a-3d7da1dec618 tempest-CreateVolumesFromSourceVolumeTest-266281004 None] Lock "cinder-a32b5ff5-ce20-4ddb-9443-ddbf66a88f9d-delete_volume" released by "delete_volume" :: held 1.498s {{(pid=83528) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 25 16:01:27 devstack sudo[91148]: pam_unix(sudo:session): session closed for user root Feb 25 16:01:27 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-382f87fe-61bc-4977-8c1f-a61d97afd59c tempest-CreateVolumesFromSourceVolumeTest-266281004 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-e6034794-3ad3-4c58-956f-994547e1e8ca" returned: 0 in 0.492s {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 25 16:01:27 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-382f87fe-61bc-4977-8c1f-a61d97afd59c tempest-CreateVolumesFromSourceVolumeTest-266281004 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-e6034794-3ad3-4c58-956f-994547e1e8ca {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 25 16:01:27 devstack sudo[91154]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-e6034794-3ad3-4c58-956f-994547e1e8ca Feb 25 16:01:27 devstack sudo[91154]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 25 16:01:28 devstack sudo[91154]: pam_unix(sudo:session): session closed for user root Feb 25 16:01:28 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-382f87fe-61bc-4977-8c1f-a61d97afd59c tempest-CreateVolumesFromSourceVolumeTest-266281004 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-e6034794-3ad3-4c58-956f-994547e1e8ca" returned: 0 in 0.440s {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 25 16:01:28 devstack cinder-volume[83528]: DEBUG cinder.coordination [None req-382f87fe-61bc-4977-8c1f-a61d97afd59c tempest-CreateVolumesFromSourceVolumeTest-266281004 None] Lock "cinder-quobyte-e6034794-3ad3-4c58-956f-994547e1e8ca" released by "delete_volume" :: held 0.953s {{(pid=83528) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 25 16:01:28 devstack cinder-volume[83528]: DEBUG cinder.quota [None req-382f87fe-61bc-4977-8c1f-a61d97afd59c tempest-CreateVolumesFromSourceVolumeTest-266281004 None] Created reservations ['2ab3c6a8-b8b5-4389-b0da-bbd321d37318', '08a3a8dd-cb8c-460e-a086-df814b9427f6', '31697514-5b2d-45f6-879c-4c6e8c3a9c8b', '76079e13-e13a-4c79-9b78-48480ad143b0'] {{(pid=83528) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 25 16:01:28 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-382f87fe-61bc-4977-8c1f-a61d97afd59c tempest-CreateVolumesFromSourceVolumeTest-266281004 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 25 16:01:28 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-382f87fe-61bc-4977-8c1f-a61d97afd59c tempest-CreateVolumesFromSourceVolumeTest-266281004 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 25 16:01:28 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.quobyte [None req-382f87fe-61bc-4977-8c1f-a61d97afd59c tempest-CreateVolumesFromSourceVolumeTest-266281004 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23e9d725-3e04-4cd9-bfe0-c8ef43305589': None} {{(pid=83528) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 25 16:01:28 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.quobyte [None req-382f87fe-61bc-4977-8c1f-a61d97afd59c tempest-CreateVolumesFromSourceVolumeTest-266281004 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23e9d725-3e04-4cd9-bfe0-c8ef43305589'] {{(pid=83528) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 25 16:01:28 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-382f87fe-61bc-4977-8c1f-a61d97afd59c tempest-CreateVolumesFromSourceVolumeTest-266281004 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 25 16:01:28 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-382f87fe-61bc-4977-8c1f-a61d97afd59c tempest-CreateVolumesFromSourceVolumeTest-266281004 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85 {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 25 16:01:28 devstack sudo[91158]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85 Feb 25 16:01:28 devstack sudo[91158]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 25 16:01:28 devstack cinder-volume[83528]: DEBUG cinder.coordination [None req-7c1e2aee-f562-4abc-8e94-635511166050 tempest-CreateVolumesFromSourceVolumeTest-266281004 None] Acquiring lock "cinder-105b0a56-9983-488e-ac6b-e2e3ab295692-delete_volume" by "delete_volume" {{(pid=83528) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 25 16:01:28 devstack cinder-volume[83528]: DEBUG cinder.coordination [None req-7c1e2aee-f562-4abc-8e94-635511166050 tempest-CreateVolumesFromSourceVolumeTest-266281004 None] Lock "cinder-105b0a56-9983-488e-ac6b-e2e3ab295692-delete_volume" acquired by "delete_volume" :: waited 0.013s {{(pid=83528) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 25 16:01:28 devstack cinder-volume[83528]: DEBUG cinder.coordination [None req-7c1e2aee-f562-4abc-8e94-635511166050 tempest-CreateVolumesFromSourceVolumeTest-266281004 None] Acquiring lock "cinder-quobyte-105b0a56-9983-488e-ac6b-e2e3ab295692" by "delete_volume" {{(pid=83528) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 25 16:01:28 devstack cinder-volume[83528]: DEBUG cinder.coordination [None req-7c1e2aee-f562-4abc-8e94-635511166050 tempest-CreateVolumesFromSourceVolumeTest-266281004 None] Lock "cinder-quobyte-105b0a56-9983-488e-ac6b-e2e3ab295692" acquired by "delete_volume" :: waited 0.010s {{(pid=83528) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 25 16:01:28 devstack cinder-volume[83528]: DEBUG oslo.privsep.daemon [-] privsep: reply[8087e5b4-3807-4ae6-b2b0-4e26e27c0c49]: (4, 'qcow2') {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 25 16:01:28 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-7c1e2aee-f562-4abc-8e94-635511166050 tempest-CreateVolumesFromSourceVolumeTest-266281004 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-105b0a56-9983-488e-ac6b-e2e3ab295692 {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 25 16:01:28 devstack sudo[91160]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-105b0a56-9983-488e-ac6b-e2e3ab295692 Feb 25 16:01:28 devstack sudo[91160]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 25 16:01:28 devstack sudo[91158]: pam_unix(sudo:session): session closed for user root Feb 25 16:01:28 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-382f87fe-61bc-4977-8c1f-a61d97afd59c tempest-CreateVolumesFromSourceVolumeTest-266281004 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85" returned: 0 in 0.428s {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 25 16:01:28 devstack cinder-volume[83528]: DEBUG cinder.manager [None req-382f87fe-61bc-4977-8c1f-a61d97afd59c tempest-CreateVolumesFromSourceVolumeTest-266281004 None] Notifying Schedulers of capabilities ... {{(pid=83528) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 25 16:01:28 devstack cinder-volume[83528]: INFO cinder.volume.manager [None req-382f87fe-61bc-4977-8c1f-a61d97afd59c tempest-CreateVolumesFromSourceVolumeTest-266281004 None] Deleted volume successfully. Feb 25 16:01:28 devstack cinder-volume[83528]: DEBUG cinder.coordination [None req-382f87fe-61bc-4977-8c1f-a61d97afd59c tempest-CreateVolumesFromSourceVolumeTest-266281004 None] Lock "cinder-e6034794-3ad3-4c58-956f-994547e1e8ca-delete_volume" released by "delete_volume" :: held 1.534s {{(pid=83528) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 25 16:01:28 devstack sudo[91160]: pam_unix(sudo:session): session closed for user root Feb 25 16:01:28 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-7c1e2aee-f562-4abc-8e94-635511166050 tempest-CreateVolumesFromSourceVolumeTest-266281004 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-105b0a56-9983-488e-ac6b-e2e3ab295692" returned: 0 in 0.471s {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 25 16:01:28 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-7c1e2aee-f562-4abc-8e94-635511166050 tempest-CreateVolumesFromSourceVolumeTest-266281004 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-105b0a56-9983-488e-ac6b-e2e3ab295692 {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 25 16:01:28 devstack sudo[91166]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-105b0a56-9983-488e-ac6b-e2e3ab295692 Feb 25 16:01:28 devstack sudo[91166]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 25 16:01:29 devstack sudo[91166]: pam_unix(sudo:session): session closed for user root Feb 25 16:01:29 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-7c1e2aee-f562-4abc-8e94-635511166050 tempest-CreateVolumesFromSourceVolumeTest-266281004 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-105b0a56-9983-488e-ac6b-e2e3ab295692" returned: 0 in 0.396s {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 25 16:01:29 devstack cinder-volume[83528]: DEBUG cinder.coordination [None req-7c1e2aee-f562-4abc-8e94-635511166050 tempest-CreateVolumesFromSourceVolumeTest-266281004 None] Lock "cinder-quobyte-105b0a56-9983-488e-ac6b-e2e3ab295692" released by "delete_volume" :: held 0.886s {{(pid=83528) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 25 16:01:29 devstack cinder-volume[83528]: DEBUG cinder.quota [None req-7c1e2aee-f562-4abc-8e94-635511166050 tempest-CreateVolumesFromSourceVolumeTest-266281004 None] Created reservations ['635fc708-caea-4a35-a457-b969293a2403', '563b874f-0b70-4b21-bf39-413bce53f381', 'b651fef1-77bc-4eab-b0b2-f47fa03bda8f', '6090da96-8fef-4068-b906-c2571c085222'] {{(pid=83528) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 25 16:01:29 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-7c1e2aee-f562-4abc-8e94-635511166050 tempest-CreateVolumesFromSourceVolumeTest-266281004 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 25 16:01:29 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-7c1e2aee-f562-4abc-8e94-635511166050 tempest-CreateVolumesFromSourceVolumeTest-266281004 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 25 16:01:29 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.quobyte [None req-7c1e2aee-f562-4abc-8e94-635511166050 tempest-CreateVolumesFromSourceVolumeTest-266281004 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23e9d725-3e04-4cd9-bfe0-c8ef43305589': None} {{(pid=83528) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 25 16:01:29 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.quobyte [None req-7c1e2aee-f562-4abc-8e94-635511166050 tempest-CreateVolumesFromSourceVolumeTest-266281004 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23e9d725-3e04-4cd9-bfe0-c8ef43305589'] {{(pid=83528) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 25 16:01:29 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-7c1e2aee-f562-4abc-8e94-635511166050 tempest-CreateVolumesFromSourceVolumeTest-266281004 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 25 16:01:29 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-7c1e2aee-f562-4abc-8e94-635511166050 tempest-CreateVolumesFromSourceVolumeTest-266281004 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85 {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 25 16:01:29 devstack sudo[91169]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85 Feb 25 16:01:29 devstack sudo[91169]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 25 16:01:29 devstack cinder-volume[83528]: DEBUG cinder.coordination [None req-67454051-34ad-4216-be40-8311a02be155 tempest-CreateVolumesFromSourceVolumeTest-266281004 None] Acquiring lock "cinder-550cb990-4941-4eb2-9c48-a8cdd7d86546-delete_volume" by "delete_volume" {{(pid=83528) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 25 16:01:29 devstack cinder-volume[83528]: DEBUG cinder.coordination [None req-67454051-34ad-4216-be40-8311a02be155 tempest-CreateVolumesFromSourceVolumeTest-266281004 None] Lock "cinder-550cb990-4941-4eb2-9c48-a8cdd7d86546-delete_volume" acquired by "delete_volume" :: waited 0.009s {{(pid=83528) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 25 16:01:29 devstack cinder-volume[83528]: DEBUG cinder.coordination [None req-67454051-34ad-4216-be40-8311a02be155 tempest-CreateVolumesFromSourceVolumeTest-266281004 None] Acquiring lock "cinder-quobyte-550cb990-4941-4eb2-9c48-a8cdd7d86546" by "delete_volume" {{(pid=83528) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 25 16:01:29 devstack cinder-volume[83528]: DEBUG cinder.coordination [None req-67454051-34ad-4216-be40-8311a02be155 tempest-CreateVolumesFromSourceVolumeTest-266281004 None] Lock "cinder-quobyte-550cb990-4941-4eb2-9c48-a8cdd7d86546" acquired by "delete_volume" :: waited 0.008s {{(pid=83528) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 25 16:01:29 devstack cinder-volume[83528]: DEBUG oslo.privsep.daemon [-] privsep: reply[caef3d35-258f-43b3-8f8e-7e699232cd33]: (4, 'qcow2') {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 25 16:01:29 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-67454051-34ad-4216-be40-8311a02be155 tempest-CreateVolumesFromSourceVolumeTest-266281004 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-550cb990-4941-4eb2-9c48-a8cdd7d86546 {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 25 16:01:29 devstack sudo[91171]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-550cb990-4941-4eb2-9c48-a8cdd7d86546 Feb 25 16:01:29 devstack sudo[91171]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 25 16:01:29 devstack sudo[91169]: pam_unix(sudo:session): session closed for user root Feb 25 16:01:29 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-7c1e2aee-f562-4abc-8e94-635511166050 tempest-CreateVolumesFromSourceVolumeTest-266281004 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85" returned: 0 in 0.426s {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 25 16:01:29 devstack cinder-volume[83528]: DEBUG cinder.manager [None req-7c1e2aee-f562-4abc-8e94-635511166050 tempest-CreateVolumesFromSourceVolumeTest-266281004 None] Notifying Schedulers of capabilities ... {{(pid=83528) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 25 16:01:29 devstack cinder-volume[83528]: INFO cinder.volume.manager [None req-7c1e2aee-f562-4abc-8e94-635511166050 tempest-CreateVolumesFromSourceVolumeTest-266281004 None] Deleted volume successfully. Feb 25 16:01:29 devstack cinder-volume[83528]: DEBUG cinder.coordination [None req-7c1e2aee-f562-4abc-8e94-635511166050 tempest-CreateVolumesFromSourceVolumeTest-266281004 None] Lock "cinder-105b0a56-9983-488e-ac6b-e2e3ab295692-delete_volume" released by "delete_volume" :: held 1.441s {{(pid=83528) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 25 16:01:29 devstack sudo[91171]: pam_unix(sudo:session): session closed for user root Feb 25 16:01:29 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-67454051-34ad-4216-be40-8311a02be155 tempest-CreateVolumesFromSourceVolumeTest-266281004 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-550cb990-4941-4eb2-9c48-a8cdd7d86546" returned: 0 in 0.477s {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 25 16:01:29 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-67454051-34ad-4216-be40-8311a02be155 tempest-CreateVolumesFromSourceVolumeTest-266281004 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-550cb990-4941-4eb2-9c48-a8cdd7d86546 {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 25 16:01:29 devstack sudo[91177]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-550cb990-4941-4eb2-9c48-a8cdd7d86546 Feb 25 16:01:29 devstack sudo[91177]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 25 16:01:30 devstack sudo[91177]: pam_unix(sudo:session): session closed for user root Feb 25 16:01:30 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-67454051-34ad-4216-be40-8311a02be155 tempest-CreateVolumesFromSourceVolumeTest-266281004 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-550cb990-4941-4eb2-9c48-a8cdd7d86546" returned: 0 in 0.396s {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 25 16:01:30 devstack cinder-volume[83528]: DEBUG cinder.coordination [None req-67454051-34ad-4216-be40-8311a02be155 tempest-CreateVolumesFromSourceVolumeTest-266281004 None] Lock "cinder-quobyte-550cb990-4941-4eb2-9c48-a8cdd7d86546" released by "delete_volume" :: held 0.897s {{(pid=83528) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 25 16:01:30 devstack cinder-volume[83528]: DEBUG cinder.quota [None req-67454051-34ad-4216-be40-8311a02be155 tempest-CreateVolumesFromSourceVolumeTest-266281004 None] Created reservations ['472df917-a162-404e-8bf2-4113b6e1f8b8', 'c246e891-8f29-4cb0-beb3-1c6c19ea0776', 'c359d933-e2e2-46e7-aba3-3e75e8796318', '5a852ea2-ccaf-46df-8f86-7bf2e7a1c1e0'] {{(pid=83528) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 25 16:01:30 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-67454051-34ad-4216-be40-8311a02be155 tempest-CreateVolumesFromSourceVolumeTest-266281004 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 25 16:01:30 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-67454051-34ad-4216-be40-8311a02be155 tempest-CreateVolumesFromSourceVolumeTest-266281004 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 25 16:01:30 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.quobyte [None req-67454051-34ad-4216-be40-8311a02be155 tempest-CreateVolumesFromSourceVolumeTest-266281004 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23e9d725-3e04-4cd9-bfe0-c8ef43305589': None} {{(pid=83528) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 25 16:01:30 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.quobyte [None req-67454051-34ad-4216-be40-8311a02be155 tempest-CreateVolumesFromSourceVolumeTest-266281004 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23e9d725-3e04-4cd9-bfe0-c8ef43305589'] {{(pid=83528) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 25 16:01:30 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-67454051-34ad-4216-be40-8311a02be155 tempest-CreateVolumesFromSourceVolumeTest-266281004 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 25 16:01:30 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-67454051-34ad-4216-be40-8311a02be155 tempest-CreateVolumesFromSourceVolumeTest-266281004 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85 {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 25 16:01:30 devstack sudo[91180]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85 Feb 25 16:01:30 devstack sudo[91180]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 25 16:01:30 devstack cinder-volume[83528]: DEBUG cinder.coordination [None req-33299405-4c25-4b77-be5d-39eb2a219c0d tempest-CreateVolumesFromSourceVolumeTest-266281004 None] Acquiring lock "cinder-7c9943d0-c4cb-4aa5-9c9e-4c5d97989a47-delete_volume" by "delete_volume" {{(pid=83528) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 25 16:01:30 devstack cinder-volume[83528]: DEBUG cinder.coordination [None req-33299405-4c25-4b77-be5d-39eb2a219c0d tempest-CreateVolumesFromSourceVolumeTest-266281004 None] Lock "cinder-7c9943d0-c4cb-4aa5-9c9e-4c5d97989a47-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=83528) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 25 16:01:30 devstack cinder-volume[83528]: DEBUG cinder.coordination [None req-33299405-4c25-4b77-be5d-39eb2a219c0d tempest-CreateVolumesFromSourceVolumeTest-266281004 None] Acquiring lock "cinder-quobyte-7c9943d0-c4cb-4aa5-9c9e-4c5d97989a47" by "delete_volume" {{(pid=83528) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 25 16:01:30 devstack cinder-volume[83528]: DEBUG cinder.coordination [None req-33299405-4c25-4b77-be5d-39eb2a219c0d tempest-CreateVolumesFromSourceVolumeTest-266281004 None] Lock "cinder-quobyte-7c9943d0-c4cb-4aa5-9c9e-4c5d97989a47" acquired by "delete_volume" :: waited 0.007s {{(pid=83528) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 25 16:01:30 devstack cinder-volume[83528]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f737b25-9366-4d36-bf93-213aa6ce10f3]: (4, 'qcow2') {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 25 16:01:30 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-33299405-4c25-4b77-be5d-39eb2a219c0d tempest-CreateVolumesFromSourceVolumeTest-266281004 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-7c9943d0-c4cb-4aa5-9c9e-4c5d97989a47 {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 25 16:01:30 devstack sudo[91182]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-7c9943d0-c4cb-4aa5-9c9e-4c5d97989a47 Feb 25 16:01:30 devstack sudo[91182]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 25 16:01:30 devstack sudo[91180]: pam_unix(sudo:session): session closed for user root Feb 25 16:01:30 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-67454051-34ad-4216-be40-8311a02be155 tempest-CreateVolumesFromSourceVolumeTest-266281004 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85" returned: 0 in 0.410s {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 25 16:01:30 devstack cinder-volume[83528]: DEBUG cinder.manager [None req-67454051-34ad-4216-be40-8311a02be155 tempest-CreateVolumesFromSourceVolumeTest-266281004 None] Notifying Schedulers of capabilities ... {{(pid=83528) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 25 16:01:30 devstack cinder-volume[83528]: INFO cinder.volume.manager [None req-67454051-34ad-4216-be40-8311a02be155 tempest-CreateVolumesFromSourceVolumeTest-266281004 None] Deleted volume successfully. Feb 25 16:01:30 devstack cinder-volume[83528]: DEBUG cinder.coordination [None req-67454051-34ad-4216-be40-8311a02be155 tempest-CreateVolumesFromSourceVolumeTest-266281004 None] Lock "cinder-550cb990-4941-4eb2-9c48-a8cdd7d86546-delete_volume" released by "delete_volume" :: held 1.456s {{(pid=83528) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 25 16:01:31 devstack sudo[91182]: pam_unix(sudo:session): session closed for user root Feb 25 16:01:31 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-33299405-4c25-4b77-be5d-39eb2a219c0d tempest-CreateVolumesFromSourceVolumeTest-266281004 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-7c9943d0-c4cb-4aa5-9c9e-4c5d97989a47" returned: 0 in 0.468s {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 25 16:01:31 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-33299405-4c25-4b77-be5d-39eb2a219c0d tempest-CreateVolumesFromSourceVolumeTest-266281004 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-7c9943d0-c4cb-4aa5-9c9e-4c5d97989a47 {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 25 16:01:31 devstack sudo[91188]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-7c9943d0-c4cb-4aa5-9c9e-4c5d97989a47 Feb 25 16:01:31 devstack sudo[91188]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 25 16:01:31 devstack sudo[91188]: pam_unix(sudo:session): session closed for user root Feb 25 16:01:31 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-33299405-4c25-4b77-be5d-39eb2a219c0d tempest-CreateVolumesFromSourceVolumeTest-266281004 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-7c9943d0-c4cb-4aa5-9c9e-4c5d97989a47" returned: 0 in 0.383s {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 25 16:01:31 devstack cinder-volume[83528]: DEBUG cinder.coordination [None req-33299405-4c25-4b77-be5d-39eb2a219c0d tempest-CreateVolumesFromSourceVolumeTest-266281004 None] Lock "cinder-quobyte-7c9943d0-c4cb-4aa5-9c9e-4c5d97989a47" released by "delete_volume" :: held 0.879s {{(pid=83528) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 25 16:01:31 devstack cinder-volume[83528]: DEBUG cinder.quota [None req-33299405-4c25-4b77-be5d-39eb2a219c0d tempest-CreateVolumesFromSourceVolumeTest-266281004 None] Created reservations ['ddc387d4-6d28-460c-8f13-1405f5ef432a', '8547831e-38e0-48ca-8489-9fa4e5ca7532', 'de201658-c7f9-4803-a173-bc432dc5bf87', '00fe9ddd-4ec7-4cb0-b12e-990fa5fea4f7'] {{(pid=83528) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 25 16:01:31 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-33299405-4c25-4b77-be5d-39eb2a219c0d tempest-CreateVolumesFromSourceVolumeTest-266281004 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 25 16:01:31 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-33299405-4c25-4b77-be5d-39eb2a219c0d tempest-CreateVolumesFromSourceVolumeTest-266281004 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 25 16:01:31 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.quobyte [None req-33299405-4c25-4b77-be5d-39eb2a219c0d tempest-CreateVolumesFromSourceVolumeTest-266281004 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23e9d725-3e04-4cd9-bfe0-c8ef43305589': None} {{(pid=83528) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 25 16:01:31 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.quobyte [None req-33299405-4c25-4b77-be5d-39eb2a219c0d tempest-CreateVolumesFromSourceVolumeTest-266281004 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23e9d725-3e04-4cd9-bfe0-c8ef43305589'] {{(pid=83528) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 25 16:01:31 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-33299405-4c25-4b77-be5d-39eb2a219c0d tempest-CreateVolumesFromSourceVolumeTest-266281004 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 25 16:01:31 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-33299405-4c25-4b77-be5d-39eb2a219c0d tempest-CreateVolumesFromSourceVolumeTest-266281004 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85 {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 25 16:01:31 devstack sudo[91191]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85 Feb 25 16:01:31 devstack sudo[91191]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 25 16:01:31 devstack cinder-volume[83528]: DEBUG cinder.coordination [None req-84d9e66b-0108-4a6a-8fec-44c0df4af666 tempest-CreateVolumesFromSourceVolumeTest-266281004 None] Acquiring lock "cinder-d96f7e72-999b-4a90-b9dd-4bebfe18f31a-delete_volume" by "delete_volume" {{(pid=83528) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 25 16:01:31 devstack cinder-volume[83528]: DEBUG cinder.coordination [None req-84d9e66b-0108-4a6a-8fec-44c0df4af666 tempest-CreateVolumesFromSourceVolumeTest-266281004 None] Lock "cinder-d96f7e72-999b-4a90-b9dd-4bebfe18f31a-delete_volume" acquired by "delete_volume" :: waited 0.012s {{(pid=83528) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 25 16:01:31 devstack cinder-volume[83528]: DEBUG cinder.coordination [None req-84d9e66b-0108-4a6a-8fec-44c0df4af666 tempest-CreateVolumesFromSourceVolumeTest-266281004 None] Acquiring lock "cinder-quobyte-d96f7e72-999b-4a90-b9dd-4bebfe18f31a" by "delete_volume" {{(pid=83528) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 25 16:01:31 devstack cinder-volume[83528]: DEBUG cinder.coordination [None req-84d9e66b-0108-4a6a-8fec-44c0df4af666 tempest-CreateVolumesFromSourceVolumeTest-266281004 None] Lock "cinder-quobyte-d96f7e72-999b-4a90-b9dd-4bebfe18f31a" acquired by "delete_volume" :: waited 0.010s {{(pid=83528) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 25 16:01:31 devstack cinder-volume[83528]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca593717-dde6-400f-873c-d3cb2db84514]: (4, 'qcow2') {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 25 16:01:31 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-84d9e66b-0108-4a6a-8fec-44c0df4af666 tempest-CreateVolumesFromSourceVolumeTest-266281004 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-d96f7e72-999b-4a90-b9dd-4bebfe18f31a {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 25 16:01:31 devstack sudo[91193]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-d96f7e72-999b-4a90-b9dd-4bebfe18f31a Feb 25 16:01:31 devstack sudo[91193]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 25 16:01:31 devstack sudo[91191]: pam_unix(sudo:session): session closed for user root Feb 25 16:01:31 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-33299405-4c25-4b77-be5d-39eb2a219c0d tempest-CreateVolumesFromSourceVolumeTest-266281004 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85" returned: 0 in 0.412s {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 25 16:01:31 devstack cinder-volume[83528]: DEBUG cinder.manager [None req-33299405-4c25-4b77-be5d-39eb2a219c0d tempest-CreateVolumesFromSourceVolumeTest-266281004 None] Notifying Schedulers of capabilities ... {{(pid=83528) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 25 16:01:31 devstack cinder-volume[83528]: INFO cinder.volume.manager [None req-33299405-4c25-4b77-be5d-39eb2a219c0d tempest-CreateVolumesFromSourceVolumeTest-266281004 None] Deleted volume successfully. Feb 25 16:01:31 devstack cinder-volume[83528]: DEBUG cinder.coordination [None req-33299405-4c25-4b77-be5d-39eb2a219c0d tempest-CreateVolumesFromSourceVolumeTest-266281004 None] Lock "cinder-7c9943d0-c4cb-4aa5-9c9e-4c5d97989a47-delete_volume" released by "delete_volume" :: held 1.410s {{(pid=83528) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 25 16:01:32 devstack sudo[91193]: pam_unix(sudo:session): session closed for user root Feb 25 16:01:32 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-84d9e66b-0108-4a6a-8fec-44c0df4af666 tempest-CreateVolumesFromSourceVolumeTest-266281004 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-d96f7e72-999b-4a90-b9dd-4bebfe18f31a" returned: 0 in 0.445s {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 25 16:01:32 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-84d9e66b-0108-4a6a-8fec-44c0df4af666 tempest-CreateVolumesFromSourceVolumeTest-266281004 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-d96f7e72-999b-4a90-b9dd-4bebfe18f31a {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 25 16:01:32 devstack sudo[91199]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-d96f7e72-999b-4a90-b9dd-4bebfe18f31a Feb 25 16:01:32 devstack sudo[91199]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 25 16:01:32 devstack sudo[91199]: pam_unix(sudo:session): session closed for user root Feb 25 16:01:32 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-84d9e66b-0108-4a6a-8fec-44c0df4af666 tempest-CreateVolumesFromSourceVolumeTest-266281004 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-d96f7e72-999b-4a90-b9dd-4bebfe18f31a" returned: 0 in 0.387s {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 25 16:01:32 devstack cinder-volume[83528]: DEBUG cinder.coordination [None req-84d9e66b-0108-4a6a-8fec-44c0df4af666 tempest-CreateVolumesFromSourceVolumeTest-266281004 None] Lock "cinder-quobyte-d96f7e72-999b-4a90-b9dd-4bebfe18f31a" released by "delete_volume" :: held 0.850s {{(pid=83528) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 25 16:01:32 devstack cinder-volume[83528]: DEBUG cinder.quota [None req-84d9e66b-0108-4a6a-8fec-44c0df4af666 tempest-CreateVolumesFromSourceVolumeTest-266281004 None] Created reservations ['f92acfb3-346f-4484-a358-dfa7adb16bb8', '43af585f-6487-4f1b-81a6-c54465f0bf98', '7ea6b9a8-f446-472b-a17e-e7cc4637adb8', 'ec1e88c1-d4ad-42b1-a6c7-a54ceb8ea47c'] {{(pid=83528) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 25 16:01:32 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-84d9e66b-0108-4a6a-8fec-44c0df4af666 tempest-CreateVolumesFromSourceVolumeTest-266281004 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 25 16:01:32 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-84d9e66b-0108-4a6a-8fec-44c0df4af666 tempest-CreateVolumesFromSourceVolumeTest-266281004 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 25 16:01:32 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.quobyte [None req-84d9e66b-0108-4a6a-8fec-44c0df4af666 tempest-CreateVolumesFromSourceVolumeTest-266281004 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23e9d725-3e04-4cd9-bfe0-c8ef43305589': None} {{(pid=83528) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 25 16:01:32 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.quobyte [None req-84d9e66b-0108-4a6a-8fec-44c0df4af666 tempest-CreateVolumesFromSourceVolumeTest-266281004 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23e9d725-3e04-4cd9-bfe0-c8ef43305589'] {{(pid=83528) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 25 16:01:32 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-84d9e66b-0108-4a6a-8fec-44c0df4af666 tempest-CreateVolumesFromSourceVolumeTest-266281004 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 25 16:01:32 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-84d9e66b-0108-4a6a-8fec-44c0df4af666 tempest-CreateVolumesFromSourceVolumeTest-266281004 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85 {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 25 16:01:32 devstack sudo[91202]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85 Feb 25 16:01:32 devstack sudo[91202]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 25 16:01:33 devstack sudo[91202]: pam_unix(sudo:session): session closed for user root Feb 25 16:01:33 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-84d9e66b-0108-4a6a-8fec-44c0df4af666 tempest-CreateVolumesFromSourceVolumeTest-266281004 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85" returned: 0 in 0.424s {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 25 16:01:33 devstack cinder-volume[83528]: DEBUG cinder.manager [None req-84d9e66b-0108-4a6a-8fec-44c0df4af666 tempest-CreateVolumesFromSourceVolumeTest-266281004 None] Notifying Schedulers of capabilities ... {{(pid=83528) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 25 16:01:33 devstack cinder-volume[83528]: INFO cinder.volume.manager [None req-84d9e66b-0108-4a6a-8fec-44c0df4af666 tempest-CreateVolumesFromSourceVolumeTest-266281004 None] Deleted volume successfully. Feb 25 16:01:33 devstack cinder-volume[83528]: DEBUG cinder.coordination [None req-84d9e66b-0108-4a6a-8fec-44c0df4af666 tempest-CreateVolumesFromSourceVolumeTest-266281004 None] Lock "cinder-d96f7e72-999b-4a90-b9dd-4bebfe18f31a-delete_volume" released by "delete_volume" :: held 1.396s {{(pid=83528) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 25 16:01:38 devstack cinder-volume[83528]: DEBUG oslo_service.periodic_task [None req-d4c764ec-0ebb-4b31-b534-c9a53c1ab0dd None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=83528) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Feb 25 16:01:38 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-d4c764ec-0ebb-4b31-b534-c9a53c1ab0dd None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 25 16:01:38 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-d4c764ec-0ebb-4b31-b534-c9a53c1ab0dd None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 25 16:01:38 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.quobyte [None req-d4c764ec-0ebb-4b31-b534-c9a53c1ab0dd None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23e9d725-3e04-4cd9-bfe0-c8ef43305589': None} {{(pid=83528) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 25 16:01:38 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.quobyte [None req-d4c764ec-0ebb-4b31-b534-c9a53c1ab0dd None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23e9d725-3e04-4cd9-bfe0-c8ef43305589'] {{(pid=83528) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 25 16:01:38 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-d4c764ec-0ebb-4b31-b534-c9a53c1ab0dd None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 25 16:01:38 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-d4c764ec-0ebb-4b31-b534-c9a53c1ab0dd None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85 {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 25 16:01:38 devstack sudo[91208]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85 Feb 25 16:01:38 devstack sudo[91208]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 25 16:01:39 devstack sudo[91208]: pam_unix(sudo:session): session closed for user root Feb 25 16:01:39 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-d4c764ec-0ebb-4b31-b534-c9a53c1ab0dd None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85" returned: 0 in 0.397s {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 25 16:01:39 devstack cinder-volume[83528]: DEBUG cinder.manager [None req-d4c764ec-0ebb-4b31-b534-c9a53c1ab0dd None None] Notifying Schedulers of capabilities ... {{(pid=83528) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 25 16:01:42 devstack cinder-volume[83528]: DEBUG dbcounter [-] [83528] Writing DB stats cinder:UPDATE=168,cinder:SELECT=129,cinder:DELETE=12,cinder:INSERT=32 {{(pid=83528) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Feb 25 16:01:43 devstack cinder-volume[83528]: DEBUG dbcounter [-] [83528] Writing DB stats cinder:UPDATE=168,cinder:SELECT=125,cinder:INSERT=49,cinder:DELETE=17 {{(pid=83528) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Feb 25 16:01:50 devstack cinder-volume[83528]: INFO cinder.volume.manager [req-8908d378-f969-4793-80e2-d9d777c4b02f req-966a8e5a-3701-4597-b510-179338262f67 tempest-TestVolumeBootPattern-1339247704 None] Terminate volume connection completed successfully. Feb 25 16:01:50 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [req-8908d378-f969-4793-80e2-d9d777c4b02f req-966a8e5a-3701-4597-b510-179338262f67 tempest-TestVolumeBootPattern-1339247704 None] Deleting attachment 3bb87d3c-bd99-49e4-ab15-825c3d9de2c7. {{(pid=83528) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Feb 25 16:01:53 devstack cinder-volume[83528]: DEBUG cinder.coordination [None req-5bcd007b-875c-417c-a1bd-8b549ca5b7c5 tempest-TestVolumeBootPattern-1339247704 None] Acquiring lock "cinder-603ceb8f-999e-4bdd-a2b4-3010a4fd6af5-delete_volume" by "delete_volume" {{(pid=83528) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 25 16:01:53 devstack cinder-volume[83528]: DEBUG cinder.coordination [None req-5bcd007b-875c-417c-a1bd-8b549ca5b7c5 tempest-TestVolumeBootPattern-1339247704 None] Lock "cinder-603ceb8f-999e-4bdd-a2b4-3010a4fd6af5-delete_volume" acquired by "delete_volume" :: waited 0.009s {{(pid=83528) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 25 16:01:53 devstack cinder-volume[83528]: DEBUG cinder.coordination [None req-5bcd007b-875c-417c-a1bd-8b549ca5b7c5 tempest-TestVolumeBootPattern-1339247704 None] Acquiring lock "cinder-quobyte-603ceb8f-999e-4bdd-a2b4-3010a4fd6af5" by "delete_volume" {{(pid=83528) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 25 16:01:53 devstack cinder-volume[83528]: DEBUG cinder.coordination [None req-5bcd007b-875c-417c-a1bd-8b549ca5b7c5 tempest-TestVolumeBootPattern-1339247704 None] Lock "cinder-quobyte-603ceb8f-999e-4bdd-a2b4-3010a4fd6af5" acquired by "delete_volume" :: waited 0.007s {{(pid=83528) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 25 16:01:53 devstack cinder-volume[83528]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f129b4a-5b58-4756-a062-c4300bd2489d]: (4, 'raw') {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 25 16:01:53 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-5bcd007b-875c-417c-a1bd-8b549ca5b7c5 tempest-TestVolumeBootPattern-1339247704 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-603ceb8f-999e-4bdd-a2b4-3010a4fd6af5 {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 25 16:01:53 devstack sudo[91239]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-603ceb8f-999e-4bdd-a2b4-3010a4fd6af5 Feb 25 16:01:53 devstack sudo[91239]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 25 16:01:54 devstack sudo[91239]: pam_unix(sudo:session): session closed for user root Feb 25 16:01:54 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-5bcd007b-875c-417c-a1bd-8b549ca5b7c5 tempest-TestVolumeBootPattern-1339247704 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-603ceb8f-999e-4bdd-a2b4-3010a4fd6af5" returned: 0 in 0.521s {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 25 16:01:54 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-5bcd007b-875c-417c-a1bd-8b549ca5b7c5 tempest-TestVolumeBootPattern-1339247704 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-603ceb8f-999e-4bdd-a2b4-3010a4fd6af5 {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 25 16:01:54 devstack sudo[91243]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-603ceb8f-999e-4bdd-a2b4-3010a4fd6af5 Feb 25 16:01:54 devstack sudo[91243]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 25 16:01:54 devstack sudo[91243]: pam_unix(sudo:session): session closed for user root Feb 25 16:01:54 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-5bcd007b-875c-417c-a1bd-8b549ca5b7c5 tempest-TestVolumeBootPattern-1339247704 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-603ceb8f-999e-4bdd-a2b4-3010a4fd6af5" returned: 1 in 0.531s {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 25 16:01:54 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-5bcd007b-875c-417c-a1bd-8b549ca5b7c5 tempest-TestVolumeBootPattern-1339247704 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-603ceb8f-999e-4bdd-a2b4-3010a4fd6af5' failed. Not Retrying. {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Feb 25 16:01:54 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-5bcd007b-875c-417c-a1bd-8b549ca5b7c5 tempest-TestVolumeBootPattern-1339247704 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-603ceb8f-999e-4bdd-a2b4-3010a4fd6af5 {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 25 16:01:54 devstack sudo[91248]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-603ceb8f-999e-4bdd-a2b4-3010a4fd6af5 Feb 25 16:01:54 devstack sudo[91248]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 25 16:01:54 devstack sudo[91248]: pam_unix(sudo:session): session closed for user root Feb 25 16:01:54 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-5bcd007b-875c-417c-a1bd-8b549ca5b7c5 tempest-TestVolumeBootPattern-1339247704 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-603ceb8f-999e-4bdd-a2b4-3010a4fd6af5" returned: 0 in 0.423s {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 25 16:01:54 devstack cinder-volume[83528]: DEBUG cinder.coordination [None req-5bcd007b-875c-417c-a1bd-8b549ca5b7c5 tempest-TestVolumeBootPattern-1339247704 None] Lock "cinder-quobyte-603ceb8f-999e-4bdd-a2b4-3010a4fd6af5" released by "delete_volume" :: held 1.525s {{(pid=83528) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 25 16:01:55 devstack cinder-volume[83528]: DEBUG cinder.quota [None req-5bcd007b-875c-417c-a1bd-8b549ca5b7c5 tempest-TestVolumeBootPattern-1339247704 None] Created reservations ['db4a772e-babd-4b4f-b774-8b26fa1edb07', '022e3f51-191f-4bce-9db8-486134cd9d72', 'be1d943e-35bd-4746-b594-917efa566838', '62182f13-c17e-4bc5-a35f-a964176cd2a2'] {{(pid=83528) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 25 16:01:55 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-5bcd007b-875c-417c-a1bd-8b549ca5b7c5 tempest-TestVolumeBootPattern-1339247704 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 25 16:01:55 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-5bcd007b-875c-417c-a1bd-8b549ca5b7c5 tempest-TestVolumeBootPattern-1339247704 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 25 16:01:55 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.quobyte [None req-5bcd007b-875c-417c-a1bd-8b549ca5b7c5 tempest-TestVolumeBootPattern-1339247704 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23e9d725-3e04-4cd9-bfe0-c8ef43305589': None} {{(pid=83528) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 25 16:01:55 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.quobyte [None req-5bcd007b-875c-417c-a1bd-8b549ca5b7c5 tempest-TestVolumeBootPattern-1339247704 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23e9d725-3e04-4cd9-bfe0-c8ef43305589'] {{(pid=83528) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 25 16:01:55 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-5bcd007b-875c-417c-a1bd-8b549ca5b7c5 tempest-TestVolumeBootPattern-1339247704 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 25 16:01:55 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-5bcd007b-875c-417c-a1bd-8b549ca5b7c5 tempest-TestVolumeBootPattern-1339247704 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85 {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 25 16:01:55 devstack sudo[91252]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85 Feb 25 16:01:55 devstack sudo[91252]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 25 16:01:55 devstack sudo[91252]: pam_unix(sudo:session): session closed for user root Feb 25 16:01:55 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-5bcd007b-875c-417c-a1bd-8b549ca5b7c5 tempest-TestVolumeBootPattern-1339247704 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85" returned: 0 in 0.406s {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 25 16:01:55 devstack cinder-volume[83528]: DEBUG cinder.manager [None req-5bcd007b-875c-417c-a1bd-8b549ca5b7c5 tempest-TestVolumeBootPattern-1339247704 None] Notifying Schedulers of capabilities ... {{(pid=83528) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 25 16:01:55 devstack cinder-volume[83528]: INFO cinder.volume.manager [None req-5bcd007b-875c-417c-a1bd-8b549ca5b7c5 tempest-TestVolumeBootPattern-1339247704 None] Deleted volume successfully. Feb 25 16:01:55 devstack cinder-volume[83528]: DEBUG cinder.coordination [None req-5bcd007b-875c-417c-a1bd-8b549ca5b7c5 tempest-TestVolumeBootPattern-1339247704 None] Lock "cinder-603ceb8f-999e-4bdd-a2b4-3010a4fd6af5-delete_volume" released by "delete_volume" :: held 2.058s {{(pid=83528) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 25 16:02:02 devstack cinder-volume[83528]: DEBUG cinder.volume.flows.manager.create_volume [None req-9ddf1a31-08d6-4906-b7ca-1bf49b55622e tempest-CinderUnicodeTest-692596937 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83528) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 25 16:02:02 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-9ddf1a31-08d6-4906-b7ca-1bf49b55622e tempest-CinderUnicodeTest-692596937 None] Flow 'volume_create_manager' (2903965d-1ff2-45ab-8640-bb0f45d10283) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83528) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 25 16:02:02 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-9ddf1a31-08d6-4906-b7ca-1bf49b55622e tempest-CinderUnicodeTest-692596937 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (37e76a8b-7400-4026-83ae-81b78f054a55) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 25 16:02:02 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-9ddf1a31-08d6-4906-b7ca-1bf49b55622e tempest-CinderUnicodeTest-692596937 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (37e76a8b-7400-4026-83ae-81b78f054a55) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-25T15:02:03Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1cf24174-f534-40f0-b138-fa852ddaaf7e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a2751060c0ce4aaca170be2f0e42d8e9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-25T15:02:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-25T15:02:03Z,use_quota=True,user_id='99d6b65ad58e49c0a53b7893ecbddcc7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ce71c2f9-6543-4165-9653-a1529b2ea243),volume_type_id=ce71c2f9-6543-4165-9653-a1529b2ea243)' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 25 16:02:02 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-9ddf1a31-08d6-4906-b7ca-1bf49b55622e tempest-CinderUnicodeTest-692596937 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8d6c0228-46f7-403d-8308-0bfa64db08bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 25 16:02:02 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-9ddf1a31-08d6-4906-b7ca-1bf49b55622e tempest-CinderUnicodeTest-692596937 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8d6c0228-46f7-403d-8308-0bfa64db08bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 25 16:02:02 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-9ddf1a31-08d6-4906-b7ca-1bf49b55622e tempest-CinderUnicodeTest-692596937 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8e9ced90-5c0f-48a6-9d08-b79e6dc00b6a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 25 16:02:02 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-9ddf1a31-08d6-4906-b7ca-1bf49b55622e tempest-CinderUnicodeTest-692596937 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8e9ced90-5c0f-48a6-9d08-b79e6dc00b6a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1cf24174-f534-40f0-b138-fa852ddaaf7e', 'volume_name': 'volume-1cf24174-f534-40f0-b138-fa852ddaaf7e', 'volume_size': 1}' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 25 16:02:02 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-9ddf1a31-08d6-4906-b7ca-1bf49b55622e tempest-CinderUnicodeTest-692596937 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a7d2b348-2a89-4658-8679-5cdf9949507b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 25 16:02:02 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-9ddf1a31-08d6-4906-b7ca-1bf49b55622e tempest-CinderUnicodeTest-692596937 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a7d2b348-2a89-4658-8679-5cdf9949507b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 25 16:02:02 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-9ddf1a31-08d6-4906-b7ca-1bf49b55622e tempest-CinderUnicodeTest-692596937 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d184d376-6378-4634-b9cf-da164f7d1a1b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 25 16:02:02 devstack cinder-volume[83528]: INFO cinder.volume.flows.manager.create_volume [None req-9ddf1a31-08d6-4906-b7ca-1bf49b55622e tempest-CinderUnicodeTest-692596937 None] Volume 1cf24174-f534-40f0-b138-fa852ddaaf7e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1cf24174-f534-40f0-b138-fa852ddaaf7e', 'volume_size': 1} Feb 25 16:02:02 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-9ddf1a31-08d6-4906-b7ca-1bf49b55622e tempest-CinderUnicodeTest-692596937 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 25 16:02:02 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-9ddf1a31-08d6-4906-b7ca-1bf49b55622e tempest-CinderUnicodeTest-692596937 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 25 16:02:02 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.quobyte [None req-9ddf1a31-08d6-4906-b7ca-1bf49b55622e tempest-CinderUnicodeTest-692596937 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-25T15:02:03Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1cf24174-f534-40f0-b138-fa852ddaaf7e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a2751060c0ce4aaca170be2f0e42d8e9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-25T15:02:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-25T15:02:03Z,use_quota=True,user_id='99d6b65ad58e49c0a53b7893ecbddcc7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ce71c2f9-6543-4165-9653-a1529b2ea243),volume_type_id=ce71c2f9-6543-4165-9653-a1529b2ea243)}" {{(pid=83528) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 25 16:02:02 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.remotefs [None req-9ddf1a31-08d6-4906-b7ca-1bf49b55622e tempest-CinderUnicodeTest-692596937 None] Creating volume 1cf24174-f534-40f0-b138-fa852ddaaf7e {{(pid=83528) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 25 16:02:02 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-9ddf1a31-08d6-4906-b7ca-1bf49b55622e tempest-CinderUnicodeTest-692596937 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 25 16:02:02 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-9ddf1a31-08d6-4906-b7ca-1bf49b55622e tempest-CinderUnicodeTest-692596937 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 25 16:02:02 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.quobyte [None req-9ddf1a31-08d6-4906-b7ca-1bf49b55622e tempest-CinderUnicodeTest-692596937 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23e9d725-3e04-4cd9-bfe0-c8ef43305589': None} {{(pid=83528) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 25 16:02:02 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.quobyte [None req-9ddf1a31-08d6-4906-b7ca-1bf49b55622e tempest-CinderUnicodeTest-692596937 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23e9d725-3e04-4cd9-bfe0-c8ef43305589'] {{(pid=83528) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 25 16:02:02 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-9ddf1a31-08d6-4906-b7ca-1bf49b55622e tempest-CinderUnicodeTest-692596937 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 25 16:02:02 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.quobyte [None req-9ddf1a31-08d6-4906-b7ca-1bf49b55622e tempest-CinderUnicodeTest-692596937 None] Selected osci02.corp.quobyte.com/cinder-vol-23e9d725-3e04-4cd9-bfe0-c8ef43305589 as target Quobyte volume. {{(pid=83528) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 25 16:02:02 devstack cinder-volume[83528]: INFO cinder.volume.drivers.remotefs [None req-9ddf1a31-08d6-4906-b7ca-1bf49b55622e tempest-CinderUnicodeTest-692596937 None] casted to osci02.corp.quobyte.com/cinder-vol-23e9d725-3e04-4cd9-bfe0-c8ef43305589 Feb 25 16:02:02 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-9ddf1a31-08d6-4906-b7ca-1bf49b55622e tempest-CinderUnicodeTest-692596937 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-1cf24174-f534-40f0-b138-fa852ddaaf7e 1073741824 {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 25 16:02:02 devstack sudo[91259]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-1cf24174-f534-40f0-b138-fa852ddaaf7e 1073741824 Feb 25 16:02:02 devstack sudo[91259]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 25 16:02:03 devstack sudo[91259]: pam_unix(sudo:session): session closed for user root Feb 25 16:02:03 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-9ddf1a31-08d6-4906-b7ca-1bf49b55622e tempest-CinderUnicodeTest-692596937 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-1cf24174-f534-40f0-b138-fa852ddaaf7e 1073741824" returned: 0 in 0.466s {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 25 16:02:03 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-9ddf1a31-08d6-4906-b7ca-1bf49b55622e tempest-CinderUnicodeTest-692596937 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-1cf24174-f534-40f0-b138-fa852ddaaf7e {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 25 16:02:03 devstack sudo[91264]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-1cf24174-f534-40f0-b138-fa852ddaaf7e Feb 25 16:02:03 devstack sudo[91264]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 25 16:02:03 devstack sudo[91264]: pam_unix(sudo:session): session closed for user root Feb 25 16:02:03 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-9ddf1a31-08d6-4906-b7ca-1bf49b55622e tempest-CinderUnicodeTest-692596937 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-1cf24174-f534-40f0-b138-fa852ddaaf7e" returned: 0 in 0.394s {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 25 16:02:03 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.quobyte [None req-9ddf1a31-08d6-4906-b7ca-1bf49b55622e tempest-CinderUnicodeTest-692596937 None] <== create_volume: return (888ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-23e9d725-3e04-4cd9-bfe0-c8ef43305589'} {{(pid=83528) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 25 16:02:03 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-9ddf1a31-08d6-4906-b7ca-1bf49b55622e tempest-CinderUnicodeTest-692596937 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.890s {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 25 16:02:03 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-9ddf1a31-08d6-4906-b7ca-1bf49b55622e tempest-CinderUnicodeTest-692596937 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d184d376-6378-4634-b9cf-da164f7d1a1b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1cf24174-f534-40f0-b138-fa852ddaaf7e', 'volume_size': 1}' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 25 16:02:03 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-9ddf1a31-08d6-4906-b7ca-1bf49b55622e tempest-CinderUnicodeTest-692596937 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9c9cf97a-064c-48e7-baa7-8fa296182665) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 25 16:02:03 devstack cinder-volume[83528]: INFO cinder.volume.flows.manager.create_volume [None req-9ddf1a31-08d6-4906-b7ca-1bf49b55622e tempest-CinderUnicodeTest-692596937 None] Volume volume-1cf24174-f534-40f0-b138-fa852ddaaf7e (1cf24174-f534-40f0-b138-fa852ddaaf7e): created successfully Feb 25 16:02:03 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-9ddf1a31-08d6-4906-b7ca-1bf49b55622e tempest-CinderUnicodeTest-692596937 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9c9cf97a-064c-48e7-baa7-8fa296182665) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 25 16:02:03 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-9ddf1a31-08d6-4906-b7ca-1bf49b55622e tempest-CinderUnicodeTest-692596937 None] Flow 'volume_create_manager' (2903965d-1ff2-45ab-8640-bb0f45d10283) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83528) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 25 16:02:03 devstack cinder-volume[83528]: INFO cinder.volume.manager [None req-9ddf1a31-08d6-4906-b7ca-1bf49b55622e tempest-CinderUnicodeTest-692596937 None] Created volume successfully. Feb 25 16:02:05 devstack cinder-volume[83528]: DEBUG cinder.volume.flows.manager.create_volume [None req-46165b75-7694-40e0-a0d5-61f7f3ad763b tempest-CinderUnicodeTest-692596937 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83528) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 25 16:02:05 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-46165b75-7694-40e0-a0d5-61f7f3ad763b tempest-CinderUnicodeTest-692596937 None] Flow 'volume_create_manager' (ddd5461a-4634-44ac-97e8-135585fb2e0a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83528) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 25 16:02:05 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-46165b75-7694-40e0-a0d5-61f7f3ad763b tempest-CinderUnicodeTest-692596937 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8fffe3f9-f70e-4d84-bee0-8d3b8dfc98bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 25 16:02:05 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-46165b75-7694-40e0-a0d5-61f7f3ad763b tempest-CinderUnicodeTest-692596937 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8fffe3f9-f70e-4d84-bee0-8d3b8dfc98bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-25T15:02:05Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-465470111',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8310f5b5-9729-47c2-81b6-14bd07a02544,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a2751060c0ce4aaca170be2f0e42d8e9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-25T15:02:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-25T15:02:05Z,use_quota=True,user_id='99d6b65ad58e49c0a53b7893ecbddcc7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ce71c2f9-6543-4165-9653-a1529b2ea243),volume_type_id=ce71c2f9-6543-4165-9653-a1529b2ea243)' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 25 16:02:05 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-46165b75-7694-40e0-a0d5-61f7f3ad763b tempest-CinderUnicodeTest-692596937 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3536fa3c-c921-4a5b-8d43-8841d505a7c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 25 16:02:05 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-46165b75-7694-40e0-a0d5-61f7f3ad763b tempest-CinderUnicodeTest-692596937 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3536fa3c-c921-4a5b-8d43-8841d505a7c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 25 16:02:05 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-46165b75-7694-40e0-a0d5-61f7f3ad763b tempest-CinderUnicodeTest-692596937 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (88e0da3a-d0e4-4315-a10c-9ab862ccf131) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 25 16:02:05 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-46165b75-7694-40e0-a0d5-61f7f3ad763b tempest-CinderUnicodeTest-692596937 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (88e0da3a-d0e4-4315-a10c-9ab862ccf131) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8310f5b5-9729-47c2-81b6-14bd07a02544', 'volume_name': 'volume-8310f5b5-9729-47c2-81b6-14bd07a02544', 'volume_size': 1}' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 25 16:02:05 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-46165b75-7694-40e0-a0d5-61f7f3ad763b tempest-CinderUnicodeTest-692596937 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (92f80cd9-f136-4d43-8adf-52072e7f2d31) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 25 16:02:05 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-46165b75-7694-40e0-a0d5-61f7f3ad763b tempest-CinderUnicodeTest-692596937 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (92f80cd9-f136-4d43-8adf-52072e7f2d31) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 25 16:02:05 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-46165b75-7694-40e0-a0d5-61f7f3ad763b tempest-CinderUnicodeTest-692596937 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2da0f17b-56f9-4c9b-af76-7b7f5221623b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 25 16:02:05 devstack cinder-volume[83528]: INFO cinder.volume.flows.manager.create_volume [None req-46165b75-7694-40e0-a0d5-61f7f3ad763b tempest-CinderUnicodeTest-692596937 None] Volume 8310f5b5-9729-47c2-81b6-14bd07a02544: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8310f5b5-9729-47c2-81b6-14bd07a02544', 'volume_size': 1} Feb 25 16:02:05 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-46165b75-7694-40e0-a0d5-61f7f3ad763b tempest-CinderUnicodeTest-692596937 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 25 16:02:05 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-46165b75-7694-40e0-a0d5-61f7f3ad763b tempest-CinderUnicodeTest-692596937 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 25 16:02:05 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.quobyte [None req-46165b75-7694-40e0-a0d5-61f7f3ad763b tempest-CinderUnicodeTest-692596937 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-25T15:02:05Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-465470111',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8310f5b5-9729-47c2-81b6-14bd07a02544,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a2751060c0ce4aaca170be2f0e42d8e9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-25T15:02:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-25T15:02:05Z,use_quota=True,user_id='99d6b65ad58e49c0a53b7893ecbddcc7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ce71c2f9-6543-4165-9653-a1529b2ea243),volume_type_id=ce71c2f9-6543-4165-9653-a1529b2ea243)}" {{(pid=83528) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 25 16:02:05 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.remotefs [None req-46165b75-7694-40e0-a0d5-61f7f3ad763b tempest-CinderUnicodeTest-692596937 None] Creating volume 8310f5b5-9729-47c2-81b6-14bd07a02544 {{(pid=83528) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 25 16:02:05 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-46165b75-7694-40e0-a0d5-61f7f3ad763b tempest-CinderUnicodeTest-692596937 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 25 16:02:05 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-46165b75-7694-40e0-a0d5-61f7f3ad763b tempest-CinderUnicodeTest-692596937 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 25 16:02:05 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.quobyte [None req-46165b75-7694-40e0-a0d5-61f7f3ad763b tempest-CinderUnicodeTest-692596937 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23e9d725-3e04-4cd9-bfe0-c8ef43305589': None} {{(pid=83528) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 25 16:02:05 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.quobyte [None req-46165b75-7694-40e0-a0d5-61f7f3ad763b tempest-CinderUnicodeTest-692596937 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23e9d725-3e04-4cd9-bfe0-c8ef43305589'] {{(pid=83528) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 25 16:02:05 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-46165b75-7694-40e0-a0d5-61f7f3ad763b tempest-CinderUnicodeTest-692596937 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 25 16:02:05 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.quobyte [None req-46165b75-7694-40e0-a0d5-61f7f3ad763b tempest-CinderUnicodeTest-692596937 None] Selected osci02.corp.quobyte.com/cinder-vol-23e9d725-3e04-4cd9-bfe0-c8ef43305589 as target Quobyte volume. {{(pid=83528) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 25 16:02:05 devstack cinder-volume[83528]: INFO cinder.volume.drivers.remotefs [None req-46165b75-7694-40e0-a0d5-61f7f3ad763b tempest-CinderUnicodeTest-692596937 None] casted to osci02.corp.quobyte.com/cinder-vol-23e9d725-3e04-4cd9-bfe0-c8ef43305589 Feb 25 16:02:05 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-46165b75-7694-40e0-a0d5-61f7f3ad763b tempest-CinderUnicodeTest-692596937 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-8310f5b5-9729-47c2-81b6-14bd07a02544 1073741824 {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 25 16:02:05 devstack sudo[91268]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-8310f5b5-9729-47c2-81b6-14bd07a02544 1073741824 Feb 25 16:02:05 devstack sudo[91268]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 25 16:02:05 devstack sudo[91268]: pam_unix(sudo:session): session closed for user root Feb 25 16:02:05 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-46165b75-7694-40e0-a0d5-61f7f3ad763b tempest-CinderUnicodeTest-692596937 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-8310f5b5-9729-47c2-81b6-14bd07a02544 1073741824" returned: 0 in 0.462s {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 25 16:02:05 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-46165b75-7694-40e0-a0d5-61f7f3ad763b tempest-CinderUnicodeTest-692596937 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-8310f5b5-9729-47c2-81b6-14bd07a02544 {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 25 16:02:05 devstack sudo[91273]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-8310f5b5-9729-47c2-81b6-14bd07a02544 Feb 25 16:02:05 devstack sudo[91273]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 25 16:02:06 devstack sudo[91273]: pam_unix(sudo:session): session closed for user root Feb 25 16:02:06 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-46165b75-7694-40e0-a0d5-61f7f3ad763b tempest-CinderUnicodeTest-692596937 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-8310f5b5-9729-47c2-81b6-14bd07a02544" returned: 0 in 0.385s {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 25 16:02:06 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.quobyte [None req-46165b75-7694-40e0-a0d5-61f7f3ad763b tempest-CinderUnicodeTest-692596937 None] <== create_volume: return (872ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-23e9d725-3e04-4cd9-bfe0-c8ef43305589'} {{(pid=83528) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 25 16:02:06 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-46165b75-7694-40e0-a0d5-61f7f3ad763b tempest-CinderUnicodeTest-692596937 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.875s {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 25 16:02:06 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-46165b75-7694-40e0-a0d5-61f7f3ad763b tempest-CinderUnicodeTest-692596937 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2da0f17b-56f9-4c9b-af76-7b7f5221623b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8310f5b5-9729-47c2-81b6-14bd07a02544', 'volume_size': 1}' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 25 16:02:06 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-46165b75-7694-40e0-a0d5-61f7f3ad763b tempest-CinderUnicodeTest-692596937 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e333663f-e6ef-4837-836d-743c7cb2b917) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 25 16:02:06 devstack cinder-volume[83528]: INFO cinder.volume.flows.manager.create_volume [None req-46165b75-7694-40e0-a0d5-61f7f3ad763b tempest-CinderUnicodeTest-692596937 None] Volume volume-8310f5b5-9729-47c2-81b6-14bd07a02544 (8310f5b5-9729-47c2-81b6-14bd07a02544): created successfully Feb 25 16:02:06 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-46165b75-7694-40e0-a0d5-61f7f3ad763b tempest-CinderUnicodeTest-692596937 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e333663f-e6ef-4837-836d-743c7cb2b917) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 25 16:02:06 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-46165b75-7694-40e0-a0d5-61f7f3ad763b tempest-CinderUnicodeTest-692596937 None] Flow 'volume_create_manager' (ddd5461a-4634-44ac-97e8-135585fb2e0a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83528) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 25 16:02:06 devstack cinder-volume[83528]: INFO cinder.volume.manager [None req-46165b75-7694-40e0-a0d5-61f7f3ad763b tempest-CinderUnicodeTest-692596937 None] Created volume successfully. Feb 25 16:02:06 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-677bdd0a-41e4-4d28-9a9a-20c10eea4cd9 tempest-CinderUnicodeTest-692596937 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 25 16:02:06 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-677bdd0a-41e4-4d28-9a9a-20c10eea4cd9 tempest-CinderUnicodeTest-692596937 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 25 16:02:06 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.remotefs [None req-677bdd0a-41e4-4d28-9a9a-20c10eea4cd9 tempest-CinderUnicodeTest-692596937 None] Creating offline snapshot 99a03b10-4ffb-4bd2-b760-1f97eaf96023 of volume 8310f5b5-9729-47c2-81b6-14bd07a02544 {{(pid=83528) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Feb 25 16:02:06 devstack cinder-volume[83528]: DEBUG oslo.privsep.daemon [-] privsep: reply[1754cd0b-3cb3-40b8-bbc6-0936df3bd4d9]: (4, 'qcow2') {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 25 16:02:06 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-677bdd0a-41e4-4d28-9a9a-20c10eea4cd9 tempest-CinderUnicodeTest-692596937 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-8310f5b5-9729-47c2-81b6-14bd07a02544 {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 25 16:02:06 devstack sudo[91276]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-8310f5b5-9729-47c2-81b6-14bd07a02544 Feb 25 16:02:06 devstack sudo[91276]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 25 16:02:06 devstack sudo[91276]: pam_unix(sudo:session): session closed for user root Feb 25 16:02:06 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-677bdd0a-41e4-4d28-9a9a-20c10eea4cd9 tempest-CinderUnicodeTest-692596937 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-8310f5b5-9729-47c2-81b6-14bd07a02544" returned: 0 in 0.473s {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 25 16:02:06 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-677bdd0a-41e4-4d28-9a9a-20c10eea4cd9 tempest-CinderUnicodeTest-692596937 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-8310f5b5-9729-47c2-81b6-14bd07a02544,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-8310f5b5-9729-47c2-81b6-14bd07a02544.99a03b10-4ffb-4bd2-b760-1f97eaf96023 1G {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 25 16:02:07 devstack sudo[91281]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-8310f5b5-9729-47c2-81b6-14bd07a02544,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-8310f5b5-9729-47c2-81b6-14bd07a02544.99a03b10-4ffb-4bd2-b760-1f97eaf96023 1G Feb 25 16:02:07 devstack sudo[91281]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 25 16:02:07 devstack sudo[91281]: pam_unix(sudo:session): session closed for user root Feb 25 16:02:07 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-677bdd0a-41e4-4d28-9a9a-20c10eea4cd9 tempest-CinderUnicodeTest-692596937 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-8310f5b5-9729-47c2-81b6-14bd07a02544,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-8310f5b5-9729-47c2-81b6-14bd07a02544.99a03b10-4ffb-4bd2-b760-1f97eaf96023 1G" returned: 0 in 0.491s {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 25 16:02:07 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-677bdd0a-41e4-4d28-9a9a-20c10eea4cd9 tempest-CinderUnicodeTest-692596937 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8310f5b5-9729-47c2-81b6-14bd07a02544 -F qcow2 /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-8310f5b5-9729-47c2-81b6-14bd07a02544.99a03b10-4ffb-4bd2-b760-1f97eaf96023 {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 25 16:02:07 devstack sudo[91286]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8310f5b5-9729-47c2-81b6-14bd07a02544 -F qcow2 /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-8310f5b5-9729-47c2-81b6-14bd07a02544.99a03b10-4ffb-4bd2-b760-1f97eaf96023 Feb 25 16:02:07 devstack sudo[91286]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 25 16:02:07 devstack sudo[91286]: pam_unix(sudo:session): session closed for user root Feb 25 16:02:07 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-677bdd0a-41e4-4d28-9a9a-20c10eea4cd9 tempest-CinderUnicodeTest-692596937 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8310f5b5-9729-47c2-81b6-14bd07a02544 -F qcow2 /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-8310f5b5-9729-47c2-81b6-14bd07a02544.99a03b10-4ffb-4bd2-b760-1f97eaf96023" returned: 0 in 0.430s {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 25 16:02:07 devstack cinder-volume[83528]: WARNING cinder.volume.drivers.remotefs [None req-677bdd0a-41e4-4d28-9a9a-20c10eea4cd9 tempest-CinderUnicodeTest-692596937 None] /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-8310f5b5-9729-47c2-81b6-14bd07a02544.99a03b10-4ffb-4bd2-b760-1f97eaf96023 is being set with open permissions: ugo+rw Feb 25 16:02:07 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-677bdd0a-41e4-4d28-9a9a-20c10eea4cd9 tempest-CinderUnicodeTest-692596937 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-8310f5b5-9729-47c2-81b6-14bd07a02544.99a03b10-4ffb-4bd2-b760-1f97eaf96023 {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 25 16:02:07 devstack sudo[91291]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-8310f5b5-9729-47c2-81b6-14bd07a02544.99a03b10-4ffb-4bd2-b760-1f97eaf96023 Feb 25 16:02:07 devstack sudo[91291]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 25 16:02:08 devstack sudo[91291]: pam_unix(sudo:session): session closed for user root Feb 25 16:02:08 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-677bdd0a-41e4-4d28-9a9a-20c10eea4cd9 tempest-CinderUnicodeTest-692596937 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-8310f5b5-9729-47c2-81b6-14bd07a02544.99a03b10-4ffb-4bd2-b760-1f97eaf96023" returned: 0 in 0.390s {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 25 16:02:08 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-677bdd0a-41e4-4d28-9a9a-20c10eea4cd9 tempest-CinderUnicodeTest-692596937 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-8310f5b5-9729-47c2-81b6-14bd07a02544.info {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 25 16:02:08 devstack sudo[91294]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-8310f5b5-9729-47c2-81b6-14bd07a02544.info Feb 25 16:02:08 devstack sudo[91294]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 25 16:02:08 devstack sudo[91294]: pam_unix(sudo:session): session closed for user root Feb 25 16:02:08 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-677bdd0a-41e4-4d28-9a9a-20c10eea4cd9 tempest-CinderUnicodeTest-692596937 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-8310f5b5-9729-47c2-81b6-14bd07a02544.info" returned: 0 in 0.410s {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 25 16:02:08 devstack cinder-volume[83528]: WARNING cinder.volume.drivers.remotefs [None req-677bdd0a-41e4-4d28-9a9a-20c10eea4cd9 tempest-CinderUnicodeTest-692596937 None] /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-8310f5b5-9729-47c2-81b6-14bd07a02544.info is being set with open permissions: ugo+rw Feb 25 16:02:08 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-677bdd0a-41e4-4d28-9a9a-20c10eea4cd9 tempest-CinderUnicodeTest-692596937 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-8310f5b5-9729-47c2-81b6-14bd07a02544.info {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 25 16:02:08 devstack sudo[91297]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-8310f5b5-9729-47c2-81b6-14bd07a02544.info Feb 25 16:02:08 devstack sudo[91297]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 25 16:02:09 devstack sudo[91297]: pam_unix(sudo:session): session closed for user root Feb 25 16:02:09 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-677bdd0a-41e4-4d28-9a9a-20c10eea4cd9 tempest-CinderUnicodeTest-692596937 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-8310f5b5-9729-47c2-81b6-14bd07a02544.info" returned: 0 in 0.401s {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 25 16:02:09 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-677bdd0a-41e4-4d28-9a9a-20c10eea4cd9 tempest-CinderUnicodeTest-692596937 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.653s {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 25 16:02:09 devstack cinder-volume[83528]: INFO cinder.volume.manager [None req-677bdd0a-41e4-4d28-9a9a-20c10eea4cd9 tempest-CinderUnicodeTest-692596937 None] Create snapshot completed successfully Feb 25 16:02:09 devstack cinder-volume[83528]: DEBUG cinder.coordination [None req-d4e72db5-3696-4c15-9b8a-09041ac34cbd tempest-CinderUnicodeTest-692596937 None] Acquiring lock "cinder-99a03b10-4ffb-4bd2-b760-1f97eaf96023-delete_snapshot" by "delete_snapshot" {{(pid=83528) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 25 16:02:09 devstack cinder-volume[83528]: DEBUG cinder.coordination [None req-d4e72db5-3696-4c15-9b8a-09041ac34cbd tempest-CinderUnicodeTest-692596937 None] Lock "cinder-99a03b10-4ffb-4bd2-b760-1f97eaf96023-delete_snapshot" acquired by "delete_snapshot" :: waited 0.010s {{(pid=83528) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 25 16:02:09 devstack cinder-volume[83528]: DEBUG cinder.coordination [None req-d4e72db5-3696-4c15-9b8a-09041ac34cbd tempest-CinderUnicodeTest-692596937 None] Acquiring lock "cinder-quobyte-8310f5b5-9729-47c2-81b6-14bd07a02544" by "delete_snapshot" {{(pid=83528) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 25 16:02:09 devstack cinder-volume[83528]: DEBUG cinder.coordination [None req-d4e72db5-3696-4c15-9b8a-09041ac34cbd tempest-CinderUnicodeTest-692596937 None] Lock "cinder-quobyte-8310f5b5-9729-47c2-81b6-14bd07a02544" acquired by "delete_snapshot" :: waited 0.008s {{(pid=83528) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 25 16:02:09 devstack cinder-volume[83528]: DEBUG cinder.coordination [None req-d4e72db5-3696-4c15-9b8a-09041ac34cbd tempest-CinderUnicodeTest-692596937 None] Acquiring lock "cinder-quobyte-99a03b10-4ffb-4bd2-b760-1f97eaf96023" by "_delete_snapshot" {{(pid=83528) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 25 16:02:09 devstack cinder-volume[83528]: DEBUG cinder.coordination [None req-d4e72db5-3696-4c15-9b8a-09041ac34cbd tempest-CinderUnicodeTest-692596937 None] Lock "cinder-quobyte-99a03b10-4ffb-4bd2-b760-1f97eaf96023" acquired by "_delete_snapshot" :: waited 0.009s {{(pid=83528) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 25 16:02:09 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.remotefs [None req-d4e72db5-3696-4c15-9b8a-09041ac34cbd tempest-CinderUnicodeTest-692596937 None] Deleting offline snapshot 99a03b10-4ffb-4bd2-b760-1f97eaf96023 of volume 8310f5b5-9729-47c2-81b6-14bd07a02544 {{(pid=83528) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Feb 25 16:02:09 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.remotefs [None req-d4e72db5-3696-4c15-9b8a-09041ac34cbd tempest-CinderUnicodeTest-692596937 None] snapshot_file for this snap is: volume-8310f5b5-9729-47c2-81b6-14bd07a02544.99a03b10-4ffb-4bd2-b760-1f97eaf96023 {{(pid=83528) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Feb 25 16:02:09 devstack cinder-volume[83528]: DEBUG oslo.privsep.daemon [-] privsep: reply[0fa2001d-746e-4521-a0bf-4a23e4f2c1e1]: (4, 'qcow2') {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 25 16:02:09 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-d4e72db5-3696-4c15-9b8a-09041ac34cbd tempest-CinderUnicodeTest-692596937 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-8310f5b5-9729-47c2-81b6-14bd07a02544.99a03b10-4ffb-4bd2-b760-1f97eaf96023 {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 25 16:02:09 devstack sudo[91300]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-8310f5b5-9729-47c2-81b6-14bd07a02544.99a03b10-4ffb-4bd2-b760-1f97eaf96023 Feb 25 16:02:09 devstack sudo[91300]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 25 16:02:10 devstack sudo[91300]: pam_unix(sudo:session): session closed for user root Feb 25 16:02:10 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-d4e72db5-3696-4c15-9b8a-09041ac34cbd tempest-CinderUnicodeTest-692596937 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-8310f5b5-9729-47c2-81b6-14bd07a02544.99a03b10-4ffb-4bd2-b760-1f97eaf96023" returned: 0 in 0.465s {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 25 16:02:10 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.remotefs [None req-d4e72db5-3696-4c15-9b8a-09041ac34cbd tempest-CinderUnicodeTest-692596937 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8310f5b5-9729-47c2-81b6-14bd07a02544(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83528) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Feb 25 16:02:10 devstack cinder-volume[83528]: DEBUG oslo.privsep.daemon [-] privsep: reply[cff9c3e1-40e3-46c2-8334-3a9297d2da9c]: (4, 'qcow2') {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 25 16:02:10 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-d4e72db5-3696-4c15-9b8a-09041ac34cbd tempest-CinderUnicodeTest-692596937 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-8310f5b5-9729-47c2-81b6-14bd07a02544 {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 25 16:02:10 devstack sudo[91305]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-8310f5b5-9729-47c2-81b6-14bd07a02544 Feb 25 16:02:10 devstack sudo[91305]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 25 16:02:10 devstack sudo[91305]: pam_unix(sudo:session): session closed for user root Feb 25 16:02:10 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-d4e72db5-3696-4c15-9b8a-09041ac34cbd tempest-CinderUnicodeTest-692596937 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-8310f5b5-9729-47c2-81b6-14bd07a02544" returned: 0 in 0.537s {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 25 16:02:10 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-d4e72db5-3696-4c15-9b8a-09041ac34cbd tempest-CinderUnicodeTest-692596937 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-8310f5b5-9729-47c2-81b6-14bd07a02544.99a03b10-4ffb-4bd2-b760-1f97eaf96023 {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 25 16:02:10 devstack sudo[91310]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-8310f5b5-9729-47c2-81b6-14bd07a02544.99a03b10-4ffb-4bd2-b760-1f97eaf96023 Feb 25 16:02:10 devstack sudo[91310]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 25 16:02:11 devstack sudo[91310]: pam_unix(sudo:session): session closed for user root Feb 25 16:02:11 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-d4e72db5-3696-4c15-9b8a-09041ac34cbd tempest-CinderUnicodeTest-692596937 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-8310f5b5-9729-47c2-81b6-14bd07a02544.99a03b10-4ffb-4bd2-b760-1f97eaf96023" returned: 0 in 0.486s {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 25 16:02:11 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-d4e72db5-3696-4c15-9b8a-09041ac34cbd tempest-CinderUnicodeTest-692596937 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-8310f5b5-9729-47c2-81b6-14bd07a02544.99a03b10-4ffb-4bd2-b760-1f97eaf96023 {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 25 16:02:11 devstack sudo[91315]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-8310f5b5-9729-47c2-81b6-14bd07a02544.99a03b10-4ffb-4bd2-b760-1f97eaf96023 Feb 25 16:02:11 devstack sudo[91315]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 25 16:02:11 devstack sudo[91315]: pam_unix(sudo:session): session closed for user root Feb 25 16:02:11 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-d4e72db5-3696-4c15-9b8a-09041ac34cbd tempest-CinderUnicodeTest-692596937 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-8310f5b5-9729-47c2-81b6-14bd07a02544.99a03b10-4ffb-4bd2-b760-1f97eaf96023" returned: 0 in 0.446s {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 25 16:02:11 devstack cinder-volume[83528]: DEBUG cinder.coordination [None req-d4e72db5-3696-4c15-9b8a-09041ac34cbd tempest-CinderUnicodeTest-692596937 None] Lock "cinder-quobyte-99a03b10-4ffb-4bd2-b760-1f97eaf96023" released by "_delete_snapshot" :: held 1.988s {{(pid=83528) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 25 16:02:11 devstack cinder-volume[83528]: DEBUG cinder.coordination [None req-d4e72db5-3696-4c15-9b8a-09041ac34cbd tempest-CinderUnicodeTest-692596937 None] Lock "cinder-quobyte-8310f5b5-9729-47c2-81b6-14bd07a02544" released by "delete_snapshot" :: held 2.004s {{(pid=83528) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 25 16:02:11 devstack cinder-volume[83528]: DEBUG cinder.quota [None req-d4e72db5-3696-4c15-9b8a-09041ac34cbd tempest-CinderUnicodeTest-692596937 None] Created reservations ['8ef63f05-f86e-457c-a8a2-31b60eeb03b0', '140fb6d7-4900-4a6f-85ca-f361abe147c8', 'ecdf9211-dbed-49ec-bf60-b45a29801e8a', '909e2d48-0024-4299-b99f-b1a917d8f768'] {{(pid=83528) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 25 16:02:11 devstack cinder-volume[83528]: INFO cinder.volume.manager [None req-d4e72db5-3696-4c15-9b8a-09041ac34cbd tempest-CinderUnicodeTest-692596937 None] Delete snapshot completed successfully. Feb 25 16:02:11 devstack cinder-volume[83528]: DEBUG cinder.coordination [None req-d4e72db5-3696-4c15-9b8a-09041ac34cbd tempest-CinderUnicodeTest-692596937 None] Lock "cinder-99a03b10-4ffb-4bd2-b760-1f97eaf96023-delete_snapshot" released by "delete_snapshot" :: held 2.111s {{(pid=83528) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 25 16:02:12 devstack cinder-volume[83528]: DEBUG cinder.coordination [None req-d3607ba1-4d60-4c03-a04a-3a33cfd70462 tempest-CinderUnicodeTest-692596937 None] Acquiring lock "cinder-8310f5b5-9729-47c2-81b6-14bd07a02544-delete_volume" by "delete_volume" {{(pid=83528) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 25 16:02:12 devstack cinder-volume[83528]: DEBUG cinder.coordination [None req-d3607ba1-4d60-4c03-a04a-3a33cfd70462 tempest-CinderUnicodeTest-692596937 None] Lock "cinder-8310f5b5-9729-47c2-81b6-14bd07a02544-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=83528) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 25 16:02:12 devstack cinder-volume[83528]: DEBUG cinder.coordination [None req-d3607ba1-4d60-4c03-a04a-3a33cfd70462 tempest-CinderUnicodeTest-692596937 None] Acquiring lock "cinder-quobyte-8310f5b5-9729-47c2-81b6-14bd07a02544" by "delete_volume" {{(pid=83528) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 25 16:02:12 devstack cinder-volume[83528]: DEBUG cinder.coordination [None req-d3607ba1-4d60-4c03-a04a-3a33cfd70462 tempest-CinderUnicodeTest-692596937 None] Lock "cinder-quobyte-8310f5b5-9729-47c2-81b6-14bd07a02544" acquired by "delete_volume" :: waited 0.011s {{(pid=83528) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 25 16:02:12 devstack cinder-volume[83528]: DEBUG oslo.privsep.daemon [-] privsep: reply[e187172e-aebc-4d96-98a7-33e67a185516]: (4, 'qcow2') {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 25 16:02:12 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-d3607ba1-4d60-4c03-a04a-3a33cfd70462 tempest-CinderUnicodeTest-692596937 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-8310f5b5-9729-47c2-81b6-14bd07a02544 {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 25 16:02:12 devstack sudo[91318]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-8310f5b5-9729-47c2-81b6-14bd07a02544 Feb 25 16:02:12 devstack sudo[91318]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 25 16:02:13 devstack sudo[91318]: pam_unix(sudo:session): session closed for user root Feb 25 16:02:13 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-d3607ba1-4d60-4c03-a04a-3a33cfd70462 tempest-CinderUnicodeTest-692596937 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-8310f5b5-9729-47c2-81b6-14bd07a02544" returned: 0 in 0.453s {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 25 16:02:13 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-d3607ba1-4d60-4c03-a04a-3a33cfd70462 tempest-CinderUnicodeTest-692596937 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-8310f5b5-9729-47c2-81b6-14bd07a02544 {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 25 16:02:13 devstack sudo[91337]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-8310f5b5-9729-47c2-81b6-14bd07a02544 Feb 25 16:02:13 devstack sudo[91337]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 25 16:02:13 devstack sudo[91337]: pam_unix(sudo:session): session closed for user root Feb 25 16:02:13 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-d3607ba1-4d60-4c03-a04a-3a33cfd70462 tempest-CinderUnicodeTest-692596937 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-8310f5b5-9729-47c2-81b6-14bd07a02544" returned: 0 in 0.405s {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 25 16:02:13 devstack cinder-volume[83528]: DEBUG cinder.coordination [None req-d3607ba1-4d60-4c03-a04a-3a33cfd70462 tempest-CinderUnicodeTest-692596937 None] Lock "cinder-quobyte-8310f5b5-9729-47c2-81b6-14bd07a02544" released by "delete_volume" :: held 0.900s {{(pid=83528) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 25 16:02:13 devstack cinder-volume[83528]: DEBUG cinder.quota [None req-d3607ba1-4d60-4c03-a04a-3a33cfd70462 tempest-CinderUnicodeTest-692596937 None] Created reservations ['8f921f86-2980-4abb-81e5-7d85edde5158', 'cec03ca4-ab71-425b-8191-cb2f230dff5e', 'd20ad403-0c8e-404c-b66a-96aaf023db2b', 'e59266ed-10fa-41cb-a409-6d7004886f63'] {{(pid=83528) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 25 16:02:13 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-d3607ba1-4d60-4c03-a04a-3a33cfd70462 tempest-CinderUnicodeTest-692596937 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 25 16:02:13 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-d3607ba1-4d60-4c03-a04a-3a33cfd70462 tempest-CinderUnicodeTest-692596937 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 25 16:02:13 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.quobyte [None req-d3607ba1-4d60-4c03-a04a-3a33cfd70462 tempest-CinderUnicodeTest-692596937 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23e9d725-3e04-4cd9-bfe0-c8ef43305589': None} {{(pid=83528) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 25 16:02:13 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.quobyte [None req-d3607ba1-4d60-4c03-a04a-3a33cfd70462 tempest-CinderUnicodeTest-692596937 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23e9d725-3e04-4cd9-bfe0-c8ef43305589'] {{(pid=83528) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 25 16:02:13 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-d3607ba1-4d60-4c03-a04a-3a33cfd70462 tempest-CinderUnicodeTest-692596937 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 25 16:02:13 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-d3607ba1-4d60-4c03-a04a-3a33cfd70462 tempest-CinderUnicodeTest-692596937 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85 {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 25 16:02:13 devstack sudo[91366]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85 Feb 25 16:02:13 devstack sudo[91366]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 25 16:02:13 devstack cinder-volume[83528]: DEBUG cinder.coordination [None req-c5903e1d-c3e9-4015-910f-e3db75052624 tempest-CinderUnicodeTest-692596937 None] Acquiring lock "cinder-1cf24174-f534-40f0-b138-fa852ddaaf7e-delete_volume" by "delete_volume" {{(pid=83528) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 25 16:02:13 devstack cinder-volume[83528]: DEBUG cinder.coordination [None req-c5903e1d-c3e9-4015-910f-e3db75052624 tempest-CinderUnicodeTest-692596937 None] Lock "cinder-1cf24174-f534-40f0-b138-fa852ddaaf7e-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=83528) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 25 16:02:13 devstack cinder-volume[83528]: DEBUG cinder.coordination [None req-c5903e1d-c3e9-4015-910f-e3db75052624 tempest-CinderUnicodeTest-692596937 None] Acquiring lock "cinder-quobyte-1cf24174-f534-40f0-b138-fa852ddaaf7e" by "delete_volume" {{(pid=83528) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 25 16:02:13 devstack cinder-volume[83528]: DEBUG cinder.coordination [None req-c5903e1d-c3e9-4015-910f-e3db75052624 tempest-CinderUnicodeTest-692596937 None] Lock "cinder-quobyte-1cf24174-f534-40f0-b138-fa852ddaaf7e" acquired by "delete_volume" :: waited 0.007s {{(pid=83528) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 25 16:02:14 devstack cinder-volume[83528]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee26654b-d43a-4ab7-945c-004196af68aa]: (4, 'qcow2') {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 25 16:02:14 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-c5903e1d-c3e9-4015-910f-e3db75052624 tempest-CinderUnicodeTest-692596937 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-1cf24174-f534-40f0-b138-fa852ddaaf7e {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 25 16:02:14 devstack sudo[91368]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-1cf24174-f534-40f0-b138-fa852ddaaf7e Feb 25 16:02:14 devstack sudo[91368]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 25 16:02:14 devstack sudo[91366]: pam_unix(sudo:session): session closed for user root Feb 25 16:02:14 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-d3607ba1-4d60-4c03-a04a-3a33cfd70462 tempest-CinderUnicodeTest-692596937 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85" returned: 0 in 0.460s {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 25 16:02:14 devstack cinder-volume[83528]: DEBUG cinder.manager [None req-d3607ba1-4d60-4c03-a04a-3a33cfd70462 tempest-CinderUnicodeTest-692596937 None] Notifying Schedulers of capabilities ... {{(pid=83528) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 25 16:02:14 devstack cinder-volume[83528]: INFO cinder.volume.manager [None req-d3607ba1-4d60-4c03-a04a-3a33cfd70462 tempest-CinderUnicodeTest-692596937 None] Deleted volume successfully. Feb 25 16:02:14 devstack cinder-volume[83528]: DEBUG cinder.coordination [None req-d3607ba1-4d60-4c03-a04a-3a33cfd70462 tempest-CinderUnicodeTest-692596937 None] Lock "cinder-8310f5b5-9729-47c2-81b6-14bd07a02544-delete_volume" released by "delete_volume" :: held 1.519s {{(pid=83528) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 25 16:02:14 devstack sudo[91368]: pam_unix(sudo:session): session closed for user root Feb 25 16:02:14 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-c5903e1d-c3e9-4015-910f-e3db75052624 tempest-CinderUnicodeTest-692596937 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-1cf24174-f534-40f0-b138-fa852ddaaf7e" returned: 0 in 0.552s {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 25 16:02:14 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-c5903e1d-c3e9-4015-910f-e3db75052624 tempest-CinderUnicodeTest-692596937 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-1cf24174-f534-40f0-b138-fa852ddaaf7e {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 25 16:02:14 devstack sudo[91375]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-1cf24174-f534-40f0-b138-fa852ddaaf7e Feb 25 16:02:14 devstack sudo[91375]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 25 16:02:14 devstack sudo[91375]: pam_unix(sudo:session): session closed for user root Feb 25 16:02:14 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-c5903e1d-c3e9-4015-910f-e3db75052624 tempest-CinderUnicodeTest-692596937 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-1cf24174-f534-40f0-b138-fa852ddaaf7e" returned: 0 in 0.403s {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 25 16:02:14 devstack cinder-volume[83528]: DEBUG cinder.coordination [None req-c5903e1d-c3e9-4015-910f-e3db75052624 tempest-CinderUnicodeTest-692596937 None] Lock "cinder-quobyte-1cf24174-f534-40f0-b138-fa852ddaaf7e" released by "delete_volume" :: held 0.979s {{(pid=83528) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 25 16:02:15 devstack cinder-volume[83528]: DEBUG cinder.quota [None req-c5903e1d-c3e9-4015-910f-e3db75052624 tempest-CinderUnicodeTest-692596937 None] Created reservations ['9869c1ea-85fe-4de5-a32e-02b0e815fc25', 'c2e4074f-9584-40b7-b024-405b83c1ce20', '16769779-7ac5-4d5e-a600-7e8d6408df8d', '8c0b3ec9-f596-4b5c-a5cb-ba7248a5d5ed'] {{(pid=83528) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 25 16:02:15 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-c5903e1d-c3e9-4015-910f-e3db75052624 tempest-CinderUnicodeTest-692596937 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 25 16:02:15 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-c5903e1d-c3e9-4015-910f-e3db75052624 tempest-CinderUnicodeTest-692596937 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 25 16:02:15 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.quobyte [None req-c5903e1d-c3e9-4015-910f-e3db75052624 tempest-CinderUnicodeTest-692596937 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23e9d725-3e04-4cd9-bfe0-c8ef43305589': None} {{(pid=83528) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 25 16:02:15 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.quobyte [None req-c5903e1d-c3e9-4015-910f-e3db75052624 tempest-CinderUnicodeTest-692596937 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23e9d725-3e04-4cd9-bfe0-c8ef43305589'] {{(pid=83528) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 25 16:02:15 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-c5903e1d-c3e9-4015-910f-e3db75052624 tempest-CinderUnicodeTest-692596937 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 25 16:02:15 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-c5903e1d-c3e9-4015-910f-e3db75052624 tempest-CinderUnicodeTest-692596937 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85 {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 25 16:02:15 devstack sudo[91379]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85 Feb 25 16:02:15 devstack sudo[91379]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 25 16:02:15 devstack sudo[91379]: pam_unix(sudo:session): session closed for user root Feb 25 16:02:15 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-c5903e1d-c3e9-4015-910f-e3db75052624 tempest-CinderUnicodeTest-692596937 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85" returned: 0 in 0.388s {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 25 16:02:15 devstack cinder-volume[83528]: DEBUG cinder.manager [None req-c5903e1d-c3e9-4015-910f-e3db75052624 tempest-CinderUnicodeTest-692596937 None] Notifying Schedulers of capabilities ... {{(pid=83528) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 25 16:02:15 devstack cinder-volume[83528]: INFO cinder.volume.manager [None req-c5903e1d-c3e9-4015-910f-e3db75052624 tempest-CinderUnicodeTest-692596937 None] Deleted volume successfully. Feb 25 16:02:15 devstack cinder-volume[83528]: DEBUG cinder.coordination [None req-c5903e1d-c3e9-4015-910f-e3db75052624 tempest-CinderUnicodeTest-692596937 None] Lock "cinder-1cf24174-f534-40f0-b138-fa852ddaaf7e-delete_volume" released by "delete_volume" :: held 1.514s {{(pid=83528) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 25 16:02:23 devstack cinder-volume[83528]: DEBUG cinder.volume.flows.manager.create_volume [None req-ddf944db-fc4c-459e-b76d-20bbe25b11f3 tempest-CreateVolumesFromImageTest-1720772828 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83528) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 25 16:02:23 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-ddf944db-fc4c-459e-b76d-20bbe25b11f3 tempest-CreateVolumesFromImageTest-1720772828 None] Flow 'volume_create_manager' (bb172e11-fd66-4a99-b74a-1d13fd1b3a13) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83528) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 25 16:02:23 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-ddf944db-fc4c-459e-b76d-20bbe25b11f3 tempest-CreateVolumesFromImageTest-1720772828 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4e4023a8-e6ea-406a-b954-78bda4800c0c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 25 16:02:23 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-ddf944db-fc4c-459e-b76d-20bbe25b11f3 tempest-CreateVolumesFromImageTest-1720772828 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4e4023a8-e6ea-406a-b954-78bda4800c0c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-25T15:02:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-48514173',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c5c32c0e-8713-4292-8dbd-ce2076f4bba6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1200ff7ee62646899ee6afb73c3faf68',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-25T15:02:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-25T15:02:24Z,use_quota=True,user_id='8d6a8e233f984f4f8eaebe7b2e641ec2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ce71c2f9-6543-4165-9653-a1529b2ea243),volume_type_id=ce71c2f9-6543-4165-9653-a1529b2ea243)' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 25 16:02:23 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-ddf944db-fc4c-459e-b76d-20bbe25b11f3 tempest-CreateVolumesFromImageTest-1720772828 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4ae3fcfd-1fc6-4536-9539-5e813a947dec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 25 16:02:23 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-ddf944db-fc4c-459e-b76d-20bbe25b11f3 tempest-CreateVolumesFromImageTest-1720772828 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4ae3fcfd-1fc6-4536-9539-5e813a947dec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 25 16:02:23 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-ddf944db-fc4c-459e-b76d-20bbe25b11f3 tempest-CreateVolumesFromImageTest-1720772828 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (58a1954f-a979-41db-bb64-d8468113f068) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 25 16:02:23 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-ddf944db-fc4c-459e-b76d-20bbe25b11f3 tempest-CreateVolumesFromImageTest-1720772828 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (58a1954f-a979-41db-bb64-d8468113f068) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c5c32c0e-8713-4292-8dbd-ce2076f4bba6', 'volume_name': 'volume-c5c32c0e-8713-4292-8dbd-ce2076f4bba6', 'volume_size': 1}' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 25 16:02:23 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-ddf944db-fc4c-459e-b76d-20bbe25b11f3 tempest-CreateVolumesFromImageTest-1720772828 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d1efd2dd-f19d-4085-bb2b-66d3293bf6e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 25 16:02:23 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-ddf944db-fc4c-459e-b76d-20bbe25b11f3 tempest-CreateVolumesFromImageTest-1720772828 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d1efd2dd-f19d-4085-bb2b-66d3293bf6e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 25 16:02:23 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-ddf944db-fc4c-459e-b76d-20bbe25b11f3 tempest-CreateVolumesFromImageTest-1720772828 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2c906f45-0feb-4a63-b1ab-57cf186fa6b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 25 16:02:23 devstack cinder-volume[83528]: INFO cinder.volume.flows.manager.create_volume [None req-ddf944db-fc4c-459e-b76d-20bbe25b11f3 tempest-CreateVolumesFromImageTest-1720772828 None] Volume c5c32c0e-8713-4292-8dbd-ce2076f4bba6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c5c32c0e-8713-4292-8dbd-ce2076f4bba6', 'volume_size': 1} Feb 25 16:02:23 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-ddf944db-fc4c-459e-b76d-20bbe25b11f3 tempest-CreateVolumesFromImageTest-1720772828 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 25 16:02:23 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-ddf944db-fc4c-459e-b76d-20bbe25b11f3 tempest-CreateVolumesFromImageTest-1720772828 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 25 16:02:23 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.quobyte [None req-ddf944db-fc4c-459e-b76d-20bbe25b11f3 tempest-CreateVolumesFromImageTest-1720772828 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-25T15:02:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-48514173',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c5c32c0e-8713-4292-8dbd-ce2076f4bba6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1200ff7ee62646899ee6afb73c3faf68',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-25T15:02:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-25T15:02:24Z,use_quota=True,user_id='8d6a8e233f984f4f8eaebe7b2e641ec2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ce71c2f9-6543-4165-9653-a1529b2ea243),volume_type_id=ce71c2f9-6543-4165-9653-a1529b2ea243)}" {{(pid=83528) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 25 16:02:23 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.remotefs [None req-ddf944db-fc4c-459e-b76d-20bbe25b11f3 tempest-CreateVolumesFromImageTest-1720772828 None] Creating volume c5c32c0e-8713-4292-8dbd-ce2076f4bba6 {{(pid=83528) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 25 16:02:23 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-ddf944db-fc4c-459e-b76d-20bbe25b11f3 tempest-CreateVolumesFromImageTest-1720772828 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 25 16:02:23 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-ddf944db-fc4c-459e-b76d-20bbe25b11f3 tempest-CreateVolumesFromImageTest-1720772828 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 25 16:02:23 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.quobyte [None req-ddf944db-fc4c-459e-b76d-20bbe25b11f3 tempest-CreateVolumesFromImageTest-1720772828 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23e9d725-3e04-4cd9-bfe0-c8ef43305589': None} {{(pid=83528) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 25 16:02:23 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.quobyte [None req-ddf944db-fc4c-459e-b76d-20bbe25b11f3 tempest-CreateVolumesFromImageTest-1720772828 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23e9d725-3e04-4cd9-bfe0-c8ef43305589'] {{(pid=83528) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 25 16:02:23 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-ddf944db-fc4c-459e-b76d-20bbe25b11f3 tempest-CreateVolumesFromImageTest-1720772828 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 25 16:02:23 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.quobyte [None req-ddf944db-fc4c-459e-b76d-20bbe25b11f3 tempest-CreateVolumesFromImageTest-1720772828 None] Selected osci02.corp.quobyte.com/cinder-vol-23e9d725-3e04-4cd9-bfe0-c8ef43305589 as target Quobyte volume. {{(pid=83528) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 25 16:02:23 devstack cinder-volume[83528]: INFO cinder.volume.drivers.remotefs [None req-ddf944db-fc4c-459e-b76d-20bbe25b11f3 tempest-CreateVolumesFromImageTest-1720772828 None] casted to osci02.corp.quobyte.com/cinder-vol-23e9d725-3e04-4cd9-bfe0-c8ef43305589 Feb 25 16:02:23 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-ddf944db-fc4c-459e-b76d-20bbe25b11f3 tempest-CreateVolumesFromImageTest-1720772828 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-c5c32c0e-8713-4292-8dbd-ce2076f4bba6 1073741824 {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 25 16:02:23 devstack sudo[91423]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-c5c32c0e-8713-4292-8dbd-ce2076f4bba6 1073741824 Feb 25 16:02:23 devstack sudo[91423]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 25 16:02:23 devstack cinder-volume[83528]: DEBUG cinder.volume.flows.manager.create_volume [None req-45553913-3bdf-474d-bde5-36743f21f4d2 tempest-VolumeDependencyTests-18272511 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83528) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 25 16:02:24 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-45553913-3bdf-474d-bde5-36743f21f4d2 tempest-VolumeDependencyTests-18272511 None] Flow 'volume_create_manager' (04f52d85-c983-4517-82f3-c7747af3eab0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83528) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 25 16:02:24 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-45553913-3bdf-474d-bde5-36743f21f4d2 tempest-VolumeDependencyTests-18272511 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (48585bc5-31b7-4fe2-a619-e0e323f7ab53) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 25 16:02:24 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-45553913-3bdf-474d-bde5-36743f21f4d2 tempest-VolumeDependencyTests-18272511 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (48585bc5-31b7-4fe2-a619-e0e323f7ab53) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-25T15:02:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1255135103',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=33b8b216-ea13-4c2a-9c22-443659f1c861,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a8840d2cf3ed4cbead7a7125ba5ed6db',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-25T15:02:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-25T15:02:24Z,use_quota=True,user_id='80a29926db28406da11a76818f583959',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ce71c2f9-6543-4165-9653-a1529b2ea243),volume_type_id=ce71c2f9-6543-4165-9653-a1529b2ea243)' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 25 16:02:24 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-45553913-3bdf-474d-bde5-36743f21f4d2 tempest-VolumeDependencyTests-18272511 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (346cd8e1-37d2-4b73-bc8d-cad9a3cafca3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 25 16:02:24 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-45553913-3bdf-474d-bde5-36743f21f4d2 tempest-VolumeDependencyTests-18272511 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (346cd8e1-37d2-4b73-bc8d-cad9a3cafca3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 25 16:02:24 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-45553913-3bdf-474d-bde5-36743f21f4d2 tempest-VolumeDependencyTests-18272511 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (839568d5-2df7-42b3-b5a1-cbd73f174c31) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 25 16:02:24 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-45553913-3bdf-474d-bde5-36743f21f4d2 tempest-VolumeDependencyTests-18272511 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (839568d5-2df7-42b3-b5a1-cbd73f174c31) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '33b8b216-ea13-4c2a-9c22-443659f1c861', 'volume_name': 'volume-33b8b216-ea13-4c2a-9c22-443659f1c861', 'volume_size': 1}' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 25 16:02:24 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-45553913-3bdf-474d-bde5-36743f21f4d2 tempest-VolumeDependencyTests-18272511 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c26021da-9529-43fa-a834-fab09fa88697) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 25 16:02:24 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-45553913-3bdf-474d-bde5-36743f21f4d2 tempest-VolumeDependencyTests-18272511 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c26021da-9529-43fa-a834-fab09fa88697) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 25 16:02:24 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-45553913-3bdf-474d-bde5-36743f21f4d2 tempest-VolumeDependencyTests-18272511 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cd618e75-e5db-4585-8d7e-e5bff79e8776) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 25 16:02:24 devstack cinder-volume[83528]: INFO cinder.volume.flows.manager.create_volume [None req-45553913-3bdf-474d-bde5-36743f21f4d2 tempest-VolumeDependencyTests-18272511 None] Volume 33b8b216-ea13-4c2a-9c22-443659f1c861: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-33b8b216-ea13-4c2a-9c22-443659f1c861', 'volume_size': 1} Feb 25 16:02:24 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-45553913-3bdf-474d-bde5-36743f21f4d2 tempest-VolumeDependencyTests-18272511 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 25 16:02:24 devstack cinder-volume[83528]: DEBUG cinder.volume.flows.manager.create_volume [None req-b8264209-afbb-456c-853b-e1dda9d336e5 tempest-CreateVolumesFromImageTest-1720772828 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83528) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 25 16:02:24 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-b8264209-afbb-456c-853b-e1dda9d336e5 tempest-CreateVolumesFromImageTest-1720772828 None] Flow 'volume_create_manager' (bac887dd-1f81-4353-b87b-147de7febf52) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83528) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 25 16:02:24 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-b8264209-afbb-456c-853b-e1dda9d336e5 tempest-CreateVolumesFromImageTest-1720772828 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (940fdd76-41cf-49a4-b0ec-6d91d662b91d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 25 16:02:24 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-b8264209-afbb-456c-853b-e1dda9d336e5 tempest-CreateVolumesFromImageTest-1720772828 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (940fdd76-41cf-49a4-b0ec-6d91d662b91d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-25T15:02:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1915947428',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bf57e8a1-484b-4bdc-80a5-aadab247e6b2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1200ff7ee62646899ee6afb73c3faf68',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-25T15:02:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-25T15:02:24Z,use_quota=True,user_id='8d6a8e233f984f4f8eaebe7b2e641ec2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ce71c2f9-6543-4165-9653-a1529b2ea243),volume_type_id=ce71c2f9-6543-4165-9653-a1529b2ea243)' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 25 16:02:24 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-b8264209-afbb-456c-853b-e1dda9d336e5 tempest-CreateVolumesFromImageTest-1720772828 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c249f37e-96f7-4867-92f0-c307028a5d08) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 25 16:02:24 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-b8264209-afbb-456c-853b-e1dda9d336e5 tempest-CreateVolumesFromImageTest-1720772828 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c249f37e-96f7-4867-92f0-c307028a5d08) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 25 16:02:24 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-b8264209-afbb-456c-853b-e1dda9d336e5 tempest-CreateVolumesFromImageTest-1720772828 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f61cec7f-a00b-4cd8-a5b5-97d9012b8d3f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 25 16:02:24 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-b8264209-afbb-456c-853b-e1dda9d336e5 tempest-CreateVolumesFromImageTest-1720772828 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f61cec7f-a00b-4cd8-a5b5-97d9012b8d3f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bf57e8a1-484b-4bdc-80a5-aadab247e6b2', 'volume_name': 'volume-bf57e8a1-484b-4bdc-80a5-aadab247e6b2', 'volume_size': 1}' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 25 16:02:24 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-b8264209-afbb-456c-853b-e1dda9d336e5 tempest-CreateVolumesFromImageTest-1720772828 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7994edde-5ebf-446d-bd1e-cadf48921342) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 25 16:02:24 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-b8264209-afbb-456c-853b-e1dda9d336e5 tempest-CreateVolumesFromImageTest-1720772828 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7994edde-5ebf-446d-bd1e-cadf48921342) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 25 16:02:24 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-b8264209-afbb-456c-853b-e1dda9d336e5 tempest-CreateVolumesFromImageTest-1720772828 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (259cb8b5-918f-4139-a452-37dcb7c7592b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 25 16:02:24 devstack cinder-volume[83528]: INFO cinder.volume.flows.manager.create_volume [None req-b8264209-afbb-456c-853b-e1dda9d336e5 tempest-CreateVolumesFromImageTest-1720772828 None] Volume bf57e8a1-484b-4bdc-80a5-aadab247e6b2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bf57e8a1-484b-4bdc-80a5-aadab247e6b2', 'volume_size': 1} Feb 25 16:02:24 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-b8264209-afbb-456c-853b-e1dda9d336e5 tempest-CreateVolumesFromImageTest-1720772828 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 25 16:02:24 devstack cinder-volume[83528]: DEBUG cinder.volume.flows.manager.create_volume [None req-83a19536-02e8-4d54-ae22-283f6615f785 tempest-CreateVolumesFromSnapshotTest-1082910625 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83528) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 25 16:02:24 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-83a19536-02e8-4d54-ae22-283f6615f785 tempest-CreateVolumesFromSnapshotTest-1082910625 None] Flow 'volume_create_manager' (0d8628b3-2586-45de-b5a2-1f58733b3fae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83528) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 25 16:02:24 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-83a19536-02e8-4d54-ae22-283f6615f785 tempest-CreateVolumesFromSnapshotTest-1082910625 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ba03ada4-3d80-4574-98ef-fce21c30ffeb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 25 16:02:24 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-83a19536-02e8-4d54-ae22-283f6615f785 tempest-CreateVolumesFromSnapshotTest-1082910625 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ba03ada4-3d80-4574-98ef-fce21c30ffeb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-25T15:02:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-754103579',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f30072d2-6e3e-4fcd-9fc0-b97e812f66ce,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='de3dcd140da840eb8693ca187507a07f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-25T15:02:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-25T15:02:24Z,use_quota=True,user_id='6d2c9b181121464abf8dc70575225af0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ce71c2f9-6543-4165-9653-a1529b2ea243),volume_type_id=ce71c2f9-6543-4165-9653-a1529b2ea243)' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 25 16:02:24 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-83a19536-02e8-4d54-ae22-283f6615f785 tempest-CreateVolumesFromSnapshotTest-1082910625 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (40bfa334-2c14-43d2-9cf1-4df82990a686) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 25 16:02:24 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-83a19536-02e8-4d54-ae22-283f6615f785 tempest-CreateVolumesFromSnapshotTest-1082910625 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (40bfa334-2c14-43d2-9cf1-4df82990a686) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 25 16:02:24 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-83a19536-02e8-4d54-ae22-283f6615f785 tempest-CreateVolumesFromSnapshotTest-1082910625 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (17ae84f5-4080-4882-af1e-eb26899599f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 25 16:02:24 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-83a19536-02e8-4d54-ae22-283f6615f785 tempest-CreateVolumesFromSnapshotTest-1082910625 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (17ae84f5-4080-4882-af1e-eb26899599f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f30072d2-6e3e-4fcd-9fc0-b97e812f66ce', 'volume_name': 'volume-f30072d2-6e3e-4fcd-9fc0-b97e812f66ce', 'volume_size': 1}' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 25 16:02:24 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-83a19536-02e8-4d54-ae22-283f6615f785 tempest-CreateVolumesFromSnapshotTest-1082910625 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9124512e-1c75-44a5-b716-5336d772a0c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 25 16:02:24 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-83a19536-02e8-4d54-ae22-283f6615f785 tempest-CreateVolumesFromSnapshotTest-1082910625 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9124512e-1c75-44a5-b716-5336d772a0c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 25 16:02:24 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-83a19536-02e8-4d54-ae22-283f6615f785 tempest-CreateVolumesFromSnapshotTest-1082910625 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (430697d6-5d87-400d-b215-a03bad925f0c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 25 16:02:24 devstack cinder-volume[83528]: INFO cinder.volume.flows.manager.create_volume [None req-83a19536-02e8-4d54-ae22-283f6615f785 tempest-CreateVolumesFromSnapshotTest-1082910625 None] Volume f30072d2-6e3e-4fcd-9fc0-b97e812f66ce: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f30072d2-6e3e-4fcd-9fc0-b97e812f66ce', 'volume_size': 1} Feb 25 16:02:24 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-83a19536-02e8-4d54-ae22-283f6615f785 tempest-CreateVolumesFromSnapshotTest-1082910625 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 25 16:02:24 devstack cinder-volume[83528]: DEBUG cinder.volume.flows.manager.create_volume [None req-f82881d1-4a49-491d-870a-cf9413bf49d1 tempest-CreateVolumesFromImageTest-1720772828 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83528) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 25 16:02:24 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-f82881d1-4a49-491d-870a-cf9413bf49d1 tempest-CreateVolumesFromImageTest-1720772828 None] Flow 'volume_create_manager' (b861f92b-6e4a-426a-815d-271a1e4dd4ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83528) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 25 16:02:24 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-f82881d1-4a49-491d-870a-cf9413bf49d1 tempest-CreateVolumesFromImageTest-1720772828 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3e9a52fb-7490-47ca-8411-88c236a7adae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 25 16:02:24 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-f82881d1-4a49-491d-870a-cf9413bf49d1 tempest-CreateVolumesFromImageTest-1720772828 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3e9a52fb-7490-47ca-8411-88c236a7adae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-25T15:02:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-683428419',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bde9af84-35ea-4c30-8222-97a4b52ae350,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1200ff7ee62646899ee6afb73c3faf68',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-25T15:02:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-25T15:02:24Z,use_quota=True,user_id='8d6a8e233f984f4f8eaebe7b2e641ec2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ce71c2f9-6543-4165-9653-a1529b2ea243),volume_type_id=ce71c2f9-6543-4165-9653-a1529b2ea243)' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 25 16:02:24 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-f82881d1-4a49-491d-870a-cf9413bf49d1 tempest-CreateVolumesFromImageTest-1720772828 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (687c213d-7a5f-4cd6-8a7b-2aad4febd9a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 25 16:02:24 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-f82881d1-4a49-491d-870a-cf9413bf49d1 tempest-CreateVolumesFromImageTest-1720772828 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (687c213d-7a5f-4cd6-8a7b-2aad4febd9a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 25 16:02:24 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-f82881d1-4a49-491d-870a-cf9413bf49d1 tempest-CreateVolumesFromImageTest-1720772828 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (49baf5cd-3dbc-4bd6-abff-75abeb81cb5b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 25 16:02:24 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-f82881d1-4a49-491d-870a-cf9413bf49d1 tempest-CreateVolumesFromImageTest-1720772828 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (49baf5cd-3dbc-4bd6-abff-75abeb81cb5b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bde9af84-35ea-4c30-8222-97a4b52ae350', 'volume_name': 'volume-bde9af84-35ea-4c30-8222-97a4b52ae350', 'volume_size': 1}' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 25 16:02:24 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-f82881d1-4a49-491d-870a-cf9413bf49d1 tempest-CreateVolumesFromImageTest-1720772828 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c5638c01-4e34-48cd-9c66-954ccf0f1349) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 25 16:02:24 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-f82881d1-4a49-491d-870a-cf9413bf49d1 tempest-CreateVolumesFromImageTest-1720772828 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c5638c01-4e34-48cd-9c66-954ccf0f1349) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 25 16:02:24 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-f82881d1-4a49-491d-870a-cf9413bf49d1 tempest-CreateVolumesFromImageTest-1720772828 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (341debaa-466c-4c03-bad6-4859ba8b74c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 25 16:02:24 devstack cinder-volume[83528]: INFO cinder.volume.flows.manager.create_volume [None req-f82881d1-4a49-491d-870a-cf9413bf49d1 tempest-CreateVolumesFromImageTest-1720772828 None] Volume bde9af84-35ea-4c30-8222-97a4b52ae350: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bde9af84-35ea-4c30-8222-97a4b52ae350', 'volume_size': 1} Feb 25 16:02:24 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-f82881d1-4a49-491d-870a-cf9413bf49d1 tempest-CreateVolumesFromImageTest-1720772828 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 25 16:02:24 devstack cinder-volume[83528]: DEBUG cinder.volume.flows.manager.create_volume [None req-12800b3a-15a4-4164-ac45-45ec88ef1bae tempest-CreateVolumesFromImageTest-1720772828 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83528) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 25 16:02:24 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-12800b3a-15a4-4164-ac45-45ec88ef1bae tempest-CreateVolumesFromImageTest-1720772828 None] Flow 'volume_create_manager' (d0cee4cb-9a34-4e35-b036-22576bc35df8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83528) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 25 16:02:24 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-12800b3a-15a4-4164-ac45-45ec88ef1bae tempest-CreateVolumesFromImageTest-1720772828 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2b679863-5167-4db4-96da-da5acabf170d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 25 16:02:24 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-12800b3a-15a4-4164-ac45-45ec88ef1bae tempest-CreateVolumesFromImageTest-1720772828 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2b679863-5167-4db4-96da-da5acabf170d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-25T15:02:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-965523296',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fe202eaa-dba1-4bc9-bcf1-06277b73ddbe,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1200ff7ee62646899ee6afb73c3faf68',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-25T15:02:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-25T15:02:25Z,use_quota=True,user_id='8d6a8e233f984f4f8eaebe7b2e641ec2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ce71c2f9-6543-4165-9653-a1529b2ea243),volume_type_id=ce71c2f9-6543-4165-9653-a1529b2ea243)' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 25 16:02:24 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-12800b3a-15a4-4164-ac45-45ec88ef1bae tempest-CreateVolumesFromImageTest-1720772828 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (22d752cb-39c8-40d2-9c2e-f6003e8d4412) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 25 16:02:24 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-12800b3a-15a4-4164-ac45-45ec88ef1bae tempest-CreateVolumesFromImageTest-1720772828 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (22d752cb-39c8-40d2-9c2e-f6003e8d4412) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 25 16:02:24 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-12800b3a-15a4-4164-ac45-45ec88ef1bae tempest-CreateVolumesFromImageTest-1720772828 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (27aeb55b-9c02-4b58-b195-9e58c72eef90) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 25 16:02:24 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-12800b3a-15a4-4164-ac45-45ec88ef1bae tempest-CreateVolumesFromImageTest-1720772828 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (27aeb55b-9c02-4b58-b195-9e58c72eef90) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fe202eaa-dba1-4bc9-bcf1-06277b73ddbe', 'volume_name': 'volume-fe202eaa-dba1-4bc9-bcf1-06277b73ddbe', 'volume_size': 1}' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 25 16:02:24 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-12800b3a-15a4-4164-ac45-45ec88ef1bae tempest-CreateVolumesFromImageTest-1720772828 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1d9fcbec-6bb5-4ac5-b456-eb5d86ee0576) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 25 16:02:24 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-12800b3a-15a4-4164-ac45-45ec88ef1bae tempest-CreateVolumesFromImageTest-1720772828 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1d9fcbec-6bb5-4ac5-b456-eb5d86ee0576) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 25 16:02:24 devstack sudo[91423]: pam_unix(sudo:session): session closed for user root Feb 25 16:02:24 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-12800b3a-15a4-4164-ac45-45ec88ef1bae tempest-CreateVolumesFromImageTest-1720772828 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fed62c22-96bf-432e-8bad-9006fc669660) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 25 16:02:24 devstack cinder-volume[83528]: INFO cinder.volume.flows.manager.create_volume [None req-12800b3a-15a4-4164-ac45-45ec88ef1bae tempest-CreateVolumesFromImageTest-1720772828 None] Volume fe202eaa-dba1-4bc9-bcf1-06277b73ddbe: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fe202eaa-dba1-4bc9-bcf1-06277b73ddbe', 'volume_size': 1} Feb 25 16:02:24 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-12800b3a-15a4-4164-ac45-45ec88ef1bae tempest-CreateVolumesFromImageTest-1720772828 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 25 16:02:24 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-ddf944db-fc4c-459e-b76d-20bbe25b11f3 tempest-CreateVolumesFromImageTest-1720772828 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-c5c32c0e-8713-4292-8dbd-ce2076f4bba6 1073741824" returned: 0 in 0.846s {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 25 16:02:24 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-ddf944db-fc4c-459e-b76d-20bbe25b11f3 tempest-CreateVolumesFromImageTest-1720772828 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-c5c32c0e-8713-4292-8dbd-ce2076f4bba6 {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 25 16:02:24 devstack sudo[91429]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-c5c32c0e-8713-4292-8dbd-ce2076f4bba6 Feb 25 16:02:24 devstack sudo[91429]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 25 16:02:24 devstack cinder-volume[83528]: DEBUG cinder.volume.flows.manager.create_volume [None req-f438338b-80a8-4383-869c-2cc27bfbc50c tempest-CreateVolumesFromImageTest-1720772828 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83528) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 25 16:02:24 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-f438338b-80a8-4383-869c-2cc27bfbc50c tempest-CreateVolumesFromImageTest-1720772828 None] Flow 'volume_create_manager' (e14ed4b8-f54e-4b9d-a2a8-77d908510e02) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83528) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 25 16:02:24 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-f438338b-80a8-4383-869c-2cc27bfbc50c tempest-CreateVolumesFromImageTest-1720772828 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f1631992-7c10-46cc-9943-3b137b67810a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 25 16:02:24 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-f438338b-80a8-4383-869c-2cc27bfbc50c tempest-CreateVolumesFromImageTest-1720772828 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f1631992-7c10-46cc-9943-3b137b67810a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-25T15:02:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-148031849',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cac4472a-7136-4994-a04f-d04d643e665b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1200ff7ee62646899ee6afb73c3faf68',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-25T15:02:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-25T15:02:25Z,use_quota=True,user_id='8d6a8e233f984f4f8eaebe7b2e641ec2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ce71c2f9-6543-4165-9653-a1529b2ea243),volume_type_id=ce71c2f9-6543-4165-9653-a1529b2ea243)' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 25 16:02:24 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-f438338b-80a8-4383-869c-2cc27bfbc50c tempest-CreateVolumesFromImageTest-1720772828 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (873d906f-bb53-4603-bfa0-3fcddff1c926) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 25 16:02:24 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-f438338b-80a8-4383-869c-2cc27bfbc50c tempest-CreateVolumesFromImageTest-1720772828 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (873d906f-bb53-4603-bfa0-3fcddff1c926) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 25 16:02:24 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-f438338b-80a8-4383-869c-2cc27bfbc50c tempest-CreateVolumesFromImageTest-1720772828 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (014ce03a-721a-4419-bde4-e20b5877f2f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 25 16:02:24 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-f438338b-80a8-4383-869c-2cc27bfbc50c tempest-CreateVolumesFromImageTest-1720772828 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (014ce03a-721a-4419-bde4-e20b5877f2f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cac4472a-7136-4994-a04f-d04d643e665b', 'volume_name': 'volume-cac4472a-7136-4994-a04f-d04d643e665b', 'volume_size': 1}' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 25 16:02:24 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-f438338b-80a8-4383-869c-2cc27bfbc50c tempest-CreateVolumesFromImageTest-1720772828 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9acbaee9-a635-449c-b6d0-68b17e431261) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 25 16:02:25 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-f438338b-80a8-4383-869c-2cc27bfbc50c tempest-CreateVolumesFromImageTest-1720772828 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9acbaee9-a635-449c-b6d0-68b17e431261) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 25 16:02:25 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-f438338b-80a8-4383-869c-2cc27bfbc50c tempest-CreateVolumesFromImageTest-1720772828 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f2c119d2-a0ef-4990-9f04-3c1d823130a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 25 16:02:25 devstack cinder-volume[83528]: INFO cinder.volume.flows.manager.create_volume [None req-f438338b-80a8-4383-869c-2cc27bfbc50c tempest-CreateVolumesFromImageTest-1720772828 None] Volume cac4472a-7136-4994-a04f-d04d643e665b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cac4472a-7136-4994-a04f-d04d643e665b', 'volume_size': 1} Feb 25 16:02:25 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-f438338b-80a8-4383-869c-2cc27bfbc50c tempest-CreateVolumesFromImageTest-1720772828 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 25 16:02:25 devstack sudo[91429]: pam_unix(sudo:session): session closed for user root Feb 25 16:02:25 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-ddf944db-fc4c-459e-b76d-20bbe25b11f3 tempest-CreateVolumesFromImageTest-1720772828 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-c5c32c0e-8713-4292-8dbd-ce2076f4bba6" returned: 0 in 0.469s {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 25 16:02:25 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.quobyte [None req-ddf944db-fc4c-459e-b76d-20bbe25b11f3 tempest-CreateVolumesFromImageTest-1720772828 None] <== create_volume: return (1356ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-23e9d725-3e04-4cd9-bfe0-c8ef43305589'} {{(pid=83528) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 25 16:02:25 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-ddf944db-fc4c-459e-b76d-20bbe25b11f3 tempest-CreateVolumesFromImageTest-1720772828 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.359s {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 25 16:02:25 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-45553913-3bdf-474d-bde5-36743f21f4d2 tempest-VolumeDependencyTests-18272511 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.216s {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 25 16:02:25 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.quobyte [None req-45553913-3bdf-474d-bde5-36743f21f4d2 tempest-VolumeDependencyTests-18272511 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-25T15:02:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1255135103',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=33b8b216-ea13-4c2a-9c22-443659f1c861,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a8840d2cf3ed4cbead7a7125ba5ed6db',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-25T15:02:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-25T15:02:24Z,use_quota=True,user_id='80a29926db28406da11a76818f583959',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ce71c2f9-6543-4165-9653-a1529b2ea243),volume_type_id=ce71c2f9-6543-4165-9653-a1529b2ea243)}" {{(pid=83528) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 25 16:02:25 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.remotefs [None req-45553913-3bdf-474d-bde5-36743f21f4d2 tempest-VolumeDependencyTests-18272511 None] Creating volume 33b8b216-ea13-4c2a-9c22-443659f1c861 {{(pid=83528) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 25 16:02:25 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-45553913-3bdf-474d-bde5-36743f21f4d2 tempest-VolumeDependencyTests-18272511 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 25 16:02:25 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-45553913-3bdf-474d-bde5-36743f21f4d2 tempest-VolumeDependencyTests-18272511 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 25 16:02:25 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.quobyte [None req-45553913-3bdf-474d-bde5-36743f21f4d2 tempest-VolumeDependencyTests-18272511 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23e9d725-3e04-4cd9-bfe0-c8ef43305589': None} {{(pid=83528) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 25 16:02:25 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.quobyte [None req-45553913-3bdf-474d-bde5-36743f21f4d2 tempest-VolumeDependencyTests-18272511 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23e9d725-3e04-4cd9-bfe0-c8ef43305589'] {{(pid=83528) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 25 16:02:25 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-45553913-3bdf-474d-bde5-36743f21f4d2 tempest-VolumeDependencyTests-18272511 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 25 16:02:25 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.quobyte [None req-45553913-3bdf-474d-bde5-36743f21f4d2 tempest-VolumeDependencyTests-18272511 None] Selected osci02.corp.quobyte.com/cinder-vol-23e9d725-3e04-4cd9-bfe0-c8ef43305589 as target Quobyte volume. {{(pid=83528) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 25 16:02:25 devstack cinder-volume[83528]: INFO cinder.volume.drivers.remotefs [None req-45553913-3bdf-474d-bde5-36743f21f4d2 tempest-VolumeDependencyTests-18272511 None] casted to osci02.corp.quobyte.com/cinder-vol-23e9d725-3e04-4cd9-bfe0-c8ef43305589 Feb 25 16:02:25 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-45553913-3bdf-474d-bde5-36743f21f4d2 tempest-VolumeDependencyTests-18272511 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-33b8b216-ea13-4c2a-9c22-443659f1c861 1073741824 {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 25 16:02:25 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-ddf944db-fc4c-459e-b76d-20bbe25b11f3 tempest-CreateVolumesFromImageTest-1720772828 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2c906f45-0feb-4a63-b1ab-57cf186fa6b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c5c32c0e-8713-4292-8dbd-ce2076f4bba6', 'volume_size': 1}' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 25 16:02:25 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-ddf944db-fc4c-459e-b76d-20bbe25b11f3 tempest-CreateVolumesFromImageTest-1720772828 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c15bb2e8-b87c-4736-a4fa-cb0adf12f430) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 25 16:02:25 devstack sudo[91432]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-33b8b216-ea13-4c2a-9c22-443659f1c861 1073741824 Feb 25 16:02:25 devstack sudo[91432]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 25 16:02:25 devstack cinder-volume[83528]: INFO cinder.volume.flows.manager.create_volume [None req-ddf944db-fc4c-459e-b76d-20bbe25b11f3 tempest-CreateVolumesFromImageTest-1720772828 None] Volume volume-c5c32c0e-8713-4292-8dbd-ce2076f4bba6 (c5c32c0e-8713-4292-8dbd-ce2076f4bba6): created successfully Feb 25 16:02:25 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-ddf944db-fc4c-459e-b76d-20bbe25b11f3 tempest-CreateVolumesFromImageTest-1720772828 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c15bb2e8-b87c-4736-a4fa-cb0adf12f430) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 25 16:02:25 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-ddf944db-fc4c-459e-b76d-20bbe25b11f3 tempest-CreateVolumesFromImageTest-1720772828 None] Flow 'volume_create_manager' (bb172e11-fd66-4a99-b74a-1d13fd1b3a13) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83528) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 25 16:02:25 devstack cinder-volume[83528]: INFO cinder.volume.manager [None req-ddf944db-fc4c-459e-b76d-20bbe25b11f3 tempest-CreateVolumesFromImageTest-1720772828 None] Created volume successfully. Feb 25 16:02:25 devstack sudo[91432]: pam_unix(sudo:session): session closed for user root Feb 25 16:02:25 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-45553913-3bdf-474d-bde5-36743f21f4d2 tempest-VolumeDependencyTests-18272511 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-33b8b216-ea13-4c2a-9c22-443659f1c861 1073741824" returned: 0 in 0.507s {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 25 16:02:25 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-45553913-3bdf-474d-bde5-36743f21f4d2 tempest-VolumeDependencyTests-18272511 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-33b8b216-ea13-4c2a-9c22-443659f1c861 {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 25 16:02:25 devstack sudo[91437]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-33b8b216-ea13-4c2a-9c22-443659f1c861 Feb 25 16:02:25 devstack sudo[91437]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 25 16:02:26 devstack sudo[91437]: pam_unix(sudo:session): session closed for user root Feb 25 16:02:26 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-45553913-3bdf-474d-bde5-36743f21f4d2 tempest-VolumeDependencyTests-18272511 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-33b8b216-ea13-4c2a-9c22-443659f1c861" returned: 0 in 0.417s {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 25 16:02:26 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.quobyte [None req-45553913-3bdf-474d-bde5-36743f21f4d2 tempest-VolumeDependencyTests-18272511 None] <== create_volume: return (950ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-23e9d725-3e04-4cd9-bfe0-c8ef43305589'} {{(pid=83528) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 25 16:02:26 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-45553913-3bdf-474d-bde5-36743f21f4d2 tempest-VolumeDependencyTests-18272511 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.953s {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 25 16:02:26 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-b8264209-afbb-456c-853b-e1dda9d336e5 tempest-CreateVolumesFromImageTest-1720772828 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.065s {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 25 16:02:26 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.quobyte [None req-b8264209-afbb-456c-853b-e1dda9d336e5 tempest-CreateVolumesFromImageTest-1720772828 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-25T15:02:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1915947428',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bf57e8a1-484b-4bdc-80a5-aadab247e6b2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1200ff7ee62646899ee6afb73c3faf68',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-25T15:02:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-25T15:02:24Z,use_quota=True,user_id='8d6a8e233f984f4f8eaebe7b2e641ec2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ce71c2f9-6543-4165-9653-a1529b2ea243),volume_type_id=ce71c2f9-6543-4165-9653-a1529b2ea243)}" {{(pid=83528) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 25 16:02:26 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.remotefs [None req-b8264209-afbb-456c-853b-e1dda9d336e5 tempest-CreateVolumesFromImageTest-1720772828 None] Creating volume bf57e8a1-484b-4bdc-80a5-aadab247e6b2 {{(pid=83528) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 25 16:02:26 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-b8264209-afbb-456c-853b-e1dda9d336e5 tempest-CreateVolumesFromImageTest-1720772828 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 25 16:02:26 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-b8264209-afbb-456c-853b-e1dda9d336e5 tempest-CreateVolumesFromImageTest-1720772828 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 25 16:02:26 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.quobyte [None req-b8264209-afbb-456c-853b-e1dda9d336e5 tempest-CreateVolumesFromImageTest-1720772828 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23e9d725-3e04-4cd9-bfe0-c8ef43305589': None} {{(pid=83528) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 25 16:02:26 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.quobyte [None req-b8264209-afbb-456c-853b-e1dda9d336e5 tempest-CreateVolumesFromImageTest-1720772828 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23e9d725-3e04-4cd9-bfe0-c8ef43305589'] {{(pid=83528) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 25 16:02:26 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-b8264209-afbb-456c-853b-e1dda9d336e5 tempest-CreateVolumesFromImageTest-1720772828 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 25 16:02:26 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.quobyte [None req-b8264209-afbb-456c-853b-e1dda9d336e5 tempest-CreateVolumesFromImageTest-1720772828 None] Selected osci02.corp.quobyte.com/cinder-vol-23e9d725-3e04-4cd9-bfe0-c8ef43305589 as target Quobyte volume. {{(pid=83528) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 25 16:02:26 devstack cinder-volume[83528]: INFO cinder.volume.drivers.remotefs [None req-b8264209-afbb-456c-853b-e1dda9d336e5 tempest-CreateVolumesFromImageTest-1720772828 None] casted to osci02.corp.quobyte.com/cinder-vol-23e9d725-3e04-4cd9-bfe0-c8ef43305589 Feb 25 16:02:26 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-b8264209-afbb-456c-853b-e1dda9d336e5 tempest-CreateVolumesFromImageTest-1720772828 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-bf57e8a1-484b-4bdc-80a5-aadab247e6b2 1073741824 {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 25 16:02:26 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-45553913-3bdf-474d-bde5-36743f21f4d2 tempest-VolumeDependencyTests-18272511 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cd618e75-e5db-4585-8d7e-e5bff79e8776) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-33b8b216-ea13-4c2a-9c22-443659f1c861', 'volume_size': 1}' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 25 16:02:26 devstack sudo[91440]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-bf57e8a1-484b-4bdc-80a5-aadab247e6b2 1073741824 Feb 25 16:02:26 devstack sudo[91440]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 25 16:02:26 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-45553913-3bdf-474d-bde5-36743f21f4d2 tempest-VolumeDependencyTests-18272511 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (626a4b11-b287-4ed3-830e-949faa6970d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 25 16:02:26 devstack cinder-volume[83528]: INFO cinder.volume.flows.manager.create_volume [None req-45553913-3bdf-474d-bde5-36743f21f4d2 tempest-VolumeDependencyTests-18272511 None] Volume volume-33b8b216-ea13-4c2a-9c22-443659f1c861 (33b8b216-ea13-4c2a-9c22-443659f1c861): created successfully Feb 25 16:02:26 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-45553913-3bdf-474d-bde5-36743f21f4d2 tempest-VolumeDependencyTests-18272511 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (626a4b11-b287-4ed3-830e-949faa6970d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 25 16:02:26 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-45553913-3bdf-474d-bde5-36743f21f4d2 tempest-VolumeDependencyTests-18272511 None] Flow 'volume_create_manager' (04f52d85-c983-4517-82f3-c7747af3eab0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83528) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 25 16:02:26 devstack cinder-volume[83528]: INFO cinder.volume.manager [None req-45553913-3bdf-474d-bde5-36743f21f4d2 tempest-VolumeDependencyTests-18272511 None] Created volume successfully. Feb 25 16:02:26 devstack sudo[91440]: pam_unix(sudo:session): session closed for user root Feb 25 16:02:26 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-b8264209-afbb-456c-853b-e1dda9d336e5 tempest-CreateVolumesFromImageTest-1720772828 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-bf57e8a1-484b-4bdc-80a5-aadab247e6b2 1073741824" returned: 0 in 0.534s {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 25 16:02:26 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-b8264209-afbb-456c-853b-e1dda9d336e5 tempest-CreateVolumesFromImageTest-1720772828 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-bf57e8a1-484b-4bdc-80a5-aadab247e6b2 {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 25 16:02:26 devstack sudo[91445]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-bf57e8a1-484b-4bdc-80a5-aadab247e6b2 Feb 25 16:02:26 devstack sudo[91445]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 25 16:02:27 devstack sudo[91445]: pam_unix(sudo:session): session closed for user root Feb 25 16:02:27 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-b8264209-afbb-456c-853b-e1dda9d336e5 tempest-CreateVolumesFromImageTest-1720772828 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-bf57e8a1-484b-4bdc-80a5-aadab247e6b2" returned: 0 in 0.491s {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 25 16:02:27 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.quobyte [None req-b8264209-afbb-456c-853b-e1dda9d336e5 tempest-CreateVolumesFromImageTest-1720772828 None] <== create_volume: return (1052ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-23e9d725-3e04-4cd9-bfe0-c8ef43305589'} {{(pid=83528) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 25 16:02:27 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-b8264209-afbb-456c-853b-e1dda9d336e5 tempest-CreateVolumesFromImageTest-1720772828 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.055s {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 25 16:02:27 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-83a19536-02e8-4d54-ae22-283f6615f785 tempest-CreateVolumesFromSnapshotTest-1082910625 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.889s {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 25 16:02:27 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.quobyte [None req-83a19536-02e8-4d54-ae22-283f6615f785 tempest-CreateVolumesFromSnapshotTest-1082910625 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-25T15:02:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-754103579',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f30072d2-6e3e-4fcd-9fc0-b97e812f66ce,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='de3dcd140da840eb8693ca187507a07f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-25T15:02:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-25T15:02:24Z,use_quota=True,user_id='6d2c9b181121464abf8dc70575225af0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ce71c2f9-6543-4165-9653-a1529b2ea243),volume_type_id=ce71c2f9-6543-4165-9653-a1529b2ea243)}" {{(pid=83528) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 25 16:02:27 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.remotefs [None req-83a19536-02e8-4d54-ae22-283f6615f785 tempest-CreateVolumesFromSnapshotTest-1082910625 None] Creating volume f30072d2-6e3e-4fcd-9fc0-b97e812f66ce {{(pid=83528) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 25 16:02:27 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-83a19536-02e8-4d54-ae22-283f6615f785 tempest-CreateVolumesFromSnapshotTest-1082910625 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 25 16:02:27 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-83a19536-02e8-4d54-ae22-283f6615f785 tempest-CreateVolumesFromSnapshotTest-1082910625 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 25 16:02:27 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.quobyte [None req-83a19536-02e8-4d54-ae22-283f6615f785 tempest-CreateVolumesFromSnapshotTest-1082910625 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23e9d725-3e04-4cd9-bfe0-c8ef43305589': None} {{(pid=83528) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 25 16:02:27 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.quobyte [None req-83a19536-02e8-4d54-ae22-283f6615f785 tempest-CreateVolumesFromSnapshotTest-1082910625 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23e9d725-3e04-4cd9-bfe0-c8ef43305589'] {{(pid=83528) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 25 16:02:27 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-83a19536-02e8-4d54-ae22-283f6615f785 tempest-CreateVolumesFromSnapshotTest-1082910625 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 25 16:02:27 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.quobyte [None req-83a19536-02e8-4d54-ae22-283f6615f785 tempest-CreateVolumesFromSnapshotTest-1082910625 None] Selected osci02.corp.quobyte.com/cinder-vol-23e9d725-3e04-4cd9-bfe0-c8ef43305589 as target Quobyte volume. {{(pid=83528) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 25 16:02:27 devstack cinder-volume[83528]: INFO cinder.volume.drivers.remotefs [None req-83a19536-02e8-4d54-ae22-283f6615f785 tempest-CreateVolumesFromSnapshotTest-1082910625 None] casted to osci02.corp.quobyte.com/cinder-vol-23e9d725-3e04-4cd9-bfe0-c8ef43305589 Feb 25 16:02:27 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-83a19536-02e8-4d54-ae22-283f6615f785 tempest-CreateVolumesFromSnapshotTest-1082910625 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-f30072d2-6e3e-4fcd-9fc0-b97e812f66ce 1073741824 {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 25 16:02:27 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-b8264209-afbb-456c-853b-e1dda9d336e5 tempest-CreateVolumesFromImageTest-1720772828 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (259cb8b5-918f-4139-a452-37dcb7c7592b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bf57e8a1-484b-4bdc-80a5-aadab247e6b2', 'volume_size': 1}' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 25 16:02:27 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-b8264209-afbb-456c-853b-e1dda9d336e5 tempest-CreateVolumesFromImageTest-1720772828 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6cf520c5-1ad6-4c60-b464-c64ab7e4d9e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 25 16:02:27 devstack sudo[91448]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-f30072d2-6e3e-4fcd-9fc0-b97e812f66ce 1073741824 Feb 25 16:02:27 devstack cinder-volume[83528]: INFO cinder.volume.flows.manager.create_volume [None req-b8264209-afbb-456c-853b-e1dda9d336e5 tempest-CreateVolumesFromImageTest-1720772828 None] Volume volume-bf57e8a1-484b-4bdc-80a5-aadab247e6b2 (bf57e8a1-484b-4bdc-80a5-aadab247e6b2): created successfully Feb 25 16:02:27 devstack sudo[91448]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 25 16:02:27 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-b8264209-afbb-456c-853b-e1dda9d336e5 tempest-CreateVolumesFromImageTest-1720772828 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6cf520c5-1ad6-4c60-b464-c64ab7e4d9e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 25 16:02:27 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-b8264209-afbb-456c-853b-e1dda9d336e5 tempest-CreateVolumesFromImageTest-1720772828 None] Flow 'volume_create_manager' (bac887dd-1f81-4353-b87b-147de7febf52) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83528) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 25 16:02:27 devstack cinder-volume[83528]: INFO cinder.volume.manager [None req-b8264209-afbb-456c-853b-e1dda9d336e5 tempest-CreateVolumesFromImageTest-1720772828 None] Created volume successfully. Feb 25 16:02:27 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-1ea3ec5c-09b9-4c7b-a585-a2c3a487c113 tempest-VolumeDependencyTests-18272511 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 25 16:02:27 devstack sudo[91448]: pam_unix(sudo:session): session closed for user root Feb 25 16:02:27 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-83a19536-02e8-4d54-ae22-283f6615f785 tempest-CreateVolumesFromSnapshotTest-1082910625 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-f30072d2-6e3e-4fcd-9fc0-b97e812f66ce 1073741824" returned: 0 in 0.552s {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 25 16:02:27 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-83a19536-02e8-4d54-ae22-283f6615f785 tempest-CreateVolumesFromSnapshotTest-1082910625 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-f30072d2-6e3e-4fcd-9fc0-b97e812f66ce {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 25 16:02:27 devstack sudo[91453]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-f30072d2-6e3e-4fcd-9fc0-b97e812f66ce Feb 25 16:02:27 devstack sudo[91453]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 25 16:02:28 devstack sudo[91453]: pam_unix(sudo:session): session closed for user root Feb 25 16:02:28 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-83a19536-02e8-4d54-ae22-283f6615f785 tempest-CreateVolumesFromSnapshotTest-1082910625 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-f30072d2-6e3e-4fcd-9fc0-b97e812f66ce" returned: 0 in 0.519s {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 25 16:02:28 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.quobyte [None req-83a19536-02e8-4d54-ae22-283f6615f785 tempest-CreateVolumesFromSnapshotTest-1082910625 None] <== create_volume: return (1097ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-23e9d725-3e04-4cd9-bfe0-c8ef43305589'} {{(pid=83528) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 25 16:02:28 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-83a19536-02e8-4d54-ae22-283f6615f785 tempest-CreateVolumesFromSnapshotTest-1082910625 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.100s {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 25 16:02:28 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-f82881d1-4a49-491d-870a-cf9413bf49d1 tempest-CreateVolumesFromImageTest-1720772828 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.898s {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 25 16:02:28 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.quobyte [None req-f82881d1-4a49-491d-870a-cf9413bf49d1 tempest-CreateVolumesFromImageTest-1720772828 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-25T15:02:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-683428419',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bde9af84-35ea-4c30-8222-97a4b52ae350,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1200ff7ee62646899ee6afb73c3faf68',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-25T15:02:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-25T15:02:24Z,use_quota=True,user_id='8d6a8e233f984f4f8eaebe7b2e641ec2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ce71c2f9-6543-4165-9653-a1529b2ea243),volume_type_id=ce71c2f9-6543-4165-9653-a1529b2ea243)}" {{(pid=83528) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 25 16:02:28 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.remotefs [None req-f82881d1-4a49-491d-870a-cf9413bf49d1 tempest-CreateVolumesFromImageTest-1720772828 None] Creating volume bde9af84-35ea-4c30-8222-97a4b52ae350 {{(pid=83528) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 25 16:02:28 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-f82881d1-4a49-491d-870a-cf9413bf49d1 tempest-CreateVolumesFromImageTest-1720772828 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 25 16:02:28 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-f82881d1-4a49-491d-870a-cf9413bf49d1 tempest-CreateVolumesFromImageTest-1720772828 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 25 16:02:28 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.quobyte [None req-f82881d1-4a49-491d-870a-cf9413bf49d1 tempest-CreateVolumesFromImageTest-1720772828 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23e9d725-3e04-4cd9-bfe0-c8ef43305589': None} {{(pid=83528) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 25 16:02:28 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.quobyte [None req-f82881d1-4a49-491d-870a-cf9413bf49d1 tempest-CreateVolumesFromImageTest-1720772828 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23e9d725-3e04-4cd9-bfe0-c8ef43305589'] {{(pid=83528) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 25 16:02:28 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-f82881d1-4a49-491d-870a-cf9413bf49d1 tempest-CreateVolumesFromImageTest-1720772828 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 25 16:02:28 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.quobyte [None req-f82881d1-4a49-491d-870a-cf9413bf49d1 tempest-CreateVolumesFromImageTest-1720772828 None] Selected osci02.corp.quobyte.com/cinder-vol-23e9d725-3e04-4cd9-bfe0-c8ef43305589 as target Quobyte volume. {{(pid=83528) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 25 16:02:28 devstack cinder-volume[83528]: INFO cinder.volume.drivers.remotefs [None req-f82881d1-4a49-491d-870a-cf9413bf49d1 tempest-CreateVolumesFromImageTest-1720772828 None] casted to osci02.corp.quobyte.com/cinder-vol-23e9d725-3e04-4cd9-bfe0-c8ef43305589 Feb 25 16:02:28 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-f82881d1-4a49-491d-870a-cf9413bf49d1 tempest-CreateVolumesFromImageTest-1720772828 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-bde9af84-35ea-4c30-8222-97a4b52ae350 1073741824 {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 25 16:02:28 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-83a19536-02e8-4d54-ae22-283f6615f785 tempest-CreateVolumesFromSnapshotTest-1082910625 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (430697d6-5d87-400d-b215-a03bad925f0c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f30072d2-6e3e-4fcd-9fc0-b97e812f66ce', 'volume_size': 1}' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 25 16:02:28 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-83a19536-02e8-4d54-ae22-283f6615f785 tempest-CreateVolumesFromSnapshotTest-1082910625 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (482b926d-a9f0-4c13-9d99-698bb99b9b26) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 25 16:02:28 devstack cinder-volume[83528]: INFO cinder.volume.flows.manager.create_volume [None req-83a19536-02e8-4d54-ae22-283f6615f785 tempest-CreateVolumesFromSnapshotTest-1082910625 None] Volume volume-f30072d2-6e3e-4fcd-9fc0-b97e812f66ce (f30072d2-6e3e-4fcd-9fc0-b97e812f66ce): created successfully Feb 25 16:02:28 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-83a19536-02e8-4d54-ae22-283f6615f785 tempest-CreateVolumesFromSnapshotTest-1082910625 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (482b926d-a9f0-4c13-9d99-698bb99b9b26) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 25 16:02:28 devstack sudo[91457]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-bde9af84-35ea-4c30-8222-97a4b52ae350 1073741824 Feb 25 16:02:28 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-83a19536-02e8-4d54-ae22-283f6615f785 tempest-CreateVolumesFromSnapshotTest-1082910625 None] Flow 'volume_create_manager' (0d8628b3-2586-45de-b5a2-1f58733b3fae) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83528) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 25 16:02:28 devstack sudo[91457]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 25 16:02:28 devstack cinder-volume[83528]: INFO cinder.volume.manager [None req-83a19536-02e8-4d54-ae22-283f6615f785 tempest-CreateVolumesFromSnapshotTest-1082910625 None] Created volume successfully. Feb 25 16:02:28 devstack sudo[91457]: pam_unix(sudo:session): session closed for user root Feb 25 16:02:28 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-f82881d1-4a49-491d-870a-cf9413bf49d1 tempest-CreateVolumesFromImageTest-1720772828 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-bde9af84-35ea-4c30-8222-97a4b52ae350 1073741824" returned: 0 in 0.570s {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 25 16:02:29 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-f82881d1-4a49-491d-870a-cf9413bf49d1 tempest-CreateVolumesFromImageTest-1720772828 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-bde9af84-35ea-4c30-8222-97a4b52ae350 {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 25 16:02:29 devstack sudo[91462]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-bde9af84-35ea-4c30-8222-97a4b52ae350 Feb 25 16:02:29 devstack sudo[91462]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 25 16:02:29 devstack sudo[91462]: pam_unix(sudo:session): session closed for user root Feb 25 16:02:29 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-f82881d1-4a49-491d-870a-cf9413bf49d1 tempest-CreateVolumesFromImageTest-1720772828 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-bde9af84-35ea-4c30-8222-97a4b52ae350" returned: 0 in 0.532s {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 25 16:02:29 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.quobyte [None req-f82881d1-4a49-491d-870a-cf9413bf49d1 tempest-CreateVolumesFromImageTest-1720772828 None] <== create_volume: return (1126ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-23e9d725-3e04-4cd9-bfe0-c8ef43305589'} {{(pid=83528) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 25 16:02:29 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-f82881d1-4a49-491d-870a-cf9413bf49d1 tempest-CreateVolumesFromImageTest-1720772828 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.129s {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 25 16:02:29 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-12800b3a-15a4-4164-ac45-45ec88ef1bae tempest-CreateVolumesFromImageTest-1720772828 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.764s {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 25 16:02:29 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.quobyte [None req-12800b3a-15a4-4164-ac45-45ec88ef1bae tempest-CreateVolumesFromImageTest-1720772828 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-25T15:02:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-965523296',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fe202eaa-dba1-4bc9-bcf1-06277b73ddbe,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1200ff7ee62646899ee6afb73c3faf68',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-25T15:02:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-25T15:02:25Z,use_quota=True,user_id='8d6a8e233f984f4f8eaebe7b2e641ec2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ce71c2f9-6543-4165-9653-a1529b2ea243),volume_type_id=ce71c2f9-6543-4165-9653-a1529b2ea243)}" {{(pid=83528) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 25 16:02:29 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.remotefs [None req-12800b3a-15a4-4164-ac45-45ec88ef1bae tempest-CreateVolumesFromImageTest-1720772828 None] Creating volume fe202eaa-dba1-4bc9-bcf1-06277b73ddbe {{(pid=83528) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 25 16:02:29 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-12800b3a-15a4-4164-ac45-45ec88ef1bae tempest-CreateVolumesFromImageTest-1720772828 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 25 16:02:29 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-12800b3a-15a4-4164-ac45-45ec88ef1bae tempest-CreateVolumesFromImageTest-1720772828 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 25 16:02:29 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.quobyte [None req-12800b3a-15a4-4164-ac45-45ec88ef1bae tempest-CreateVolumesFromImageTest-1720772828 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23e9d725-3e04-4cd9-bfe0-c8ef43305589': None} {{(pid=83528) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 25 16:02:29 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.quobyte [None req-12800b3a-15a4-4164-ac45-45ec88ef1bae tempest-CreateVolumesFromImageTest-1720772828 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23e9d725-3e04-4cd9-bfe0-c8ef43305589'] {{(pid=83528) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 25 16:02:29 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-12800b3a-15a4-4164-ac45-45ec88ef1bae tempest-CreateVolumesFromImageTest-1720772828 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 25 16:02:29 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.quobyte [None req-12800b3a-15a4-4164-ac45-45ec88ef1bae tempest-CreateVolumesFromImageTest-1720772828 None] Selected osci02.corp.quobyte.com/cinder-vol-23e9d725-3e04-4cd9-bfe0-c8ef43305589 as target Quobyte volume. {{(pid=83528) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 25 16:02:29 devstack cinder-volume[83528]: INFO cinder.volume.drivers.remotefs [None req-12800b3a-15a4-4164-ac45-45ec88ef1bae tempest-CreateVolumesFromImageTest-1720772828 None] casted to osci02.corp.quobyte.com/cinder-vol-23e9d725-3e04-4cd9-bfe0-c8ef43305589 Feb 25 16:02:29 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-12800b3a-15a4-4164-ac45-45ec88ef1bae tempest-CreateVolumesFromImageTest-1720772828 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-fe202eaa-dba1-4bc9-bcf1-06277b73ddbe 1073741824 {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 25 16:02:29 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-f82881d1-4a49-491d-870a-cf9413bf49d1 tempest-CreateVolumesFromImageTest-1720772828 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (341debaa-466c-4c03-bad6-4859ba8b74c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bde9af84-35ea-4c30-8222-97a4b52ae350', 'volume_size': 1}' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 25 16:02:29 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-f82881d1-4a49-491d-870a-cf9413bf49d1 tempest-CreateVolumesFromImageTest-1720772828 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (23584ce0-d761-4695-aac9-3da4c24c04b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 25 16:02:29 devstack cinder-volume[83528]: INFO cinder.volume.flows.manager.create_volume [None req-f82881d1-4a49-491d-870a-cf9413bf49d1 tempest-CreateVolumesFromImageTest-1720772828 None] Volume volume-bde9af84-35ea-4c30-8222-97a4b52ae350 (bde9af84-35ea-4c30-8222-97a4b52ae350): created successfully Feb 25 16:02:29 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-f82881d1-4a49-491d-870a-cf9413bf49d1 tempest-CreateVolumesFromImageTest-1720772828 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (23584ce0-d761-4695-aac9-3da4c24c04b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 25 16:02:29 devstack sudo[91465]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-fe202eaa-dba1-4bc9-bcf1-06277b73ddbe 1073741824 Feb 25 16:02:29 devstack sudo[91465]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 25 16:02:29 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-f82881d1-4a49-491d-870a-cf9413bf49d1 tempest-CreateVolumesFromImageTest-1720772828 None] Flow 'volume_create_manager' (b861f92b-6e4a-426a-815d-271a1e4dd4ae) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83528) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 25 16:02:29 devstack cinder-volume[83528]: INFO cinder.volume.manager [None req-f82881d1-4a49-491d-870a-cf9413bf49d1 tempest-CreateVolumesFromImageTest-1720772828 None] Created volume successfully. Feb 25 16:02:29 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-34b6dbcb-5310-4f3f-9838-f282a3188967 tempest-CreateVolumesFromSnapshotTest-1082910625 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 25 16:02:30 devstack sudo[91465]: pam_unix(sudo:session): session closed for user root Feb 25 16:02:30 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-12800b3a-15a4-4164-ac45-45ec88ef1bae tempest-CreateVolumesFromImageTest-1720772828 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-fe202eaa-dba1-4bc9-bcf1-06277b73ddbe 1073741824" returned: 0 in 0.609s {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 25 16:02:30 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-12800b3a-15a4-4164-ac45-45ec88ef1bae tempest-CreateVolumesFromImageTest-1720772828 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-fe202eaa-dba1-4bc9-bcf1-06277b73ddbe {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 25 16:02:30 devstack sudo[91470]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-fe202eaa-dba1-4bc9-bcf1-06277b73ddbe Feb 25 16:02:30 devstack sudo[91470]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 25 16:02:30 devstack sudo[91470]: pam_unix(sudo:session): session closed for user root Feb 25 16:02:30 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-12800b3a-15a4-4164-ac45-45ec88ef1bae tempest-CreateVolumesFromImageTest-1720772828 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-fe202eaa-dba1-4bc9-bcf1-06277b73ddbe" returned: 0 in 0.432s {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 25 16:02:30 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.quobyte [None req-12800b3a-15a4-4164-ac45-45ec88ef1bae tempest-CreateVolumesFromImageTest-1720772828 None] <== create_volume: return (1079ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-23e9d725-3e04-4cd9-bfe0-c8ef43305589'} {{(pid=83528) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 25 16:02:30 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-12800b3a-15a4-4164-ac45-45ec88ef1bae tempest-CreateVolumesFromImageTest-1720772828 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.084s {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 25 16:02:30 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-f438338b-80a8-4383-869c-2cc27bfbc50c tempest-CreateVolumesFromImageTest-1720772828 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.625s {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 25 16:02:30 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.quobyte [None req-f438338b-80a8-4383-869c-2cc27bfbc50c tempest-CreateVolumesFromImageTest-1720772828 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-25T15:02:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-148031849',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cac4472a-7136-4994-a04f-d04d643e665b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1200ff7ee62646899ee6afb73c3faf68',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-25T15:02:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-25T15:02:25Z,use_quota=True,user_id='8d6a8e233f984f4f8eaebe7b2e641ec2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ce71c2f9-6543-4165-9653-a1529b2ea243),volume_type_id=ce71c2f9-6543-4165-9653-a1529b2ea243)}" {{(pid=83528) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 25 16:02:30 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.remotefs [None req-f438338b-80a8-4383-869c-2cc27bfbc50c tempest-CreateVolumesFromImageTest-1720772828 None] Creating volume cac4472a-7136-4994-a04f-d04d643e665b {{(pid=83528) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 25 16:02:30 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-f438338b-80a8-4383-869c-2cc27bfbc50c tempest-CreateVolumesFromImageTest-1720772828 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 25 16:02:30 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-f438338b-80a8-4383-869c-2cc27bfbc50c tempest-CreateVolumesFromImageTest-1720772828 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 25 16:02:30 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.quobyte [None req-f438338b-80a8-4383-869c-2cc27bfbc50c tempest-CreateVolumesFromImageTest-1720772828 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23e9d725-3e04-4cd9-bfe0-c8ef43305589': None} {{(pid=83528) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 25 16:02:30 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.quobyte [None req-f438338b-80a8-4383-869c-2cc27bfbc50c tempest-CreateVolumesFromImageTest-1720772828 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23e9d725-3e04-4cd9-bfe0-c8ef43305589'] {{(pid=83528) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 25 16:02:30 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-f438338b-80a8-4383-869c-2cc27bfbc50c tempest-CreateVolumesFromImageTest-1720772828 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 25 16:02:30 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.quobyte [None req-f438338b-80a8-4383-869c-2cc27bfbc50c tempest-CreateVolumesFromImageTest-1720772828 None] Selected osci02.corp.quobyte.com/cinder-vol-23e9d725-3e04-4cd9-bfe0-c8ef43305589 as target Quobyte volume. {{(pid=83528) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 25 16:02:30 devstack cinder-volume[83528]: INFO cinder.volume.drivers.remotefs [None req-f438338b-80a8-4383-869c-2cc27bfbc50c tempest-CreateVolumesFromImageTest-1720772828 None] casted to osci02.corp.quobyte.com/cinder-vol-23e9d725-3e04-4cd9-bfe0-c8ef43305589 Feb 25 16:02:30 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-f438338b-80a8-4383-869c-2cc27bfbc50c tempest-CreateVolumesFromImageTest-1720772828 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-cac4472a-7136-4994-a04f-d04d643e665b 1073741824 {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 25 16:02:30 devstack sudo[91473]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-cac4472a-7136-4994-a04f-d04d643e665b 1073741824 Feb 25 16:02:30 devstack sudo[91473]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 25 16:02:30 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-12800b3a-15a4-4164-ac45-45ec88ef1bae tempest-CreateVolumesFromImageTest-1720772828 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fed62c22-96bf-432e-8bad-9006fc669660) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fe202eaa-dba1-4bc9-bcf1-06277b73ddbe', 'volume_size': 1}' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 25 16:02:30 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-12800b3a-15a4-4164-ac45-45ec88ef1bae tempest-CreateVolumesFromImageTest-1720772828 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (48f8c812-a060-4645-b0bb-76d1ac959afa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 25 16:02:30 devstack cinder-volume[83528]: INFO cinder.volume.flows.manager.create_volume [None req-12800b3a-15a4-4164-ac45-45ec88ef1bae tempest-CreateVolumesFromImageTest-1720772828 None] Volume volume-fe202eaa-dba1-4bc9-bcf1-06277b73ddbe (fe202eaa-dba1-4bc9-bcf1-06277b73ddbe): created successfully Feb 25 16:02:30 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-12800b3a-15a4-4164-ac45-45ec88ef1bae tempest-CreateVolumesFromImageTest-1720772828 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (48f8c812-a060-4645-b0bb-76d1ac959afa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 25 16:02:30 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-12800b3a-15a4-4164-ac45-45ec88ef1bae tempest-CreateVolumesFromImageTest-1720772828 None] Flow 'volume_create_manager' (d0cee4cb-9a34-4e35-b036-22576bc35df8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83528) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 25 16:02:30 devstack cinder-volume[83528]: INFO cinder.volume.manager [None req-12800b3a-15a4-4164-ac45-45ec88ef1bae tempest-CreateVolumesFromImageTest-1720772828 None] Created volume successfully. Feb 25 16:02:31 devstack sudo[91473]: pam_unix(sudo:session): session closed for user root Feb 25 16:02:31 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-f438338b-80a8-4383-869c-2cc27bfbc50c tempest-CreateVolumesFromImageTest-1720772828 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-cac4472a-7136-4994-a04f-d04d643e665b 1073741824" returned: 0 in 0.511s {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 25 16:02:31 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-f438338b-80a8-4383-869c-2cc27bfbc50c tempest-CreateVolumesFromImageTest-1720772828 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-cac4472a-7136-4994-a04f-d04d643e665b {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 25 16:02:31 devstack sudo[91478]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-cac4472a-7136-4994-a04f-d04d643e665b Feb 25 16:02:31 devstack sudo[91478]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 25 16:02:31 devstack sudo[91478]: pam_unix(sudo:session): session closed for user root Feb 25 16:02:31 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-f438338b-80a8-4383-869c-2cc27bfbc50c tempest-CreateVolumesFromImageTest-1720772828 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-cac4472a-7136-4994-a04f-d04d643e665b" returned: 0 in 0.561s {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 25 16:02:31 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.quobyte [None req-f438338b-80a8-4383-869c-2cc27bfbc50c tempest-CreateVolumesFromImageTest-1720772828 None] <== create_volume: return (1104ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-23e9d725-3e04-4cd9-bfe0-c8ef43305589'} {{(pid=83528) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 25 16:02:31 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-f438338b-80a8-4383-869c-2cc27bfbc50c tempest-CreateVolumesFromImageTest-1720772828 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.107s {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 25 16:02:31 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-1ea3ec5c-09b9-4c7b-a585-a2c3a487c113 tempest-VolumeDependencyTests-18272511 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 4.338s {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 25 16:02:31 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.remotefs [None req-1ea3ec5c-09b9-4c7b-a585-a2c3a487c113 tempest-VolumeDependencyTests-18272511 None] Creating offline snapshot 7858c649-02d6-47b0-84db-35030ffbc4ca of volume 33b8b216-ea13-4c2a-9c22-443659f1c861 {{(pid=83528) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Feb 25 16:02:31 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-f438338b-80a8-4383-869c-2cc27bfbc50c tempest-CreateVolumesFromImageTest-1720772828 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f2c119d2-a0ef-4990-9f04-3c1d823130a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cac4472a-7136-4994-a04f-d04d643e665b', 'volume_size': 1}' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 25 16:02:31 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-f438338b-80a8-4383-869c-2cc27bfbc50c tempest-CreateVolumesFromImageTest-1720772828 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c4303535-34ef-4fbd-a17d-86b89d50ebd1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 25 16:02:31 devstack cinder-volume[83528]: DEBUG oslo.privsep.daemon [-] privsep: reply[9359584c-f6ef-478c-8a69-85dc29cd230a]: (4, 'qcow2') {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 25 16:02:31 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-1ea3ec5c-09b9-4c7b-a585-a2c3a487c113 tempest-VolumeDependencyTests-18272511 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-33b8b216-ea13-4c2a-9c22-443659f1c861 {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 25 16:02:31 devstack cinder-volume[83528]: INFO cinder.volume.flows.manager.create_volume [None req-f438338b-80a8-4383-869c-2cc27bfbc50c tempest-CreateVolumesFromImageTest-1720772828 None] Volume volume-cac4472a-7136-4994-a04f-d04d643e665b (cac4472a-7136-4994-a04f-d04d643e665b): created successfully Feb 25 16:02:31 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-f438338b-80a8-4383-869c-2cc27bfbc50c tempest-CreateVolumesFromImageTest-1720772828 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c4303535-34ef-4fbd-a17d-86b89d50ebd1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 25 16:02:31 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-f438338b-80a8-4383-869c-2cc27bfbc50c tempest-CreateVolumesFromImageTest-1720772828 None] Flow 'volume_create_manager' (e14ed4b8-f54e-4b9d-a2a8-77d908510e02) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83528) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 25 16:02:31 devstack cinder-volume[83528]: INFO cinder.volume.manager [None req-f438338b-80a8-4383-869c-2cc27bfbc50c tempest-CreateVolumesFromImageTest-1720772828 None] Created volume successfully. Feb 25 16:02:31 devstack sudo[91481]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-33b8b216-ea13-4c2a-9c22-443659f1c861 Feb 25 16:02:31 devstack sudo[91481]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 25 16:02:32 devstack sudo[91481]: pam_unix(sudo:session): session closed for user root Feb 25 16:02:32 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-1ea3ec5c-09b9-4c7b-a585-a2c3a487c113 tempest-VolumeDependencyTests-18272511 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-33b8b216-ea13-4c2a-9c22-443659f1c861" returned: 0 in 0.605s {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 25 16:02:32 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-1ea3ec5c-09b9-4c7b-a585-a2c3a487c113 tempest-VolumeDependencyTests-18272511 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-33b8b216-ea13-4c2a-9c22-443659f1c861,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-33b8b216-ea13-4c2a-9c22-443659f1c861.7858c649-02d6-47b0-84db-35030ffbc4ca 1G {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 25 16:02:32 devstack sudo[91486]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-33b8b216-ea13-4c2a-9c22-443659f1c861,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-33b8b216-ea13-4c2a-9c22-443659f1c861.7858c649-02d6-47b0-84db-35030ffbc4ca 1G Feb 25 16:02:32 devstack sudo[91486]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 25 16:02:32 devstack cinder-volume[83528]: DEBUG cinder.coordination [None req-10ebc9ee-4c62-4873-8e54-5ddd55de91e8 tempest-CreateVolumesFromImageTest-1720772828 None] Acquiring lock "cinder-cac4472a-7136-4994-a04f-d04d643e665b-delete_volume" by "delete_volume" {{(pid=83528) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 25 16:02:32 devstack cinder-volume[83528]: DEBUG cinder.coordination [None req-10ebc9ee-4c62-4873-8e54-5ddd55de91e8 tempest-CreateVolumesFromImageTest-1720772828 None] Lock "cinder-cac4472a-7136-4994-a04f-d04d643e665b-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=83528) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 25 16:02:32 devstack cinder-volume[83528]: DEBUG cinder.coordination [None req-10ebc9ee-4c62-4873-8e54-5ddd55de91e8 tempest-CreateVolumesFromImageTest-1720772828 None] Acquiring lock "cinder-quobyte-cac4472a-7136-4994-a04f-d04d643e665b" by "delete_volume" {{(pid=83528) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 25 16:02:32 devstack cinder-volume[83528]: DEBUG cinder.coordination [None req-10ebc9ee-4c62-4873-8e54-5ddd55de91e8 tempest-CreateVolumesFromImageTest-1720772828 None] Lock "cinder-quobyte-cac4472a-7136-4994-a04f-d04d643e665b" acquired by "delete_volume" :: waited 0.009s {{(pid=83528) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 25 16:02:32 devstack cinder-volume[83528]: DEBUG oslo.privsep.daemon [-] privsep: reply[fac16c98-fbcf-458a-8213-7422b532d815]: (4, 'qcow2') {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 25 16:02:32 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-10ebc9ee-4c62-4873-8e54-5ddd55de91e8 tempest-CreateVolumesFromImageTest-1720772828 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-cac4472a-7136-4994-a04f-d04d643e665b {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 25 16:02:32 devstack sudo[91488]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-cac4472a-7136-4994-a04f-d04d643e665b Feb 25 16:02:32 devstack sudo[91488]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 25 16:02:33 devstack sudo[91486]: pam_unix(sudo:session): session closed for user root Feb 25 16:02:33 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-1ea3ec5c-09b9-4c7b-a585-a2c3a487c113 tempest-VolumeDependencyTests-18272511 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-33b8b216-ea13-4c2a-9c22-443659f1c861,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-33b8b216-ea13-4c2a-9c22-443659f1c861.7858c649-02d6-47b0-84db-35030ffbc4ca 1G" returned: 0 in 0.610s {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 25 16:02:33 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-1ea3ec5c-09b9-4c7b-a585-a2c3a487c113 tempest-VolumeDependencyTests-18272511 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-33b8b216-ea13-4c2a-9c22-443659f1c861 -F qcow2 /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-33b8b216-ea13-4c2a-9c22-443659f1c861.7858c649-02d6-47b0-84db-35030ffbc4ca {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 25 16:02:33 devstack sudo[91495]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-33b8b216-ea13-4c2a-9c22-443659f1c861 -F qcow2 /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-33b8b216-ea13-4c2a-9c22-443659f1c861.7858c649-02d6-47b0-84db-35030ffbc4ca Feb 25 16:02:33 devstack sudo[91495]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 25 16:02:33 devstack sudo[91488]: pam_unix(sudo:session): session closed for user root Feb 25 16:02:33 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-10ebc9ee-4c62-4873-8e54-5ddd55de91e8 tempest-CreateVolumesFromImageTest-1720772828 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-cac4472a-7136-4994-a04f-d04d643e665b" returned: 0 in 0.559s {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 25 16:02:33 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-10ebc9ee-4c62-4873-8e54-5ddd55de91e8 tempest-CreateVolumesFromImageTest-1720772828 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-cac4472a-7136-4994-a04f-d04d643e665b {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 25 16:02:33 devstack sudo[91500]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-cac4472a-7136-4994-a04f-d04d643e665b Feb 25 16:02:33 devstack sudo[91500]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 25 16:02:33 devstack sudo[91495]: pam_unix(sudo:session): session closed for user root Feb 25 16:02:33 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-1ea3ec5c-09b9-4c7b-a585-a2c3a487c113 tempest-VolumeDependencyTests-18272511 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-33b8b216-ea13-4c2a-9c22-443659f1c861 -F qcow2 /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-33b8b216-ea13-4c2a-9c22-443659f1c861.7858c649-02d6-47b0-84db-35030ffbc4ca" returned: 0 in 0.492s {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 25 16:02:33 devstack cinder-volume[83528]: WARNING cinder.volume.drivers.remotefs [None req-1ea3ec5c-09b9-4c7b-a585-a2c3a487c113 tempest-VolumeDependencyTests-18272511 None] /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-33b8b216-ea13-4c2a-9c22-443659f1c861.7858c649-02d6-47b0-84db-35030ffbc4ca is being set with open permissions: ugo+rw Feb 25 16:02:33 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-1ea3ec5c-09b9-4c7b-a585-a2c3a487c113 tempest-VolumeDependencyTests-18272511 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-33b8b216-ea13-4c2a-9c22-443659f1c861.7858c649-02d6-47b0-84db-35030ffbc4ca {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 25 16:02:33 devstack sudo[91505]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-33b8b216-ea13-4c2a-9c22-443659f1c861.7858c649-02d6-47b0-84db-35030ffbc4ca Feb 25 16:02:33 devstack sudo[91505]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 25 16:02:33 devstack sudo[91500]: pam_unix(sudo:session): session closed for user root Feb 25 16:02:33 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-10ebc9ee-4c62-4873-8e54-5ddd55de91e8 tempest-CreateVolumesFromImageTest-1720772828 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-cac4472a-7136-4994-a04f-d04d643e665b" returned: 0 in 0.503s {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 25 16:02:33 devstack cinder-volume[83528]: DEBUG cinder.coordination [None req-10ebc9ee-4c62-4873-8e54-5ddd55de91e8 tempest-CreateVolumesFromImageTest-1720772828 None] Lock "cinder-quobyte-cac4472a-7136-4994-a04f-d04d643e665b" released by "delete_volume" :: held 1.088s {{(pid=83528) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 25 16:02:33 devstack cinder-volume[83528]: DEBUG cinder.quota [None req-10ebc9ee-4c62-4873-8e54-5ddd55de91e8 tempest-CreateVolumesFromImageTest-1720772828 None] Created reservations ['4dbf2bbc-9b29-4e66-ac2c-670b0c37521a', '9668d582-e9bd-423f-9b43-f6b5c4e78145', '392e9ac5-3eca-4b33-8e26-1155592b8832', '0ce70b53-dc7d-461a-b1b4-d48dc79dcfe5'] {{(pid=83528) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 25 16:02:33 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-10ebc9ee-4c62-4873-8e54-5ddd55de91e8 tempest-CreateVolumesFromImageTest-1720772828 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 25 16:02:33 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-10ebc9ee-4c62-4873-8e54-5ddd55de91e8 tempest-CreateVolumesFromImageTest-1720772828 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 25 16:02:33 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.quobyte [None req-10ebc9ee-4c62-4873-8e54-5ddd55de91e8 tempest-CreateVolumesFromImageTest-1720772828 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23e9d725-3e04-4cd9-bfe0-c8ef43305589': None} {{(pid=83528) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 25 16:02:33 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.quobyte [None req-10ebc9ee-4c62-4873-8e54-5ddd55de91e8 tempest-CreateVolumesFromImageTest-1720772828 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23e9d725-3e04-4cd9-bfe0-c8ef43305589'] {{(pid=83528) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 25 16:02:33 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-10ebc9ee-4c62-4873-8e54-5ddd55de91e8 tempest-CreateVolumesFromImageTest-1720772828 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 25 16:02:33 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-10ebc9ee-4c62-4873-8e54-5ddd55de91e8 tempest-CreateVolumesFromImageTest-1720772828 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85 {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 25 16:02:33 devstack sudo[91508]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85 Feb 25 16:02:33 devstack sudo[91508]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 25 16:02:33 devstack sudo[91505]: pam_unix(sudo:session): session closed for user root Feb 25 16:02:34 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-1ea3ec5c-09b9-4c7b-a585-a2c3a487c113 tempest-VolumeDependencyTests-18272511 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-33b8b216-ea13-4c2a-9c22-443659f1c861.7858c649-02d6-47b0-84db-35030ffbc4ca" returned: 0 in 0.487s {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 25 16:02:34 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-1ea3ec5c-09b9-4c7b-a585-a2c3a487c113 tempest-VolumeDependencyTests-18272511 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-33b8b216-ea13-4c2a-9c22-443659f1c861.info {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 25 16:02:34 devstack sudo[91511]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-33b8b216-ea13-4c2a-9c22-443659f1c861.info Feb 25 16:02:34 devstack sudo[91511]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 25 16:02:34 devstack sudo[91508]: pam_unix(sudo:session): session closed for user root Feb 25 16:02:34 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-10ebc9ee-4c62-4873-8e54-5ddd55de91e8 tempest-CreateVolumesFromImageTest-1720772828 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85" returned: 0 in 0.423s {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 25 16:02:34 devstack cinder-volume[83528]: DEBUG cinder.manager [None req-10ebc9ee-4c62-4873-8e54-5ddd55de91e8 tempest-CreateVolumesFromImageTest-1720772828 None] Notifying Schedulers of capabilities ... {{(pid=83528) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 25 16:02:34 devstack cinder-volume[83528]: INFO cinder.volume.manager [None req-10ebc9ee-4c62-4873-8e54-5ddd55de91e8 tempest-CreateVolumesFromImageTest-1720772828 None] Deleted volume successfully. Feb 25 16:02:34 devstack cinder-volume[83528]: DEBUG cinder.coordination [None req-10ebc9ee-4c62-4873-8e54-5ddd55de91e8 tempest-CreateVolumesFromImageTest-1720772828 None] Lock "cinder-cac4472a-7136-4994-a04f-d04d643e665b-delete_volume" released by "delete_volume" :: held 1.684s {{(pid=83528) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 25 16:02:34 devstack sudo[91511]: pam_unix(sudo:session): session closed for user root Feb 25 16:02:34 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-1ea3ec5c-09b9-4c7b-a585-a2c3a487c113 tempest-VolumeDependencyTests-18272511 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-33b8b216-ea13-4c2a-9c22-443659f1c861.info" returned: 0 in 0.498s {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 25 16:02:34 devstack cinder-volume[83528]: WARNING cinder.volume.drivers.remotefs [None req-1ea3ec5c-09b9-4c7b-a585-a2c3a487c113 tempest-VolumeDependencyTests-18272511 None] /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-33b8b216-ea13-4c2a-9c22-443659f1c861.info is being set with open permissions: ugo+rw Feb 25 16:02:34 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-1ea3ec5c-09b9-4c7b-a585-a2c3a487c113 tempest-VolumeDependencyTests-18272511 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-33b8b216-ea13-4c2a-9c22-443659f1c861.info {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 25 16:02:34 devstack sudo[91515]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-33b8b216-ea13-4c2a-9c22-443659f1c861.info Feb 25 16:02:34 devstack sudo[91515]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 25 16:02:34 devstack cinder-volume[83528]: DEBUG cinder.coordination [None req-0ae93ab9-07e2-47fe-a275-4ade0bf1f934 tempest-CreateVolumesFromImageTest-1720772828 None] Acquiring lock "cinder-fe202eaa-dba1-4bc9-bcf1-06277b73ddbe-delete_volume" by "delete_volume" {{(pid=83528) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 25 16:02:34 devstack cinder-volume[83528]: DEBUG cinder.coordination [None req-0ae93ab9-07e2-47fe-a275-4ade0bf1f934 tempest-CreateVolumesFromImageTest-1720772828 None] Lock "cinder-fe202eaa-dba1-4bc9-bcf1-06277b73ddbe-delete_volume" acquired by "delete_volume" :: waited 0.014s {{(pid=83528) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 25 16:02:34 devstack cinder-volume[83528]: DEBUG cinder.coordination [None req-0ae93ab9-07e2-47fe-a275-4ade0bf1f934 tempest-CreateVolumesFromImageTest-1720772828 None] Acquiring lock "cinder-quobyte-fe202eaa-dba1-4bc9-bcf1-06277b73ddbe" by "delete_volume" {{(pid=83528) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 25 16:02:34 devstack cinder-volume[83528]: DEBUG cinder.coordination [None req-0ae93ab9-07e2-47fe-a275-4ade0bf1f934 tempest-CreateVolumesFromImageTest-1720772828 None] Lock "cinder-quobyte-fe202eaa-dba1-4bc9-bcf1-06277b73ddbe" acquired by "delete_volume" :: waited 0.010s {{(pid=83528) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 25 16:02:34 devstack cinder-volume[83528]: DEBUG oslo.privsep.daemon [-] privsep: reply[537a2739-1904-4ace-bc89-3a6f4cb905e8]: (4, 'qcow2') {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 25 16:02:34 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-0ae93ab9-07e2-47fe-a275-4ade0bf1f934 tempest-CreateVolumesFromImageTest-1720772828 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-fe202eaa-dba1-4bc9-bcf1-06277b73ddbe {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 25 16:02:34 devstack sudo[91518]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-fe202eaa-dba1-4bc9-bcf1-06277b73ddbe Feb 25 16:02:34 devstack sudo[91518]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 25 16:02:35 devstack sudo[91515]: pam_unix(sudo:session): session closed for user root Feb 25 16:02:35 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-1ea3ec5c-09b9-4c7b-a585-a2c3a487c113 tempest-VolumeDependencyTests-18272511 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-33b8b216-ea13-4c2a-9c22-443659f1c861.info" returned: 0 in 0.497s {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 25 16:02:35 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-1ea3ec5c-09b9-4c7b-a585-a2c3a487c113 tempest-VolumeDependencyTests-18272511 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.283s {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 25 16:02:35 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-34b6dbcb-5310-4f3f-9838-f282a3188967 tempest-CreateVolumesFromSnapshotTest-1082910625 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 5.267s {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 25 16:02:35 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.remotefs [None req-34b6dbcb-5310-4f3f-9838-f282a3188967 tempest-CreateVolumesFromSnapshotTest-1082910625 None] Creating offline snapshot 71173e35-0ede-4a74-ab84-544e29e78339 of volume f30072d2-6e3e-4fcd-9fc0-b97e812f66ce {{(pid=83528) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Feb 25 16:02:35 devstack cinder-volume[83528]: DEBUG oslo.privsep.daemon [-] privsep: reply[03aa7da0-ef26-491f-9d81-f164cdcd2030]: (4, 'qcow2') {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 25 16:02:35 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-34b6dbcb-5310-4f3f-9838-f282a3188967 tempest-CreateVolumesFromSnapshotTest-1082910625 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-f30072d2-6e3e-4fcd-9fc0-b97e812f66ce {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 25 16:02:35 devstack cinder-volume[83528]: INFO cinder.volume.manager [None req-1ea3ec5c-09b9-4c7b-a585-a2c3a487c113 tempest-VolumeDependencyTests-18272511 None] Create snapshot completed successfully Feb 25 16:02:35 devstack sudo[91521]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-f30072d2-6e3e-4fcd-9fc0-b97e812f66ce Feb 25 16:02:35 devstack sudo[91521]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 25 16:02:35 devstack sudo[91518]: pam_unix(sudo:session): session closed for user root Feb 25 16:02:35 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-0ae93ab9-07e2-47fe-a275-4ade0bf1f934 tempest-CreateVolumesFromImageTest-1720772828 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-fe202eaa-dba1-4bc9-bcf1-06277b73ddbe" returned: 0 in 0.589s {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 25 16:02:35 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-0ae93ab9-07e2-47fe-a275-4ade0bf1f934 tempest-CreateVolumesFromImageTest-1720772828 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-fe202eaa-dba1-4bc9-bcf1-06277b73ddbe {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 25 16:02:35 devstack sudo[91526]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-fe202eaa-dba1-4bc9-bcf1-06277b73ddbe Feb 25 16:02:35 devstack sudo[91526]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 25 16:02:35 devstack sudo[91521]: pam_unix(sudo:session): session closed for user root Feb 25 16:02:35 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-34b6dbcb-5310-4f3f-9838-f282a3188967 tempest-CreateVolumesFromSnapshotTest-1082910625 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-f30072d2-6e3e-4fcd-9fc0-b97e812f66ce" returned: 0 in 0.665s {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 25 16:02:35 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-34b6dbcb-5310-4f3f-9838-f282a3188967 tempest-CreateVolumesFromSnapshotTest-1082910625 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-f30072d2-6e3e-4fcd-9fc0-b97e812f66ce,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-f30072d2-6e3e-4fcd-9fc0-b97e812f66ce.71173e35-0ede-4a74-ab84-544e29e78339 1G {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 25 16:02:35 devstack sudo[91531]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-f30072d2-6e3e-4fcd-9fc0-b97e812f66ce,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-f30072d2-6e3e-4fcd-9fc0-b97e812f66ce.71173e35-0ede-4a74-ab84-544e29e78339 1G Feb 25 16:02:35 devstack sudo[91531]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 25 16:02:35 devstack sudo[91526]: pam_unix(sudo:session): session closed for user root Feb 25 16:02:35 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-0ae93ab9-07e2-47fe-a275-4ade0bf1f934 tempest-CreateVolumesFromImageTest-1720772828 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-fe202eaa-dba1-4bc9-bcf1-06277b73ddbe" returned: 0 in 0.494s {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 25 16:02:35 devstack cinder-volume[83528]: DEBUG cinder.coordination [None req-0ae93ab9-07e2-47fe-a275-4ade0bf1f934 tempest-CreateVolumesFromImageTest-1720772828 None] Lock "cinder-quobyte-fe202eaa-dba1-4bc9-bcf1-06277b73ddbe" released by "delete_volume" :: held 1.127s {{(pid=83528) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 25 16:02:36 devstack cinder-volume[83528]: DEBUG cinder.quota [None req-0ae93ab9-07e2-47fe-a275-4ade0bf1f934 tempest-CreateVolumesFromImageTest-1720772828 None] Created reservations ['7dcda78b-de16-44dc-943a-64dee0a45092', '4b909624-ea0a-4e78-9d02-10e35adebe2c', '6be80517-de3b-4fa3-9e33-a5a78525629b', 'a6888985-cbe5-4186-9aa0-ce91c2092e3b'] {{(pid=83528) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 25 16:02:36 devstack cinder-volume[83528]: DEBUG cinder.volume.flows.manager.create_volume [None req-7ec58354-33b8-4930-8045-dca91794ba76 tempest-VolumeDependencyTests-18272511 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83528) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 25 16:02:36 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-7ec58354-33b8-4930-8045-dca91794ba76 tempest-VolumeDependencyTests-18272511 None] Flow 'volume_create_manager' (4752b42e-dfcb-40ae-a61b-5f63bc945026) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83528) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 25 16:02:36 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-7ec58354-33b8-4930-8045-dca91794ba76 tempest-VolumeDependencyTests-18272511 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (447c622d-f25f-4ddc-bf9c-af79c46faa9c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 25 16:02:36 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-7ec58354-33b8-4930-8045-dca91794ba76 tempest-VolumeDependencyTests-18272511 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (447c622d-f25f-4ddc-bf9c-af79c46faa9c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-25T15:02:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-176730233',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=aaff583b-3dac-4ecc-bea8-832524cd0fd0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a8840d2cf3ed4cbead7a7125ba5ed6db',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-25T15:02:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=7858c649-02d6-47b0-84db-35030ffbc4ca,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-25T15:02:36Z,use_quota=True,user_id='80a29926db28406da11a76818f583959',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ce71c2f9-6543-4165-9653-a1529b2ea243),volume_type_id=ce71c2f9-6543-4165-9653-a1529b2ea243)' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 25 16:02:36 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-7ec58354-33b8-4930-8045-dca91794ba76 tempest-VolumeDependencyTests-18272511 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8a6e27f1-fca8-4a52-842c-7745d2613338) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 25 16:02:36 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-7ec58354-33b8-4930-8045-dca91794ba76 tempest-VolumeDependencyTests-18272511 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8a6e27f1-fca8-4a52-842c-7745d2613338) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 25 16:02:36 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-7ec58354-33b8-4930-8045-dca91794ba76 tempest-VolumeDependencyTests-18272511 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8cddb59d-3518-4d13-acaf-0bf3f6dfc93f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 25 16:02:36 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-7ec58354-33b8-4930-8045-dca91794ba76 tempest-VolumeDependencyTests-18272511 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8cddb59d-3518-4d13-acaf-0bf3f6dfc93f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'aaff583b-3dac-4ecc-bea8-832524cd0fd0', 'volume_name': 'volume-aaff583b-3dac-4ecc-bea8-832524cd0fd0', 'volume_size': 1, 'snapshot_id': '7858c649-02d6-47b0-84db-35030ffbc4ca'}' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 25 16:02:36 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-7ec58354-33b8-4930-8045-dca91794ba76 tempest-VolumeDependencyTests-18272511 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7709a767-d659-4ac4-aac5-653d344ea47a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 25 16:02:36 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-7ec58354-33b8-4930-8045-dca91794ba76 tempest-VolumeDependencyTests-18272511 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7709a767-d659-4ac4-aac5-653d344ea47a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 25 16:02:36 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-7ec58354-33b8-4930-8045-dca91794ba76 tempest-VolumeDependencyTests-18272511 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (edbef620-b1cf-44e2-9307-80f3f5cd77ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 25 16:02:36 devstack cinder-volume[83528]: INFO cinder.volume.flows.manager.create_volume [None req-7ec58354-33b8-4930-8045-dca91794ba76 tempest-VolumeDependencyTests-18272511 None] Volume aaff583b-3dac-4ecc-bea8-832524cd0fd0: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-aaff583b-3dac-4ecc-bea8-832524cd0fd0', 'volume_size': 1, 'snapshot_id': '7858c649-02d6-47b0-84db-35030ffbc4ca'} Feb 25 16:02:36 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-7ec58354-33b8-4930-8045-dca91794ba76 tempest-VolumeDependencyTests-18272511 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 25 16:02:36 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-0ae93ab9-07e2-47fe-a275-4ade0bf1f934 tempest-CreateVolumesFromImageTest-1720772828 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 25 16:02:36 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-0ae93ab9-07e2-47fe-a275-4ade0bf1f934 tempest-CreateVolumesFromImageTest-1720772828 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 25 16:02:36 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.quobyte [None req-0ae93ab9-07e2-47fe-a275-4ade0bf1f934 tempest-CreateVolumesFromImageTest-1720772828 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23e9d725-3e04-4cd9-bfe0-c8ef43305589': None} {{(pid=83528) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 25 16:02:36 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.quobyte [None req-0ae93ab9-07e2-47fe-a275-4ade0bf1f934 tempest-CreateVolumesFromImageTest-1720772828 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23e9d725-3e04-4cd9-bfe0-c8ef43305589'] {{(pid=83528) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 25 16:02:36 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-0ae93ab9-07e2-47fe-a275-4ade0bf1f934 tempest-CreateVolumesFromImageTest-1720772828 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 25 16:02:36 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-0ae93ab9-07e2-47fe-a275-4ade0bf1f934 tempest-CreateVolumesFromImageTest-1720772828 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85 {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 25 16:02:36 devstack sudo[91536]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85 Feb 25 16:02:36 devstack sudo[91536]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 25 16:02:36 devstack sudo[91531]: pam_unix(sudo:session): session closed for user root Feb 25 16:02:36 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-34b6dbcb-5310-4f3f-9838-f282a3188967 tempest-CreateVolumesFromSnapshotTest-1082910625 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-f30072d2-6e3e-4fcd-9fc0-b97e812f66ce,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-f30072d2-6e3e-4fcd-9fc0-b97e812f66ce.71173e35-0ede-4a74-ab84-544e29e78339 1G" returned: 0 in 0.601s {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 25 16:02:36 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-34b6dbcb-5310-4f3f-9838-f282a3188967 tempest-CreateVolumesFromSnapshotTest-1082910625 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f30072d2-6e3e-4fcd-9fc0-b97e812f66ce -F qcow2 /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-f30072d2-6e3e-4fcd-9fc0-b97e812f66ce.71173e35-0ede-4a74-ab84-544e29e78339 {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 25 16:02:36 devstack sudo[91539]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f30072d2-6e3e-4fcd-9fc0-b97e812f66ce -F qcow2 /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-f30072d2-6e3e-4fcd-9fc0-b97e812f66ce.71173e35-0ede-4a74-ab84-544e29e78339 Feb 25 16:02:36 devstack sudo[91539]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 25 16:02:36 devstack sudo[91536]: pam_unix(sudo:session): session closed for user root Feb 25 16:02:36 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-0ae93ab9-07e2-47fe-a275-4ade0bf1f934 tempest-CreateVolumesFromImageTest-1720772828 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85" returned: 0 in 0.497s {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 25 16:02:36 devstack cinder-volume[83528]: DEBUG cinder.manager [None req-0ae93ab9-07e2-47fe-a275-4ade0bf1f934 tempest-CreateVolumesFromImageTest-1720772828 None] Notifying Schedulers of capabilities ... {{(pid=83528) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 25 16:02:36 devstack cinder-volume[83528]: INFO cinder.volume.manager [None req-0ae93ab9-07e2-47fe-a275-4ade0bf1f934 tempest-CreateVolumesFromImageTest-1720772828 None] Deleted volume successfully. Feb 25 16:02:36 devstack cinder-volume[83528]: DEBUG cinder.coordination [None req-0ae93ab9-07e2-47fe-a275-4ade0bf1f934 tempest-CreateVolumesFromImageTest-1720772828 None] Lock "cinder-fe202eaa-dba1-4bc9-bcf1-06277b73ddbe-delete_volume" released by "delete_volume" :: held 1.876s {{(pid=83528) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 25 16:02:36 devstack sudo[91539]: pam_unix(sudo:session): session closed for user root Feb 25 16:02:36 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-34b6dbcb-5310-4f3f-9838-f282a3188967 tempest-CreateVolumesFromSnapshotTest-1082910625 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f30072d2-6e3e-4fcd-9fc0-b97e812f66ce -F qcow2 /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-f30072d2-6e3e-4fcd-9fc0-b97e812f66ce.71173e35-0ede-4a74-ab84-544e29e78339" returned: 0 in 0.547s {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 25 16:02:36 devstack cinder-volume[83528]: WARNING cinder.volume.drivers.remotefs [None req-34b6dbcb-5310-4f3f-9838-f282a3188967 tempest-CreateVolumesFromSnapshotTest-1082910625 None] /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-f30072d2-6e3e-4fcd-9fc0-b97e812f66ce.71173e35-0ede-4a74-ab84-544e29e78339 is being set with open permissions: ugo+rw Feb 25 16:02:36 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-34b6dbcb-5310-4f3f-9838-f282a3188967 tempest-CreateVolumesFromSnapshotTest-1082910625 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-f30072d2-6e3e-4fcd-9fc0-b97e812f66ce.71173e35-0ede-4a74-ab84-544e29e78339 {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 25 16:02:36 devstack sudo[91545]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-f30072d2-6e3e-4fcd-9fc0-b97e812f66ce.71173e35-0ede-4a74-ab84-544e29e78339 Feb 25 16:02:36 devstack sudo[91545]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 25 16:02:37 devstack cinder-volume[83528]: DEBUG cinder.coordination [None req-b14db793-a770-40b3-b604-b38a086eaea5 tempest-CreateVolumesFromImageTest-1720772828 None] Acquiring lock "cinder-bde9af84-35ea-4c30-8222-97a4b52ae350-delete_volume" by "delete_volume" {{(pid=83528) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 25 16:02:37 devstack cinder-volume[83528]: DEBUG cinder.coordination [None req-b14db793-a770-40b3-b604-b38a086eaea5 tempest-CreateVolumesFromImageTest-1720772828 None] Lock "cinder-bde9af84-35ea-4c30-8222-97a4b52ae350-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=83528) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 25 16:02:37 devstack cinder-volume[83528]: DEBUG cinder.coordination [None req-b14db793-a770-40b3-b604-b38a086eaea5 tempest-CreateVolumesFromImageTest-1720772828 None] Acquiring lock "cinder-quobyte-bde9af84-35ea-4c30-8222-97a4b52ae350" by "delete_volume" {{(pid=83528) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 25 16:02:37 devstack cinder-volume[83528]: DEBUG cinder.coordination [None req-b14db793-a770-40b3-b604-b38a086eaea5 tempest-CreateVolumesFromImageTest-1720772828 None] Lock "cinder-quobyte-bde9af84-35ea-4c30-8222-97a4b52ae350" acquired by "delete_volume" :: waited 0.007s {{(pid=83528) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 25 16:02:37 devstack cinder-volume[83528]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ca54736-0ab8-4cc2-af1c-ee559dfc781f]: (4, 'qcow2') {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 25 16:02:37 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-b14db793-a770-40b3-b604-b38a086eaea5 tempest-CreateVolumesFromImageTest-1720772828 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-bde9af84-35ea-4c30-8222-97a4b52ae350 {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 25 16:02:37 devstack sudo[91547]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-bde9af84-35ea-4c30-8222-97a4b52ae350 Feb 25 16:02:37 devstack sudo[91547]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 25 16:02:37 devstack sudo[91545]: pam_unix(sudo:session): session closed for user root Feb 25 16:02:37 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-34b6dbcb-5310-4f3f-9838-f282a3188967 tempest-CreateVolumesFromSnapshotTest-1082910625 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-f30072d2-6e3e-4fcd-9fc0-b97e812f66ce.71173e35-0ede-4a74-ab84-544e29e78339" returned: 0 in 0.498s {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 25 16:02:37 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-34b6dbcb-5310-4f3f-9838-f282a3188967 tempest-CreateVolumesFromSnapshotTest-1082910625 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-f30072d2-6e3e-4fcd-9fc0-b97e812f66ce.info {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 25 16:02:37 devstack sudo[91550]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-f30072d2-6e3e-4fcd-9fc0-b97e812f66ce.info Feb 25 16:02:37 devstack sudo[91550]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 25 16:02:37 devstack sudo[91547]: pam_unix(sudo:session): session closed for user root Feb 25 16:02:37 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-b14db793-a770-40b3-b604-b38a086eaea5 tempest-CreateVolumesFromImageTest-1720772828 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-bde9af84-35ea-4c30-8222-97a4b52ae350" returned: 0 in 0.572s {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 25 16:02:37 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-b14db793-a770-40b3-b604-b38a086eaea5 tempest-CreateVolumesFromImageTest-1720772828 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-bde9af84-35ea-4c30-8222-97a4b52ae350 {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 25 16:02:37 devstack sudo[91555]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-bde9af84-35ea-4c30-8222-97a4b52ae350 Feb 25 16:02:37 devstack sudo[91555]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 25 16:02:37 devstack sudo[91550]: pam_unix(sudo:session): session closed for user root Feb 25 16:02:37 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-34b6dbcb-5310-4f3f-9838-f282a3188967 tempest-CreateVolumesFromSnapshotTest-1082910625 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-f30072d2-6e3e-4fcd-9fc0-b97e812f66ce.info" returned: 0 in 0.492s {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 25 16:02:37 devstack cinder-volume[83528]: WARNING cinder.volume.drivers.remotefs [None req-34b6dbcb-5310-4f3f-9838-f282a3188967 tempest-CreateVolumesFromSnapshotTest-1082910625 None] /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-f30072d2-6e3e-4fcd-9fc0-b97e812f66ce.info is being set with open permissions: ugo+rw Feb 25 16:02:37 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-34b6dbcb-5310-4f3f-9838-f282a3188967 tempest-CreateVolumesFromSnapshotTest-1082910625 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-f30072d2-6e3e-4fcd-9fc0-b97e812f66ce.info {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 25 16:02:37 devstack sudo[91558]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-f30072d2-6e3e-4fcd-9fc0-b97e812f66ce.info Feb 25 16:02:37 devstack sudo[91558]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 25 16:02:38 devstack sudo[91555]: pam_unix(sudo:session): session closed for user root Feb 25 16:02:38 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-b14db793-a770-40b3-b604-b38a086eaea5 tempest-CreateVolumesFromImageTest-1720772828 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-bde9af84-35ea-4c30-8222-97a4b52ae350" returned: 0 in 0.623s {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 25 16:02:38 devstack cinder-volume[83528]: DEBUG cinder.coordination [None req-b14db793-a770-40b3-b604-b38a086eaea5 tempest-CreateVolumesFromImageTest-1720772828 None] Lock "cinder-quobyte-bde9af84-35ea-4c30-8222-97a4b52ae350" released by "delete_volume" :: held 1.238s {{(pid=83528) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 25 16:02:38 devstack sudo[91558]: pam_unix(sudo:session): session closed for user root Feb 25 16:02:38 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-34b6dbcb-5310-4f3f-9838-f282a3188967 tempest-CreateVolumesFromSnapshotTest-1082910625 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-f30072d2-6e3e-4fcd-9fc0-b97e812f66ce.info" returned: 0 in 0.490s {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 25 16:02:38 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-34b6dbcb-5310-4f3f-9838-f282a3188967 tempest-CreateVolumesFromSnapshotTest-1082910625 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.367s {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 25 16:02:38 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-7ec58354-33b8-4930-8045-dca91794ba76 tempest-VolumeDependencyTests-18272511 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 2.247s {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 25 16:02:38 devstack cinder-volume[83528]: DEBUG cinder.coordination [None req-7ec58354-33b8-4930-8045-dca91794ba76 tempest-VolumeDependencyTests-18272511 None] Acquiring lock "cinder-quobyte-7858c649-02d6-47b0-84db-35030ffbc4ca-aaff583b-3dac-4ecc-bea8-832524cd0fd0" by "_create_volume_from_snapshot" {{(pid=83528) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 25 16:02:38 devstack cinder-volume[83528]: INFO cinder.volume.manager [None req-34b6dbcb-5310-4f3f-9838-f282a3188967 tempest-CreateVolumesFromSnapshotTest-1082910625 None] Create snapshot completed successfully Feb 25 16:02:38 devstack cinder-volume[83528]: DEBUG cinder.coordination [None req-7ec58354-33b8-4930-8045-dca91794ba76 tempest-VolumeDependencyTests-18272511 None] Lock "cinder-quobyte-7858c649-02d6-47b0-84db-35030ffbc4ca-aaff583b-3dac-4ecc-bea8-832524cd0fd0" acquired by "_create_volume_from_snapshot" :: waited 0.018s {{(pid=83528) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 25 16:02:38 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.quobyte [None req-7ec58354-33b8-4930-8045-dca91794ba76 tempest-VolumeDependencyTests-18272511 None] Creating volume aaff583b-3dac-4ecc-bea8-832524cd0fd0 from snapshot 7858c649-02d6-47b0-84db-35030ffbc4ca {{(pid=83528) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Feb 25 16:02:38 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-7ec58354-33b8-4930-8045-dca91794ba76 tempest-VolumeDependencyTests-18272511 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 25 16:02:38 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-7ec58354-33b8-4930-8045-dca91794ba76 tempest-VolumeDependencyTests-18272511 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 25 16:02:38 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.quobyte [None req-7ec58354-33b8-4930-8045-dca91794ba76 tempest-VolumeDependencyTests-18272511 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23e9d725-3e04-4cd9-bfe0-c8ef43305589': None} {{(pid=83528) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 25 16:02:38 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.quobyte [None req-7ec58354-33b8-4930-8045-dca91794ba76 tempest-VolumeDependencyTests-18272511 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23e9d725-3e04-4cd9-bfe0-c8ef43305589'] {{(pid=83528) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 25 16:02:38 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-7ec58354-33b8-4930-8045-dca91794ba76 tempest-VolumeDependencyTests-18272511 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 25 16:02:38 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.quobyte [None req-7ec58354-33b8-4930-8045-dca91794ba76 tempest-VolumeDependencyTests-18272511 None] Selected osci02.corp.quobyte.com/cinder-vol-23e9d725-3e04-4cd9-bfe0-c8ef43305589 as target Quobyte volume. {{(pid=83528) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 25 16:02:38 devstack cinder-volume[83528]: DEBUG cinder.coordination [None req-7ec58354-33b8-4930-8045-dca91794ba76 tempest-VolumeDependencyTests-18272511 None] Acquiring lock "cinder-quobyte-aaff583b-3dac-4ecc-bea8-832524cd0fd0" by "_copy_volume_from_snapshot" {{(pid=83528) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 25 16:02:38 devstack cinder-volume[83528]: DEBUG cinder.quota [None req-b14db793-a770-40b3-b604-b38a086eaea5 tempest-CreateVolumesFromImageTest-1720772828 None] Created reservations ['9952c922-b775-48eb-8ab0-75a3312cfd25', 'a585bb42-2fe2-4102-aa6c-c2b94959bd0f', '4fa2e66c-d629-4c2e-82af-4c44e65f6c1a', '70878d2e-f3a3-4891-b357-1b9730d974c4'] {{(pid=83528) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 25 16:02:38 devstack cinder-volume[83528]: DEBUG cinder.coordination [None req-7ec58354-33b8-4930-8045-dca91794ba76 tempest-VolumeDependencyTests-18272511 None] Lock "cinder-quobyte-aaff583b-3dac-4ecc-bea8-832524cd0fd0" acquired by "_copy_volume_from_snapshot" :: waited 0.016s {{(pid=83528) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 25 16:02:38 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.quobyte [None req-7ec58354-33b8-4930-8045-dca91794ba76 tempest-VolumeDependencyTests-18272511 None] snapshot: 7858c649-02d6-47b0-84db-35030ffbc4ca, volume: aaff583b-3dac-4ecc-bea8-832524cd0fd0, {{(pid=83528) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Feb 25 16:02:38 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-7ec58354-33b8-4930-8045-dca91794ba76 tempest-VolumeDependencyTests-18272511 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 25 16:02:38 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-7ec58354-33b8-4930-8045-dca91794ba76 tempest-VolumeDependencyTests-18272511 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 25 16:02:38 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.quobyte [None req-7ec58354-33b8-4930-8045-dca91794ba76 tempest-VolumeDependencyTests-18272511 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23e9d725-3e04-4cd9-bfe0-c8ef43305589': None} {{(pid=83528) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 25 16:02:38 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.quobyte [None req-7ec58354-33b8-4930-8045-dca91794ba76 tempest-VolumeDependencyTests-18272511 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23e9d725-3e04-4cd9-bfe0-c8ef43305589'] {{(pid=83528) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 25 16:02:38 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-7ec58354-33b8-4930-8045-dca91794ba76 tempest-VolumeDependencyTests-18272511 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 25 16:02:38 devstack cinder-volume[83528]: DEBUG oslo.privsep.daemon [-] privsep: reply[90f817c5-7bb5-403f-83b6-a1dbe82cead8]: (4, 'qcow2') {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 25 16:02:38 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-7ec58354-33b8-4930-8045-dca91794ba76 tempest-VolumeDependencyTests-18272511 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-33b8b216-ea13-4c2a-9c22-443659f1c861.7858c649-02d6-47b0-84db-35030ffbc4ca {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 25 16:02:38 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-b14db793-a770-40b3-b604-b38a086eaea5 tempest-CreateVolumesFromImageTest-1720772828 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 25 16:02:38 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-b14db793-a770-40b3-b604-b38a086eaea5 tempest-CreateVolumesFromImageTest-1720772828 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 25 16:02:38 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.quobyte [None req-b14db793-a770-40b3-b604-b38a086eaea5 tempest-CreateVolumesFromImageTest-1720772828 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23e9d725-3e04-4cd9-bfe0-c8ef43305589': None} {{(pid=83528) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 25 16:02:38 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.quobyte [None req-b14db793-a770-40b3-b604-b38a086eaea5 tempest-CreateVolumesFromImageTest-1720772828 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23e9d725-3e04-4cd9-bfe0-c8ef43305589'] {{(pid=83528) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 25 16:02:38 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-b14db793-a770-40b3-b604-b38a086eaea5 tempest-CreateVolumesFromImageTest-1720772828 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 25 16:02:38 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-b14db793-a770-40b3-b604-b38a086eaea5 tempest-CreateVolumesFromImageTest-1720772828 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85 {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 25 16:02:38 devstack sudo[91563]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85 Feb 25 16:02:38 devstack sudo[91563]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 25 16:02:38 devstack sudo[91562]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-33b8b216-ea13-4c2a-9c22-443659f1c861.7858c649-02d6-47b0-84db-35030ffbc4ca Feb 25 16:02:38 devstack sudo[91562]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 25 16:02:38 devstack cinder-volume[83528]: DEBUG oslo_service.periodic_task [None req-d4c764ec-0ebb-4b31-b534-c9a53c1ab0dd None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=83528) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Feb 25 16:02:38 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-d4c764ec-0ebb-4b31-b534-c9a53c1ab0dd None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 25 16:02:38 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-d4c764ec-0ebb-4b31-b534-c9a53c1ab0dd None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 25 16:02:38 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.quobyte [None req-d4c764ec-0ebb-4b31-b534-c9a53c1ab0dd None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23e9d725-3e04-4cd9-bfe0-c8ef43305589': None} {{(pid=83528) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 25 16:02:38 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.quobyte [None req-d4c764ec-0ebb-4b31-b534-c9a53c1ab0dd None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23e9d725-3e04-4cd9-bfe0-c8ef43305589'] {{(pid=83528) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 25 16:02:38 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-d4c764ec-0ebb-4b31-b534-c9a53c1ab0dd None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 25 16:02:38 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-d4c764ec-0ebb-4b31-b534-c9a53c1ab0dd None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85 {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 25 16:02:38 devstack sudo[91566]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85 Feb 25 16:02:38 devstack sudo[91566]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 25 16:02:39 devstack sudo[91563]: pam_unix(sudo:session): session closed for user root Feb 25 16:02:39 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-b14db793-a770-40b3-b604-b38a086eaea5 tempest-CreateVolumesFromImageTest-1720772828 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85" returned: 0 in 0.530s {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 25 16:02:39 devstack cinder-volume[83528]: DEBUG cinder.manager [None req-b14db793-a770-40b3-b604-b38a086eaea5 tempest-CreateVolumesFromImageTest-1720772828 None] Notifying Schedulers of capabilities ... {{(pid=83528) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 25 16:02:39 devstack cinder-volume[83528]: INFO cinder.volume.manager [None req-b14db793-a770-40b3-b604-b38a086eaea5 tempest-CreateVolumesFromImageTest-1720772828 None] Deleted volume successfully. Feb 25 16:02:39 devstack sudo[91562]: pam_unix(sudo:session): session closed for user root Feb 25 16:02:39 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-7ec58354-33b8-4930-8045-dca91794ba76 tempest-VolumeDependencyTests-18272511 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-33b8b216-ea13-4c2a-9c22-443659f1c861.7858c649-02d6-47b0-84db-35030ffbc4ca" returned: 0 in 0.590s {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 25 16:02:39 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.remotefs [None req-7ec58354-33b8-4930-8045-dca91794ba76 tempest-VolumeDependencyTests-18272511 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-33b8b216-ea13-4c2a-9c22-443659f1c861(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83528) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Feb 25 16:02:39 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.quobyte [None req-7ec58354-33b8-4930-8045-dca91794ba76 tempest-VolumeDependencyTests-18272511 None] will copy from snapshot at /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-33b8b216-ea13-4c2a-9c22-443659f1c861 {{(pid=83528) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Feb 25 16:02:39 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.quobyte [None req-7ec58354-33b8-4930-8045-dca91794ba76 tempest-VolumeDependencyTests-18272511 None] Creating direct copy from snapshot {{(pid=83528) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Feb 25 16:02:39 devstack cinder-volume[83528]: DEBUG oslo.privsep.daemon [-] privsep: reply[949d41de-7c84-4d63-8d5f-807bb63850a7]: (4, 'qcow2') {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 25 16:02:39 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-7ec58354-33b8-4930-8045-dca91794ba76 tempest-VolumeDependencyTests-18272511 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-33b8b216-ea13-4c2a-9c22-443659f1c861 {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 25 16:02:39 devstack cinder-volume[83528]: DEBUG cinder.coordination [None req-b14db793-a770-40b3-b604-b38a086eaea5 tempest-CreateVolumesFromImageTest-1720772828 None] Lock "cinder-bde9af84-35ea-4c30-8222-97a4b52ae350-delete_volume" released by "delete_volume" :: held 2.095s {{(pid=83528) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 25 16:02:39 devstack sudo[91572]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-33b8b216-ea13-4c2a-9c22-443659f1c861 Feb 25 16:02:39 devstack sudo[91572]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 25 16:02:39 devstack cinder-volume[83528]: DEBUG cinder.coordination [None req-d9883d33-a6d6-4513-b71f-192b8976e232 tempest-CreateVolumesFromImageTest-1720772828 None] Acquiring lock "cinder-bf57e8a1-484b-4bdc-80a5-aadab247e6b2-delete_volume" by "delete_volume" {{(pid=83528) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 25 16:02:39 devstack cinder-volume[83528]: DEBUG cinder.coordination [None req-d9883d33-a6d6-4513-b71f-192b8976e232 tempest-CreateVolumesFromImageTest-1720772828 None] Lock "cinder-bf57e8a1-484b-4bdc-80a5-aadab247e6b2-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=83528) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 25 16:02:39 devstack cinder-volume[83528]: DEBUG cinder.coordination [None req-d9883d33-a6d6-4513-b71f-192b8976e232 tempest-CreateVolumesFromImageTest-1720772828 None] Acquiring lock "cinder-quobyte-bf57e8a1-484b-4bdc-80a5-aadab247e6b2" by "delete_volume" {{(pid=83528) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 25 16:02:39 devstack cinder-volume[83528]: DEBUG cinder.coordination [None req-d9883d33-a6d6-4513-b71f-192b8976e232 tempest-CreateVolumesFromImageTest-1720772828 None] Lock "cinder-quobyte-bf57e8a1-484b-4bdc-80a5-aadab247e6b2" acquired by "delete_volume" :: waited 0.079s {{(pid=83528) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 25 16:02:39 devstack sudo[91566]: pam_unix(sudo:session): session closed for user root Feb 25 16:02:39 devstack cinder-volume[83528]: DEBUG cinder.volume.flows.manager.create_volume [None req-de5032c5-b400-419d-af45-c2cfb906c2be tempest-CreateVolumesFromSnapshotTest-1082910625 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83528) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 25 16:02:39 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-de5032c5-b400-419d-af45-c2cfb906c2be tempest-CreateVolumesFromSnapshotTest-1082910625 None] Flow 'volume_create_manager' (0d81500f-1760-4148-a5bb-003d57b8584c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83528) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 25 16:02:39 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-de5032c5-b400-419d-af45-c2cfb906c2be tempest-CreateVolumesFromSnapshotTest-1082910625 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (69595776-5921-4918-985b-6d8e602ffd2d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 25 16:02:39 devstack cinder-volume[83528]: DEBUG oslo.privsep.daemon [-] privsep: reply[e030fe1e-cf8e-4751-aa72-196bb9f46e7a]: (4, 'qcow2') {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 25 16:02:39 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-de5032c5-b400-419d-af45-c2cfb906c2be tempest-CreateVolumesFromSnapshotTest-1082910625 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (69595776-5921-4918-985b-6d8e602ffd2d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-25T15:02:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1694901921',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=81f3f2c7-aaae-494b-98fc-e393c88dbc38,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='de3dcd140da840eb8693ca187507a07f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-25T15:02:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-25T15:02:40Z,use_quota=True,user_id='6d2c9b181121464abf8dc70575225af0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ce71c2f9-6543-4165-9653-a1529b2ea243),volume_type_id=ce71c2f9-6543-4165-9653-a1529b2ea243)' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 25 16:02:39 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-de5032c5-b400-419d-af45-c2cfb906c2be tempest-CreateVolumesFromSnapshotTest-1082910625 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (416e9605-6ca9-4f07-ac66-ce1d7ee1c8a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 25 16:02:39 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-de5032c5-b400-419d-af45-c2cfb906c2be tempest-CreateVolumesFromSnapshotTest-1082910625 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (416e9605-6ca9-4f07-ac66-ce1d7ee1c8a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 25 16:02:39 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-de5032c5-b400-419d-af45-c2cfb906c2be tempest-CreateVolumesFromSnapshotTest-1082910625 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1d8a0d43-89a4-425a-9b59-7036758d0e39) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 25 16:02:39 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-de5032c5-b400-419d-af45-c2cfb906c2be tempest-CreateVolumesFromSnapshotTest-1082910625 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1d8a0d43-89a4-425a-9b59-7036758d0e39) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '81f3f2c7-aaae-494b-98fc-e393c88dbc38', 'volume_name': 'volume-81f3f2c7-aaae-494b-98fc-e393c88dbc38', 'volume_size': 1}' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 25 16:02:39 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-de5032c5-b400-419d-af45-c2cfb906c2be tempest-CreateVolumesFromSnapshotTest-1082910625 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (42bf522d-89c8-482c-850b-b6b222e18c45) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 25 16:02:39 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-de5032c5-b400-419d-af45-c2cfb906c2be tempest-CreateVolumesFromSnapshotTest-1082910625 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (42bf522d-89c8-482c-850b-b6b222e18c45) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 25 16:02:39 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-de5032c5-b400-419d-af45-c2cfb906c2be tempest-CreateVolumesFromSnapshotTest-1082910625 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1201254f-c233-4ace-9119-38c508f6dc8c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 25 16:02:39 devstack cinder-volume[83528]: INFO cinder.volume.flows.manager.create_volume [None req-de5032c5-b400-419d-af45-c2cfb906c2be tempest-CreateVolumesFromSnapshotTest-1082910625 None] Volume 81f3f2c7-aaae-494b-98fc-e393c88dbc38: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-81f3f2c7-aaae-494b-98fc-e393c88dbc38', 'volume_size': 1} Feb 25 16:02:39 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-de5032c5-b400-419d-af45-c2cfb906c2be tempest-CreateVolumesFromSnapshotTest-1082910625 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 25 16:02:39 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-d9883d33-a6d6-4513-b71f-192b8976e232 tempest-CreateVolumesFromImageTest-1720772828 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-bf57e8a1-484b-4bdc-80a5-aadab247e6b2 {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 25 16:02:39 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-d4c764ec-0ebb-4b31-b534-c9a53c1ab0dd None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85" returned: 0 in 1.040s {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 25 16:02:39 devstack cinder-volume[83528]: DEBUG cinder.manager [None req-d4c764ec-0ebb-4b31-b534-c9a53c1ab0dd None None] Notifying Schedulers of capabilities ... {{(pid=83528) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 25 16:02:39 devstack sudo[91575]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-bf57e8a1-484b-4bdc-80a5-aadab247e6b2 Feb 25 16:02:39 devstack sudo[91575]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 25 16:02:39 devstack cinder-volume[83528]: DEBUG cinder.volume.flows.manager.create_volume [None req-9f71aed5-a8a2-4c92-997b-5e685e36b833 tempest-CreateVolumesFromSnapshotTest-1082910625 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83528) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 25 16:02:39 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-9f71aed5-a8a2-4c92-997b-5e685e36b833 tempest-CreateVolumesFromSnapshotTest-1082910625 None] Flow 'volume_create_manager' (a1e3feff-df25-4194-9948-f0a75a292eab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83528) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 25 16:02:40 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-9f71aed5-a8a2-4c92-997b-5e685e36b833 tempest-CreateVolumesFromSnapshotTest-1082910625 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e83ee52e-2b45-45d1-a535-fc9b1c6bee91) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 25 16:02:40 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-9f71aed5-a8a2-4c92-997b-5e685e36b833 tempest-CreateVolumesFromSnapshotTest-1082910625 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e83ee52e-2b45-45d1-a535-fc9b1c6bee91) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-25T15:02:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-246914361',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dc4218d7-b90b-4062-9d9f-c3a0ece20987,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='de3dcd140da840eb8693ca187507a07f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-25T15:02:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-25T15:02:40Z,use_quota=True,user_id='6d2c9b181121464abf8dc70575225af0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ce71c2f9-6543-4165-9653-a1529b2ea243),volume_type_id=ce71c2f9-6543-4165-9653-a1529b2ea243)' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 25 16:02:40 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-9f71aed5-a8a2-4c92-997b-5e685e36b833 tempest-CreateVolumesFromSnapshotTest-1082910625 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9784a324-cbf2-452e-89ce-608041e6f3cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 25 16:02:40 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-9f71aed5-a8a2-4c92-997b-5e685e36b833 tempest-CreateVolumesFromSnapshotTest-1082910625 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9784a324-cbf2-452e-89ce-608041e6f3cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 25 16:02:40 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-9f71aed5-a8a2-4c92-997b-5e685e36b833 tempest-CreateVolumesFromSnapshotTest-1082910625 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (30ee2053-8c63-4e70-aac5-3147dc872798) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 25 16:02:40 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-9f71aed5-a8a2-4c92-997b-5e685e36b833 tempest-CreateVolumesFromSnapshotTest-1082910625 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (30ee2053-8c63-4e70-aac5-3147dc872798) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'dc4218d7-b90b-4062-9d9f-c3a0ece20987', 'volume_name': 'volume-dc4218d7-b90b-4062-9d9f-c3a0ece20987', 'volume_size': 1}' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 25 16:02:40 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-9f71aed5-a8a2-4c92-997b-5e685e36b833 tempest-CreateVolumesFromSnapshotTest-1082910625 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (28c64a2c-3d93-4ff0-bb83-9045706c3062) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 25 16:02:40 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-9f71aed5-a8a2-4c92-997b-5e685e36b833 tempest-CreateVolumesFromSnapshotTest-1082910625 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (28c64a2c-3d93-4ff0-bb83-9045706c3062) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 25 16:02:40 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-9f71aed5-a8a2-4c92-997b-5e685e36b833 tempest-CreateVolumesFromSnapshotTest-1082910625 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (97065314-6668-4880-918a-88fda7112558) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 25 16:02:40 devstack cinder-volume[83528]: INFO cinder.volume.flows.manager.create_volume [None req-9f71aed5-a8a2-4c92-997b-5e685e36b833 tempest-CreateVolumesFromSnapshotTest-1082910625 None] Volume dc4218d7-b90b-4062-9d9f-c3a0ece20987: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-dc4218d7-b90b-4062-9d9f-c3a0ece20987', 'volume_size': 1} Feb 25 16:02:40 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-9f71aed5-a8a2-4c92-997b-5e685e36b833 tempest-CreateVolumesFromSnapshotTest-1082910625 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 25 16:02:40 devstack cinder-volume[83528]: DEBUG cinder.volume.flows.manager.create_volume [None req-e8545b74-0f81-4829-9367-f7426edbc28d tempest-CreateVolumesFromSnapshotTest-1082910625 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83528) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 25 16:02:40 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-e8545b74-0f81-4829-9367-f7426edbc28d tempest-CreateVolumesFromSnapshotTest-1082910625 None] Flow 'volume_create_manager' (6216eb3a-6dc5-4afd-bd16-c6acd3d0219a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83528) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 25 16:02:40 devstack sudo[91572]: pam_unix(sudo:session): session closed for user root Feb 25 16:02:40 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-e8545b74-0f81-4829-9367-f7426edbc28d tempest-CreateVolumesFromSnapshotTest-1082910625 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4de6c099-fe9a-4d9c-ac51-666d1fc2b7fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 25 16:02:40 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-e8545b74-0f81-4829-9367-f7426edbc28d tempest-CreateVolumesFromSnapshotTest-1082910625 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4de6c099-fe9a-4d9c-ac51-666d1fc2b7fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-25T15:02:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-270352322',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b9fd0823-d4fe-4556-a10e-236a5baed233,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='de3dcd140da840eb8693ca187507a07f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-25T15:02:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-25T15:02:40Z,use_quota=True,user_id='6d2c9b181121464abf8dc70575225af0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ce71c2f9-6543-4165-9653-a1529b2ea243),volume_type_id=ce71c2f9-6543-4165-9653-a1529b2ea243)' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 25 16:02:40 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-e8545b74-0f81-4829-9367-f7426edbc28d tempest-CreateVolumesFromSnapshotTest-1082910625 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (571f2dec-4941-4e97-8c54-2523e572e1e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 25 16:02:40 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-e8545b74-0f81-4829-9367-f7426edbc28d tempest-CreateVolumesFromSnapshotTest-1082910625 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (571f2dec-4941-4e97-8c54-2523e572e1e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 25 16:02:40 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-e8545b74-0f81-4829-9367-f7426edbc28d tempest-CreateVolumesFromSnapshotTest-1082910625 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cdb14687-4c1e-46be-ac62-4ee7f97ba9c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 25 16:02:40 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-e8545b74-0f81-4829-9367-f7426edbc28d tempest-CreateVolumesFromSnapshotTest-1082910625 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cdb14687-4c1e-46be-ac62-4ee7f97ba9c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b9fd0823-d4fe-4556-a10e-236a5baed233', 'volume_name': 'volume-b9fd0823-d4fe-4556-a10e-236a5baed233', 'volume_size': 1}' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 25 16:02:40 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-e8545b74-0f81-4829-9367-f7426edbc28d tempest-CreateVolumesFromSnapshotTest-1082910625 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (766be1c6-c030-4438-9071-0a433520cf35) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 25 16:02:40 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-e8545b74-0f81-4829-9367-f7426edbc28d tempest-CreateVolumesFromSnapshotTest-1082910625 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (766be1c6-c030-4438-9071-0a433520cf35) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 25 16:02:40 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-e8545b74-0f81-4829-9367-f7426edbc28d tempest-CreateVolumesFromSnapshotTest-1082910625 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bae752ca-81f6-42e6-9046-d17f2a198f2b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 25 16:02:40 devstack cinder-volume[83528]: INFO cinder.volume.flows.manager.create_volume [None req-e8545b74-0f81-4829-9367-f7426edbc28d tempest-CreateVolumesFromSnapshotTest-1082910625 None] Volume b9fd0823-d4fe-4556-a10e-236a5baed233: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b9fd0823-d4fe-4556-a10e-236a5baed233', 'volume_size': 1} Feb 25 16:02:40 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-e8545b74-0f81-4829-9367-f7426edbc28d tempest-CreateVolumesFromSnapshotTest-1082910625 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 25 16:02:40 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-7ec58354-33b8-4930-8045-dca91794ba76 tempest-VolumeDependencyTests-18272511 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-33b8b216-ea13-4c2a-9c22-443659f1c861" returned: 0 in 1.181s {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 25 16:02:40 devstack cinder-volume[83528]: DEBUG cinder.utils [None req-7ec58354-33b8-4930-8045-dca91794ba76 tempest-VolumeDependencyTests-18272511 None] Path /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-aaff583b-3dac-4ecc-bea8-832524cd0fd0 not found in is_blk_device check {{(pid=83528) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Feb 25 16:02:40 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-7ec58354-33b8-4930-8045-dca91794ba76 tempest-VolumeDependencyTests-18272511 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-33b8b216-ea13-4c2a-9c22-443659f1c861 /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-aaff583b-3dac-4ecc-bea8-832524cd0fd0 {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 25 16:02:40 devstack sudo[91580]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-33b8b216-ea13-4c2a-9c22-443659f1c861 /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-aaff583b-3dac-4ecc-bea8-832524cd0fd0 Feb 25 16:02:40 devstack sudo[91580]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 25 16:02:40 devstack cinder-volume[83528]: DEBUG cinder.volume.flows.manager.create_volume [None req-60c16c2f-f1d7-47d5-b6c9-0879459354af tempest-CreateVolumesFromSnapshotTest-1082910625 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83528) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 25 16:02:40 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-60c16c2f-f1d7-47d5-b6c9-0879459354af tempest-CreateVolumesFromSnapshotTest-1082910625 None] Flow 'volume_create_manager' (dd6c40a0-d8f9-420a-9b89-d4989545ecac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83528) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 25 16:02:40 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-60c16c2f-f1d7-47d5-b6c9-0879459354af tempest-CreateVolumesFromSnapshotTest-1082910625 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (034d10d5-4c0f-486d-877d-f6a9fd48d1b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 25 16:02:40 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-60c16c2f-f1d7-47d5-b6c9-0879459354af tempest-CreateVolumesFromSnapshotTest-1082910625 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (034d10d5-4c0f-486d-877d-f6a9fd48d1b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-25T15:02:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-729193567',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=92131519-d016-4969-b0d0-1dbcde63abda,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='de3dcd140da840eb8693ca187507a07f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-25T15:02:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-25T15:02:40Z,use_quota=True,user_id='6d2c9b181121464abf8dc70575225af0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ce71c2f9-6543-4165-9653-a1529b2ea243),volume_type_id=ce71c2f9-6543-4165-9653-a1529b2ea243)' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 25 16:02:40 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-60c16c2f-f1d7-47d5-b6c9-0879459354af tempest-CreateVolumesFromSnapshotTest-1082910625 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fd035163-8baa-44e7-b7c4-ece2cb693968) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 25 16:02:40 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-60c16c2f-f1d7-47d5-b6c9-0879459354af tempest-CreateVolumesFromSnapshotTest-1082910625 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fd035163-8baa-44e7-b7c4-ece2cb693968) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 25 16:02:40 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-60c16c2f-f1d7-47d5-b6c9-0879459354af tempest-CreateVolumesFromSnapshotTest-1082910625 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (19f9bc0c-30cd-4f25-8de4-2b44e7c9b3cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 25 16:02:40 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-60c16c2f-f1d7-47d5-b6c9-0879459354af tempest-CreateVolumesFromSnapshotTest-1082910625 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (19f9bc0c-30cd-4f25-8de4-2b44e7c9b3cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '92131519-d016-4969-b0d0-1dbcde63abda', 'volume_name': 'volume-92131519-d016-4969-b0d0-1dbcde63abda', 'volume_size': 1}' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 25 16:02:40 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-60c16c2f-f1d7-47d5-b6c9-0879459354af tempest-CreateVolumesFromSnapshotTest-1082910625 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (59973468-29d0-47eb-9f53-ba799b40b47e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 25 16:02:40 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-60c16c2f-f1d7-47d5-b6c9-0879459354af tempest-CreateVolumesFromSnapshotTest-1082910625 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (59973468-29d0-47eb-9f53-ba799b40b47e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 25 16:02:40 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-60c16c2f-f1d7-47d5-b6c9-0879459354af tempest-CreateVolumesFromSnapshotTest-1082910625 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6dcde4d7-0160-40f1-a01d-f444f88edef7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 25 16:02:40 devstack cinder-volume[83528]: INFO cinder.volume.flows.manager.create_volume [None req-60c16c2f-f1d7-47d5-b6c9-0879459354af tempest-CreateVolumesFromSnapshotTest-1082910625 None] Volume 92131519-d016-4969-b0d0-1dbcde63abda: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-92131519-d016-4969-b0d0-1dbcde63abda', 'volume_size': 1} Feb 25 16:02:40 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-60c16c2f-f1d7-47d5-b6c9-0879459354af tempest-CreateVolumesFromSnapshotTest-1082910625 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 25 16:02:40 devstack sudo[91575]: pam_unix(sudo:session): session closed for user root Feb 25 16:02:40 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-d9883d33-a6d6-4513-b71f-192b8976e232 tempest-CreateVolumesFromImageTest-1720772828 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-bf57e8a1-484b-4bdc-80a5-aadab247e6b2" returned: 0 in 0.992s {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 25 16:02:40 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-d9883d33-a6d6-4513-b71f-192b8976e232 tempest-CreateVolumesFromImageTest-1720772828 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-bf57e8a1-484b-4bdc-80a5-aadab247e6b2 {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 25 16:02:40 devstack sudo[91585]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-bf57e8a1-484b-4bdc-80a5-aadab247e6b2 Feb 25 16:02:40 devstack sudo[91585]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 25 16:02:40 devstack cinder-volume[83528]: DEBUG cinder.volume.flows.manager.create_volume [None req-67a19ad6-f708-4b19-94d2-9e4b78a359f5 tempest-CreateVolumesFromSnapshotTest-1082910625 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83528) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 25 16:02:40 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-67a19ad6-f708-4b19-94d2-9e4b78a359f5 tempest-CreateVolumesFromSnapshotTest-1082910625 None] Flow 'volume_create_manager' (5adac81d-6780-4d10-9c28-56d59a40a3a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83528) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 25 16:02:40 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-67a19ad6-f708-4b19-94d2-9e4b78a359f5 tempest-CreateVolumesFromSnapshotTest-1082910625 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (28c0ea0b-c4a7-4d1c-aacd-cc1cbb05b4d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 25 16:02:40 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-67a19ad6-f708-4b19-94d2-9e4b78a359f5 tempest-CreateVolumesFromSnapshotTest-1082910625 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (28c0ea0b-c4a7-4d1c-aacd-cc1cbb05b4d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-25T15:02:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-623484724',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b5e1b664-0dd6-4713-90ab-2f906f960a4d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='de3dcd140da840eb8693ca187507a07f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-25T15:02:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-25T15:02:41Z,use_quota=True,user_id='6d2c9b181121464abf8dc70575225af0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ce71c2f9-6543-4165-9653-a1529b2ea243),volume_type_id=ce71c2f9-6543-4165-9653-a1529b2ea243)' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 25 16:02:40 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-67a19ad6-f708-4b19-94d2-9e4b78a359f5 tempest-CreateVolumesFromSnapshotTest-1082910625 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f670a902-eda2-4ae9-b8be-9703cb655fa1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 25 16:02:40 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-67a19ad6-f708-4b19-94d2-9e4b78a359f5 tempest-CreateVolumesFromSnapshotTest-1082910625 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f670a902-eda2-4ae9-b8be-9703cb655fa1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 25 16:02:40 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-67a19ad6-f708-4b19-94d2-9e4b78a359f5 tempest-CreateVolumesFromSnapshotTest-1082910625 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (633535b8-4e60-48e2-8726-9a1381007ce9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 25 16:02:40 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-67a19ad6-f708-4b19-94d2-9e4b78a359f5 tempest-CreateVolumesFromSnapshotTest-1082910625 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (633535b8-4e60-48e2-8726-9a1381007ce9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b5e1b664-0dd6-4713-90ab-2f906f960a4d', 'volume_name': 'volume-b5e1b664-0dd6-4713-90ab-2f906f960a4d', 'volume_size': 1}' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 25 16:02:41 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-67a19ad6-f708-4b19-94d2-9e4b78a359f5 tempest-CreateVolumesFromSnapshotTest-1082910625 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (19c6c208-6494-467c-814c-c9faff50714c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 25 16:02:41 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-67a19ad6-f708-4b19-94d2-9e4b78a359f5 tempest-CreateVolumesFromSnapshotTest-1082910625 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (19c6c208-6494-467c-814c-c9faff50714c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 25 16:02:41 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-67a19ad6-f708-4b19-94d2-9e4b78a359f5 tempest-CreateVolumesFromSnapshotTest-1082910625 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b90783f8-68e6-4841-a720-f5d92e95557f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 25 16:02:41 devstack cinder-volume[83528]: INFO cinder.volume.flows.manager.create_volume [None req-67a19ad6-f708-4b19-94d2-9e4b78a359f5 tempest-CreateVolumesFromSnapshotTest-1082910625 None] Volume b5e1b664-0dd6-4713-90ab-2f906f960a4d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b5e1b664-0dd6-4713-90ab-2f906f960a4d', 'volume_size': 1} Feb 25 16:02:41 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-67a19ad6-f708-4b19-94d2-9e4b78a359f5 tempest-CreateVolumesFromSnapshotTest-1082910625 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 25 16:02:41 devstack cinder-volume[83528]: DEBUG cinder.volume.flows.manager.create_volume [None req-e6657e4e-8c82-48eb-9b16-f8db29c9dead tempest-SnapshotDependencyTests-2073568565 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83528) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 25 16:02:41 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-e6657e4e-8c82-48eb-9b16-f8db29c9dead tempest-SnapshotDependencyTests-2073568565 None] Flow 'volume_create_manager' (d1eda8dd-a38f-4e9e-8b0f-e6ce5bbccb11) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83528) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 25 16:02:41 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-e6657e4e-8c82-48eb-9b16-f8db29c9dead tempest-SnapshotDependencyTests-2073568565 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (385492b5-1c28-4c36-981d-fd54ce8e66f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 25 16:02:41 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-e6657e4e-8c82-48eb-9b16-f8db29c9dead tempest-SnapshotDependencyTests-2073568565 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (385492b5-1c28-4c36-981d-fd54ce8e66f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-25T15:02:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-439522795',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b4a78707-43cc-4a9c-b6f9-e2b8ca42cfdc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2159f924ae4341cb8b84ebb667bb254e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-25T15:02:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-25T15:02:41Z,use_quota=True,user_id='2efbdffb69d64dcb93e4f254c8140fbf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ce71c2f9-6543-4165-9653-a1529b2ea243),volume_type_id=ce71c2f9-6543-4165-9653-a1529b2ea243)' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 25 16:02:41 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-e6657e4e-8c82-48eb-9b16-f8db29c9dead tempest-SnapshotDependencyTests-2073568565 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d1ff6113-125b-49ce-878a-029cd47f20be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 25 16:02:41 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-e6657e4e-8c82-48eb-9b16-f8db29c9dead tempest-SnapshotDependencyTests-2073568565 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d1ff6113-125b-49ce-878a-029cd47f20be) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 25 16:02:41 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-e6657e4e-8c82-48eb-9b16-f8db29c9dead tempest-SnapshotDependencyTests-2073568565 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (19ec9300-866e-4e25-93e9-d0f6f5e6797e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 25 16:02:41 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-e6657e4e-8c82-48eb-9b16-f8db29c9dead tempest-SnapshotDependencyTests-2073568565 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (19ec9300-866e-4e25-93e9-d0f6f5e6797e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b4a78707-43cc-4a9c-b6f9-e2b8ca42cfdc', 'volume_name': 'volume-b4a78707-43cc-4a9c-b6f9-e2b8ca42cfdc', 'volume_size': 1}' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 25 16:02:41 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-e6657e4e-8c82-48eb-9b16-f8db29c9dead tempest-SnapshotDependencyTests-2073568565 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bc400303-63dd-4898-98b3-fb9c041fa6c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 25 16:02:41 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-e6657e4e-8c82-48eb-9b16-f8db29c9dead tempest-SnapshotDependencyTests-2073568565 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bc400303-63dd-4898-98b3-fb9c041fa6c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 25 16:02:41 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-e6657e4e-8c82-48eb-9b16-f8db29c9dead tempest-SnapshotDependencyTests-2073568565 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (34e65e52-5b97-405d-a3bd-cae444a88a28) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 25 16:02:41 devstack cinder-volume[83528]: INFO cinder.volume.flows.manager.create_volume [None req-e6657e4e-8c82-48eb-9b16-f8db29c9dead tempest-SnapshotDependencyTests-2073568565 None] Volume b4a78707-43cc-4a9c-b6f9-e2b8ca42cfdc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b4a78707-43cc-4a9c-b6f9-e2b8ca42cfdc', 'volume_size': 1} Feb 25 16:02:41 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-e6657e4e-8c82-48eb-9b16-f8db29c9dead tempest-SnapshotDependencyTests-2073568565 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 25 16:02:41 devstack sudo[91585]: pam_unix(sudo:session): session closed for user root Feb 25 16:02:41 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-d9883d33-a6d6-4513-b71f-192b8976e232 tempest-CreateVolumesFromImageTest-1720772828 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-bf57e8a1-484b-4bdc-80a5-aadab247e6b2" returned: 0 in 1.080s {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 25 16:02:41 devstack cinder-volume[83528]: DEBUG cinder.coordination [None req-d9883d33-a6d6-4513-b71f-192b8976e232 tempest-CreateVolumesFromImageTest-1720772828 None] Lock "cinder-quobyte-bf57e8a1-484b-4bdc-80a5-aadab247e6b2" released by "delete_volume" :: held 2.193s {{(pid=83528) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 25 16:02:41 devstack cinder-volume[83528]: DEBUG cinder.quota [None req-d9883d33-a6d6-4513-b71f-192b8976e232 tempest-CreateVolumesFromImageTest-1720772828 None] Created reservations ['11467041-8a15-49ad-8e0d-4a56db82c2e6', 'c5d536d2-04e2-4271-bb8d-c7257d8ce7aa', '2df53c5c-6f60-4005-ac00-e8c3eea3ae61', '98935ba8-7b93-40c6-a390-f8a228d00294'] {{(pid=83528) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 25 16:02:41 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-d9883d33-a6d6-4513-b71f-192b8976e232 tempest-CreateVolumesFromImageTest-1720772828 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 25 16:02:41 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-d9883d33-a6d6-4513-b71f-192b8976e232 tempest-CreateVolumesFromImageTest-1720772828 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 25 16:02:41 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.quobyte [None req-d9883d33-a6d6-4513-b71f-192b8976e232 tempest-CreateVolumesFromImageTest-1720772828 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23e9d725-3e04-4cd9-bfe0-c8ef43305589': None} {{(pid=83528) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 25 16:02:41 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.quobyte [None req-d9883d33-a6d6-4513-b71f-192b8976e232 tempest-CreateVolumesFromImageTest-1720772828 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23e9d725-3e04-4cd9-bfe0-c8ef43305589'] {{(pid=83528) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 25 16:02:41 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-d9883d33-a6d6-4513-b71f-192b8976e232 tempest-CreateVolumesFromImageTest-1720772828 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 25 16:02:41 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-d9883d33-a6d6-4513-b71f-192b8976e232 tempest-CreateVolumesFromImageTest-1720772828 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85 {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 25 16:02:42 devstack sudo[91598]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85 Feb 25 16:02:42 devstack sudo[91598]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 25 16:02:42 devstack sudo[91580]: pam_unix(sudo:session): session closed for user root Feb 25 16:02:42 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-7ec58354-33b8-4930-8045-dca91794ba76 tempest-VolumeDependencyTests-18272511 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-33b8b216-ea13-4c2a-9c22-443659f1c861 /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-aaff583b-3dac-4ecc-bea8-832524cd0fd0" returned: 0 in 2.265s {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 25 16:02:42 devstack cinder-volume[83528]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a2f034b-2540-4e7d-975b-07380e85b309]: (4, 'qcow2') {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 25 16:02:42 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-7ec58354-33b8-4930-8045-dca91794ba76 tempest-VolumeDependencyTests-18272511 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-33b8b216-ea13-4c2a-9c22-443659f1c861 {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 25 16:02:42 devstack sudo[91600]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-33b8b216-ea13-4c2a-9c22-443659f1c861 Feb 25 16:02:42 devstack sudo[91600]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 25 16:02:42 devstack sudo[91598]: pam_unix(sudo:session): session closed for user root Feb 25 16:02:42 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-d9883d33-a6d6-4513-b71f-192b8976e232 tempest-CreateVolumesFromImageTest-1720772828 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85" returned: 0 in 0.692s {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 25 16:02:42 devstack cinder-volume[83528]: DEBUG cinder.manager [None req-d9883d33-a6d6-4513-b71f-192b8976e232 tempest-CreateVolumesFromImageTest-1720772828 None] Notifying Schedulers of capabilities ... {{(pid=83528) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 25 16:02:42 devstack cinder-volume[83528]: INFO cinder.volume.manager [None req-d9883d33-a6d6-4513-b71f-192b8976e232 tempest-CreateVolumesFromImageTest-1720772828 None] Deleted volume successfully. Feb 25 16:02:42 devstack cinder-volume[83528]: DEBUG dbcounter [-] [83528] Writing DB stats cinder:SELECT=79,cinder:UPDATE=96,cinder:INSERT=23,cinder:DELETE=11 {{(pid=83528) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Feb 25 16:02:42 devstack cinder-volume[83528]: DEBUG cinder.coordination [None req-d9883d33-a6d6-4513-b71f-192b8976e232 tempest-CreateVolumesFromImageTest-1720772828 None] Lock "cinder-bf57e8a1-484b-4bdc-80a5-aadab247e6b2-delete_volume" released by "delete_volume" :: held 3.241s {{(pid=83528) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 25 16:02:42 devstack cinder-volume[83528]: DEBUG cinder.coordination [None req-f7d1960d-9142-4ca2-85c5-a94e96e11e78 tempest-CreateVolumesFromImageTest-1720772828 None] Acquiring lock "cinder-c5c32c0e-8713-4292-8dbd-ce2076f4bba6-delete_volume" by "delete_volume" {{(pid=83528) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 25 16:02:42 devstack cinder-volume[83528]: DEBUG cinder.coordination [None req-f7d1960d-9142-4ca2-85c5-a94e96e11e78 tempest-CreateVolumesFromImageTest-1720772828 None] Lock "cinder-c5c32c0e-8713-4292-8dbd-ce2076f4bba6-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=83528) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 25 16:02:42 devstack cinder-volume[83528]: DEBUG cinder.coordination [None req-f7d1960d-9142-4ca2-85c5-a94e96e11e78 tempest-CreateVolumesFromImageTest-1720772828 None] Acquiring lock "cinder-quobyte-c5c32c0e-8713-4292-8dbd-ce2076f4bba6" by "delete_volume" {{(pid=83528) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 25 16:02:42 devstack cinder-volume[83528]: DEBUG cinder.coordination [None req-f7d1960d-9142-4ca2-85c5-a94e96e11e78 tempest-CreateVolumesFromImageTest-1720772828 None] Lock "cinder-quobyte-c5c32c0e-8713-4292-8dbd-ce2076f4bba6" acquired by "delete_volume" :: waited 0.009s {{(pid=83528) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 25 16:02:42 devstack cinder-volume[83528]: DEBUG oslo.privsep.daemon [-] privsep: reply[52b79004-8ee5-4d0f-94cf-08884e3e34b1]: (4, 'qcow2') {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 25 16:02:42 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-f7d1960d-9142-4ca2-85c5-a94e96e11e78 tempest-CreateVolumesFromImageTest-1720772828 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-c5c32c0e-8713-4292-8dbd-ce2076f4bba6 {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 25 16:02:43 devstack sudo[91603]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-c5c32c0e-8713-4292-8dbd-ce2076f4bba6 Feb 25 16:02:43 devstack sudo[91603]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 25 16:02:43 devstack sudo[91600]: pam_unix(sudo:session): session closed for user root Feb 25 16:02:43 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-7ec58354-33b8-4930-8045-dca91794ba76 tempest-VolumeDependencyTests-18272511 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-33b8b216-ea13-4c2a-9c22-443659f1c861" returned: 0 in 0.604s {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 25 16:02:43 devstack cinder-volume[83528]: DEBUG cinder.image.image_utils [None req-7ec58354-33b8-4930-8045-dca91794ba76 tempest-VolumeDependencyTests-18272511 None] Image conversion details: src /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-33b8b216-ea13-4c2a-9c22-443659f1c861, size 1024.00 MB, duration 2.27 sec, destination /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-aaff583b-3dac-4ecc-bea8-832524cd0fd0 {{(pid=83528) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Feb 25 16:02:43 devstack cinder-volume[83528]: INFO cinder.image.image_utils [None req-7ec58354-33b8-4930-8045-dca91794ba76 tempest-VolumeDependencyTests-18272511 None] Converted 1024.00 MB image at 451.83 MB/s Feb 25 16:02:43 devstack cinder-volume[83528]: WARNING cinder.volume.drivers.remotefs [None req-7ec58354-33b8-4930-8045-dca91794ba76 tempest-VolumeDependencyTests-18272511 None] /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-aaff583b-3dac-4ecc-bea8-832524cd0fd0 is being set with open permissions: ugo+rw Feb 25 16:02:43 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-7ec58354-33b8-4930-8045-dca91794ba76 tempest-VolumeDependencyTests-18272511 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-aaff583b-3dac-4ecc-bea8-832524cd0fd0 {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 25 16:02:43 devstack sudo[91608]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-aaff583b-3dac-4ecc-bea8-832524cd0fd0 Feb 25 16:02:43 devstack sudo[91608]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 25 16:02:43 devstack sudo[91603]: pam_unix(sudo:session): session closed for user root Feb 25 16:02:43 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-f7d1960d-9142-4ca2-85c5-a94e96e11e78 tempest-CreateVolumesFromImageTest-1720772828 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-c5c32c0e-8713-4292-8dbd-ce2076f4bba6" returned: 0 in 0.488s {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 25 16:02:43 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-f7d1960d-9142-4ca2-85c5-a94e96e11e78 tempest-CreateVolumesFromImageTest-1720772828 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-c5c32c0e-8713-4292-8dbd-ce2076f4bba6 {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 25 16:02:43 devstack sudo[91613]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-c5c32c0e-8713-4292-8dbd-ce2076f4bba6 Feb 25 16:02:43 devstack sudo[91613]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 25 16:02:43 devstack sudo[91608]: pam_unix(sudo:session): session closed for user root Feb 25 16:02:43 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-7ec58354-33b8-4930-8045-dca91794ba76 tempest-VolumeDependencyTests-18272511 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-aaff583b-3dac-4ecc-bea8-832524cd0fd0" returned: 0 in 0.397s {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 25 16:02:43 devstack cinder-volume[83528]: DEBUG cinder.coordination [None req-7ec58354-33b8-4930-8045-dca91794ba76 tempest-VolumeDependencyTests-18272511 None] Lock "cinder-quobyte-aaff583b-3dac-4ecc-bea8-832524cd0fd0" released by "_copy_volume_from_snapshot" :: held 5.146s {{(pid=83528) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 25 16:02:43 devstack cinder-volume[83528]: DEBUG cinder.coordination [None req-7ec58354-33b8-4930-8045-dca91794ba76 tempest-VolumeDependencyTests-18272511 None] Lock "cinder-quobyte-7858c649-02d6-47b0-84db-35030ffbc4ca-aaff583b-3dac-4ecc-bea8-832524cd0fd0" released by "_create_volume_from_snapshot" :: held 5.173s {{(pid=83528) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 25 16:02:43 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-7ec58354-33b8-4930-8045-dca91794ba76 tempest-VolumeDependencyTests-18272511 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 5.193s {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 25 16:02:43 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-de5032c5-b400-419d-af45-c2cfb906c2be tempest-CreateVolumesFromSnapshotTest-1082910625 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.854s {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 25 16:02:43 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.quobyte [None req-de5032c5-b400-419d-af45-c2cfb906c2be tempest-CreateVolumesFromSnapshotTest-1082910625 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-25T15:02:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1694901921',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=81f3f2c7-aaae-494b-98fc-e393c88dbc38,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='de3dcd140da840eb8693ca187507a07f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-25T15:02:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-25T15:02:40Z,use_quota=True,user_id='6d2c9b181121464abf8dc70575225af0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ce71c2f9-6543-4165-9653-a1529b2ea243),volume_type_id=ce71c2f9-6543-4165-9653-a1529b2ea243)}" {{(pid=83528) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 25 16:02:43 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.remotefs [None req-de5032c5-b400-419d-af45-c2cfb906c2be tempest-CreateVolumesFromSnapshotTest-1082910625 None] Creating volume 81f3f2c7-aaae-494b-98fc-e393c88dbc38 {{(pid=83528) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 25 16:02:43 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-de5032c5-b400-419d-af45-c2cfb906c2be tempest-CreateVolumesFromSnapshotTest-1082910625 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 25 16:02:43 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-de5032c5-b400-419d-af45-c2cfb906c2be tempest-CreateVolumesFromSnapshotTest-1082910625 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 25 16:02:43 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.quobyte [None req-de5032c5-b400-419d-af45-c2cfb906c2be tempest-CreateVolumesFromSnapshotTest-1082910625 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23e9d725-3e04-4cd9-bfe0-c8ef43305589': None} {{(pid=83528) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 25 16:02:43 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.quobyte [None req-de5032c5-b400-419d-af45-c2cfb906c2be tempest-CreateVolumesFromSnapshotTest-1082910625 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23e9d725-3e04-4cd9-bfe0-c8ef43305589'] {{(pid=83528) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 25 16:02:43 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-de5032c5-b400-419d-af45-c2cfb906c2be tempest-CreateVolumesFromSnapshotTest-1082910625 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 25 16:02:43 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.quobyte [None req-de5032c5-b400-419d-af45-c2cfb906c2be tempest-CreateVolumesFromSnapshotTest-1082910625 None] Selected osci02.corp.quobyte.com/cinder-vol-23e9d725-3e04-4cd9-bfe0-c8ef43305589 as target Quobyte volume. {{(pid=83528) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 25 16:02:43 devstack cinder-volume[83528]: INFO cinder.volume.drivers.remotefs [None req-de5032c5-b400-419d-af45-c2cfb906c2be tempest-CreateVolumesFromSnapshotTest-1082910625 None] casted to osci02.corp.quobyte.com/cinder-vol-23e9d725-3e04-4cd9-bfe0-c8ef43305589 Feb 25 16:02:43 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-de5032c5-b400-419d-af45-c2cfb906c2be tempest-CreateVolumesFromSnapshotTest-1082910625 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-81f3f2c7-aaae-494b-98fc-e393c88dbc38 1073741824 {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 25 16:02:43 devstack sudo[91616]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-81f3f2c7-aaae-494b-98fc-e393c88dbc38 1073741824 Feb 25 16:02:43 devstack sudo[91616]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 25 16:02:43 devstack cinder-volume[83528]: DEBUG dbcounter [-] [83528] Writing DB stats cinder:SELECT=79,cinder:INSERT=21,cinder:UPDATE=98,cinder:DELETE=8 {{(pid=83528) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Feb 25 16:02:43 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-7ec58354-33b8-4930-8045-dca91794ba76 tempest-VolumeDependencyTests-18272511 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (edbef620-b1cf-44e2-9307-80f3f5cd77ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-aaff583b-3dac-4ecc-bea8-832524cd0fd0', 'volume_size': 1, 'snapshot_id': '7858c649-02d6-47b0-84db-35030ffbc4ca'}' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 25 16:02:43 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-7ec58354-33b8-4930-8045-dca91794ba76 tempest-VolumeDependencyTests-18272511 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (30e6e86e-c166-4873-b8d6-b20a5379ece9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 25 16:02:43 devstack cinder-volume[83528]: INFO cinder.volume.flows.manager.create_volume [None req-7ec58354-33b8-4930-8045-dca91794ba76 tempest-VolumeDependencyTests-18272511 None] Volume volume-aaff583b-3dac-4ecc-bea8-832524cd0fd0 (aaff583b-3dac-4ecc-bea8-832524cd0fd0): created successfully Feb 25 16:02:43 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-7ec58354-33b8-4930-8045-dca91794ba76 tempest-VolumeDependencyTests-18272511 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (30e6e86e-c166-4873-b8d6-b20a5379ece9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 25 16:02:43 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-7ec58354-33b8-4930-8045-dca91794ba76 tempest-VolumeDependencyTests-18272511 None] Flow 'volume_create_manager' (4752b42e-dfcb-40ae-a61b-5f63bc945026) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83528) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 25 16:02:43 devstack cinder-volume[83528]: INFO cinder.volume.manager [None req-7ec58354-33b8-4930-8045-dca91794ba76 tempest-VolumeDependencyTests-18272511 None] Created volume successfully. Feb 25 16:02:43 devstack sudo[91613]: pam_unix(sudo:session): session closed for user root Feb 25 16:02:43 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-f7d1960d-9142-4ca2-85c5-a94e96e11e78 tempest-CreateVolumesFromImageTest-1720772828 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-c5c32c0e-8713-4292-8dbd-ce2076f4bba6" returned: 0 in 0.453s {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 25 16:02:43 devstack cinder-volume[83528]: DEBUG cinder.coordination [None req-f7d1960d-9142-4ca2-85c5-a94e96e11e78 tempest-CreateVolumesFromImageTest-1720772828 None] Lock "cinder-quobyte-c5c32c0e-8713-4292-8dbd-ce2076f4bba6" released by "delete_volume" :: held 0.961s {{(pid=83528) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 25 16:02:43 devstack cinder-volume[83528]: DEBUG cinder.quota [None req-f7d1960d-9142-4ca2-85c5-a94e96e11e78 tempest-CreateVolumesFromImageTest-1720772828 None] Created reservations ['e4684507-3bbf-475c-aa62-6b527bd80c91', '9dc186b7-45c3-43f0-aced-4c7baee82582', '22866c1e-9235-400c-bfa1-eae65ecb389f', '540d27e1-5538-4469-b206-f7a2ec332f0a'] {{(pid=83528) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 25 16:02:44 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-f7d1960d-9142-4ca2-85c5-a94e96e11e78 tempest-CreateVolumesFromImageTest-1720772828 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 25 16:02:44 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-f7d1960d-9142-4ca2-85c5-a94e96e11e78 tempest-CreateVolumesFromImageTest-1720772828 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 25 16:02:44 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.quobyte [None req-f7d1960d-9142-4ca2-85c5-a94e96e11e78 tempest-CreateVolumesFromImageTest-1720772828 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23e9d725-3e04-4cd9-bfe0-c8ef43305589': None} {{(pid=83528) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 25 16:02:44 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.quobyte [None req-f7d1960d-9142-4ca2-85c5-a94e96e11e78 tempest-CreateVolumesFromImageTest-1720772828 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23e9d725-3e04-4cd9-bfe0-c8ef43305589'] {{(pid=83528) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 25 16:02:44 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-f7d1960d-9142-4ca2-85c5-a94e96e11e78 tempest-CreateVolumesFromImageTest-1720772828 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 25 16:02:44 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-f7d1960d-9142-4ca2-85c5-a94e96e11e78 tempest-CreateVolumesFromImageTest-1720772828 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85 {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 25 16:02:44 devstack sudo[91622]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85 Feb 25 16:02:44 devstack sudo[91622]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 25 16:02:44 devstack sudo[91616]: pam_unix(sudo:session): session closed for user root Feb 25 16:02:44 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-de5032c5-b400-419d-af45-c2cfb906c2be tempest-CreateVolumesFromSnapshotTest-1082910625 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-81f3f2c7-aaae-494b-98fc-e393c88dbc38 1073741824" returned: 0 in 0.537s {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 25 16:02:44 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-de5032c5-b400-419d-af45-c2cfb906c2be tempest-CreateVolumesFromSnapshotTest-1082910625 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-81f3f2c7-aaae-494b-98fc-e393c88dbc38 {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 25 16:02:44 devstack sudo[91624]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-81f3f2c7-aaae-494b-98fc-e393c88dbc38 Feb 25 16:02:44 devstack sudo[91624]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 25 16:02:44 devstack sudo[91622]: pam_unix(sudo:session): session closed for user root Feb 25 16:02:44 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-f7d1960d-9142-4ca2-85c5-a94e96e11e78 tempest-CreateVolumesFromImageTest-1720772828 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85" returned: 0 in 0.532s {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 25 16:02:44 devstack cinder-volume[83528]: DEBUG cinder.manager [None req-f7d1960d-9142-4ca2-85c5-a94e96e11e78 tempest-CreateVolumesFromImageTest-1720772828 None] Notifying Schedulers of capabilities ... {{(pid=83528) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 25 16:02:44 devstack cinder-volume[83528]: INFO cinder.volume.manager [None req-f7d1960d-9142-4ca2-85c5-a94e96e11e78 tempest-CreateVolumesFromImageTest-1720772828 None] Deleted volume successfully. Feb 25 16:02:44 devstack cinder-volume[83528]: DEBUG cinder.coordination [None req-f7d1960d-9142-4ca2-85c5-a94e96e11e78 tempest-CreateVolumesFromImageTest-1720772828 None] Lock "cinder-c5c32c0e-8713-4292-8dbd-ce2076f4bba6-delete_volume" released by "delete_volume" :: held 1.664s {{(pid=83528) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 25 16:02:44 devstack sudo[91624]: pam_unix(sudo:session): session closed for user root Feb 25 16:02:44 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-de5032c5-b400-419d-af45-c2cfb906c2be tempest-CreateVolumesFromSnapshotTest-1082910625 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-81f3f2c7-aaae-494b-98fc-e393c88dbc38" returned: 0 in 0.492s {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 25 16:02:44 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.quobyte [None req-de5032c5-b400-419d-af45-c2cfb906c2be tempest-CreateVolumesFromSnapshotTest-1082910625 None] <== create_volume: return (1066ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-23e9d725-3e04-4cd9-bfe0-c8ef43305589'} {{(pid=83528) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 25 16:02:44 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-de5032c5-b400-419d-af45-c2cfb906c2be tempest-CreateVolumesFromSnapshotTest-1082910625 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.070s {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 25 16:02:44 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-9f71aed5-a8a2-4c92-997b-5e685e36b833 tempest-CreateVolumesFromSnapshotTest-1082910625 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.584s {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 25 16:02:44 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.quobyte [None req-9f71aed5-a8a2-4c92-997b-5e685e36b833 tempest-CreateVolumesFromSnapshotTest-1082910625 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-25T15:02:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-246914361',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dc4218d7-b90b-4062-9d9f-c3a0ece20987,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='de3dcd140da840eb8693ca187507a07f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-25T15:02:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-25T15:02:40Z,use_quota=True,user_id='6d2c9b181121464abf8dc70575225af0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ce71c2f9-6543-4165-9653-a1529b2ea243),volume_type_id=ce71c2f9-6543-4165-9653-a1529b2ea243)}" {{(pid=83528) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 25 16:02:44 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.remotefs [None req-9f71aed5-a8a2-4c92-997b-5e685e36b833 tempest-CreateVolumesFromSnapshotTest-1082910625 None] Creating volume dc4218d7-b90b-4062-9d9f-c3a0ece20987 {{(pid=83528) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 25 16:02:44 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-9f71aed5-a8a2-4c92-997b-5e685e36b833 tempest-CreateVolumesFromSnapshotTest-1082910625 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 25 16:02:44 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-9f71aed5-a8a2-4c92-997b-5e685e36b833 tempest-CreateVolumesFromSnapshotTest-1082910625 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 25 16:02:44 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.quobyte [None req-9f71aed5-a8a2-4c92-997b-5e685e36b833 tempest-CreateVolumesFromSnapshotTest-1082910625 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23e9d725-3e04-4cd9-bfe0-c8ef43305589': None} {{(pid=83528) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 25 16:02:44 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.quobyte [None req-9f71aed5-a8a2-4c92-997b-5e685e36b833 tempest-CreateVolumesFromSnapshotTest-1082910625 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23e9d725-3e04-4cd9-bfe0-c8ef43305589'] {{(pid=83528) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 25 16:02:44 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-9f71aed5-a8a2-4c92-997b-5e685e36b833 tempest-CreateVolumesFromSnapshotTest-1082910625 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 25 16:02:44 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.quobyte [None req-9f71aed5-a8a2-4c92-997b-5e685e36b833 tempest-CreateVolumesFromSnapshotTest-1082910625 None] Selected osci02.corp.quobyte.com/cinder-vol-23e9d725-3e04-4cd9-bfe0-c8ef43305589 as target Quobyte volume. {{(pid=83528) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 25 16:02:44 devstack cinder-volume[83528]: INFO cinder.volume.drivers.remotefs [None req-9f71aed5-a8a2-4c92-997b-5e685e36b833 tempest-CreateVolumesFromSnapshotTest-1082910625 None] casted to osci02.corp.quobyte.com/cinder-vol-23e9d725-3e04-4cd9-bfe0-c8ef43305589 Feb 25 16:02:44 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-9f71aed5-a8a2-4c92-997b-5e685e36b833 tempest-CreateVolumesFromSnapshotTest-1082910625 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-dc4218d7-b90b-4062-9d9f-c3a0ece20987 1073741824 {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 25 16:02:44 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-de5032c5-b400-419d-af45-c2cfb906c2be tempest-CreateVolumesFromSnapshotTest-1082910625 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1201254f-c233-4ace-9119-38c508f6dc8c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-81f3f2c7-aaae-494b-98fc-e393c88dbc38', 'volume_size': 1}' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 25 16:02:44 devstack sudo[91629]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-dc4218d7-b90b-4062-9d9f-c3a0ece20987 1073741824 Feb 25 16:02:44 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-de5032c5-b400-419d-af45-c2cfb906c2be tempest-CreateVolumesFromSnapshotTest-1082910625 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (466b707c-2b31-450f-b806-6b62fe8ad37b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 25 16:02:44 devstack sudo[91629]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 25 16:02:44 devstack cinder-volume[83528]: INFO cinder.volume.flows.manager.create_volume [None req-de5032c5-b400-419d-af45-c2cfb906c2be tempest-CreateVolumesFromSnapshotTest-1082910625 None] Volume volume-81f3f2c7-aaae-494b-98fc-e393c88dbc38 (81f3f2c7-aaae-494b-98fc-e393c88dbc38): created successfully Feb 25 16:02:44 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-de5032c5-b400-419d-af45-c2cfb906c2be tempest-CreateVolumesFromSnapshotTest-1082910625 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (466b707c-2b31-450f-b806-6b62fe8ad37b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 25 16:02:44 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-de5032c5-b400-419d-af45-c2cfb906c2be tempest-CreateVolumesFromSnapshotTest-1082910625 None] Flow 'volume_create_manager' (0d81500f-1760-4148-a5bb-003d57b8584c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83528) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 25 16:02:44 devstack cinder-volume[83528]: INFO cinder.volume.manager [None req-de5032c5-b400-419d-af45-c2cfb906c2be tempest-CreateVolumesFromSnapshotTest-1082910625 None] Created volume successfully. Feb 25 16:02:44 devstack cinder-volume[83528]: DEBUG cinder.coordination [None req-47f6e700-aed8-4dc4-948d-aec5e9d64af5 tempest-VolumeDependencyTests-18272511 None] Acquiring lock "cinder-7858c649-02d6-47b0-84db-35030ffbc4ca-delete_snapshot" by "delete_snapshot" {{(pid=83528) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 25 16:02:44 devstack cinder-volume[83528]: DEBUG cinder.coordination [None req-47f6e700-aed8-4dc4-948d-aec5e9d64af5 tempest-VolumeDependencyTests-18272511 None] Lock "cinder-7858c649-02d6-47b0-84db-35030ffbc4ca-delete_snapshot" acquired by "delete_snapshot" :: waited 0.012s {{(pid=83528) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 25 16:02:44 devstack cinder-volume[83528]: DEBUG cinder.coordination [None req-47f6e700-aed8-4dc4-948d-aec5e9d64af5 tempest-VolumeDependencyTests-18272511 None] Acquiring lock "cinder-quobyte-33b8b216-ea13-4c2a-9c22-443659f1c861" by "delete_snapshot" {{(pid=83528) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 25 16:02:44 devstack cinder-volume[83528]: DEBUG cinder.coordination [None req-47f6e700-aed8-4dc4-948d-aec5e9d64af5 tempest-VolumeDependencyTests-18272511 None] Lock "cinder-quobyte-33b8b216-ea13-4c2a-9c22-443659f1c861" acquired by "delete_snapshot" :: waited 0.007s {{(pid=83528) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 25 16:02:44 devstack cinder-volume[83528]: DEBUG cinder.coordination [None req-47f6e700-aed8-4dc4-948d-aec5e9d64af5 tempest-VolumeDependencyTests-18272511 None] Acquiring lock "cinder-quobyte-7858c649-02d6-47b0-84db-35030ffbc4ca" by "_delete_snapshot" {{(pid=83528) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 25 16:02:44 devstack cinder-volume[83528]: DEBUG cinder.coordination [None req-47f6e700-aed8-4dc4-948d-aec5e9d64af5 tempest-VolumeDependencyTests-18272511 None] Lock "cinder-quobyte-7858c649-02d6-47b0-84db-35030ffbc4ca" acquired by "_delete_snapshot" :: waited 0.008s {{(pid=83528) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 25 16:02:44 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.remotefs [None req-47f6e700-aed8-4dc4-948d-aec5e9d64af5 tempest-VolumeDependencyTests-18272511 None] Deleting offline snapshot 7858c649-02d6-47b0-84db-35030ffbc4ca of volume 33b8b216-ea13-4c2a-9c22-443659f1c861 {{(pid=83528) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Feb 25 16:02:44 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.remotefs [None req-47f6e700-aed8-4dc4-948d-aec5e9d64af5 tempest-VolumeDependencyTests-18272511 None] snapshot_file for this snap is: volume-33b8b216-ea13-4c2a-9c22-443659f1c861.7858c649-02d6-47b0-84db-35030ffbc4ca {{(pid=83528) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Feb 25 16:02:44 devstack cinder-volume[83528]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3886705-3973-4db2-a01c-cf461ee5c380]: (4, 'qcow2') {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 25 16:02:44 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-47f6e700-aed8-4dc4-948d-aec5e9d64af5 tempest-VolumeDependencyTests-18272511 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-33b8b216-ea13-4c2a-9c22-443659f1c861.7858c649-02d6-47b0-84db-35030ffbc4ca {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 25 16:02:44 devstack sudo[91631]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-33b8b216-ea13-4c2a-9c22-443659f1c861.7858c649-02d6-47b0-84db-35030ffbc4ca Feb 25 16:02:44 devstack sudo[91631]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 25 16:02:45 devstack sudo[91629]: pam_unix(sudo:session): session closed for user root Feb 25 16:02:45 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-9f71aed5-a8a2-4c92-997b-5e685e36b833 tempest-CreateVolumesFromSnapshotTest-1082910625 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-dc4218d7-b90b-4062-9d9f-c3a0ece20987 1073741824" returned: 0 in 0.610s {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 25 16:02:45 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-9f71aed5-a8a2-4c92-997b-5e685e36b833 tempest-CreateVolumesFromSnapshotTest-1082910625 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-dc4218d7-b90b-4062-9d9f-c3a0ece20987 {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 25 16:02:45 devstack sudo[91639]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-dc4218d7-b90b-4062-9d9f-c3a0ece20987 Feb 25 16:02:45 devstack sudo[91639]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 25 16:02:45 devstack sudo[91631]: pam_unix(sudo:session): session closed for user root Feb 25 16:02:45 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-47f6e700-aed8-4dc4-948d-aec5e9d64af5 tempest-VolumeDependencyTests-18272511 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-33b8b216-ea13-4c2a-9c22-443659f1c861.7858c649-02d6-47b0-84db-35030ffbc4ca" returned: 0 in 0.605s {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 25 16:02:45 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.remotefs [None req-47f6e700-aed8-4dc4-948d-aec5e9d64af5 tempest-VolumeDependencyTests-18272511 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-33b8b216-ea13-4c2a-9c22-443659f1c861(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83528) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Feb 25 16:02:45 devstack cinder-volume[83528]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f08e850-cba9-4d94-9d68-078e7544d617]: (4, 'qcow2') {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 25 16:02:45 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-47f6e700-aed8-4dc4-948d-aec5e9d64af5 tempest-VolumeDependencyTests-18272511 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-33b8b216-ea13-4c2a-9c22-443659f1c861 {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 25 16:02:45 devstack sudo[91641]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-33b8b216-ea13-4c2a-9c22-443659f1c861 Feb 25 16:02:45 devstack sudo[91641]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 25 16:02:45 devstack sudo[91639]: pam_unix(sudo:session): session closed for user root Feb 25 16:02:45 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-9f71aed5-a8a2-4c92-997b-5e685e36b833 tempest-CreateVolumesFromSnapshotTest-1082910625 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-dc4218d7-b90b-4062-9d9f-c3a0ece20987" returned: 0 in 0.508s {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 25 16:02:45 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.quobyte [None req-9f71aed5-a8a2-4c92-997b-5e685e36b833 tempest-CreateVolumesFromSnapshotTest-1082910625 None] <== create_volume: return (1160ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-23e9d725-3e04-4cd9-bfe0-c8ef43305589'} {{(pid=83528) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 25 16:02:45 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-9f71aed5-a8a2-4c92-997b-5e685e36b833 tempest-CreateVolumesFromSnapshotTest-1082910625 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.162s {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 25 16:02:45 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-e8545b74-0f81-4829-9367-f7426edbc28d tempest-CreateVolumesFromSnapshotTest-1082910625 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.542s {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 25 16:02:45 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.quobyte [None req-e8545b74-0f81-4829-9367-f7426edbc28d tempest-CreateVolumesFromSnapshotTest-1082910625 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-25T15:02:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-270352322',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b9fd0823-d4fe-4556-a10e-236a5baed233,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='de3dcd140da840eb8693ca187507a07f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-25T15:02:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-25T15:02:40Z,use_quota=True,user_id='6d2c9b181121464abf8dc70575225af0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ce71c2f9-6543-4165-9653-a1529b2ea243),volume_type_id=ce71c2f9-6543-4165-9653-a1529b2ea243)}" {{(pid=83528) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 25 16:02:45 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.remotefs [None req-e8545b74-0f81-4829-9367-f7426edbc28d tempest-CreateVolumesFromSnapshotTest-1082910625 None] Creating volume b9fd0823-d4fe-4556-a10e-236a5baed233 {{(pid=83528) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 25 16:02:45 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-e8545b74-0f81-4829-9367-f7426edbc28d tempest-CreateVolumesFromSnapshotTest-1082910625 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 25 16:02:45 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-e8545b74-0f81-4829-9367-f7426edbc28d tempest-CreateVolumesFromSnapshotTest-1082910625 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 25 16:02:45 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.quobyte [None req-e8545b74-0f81-4829-9367-f7426edbc28d tempest-CreateVolumesFromSnapshotTest-1082910625 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23e9d725-3e04-4cd9-bfe0-c8ef43305589': None} {{(pid=83528) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 25 16:02:45 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.quobyte [None req-e8545b74-0f81-4829-9367-f7426edbc28d tempest-CreateVolumesFromSnapshotTest-1082910625 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23e9d725-3e04-4cd9-bfe0-c8ef43305589'] {{(pid=83528) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 25 16:02:45 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-e8545b74-0f81-4829-9367-f7426edbc28d tempest-CreateVolumesFromSnapshotTest-1082910625 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 25 16:02:45 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.quobyte [None req-e8545b74-0f81-4829-9367-f7426edbc28d tempest-CreateVolumesFromSnapshotTest-1082910625 None] Selected osci02.corp.quobyte.com/cinder-vol-23e9d725-3e04-4cd9-bfe0-c8ef43305589 as target Quobyte volume. {{(pid=83528) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 25 16:02:45 devstack cinder-volume[83528]: INFO cinder.volume.drivers.remotefs [None req-e8545b74-0f81-4829-9367-f7426edbc28d tempest-CreateVolumesFromSnapshotTest-1082910625 None] casted to osci02.corp.quobyte.com/cinder-vol-23e9d725-3e04-4cd9-bfe0-c8ef43305589 Feb 25 16:02:45 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-e8545b74-0f81-4829-9367-f7426edbc28d tempest-CreateVolumesFromSnapshotTest-1082910625 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-b9fd0823-d4fe-4556-a10e-236a5baed233 1073741824 {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 25 16:02:45 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-9f71aed5-a8a2-4c92-997b-5e685e36b833 tempest-CreateVolumesFromSnapshotTest-1082910625 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (97065314-6668-4880-918a-88fda7112558) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dc4218d7-b90b-4062-9d9f-c3a0ece20987', 'volume_size': 1}' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 25 16:02:45 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-9f71aed5-a8a2-4c92-997b-5e685e36b833 tempest-CreateVolumesFromSnapshotTest-1082910625 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (370375c4-c407-4d7c-ae70-d6b26a096d09) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 25 16:02:45 devstack cinder-volume[83528]: INFO cinder.volume.flows.manager.create_volume [None req-9f71aed5-a8a2-4c92-997b-5e685e36b833 tempest-CreateVolumesFromSnapshotTest-1082910625 None] Volume volume-dc4218d7-b90b-4062-9d9f-c3a0ece20987 (dc4218d7-b90b-4062-9d9f-c3a0ece20987): created successfully Feb 25 16:02:45 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-9f71aed5-a8a2-4c92-997b-5e685e36b833 tempest-CreateVolumesFromSnapshotTest-1082910625 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (370375c4-c407-4d7c-ae70-d6b26a096d09) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 25 16:02:45 devstack sudo[91645]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-b9fd0823-d4fe-4556-a10e-236a5baed233 1073741824 Feb 25 16:02:45 devstack sudo[91645]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 25 16:02:45 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-9f71aed5-a8a2-4c92-997b-5e685e36b833 tempest-CreateVolumesFromSnapshotTest-1082910625 None] Flow 'volume_create_manager' (a1e3feff-df25-4194-9948-f0a75a292eab) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83528) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 25 16:02:45 devstack cinder-volume[83528]: INFO cinder.volume.manager [None req-9f71aed5-a8a2-4c92-997b-5e685e36b833 tempest-CreateVolumesFromSnapshotTest-1082910625 None] Created volume successfully. Feb 25 16:02:46 devstack sudo[91641]: pam_unix(sudo:session): session closed for user root Feb 25 16:02:46 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-47f6e700-aed8-4dc4-948d-aec5e9d64af5 tempest-VolumeDependencyTests-18272511 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-33b8b216-ea13-4c2a-9c22-443659f1c861" returned: 0 in 0.675s {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 25 16:02:46 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-47f6e700-aed8-4dc4-948d-aec5e9d64af5 tempest-VolumeDependencyTests-18272511 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-33b8b216-ea13-4c2a-9c22-443659f1c861.7858c649-02d6-47b0-84db-35030ffbc4ca {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 25 16:02:46 devstack cinder-volume[83528]: DEBUG cinder.volume.flows.manager.create_volume [None req-d8e823ad-699d-4750-b589-06884716ca98 tempest-CreateVolumesFromSourceVolumeTest-931808651 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83528) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 25 16:02:46 devstack sudo[91649]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-33b8b216-ea13-4c2a-9c22-443659f1c861.7858c649-02d6-47b0-84db-35030ffbc4ca Feb 25 16:02:46 devstack sudo[91649]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 25 16:02:46 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-d8e823ad-699d-4750-b589-06884716ca98 tempest-CreateVolumesFromSourceVolumeTest-931808651 None] Flow 'volume_create_manager' (fb0f3f52-a43c-48a4-bbc0-707455095bab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83528) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 25 16:02:46 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-d8e823ad-699d-4750-b589-06884716ca98 tempest-CreateVolumesFromSourceVolumeTest-931808651 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (66b5fbe8-7906-436c-b9e7-2b815681c258) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 25 16:02:46 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-d8e823ad-699d-4750-b589-06884716ca98 tempest-CreateVolumesFromSourceVolumeTest-931808651 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (66b5fbe8-7906-436c-b9e7-2b815681c258) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-25T15:02:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1404409029',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fb9f5973-8aae-4d7a-a652-ba930478dbc0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fcf12f31e52c40859d85ba8f3aa4076b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-25T15:02:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-25T15:02:46Z,use_quota=True,user_id='ce4e44485cd646fc9c78daa6a071c681',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ce71c2f9-6543-4165-9653-a1529b2ea243),volume_type_id=ce71c2f9-6543-4165-9653-a1529b2ea243)' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 25 16:02:46 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-d8e823ad-699d-4750-b589-06884716ca98 tempest-CreateVolumesFromSourceVolumeTest-931808651 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bd9ac32d-4dce-4316-9c7b-f0ecca965863) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 25 16:02:46 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-d8e823ad-699d-4750-b589-06884716ca98 tempest-CreateVolumesFromSourceVolumeTest-931808651 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bd9ac32d-4dce-4316-9c7b-f0ecca965863) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 25 16:02:46 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-d8e823ad-699d-4750-b589-06884716ca98 tempest-CreateVolumesFromSourceVolumeTest-931808651 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bb5a49e6-ea80-49da-8ec0-5c9289fe7199) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 25 16:02:46 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-d8e823ad-699d-4750-b589-06884716ca98 tempest-CreateVolumesFromSourceVolumeTest-931808651 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bb5a49e6-ea80-49da-8ec0-5c9289fe7199) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fb9f5973-8aae-4d7a-a652-ba930478dbc0', 'volume_name': 'volume-fb9f5973-8aae-4d7a-a652-ba930478dbc0', 'volume_size': 1}' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 25 16:02:46 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-d8e823ad-699d-4750-b589-06884716ca98 tempest-CreateVolumesFromSourceVolumeTest-931808651 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1017fdef-d8be-4cb8-aa1e-85267cf7bef6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 25 16:02:46 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-d8e823ad-699d-4750-b589-06884716ca98 tempest-CreateVolumesFromSourceVolumeTest-931808651 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1017fdef-d8be-4cb8-aa1e-85267cf7bef6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 25 16:02:46 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-d8e823ad-699d-4750-b589-06884716ca98 tempest-CreateVolumesFromSourceVolumeTest-931808651 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1e8d4fac-6414-4478-b05d-b3422353a1c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 25 16:02:46 devstack cinder-volume[83528]: INFO cinder.volume.flows.manager.create_volume [None req-d8e823ad-699d-4750-b589-06884716ca98 tempest-CreateVolumesFromSourceVolumeTest-931808651 None] Volume fb9f5973-8aae-4d7a-a652-ba930478dbc0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fb9f5973-8aae-4d7a-a652-ba930478dbc0', 'volume_size': 1} Feb 25 16:02:46 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-d8e823ad-699d-4750-b589-06884716ca98 tempest-CreateVolumesFromSourceVolumeTest-931808651 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 25 16:02:46 devstack sudo[91645]: pam_unix(sudo:session): session closed for user root Feb 25 16:02:46 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-e8545b74-0f81-4829-9367-f7426edbc28d tempest-CreateVolumesFromSnapshotTest-1082910625 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-b9fd0823-d4fe-4556-a10e-236a5baed233 1073741824" returned: 0 in 0.579s {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 25 16:02:46 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-e8545b74-0f81-4829-9367-f7426edbc28d tempest-CreateVolumesFromSnapshotTest-1082910625 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-b9fd0823-d4fe-4556-a10e-236a5baed233 {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 25 16:02:46 devstack sudo[91654]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-b9fd0823-d4fe-4556-a10e-236a5baed233 Feb 25 16:02:46 devstack sudo[91654]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 25 16:02:46 devstack sudo[91649]: pam_unix(sudo:session): session closed for user root Feb 25 16:02:46 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-47f6e700-aed8-4dc4-948d-aec5e9d64af5 tempest-VolumeDependencyTests-18272511 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-33b8b216-ea13-4c2a-9c22-443659f1c861.7858c649-02d6-47b0-84db-35030ffbc4ca" returned: 0 in 0.509s {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 25 16:02:46 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-47f6e700-aed8-4dc4-948d-aec5e9d64af5 tempest-VolumeDependencyTests-18272511 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-33b8b216-ea13-4c2a-9c22-443659f1c861.7858c649-02d6-47b0-84db-35030ffbc4ca {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 25 16:02:46 devstack sudo[91659]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-33b8b216-ea13-4c2a-9c22-443659f1c861.7858c649-02d6-47b0-84db-35030ffbc4ca Feb 25 16:02:46 devstack sudo[91659]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 25 16:02:46 devstack sudo[91654]: pam_unix(sudo:session): session closed for user root Feb 25 16:02:46 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-e8545b74-0f81-4829-9367-f7426edbc28d tempest-CreateVolumesFromSnapshotTest-1082910625 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-b9fd0823-d4fe-4556-a10e-236a5baed233" returned: 0 in 0.435s {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 25 16:02:46 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.quobyte [None req-e8545b74-0f81-4829-9367-f7426edbc28d tempest-CreateVolumesFromSnapshotTest-1082910625 None] <== create_volume: return (1038ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-23e9d725-3e04-4cd9-bfe0-c8ef43305589'} {{(pid=83528) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 25 16:02:46 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-e8545b74-0f81-4829-9367-f7426edbc28d tempest-CreateVolumesFromSnapshotTest-1082910625 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.041s {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 25 16:02:46 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-60c16c2f-f1d7-47d5-b6c9-0879459354af tempest-CreateVolumesFromSnapshotTest-1082910625 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.284s {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 25 16:02:46 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.quobyte [None req-60c16c2f-f1d7-47d5-b6c9-0879459354af tempest-CreateVolumesFromSnapshotTest-1082910625 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-25T15:02:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-729193567',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=92131519-d016-4969-b0d0-1dbcde63abda,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='de3dcd140da840eb8693ca187507a07f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-25T15:02:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-25T15:02:40Z,use_quota=True,user_id='6d2c9b181121464abf8dc70575225af0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ce71c2f9-6543-4165-9653-a1529b2ea243),volume_type_id=ce71c2f9-6543-4165-9653-a1529b2ea243)}" {{(pid=83528) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 25 16:02:46 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.remotefs [None req-60c16c2f-f1d7-47d5-b6c9-0879459354af tempest-CreateVolumesFromSnapshotTest-1082910625 None] Creating volume 92131519-d016-4969-b0d0-1dbcde63abda {{(pid=83528) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 25 16:02:46 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-60c16c2f-f1d7-47d5-b6c9-0879459354af tempest-CreateVolumesFromSnapshotTest-1082910625 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 25 16:02:46 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-60c16c2f-f1d7-47d5-b6c9-0879459354af tempest-CreateVolumesFromSnapshotTest-1082910625 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 25 16:02:46 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.quobyte [None req-60c16c2f-f1d7-47d5-b6c9-0879459354af tempest-CreateVolumesFromSnapshotTest-1082910625 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23e9d725-3e04-4cd9-bfe0-c8ef43305589': None} {{(pid=83528) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 25 16:02:46 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.quobyte [None req-60c16c2f-f1d7-47d5-b6c9-0879459354af tempest-CreateVolumesFromSnapshotTest-1082910625 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23e9d725-3e04-4cd9-bfe0-c8ef43305589'] {{(pid=83528) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 25 16:02:46 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-60c16c2f-f1d7-47d5-b6c9-0879459354af tempest-CreateVolumesFromSnapshotTest-1082910625 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 25 16:02:46 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.quobyte [None req-60c16c2f-f1d7-47d5-b6c9-0879459354af tempest-CreateVolumesFromSnapshotTest-1082910625 None] Selected osci02.corp.quobyte.com/cinder-vol-23e9d725-3e04-4cd9-bfe0-c8ef43305589 as target Quobyte volume. {{(pid=83528) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 25 16:02:46 devstack cinder-volume[83528]: INFO cinder.volume.drivers.remotefs [None req-60c16c2f-f1d7-47d5-b6c9-0879459354af tempest-CreateVolumesFromSnapshotTest-1082910625 None] casted to osci02.corp.quobyte.com/cinder-vol-23e9d725-3e04-4cd9-bfe0-c8ef43305589 Feb 25 16:02:46 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-60c16c2f-f1d7-47d5-b6c9-0879459354af tempest-CreateVolumesFromSnapshotTest-1082910625 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-92131519-d016-4969-b0d0-1dbcde63abda 1073741824 {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 25 16:02:46 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-e8545b74-0f81-4829-9367-f7426edbc28d tempest-CreateVolumesFromSnapshotTest-1082910625 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bae752ca-81f6-42e6-9046-d17f2a198f2b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b9fd0823-d4fe-4556-a10e-236a5baed233', 'volume_size': 1}' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 25 16:02:46 devstack sudo[91662]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-92131519-d016-4969-b0d0-1dbcde63abda 1073741824 Feb 25 16:02:46 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-e8545b74-0f81-4829-9367-f7426edbc28d tempest-CreateVolumesFromSnapshotTest-1082910625 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2b656321-4f53-4219-8ba6-92b9e63d0d70) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 25 16:02:46 devstack sudo[91662]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 25 16:02:46 devstack cinder-volume[83528]: INFO cinder.volume.flows.manager.create_volume [None req-e8545b74-0f81-4829-9367-f7426edbc28d tempest-CreateVolumesFromSnapshotTest-1082910625 None] Volume volume-b9fd0823-d4fe-4556-a10e-236a5baed233 (b9fd0823-d4fe-4556-a10e-236a5baed233): created successfully Feb 25 16:02:46 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-e8545b74-0f81-4829-9367-f7426edbc28d tempest-CreateVolumesFromSnapshotTest-1082910625 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2b656321-4f53-4219-8ba6-92b9e63d0d70) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 25 16:02:46 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-e8545b74-0f81-4829-9367-f7426edbc28d tempest-CreateVolumesFromSnapshotTest-1082910625 None] Flow 'volume_create_manager' (6216eb3a-6dc5-4afd-bd16-c6acd3d0219a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83528) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 25 16:02:46 devstack cinder-volume[83528]: INFO cinder.volume.manager [None req-e8545b74-0f81-4829-9367-f7426edbc28d tempest-CreateVolumesFromSnapshotTest-1082910625 None] Created volume successfully. Feb 25 16:02:47 devstack sudo[91659]: pam_unix(sudo:session): session closed for user root Feb 25 16:02:47 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-47f6e700-aed8-4dc4-948d-aec5e9d64af5 tempest-VolumeDependencyTests-18272511 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-33b8b216-ea13-4c2a-9c22-443659f1c861.7858c649-02d6-47b0-84db-35030ffbc4ca" returned: 0 in 0.433s {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 25 16:02:47 devstack cinder-volume[83528]: DEBUG cinder.coordination [None req-47f6e700-aed8-4dc4-948d-aec5e9d64af5 tempest-VolumeDependencyTests-18272511 None] Lock "cinder-quobyte-7858c649-02d6-47b0-84db-35030ffbc4ca" released by "_delete_snapshot" :: held 2.293s {{(pid=83528) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 25 16:02:47 devstack cinder-volume[83528]: DEBUG cinder.coordination [None req-47f6e700-aed8-4dc4-948d-aec5e9d64af5 tempest-VolumeDependencyTests-18272511 None] Lock "cinder-quobyte-33b8b216-ea13-4c2a-9c22-443659f1c861" released by "delete_snapshot" :: held 2.305s {{(pid=83528) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 25 16:02:47 devstack cinder-volume[83528]: DEBUG cinder.quota [None req-47f6e700-aed8-4dc4-948d-aec5e9d64af5 tempest-VolumeDependencyTests-18272511 None] Created reservations ['da70e2cb-2c6b-47f4-8b48-a39eb8c16f4e', '2611ae5a-9226-4622-bb3c-60402aea980a', '4c2f0726-7b1d-4ff4-abb5-19d9bd3aaf9f', '03988440-2f4f-446e-8f2f-b0919f490555'] {{(pid=83528) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 25 16:02:47 devstack cinder-volume[83528]: INFO cinder.volume.manager [None req-47f6e700-aed8-4dc4-948d-aec5e9d64af5 tempest-VolumeDependencyTests-18272511 None] Delete snapshot completed successfully. Feb 25 16:02:47 devstack cinder-volume[83528]: DEBUG cinder.coordination [None req-47f6e700-aed8-4dc4-948d-aec5e9d64af5 tempest-VolumeDependencyTests-18272511 None] Lock "cinder-7858c649-02d6-47b0-84db-35030ffbc4ca-delete_snapshot" released by "delete_snapshot" :: held 2.390s {{(pid=83528) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 25 16:02:47 devstack sudo[91662]: pam_unix(sudo:session): session closed for user root Feb 25 16:02:47 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-60c16c2f-f1d7-47d5-b6c9-0879459354af tempest-CreateVolumesFromSnapshotTest-1082910625 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-92131519-d016-4969-b0d0-1dbcde63abda 1073741824" returned: 0 in 0.519s {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 25 16:02:47 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-60c16c2f-f1d7-47d5-b6c9-0879459354af tempest-CreateVolumesFromSnapshotTest-1082910625 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-92131519-d016-4969-b0d0-1dbcde63abda {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 25 16:02:47 devstack sudo[91668]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-92131519-d016-4969-b0d0-1dbcde63abda Feb 25 16:02:47 devstack sudo[91668]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 25 16:02:47 devstack sudo[91668]: pam_unix(sudo:session): session closed for user root Feb 25 16:02:47 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-60c16c2f-f1d7-47d5-b6c9-0879459354af tempest-CreateVolumesFromSnapshotTest-1082910625 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-92131519-d016-4969-b0d0-1dbcde63abda" returned: 0 in 0.409s {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 25 16:02:47 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.quobyte [None req-60c16c2f-f1d7-47d5-b6c9-0879459354af tempest-CreateVolumesFromSnapshotTest-1082910625 None] <== create_volume: return (952ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-23e9d725-3e04-4cd9-bfe0-c8ef43305589'} {{(pid=83528) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 25 16:02:47 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-60c16c2f-f1d7-47d5-b6c9-0879459354af tempest-CreateVolumesFromSnapshotTest-1082910625 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.956s {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 25 16:02:47 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-67a19ad6-f708-4b19-94d2-9e4b78a359f5 tempest-CreateVolumesFromSnapshotTest-1082910625 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.767s {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 25 16:02:47 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.quobyte [None req-67a19ad6-f708-4b19-94d2-9e4b78a359f5 tempest-CreateVolumesFromSnapshotTest-1082910625 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-25T15:02:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-623484724',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b5e1b664-0dd6-4713-90ab-2f906f960a4d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='de3dcd140da840eb8693ca187507a07f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-25T15:02:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-25T15:02:41Z,use_quota=True,user_id='6d2c9b181121464abf8dc70575225af0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ce71c2f9-6543-4165-9653-a1529b2ea243),volume_type_id=ce71c2f9-6543-4165-9653-a1529b2ea243)}" {{(pid=83528) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 25 16:02:47 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.remotefs [None req-67a19ad6-f708-4b19-94d2-9e4b78a359f5 tempest-CreateVolumesFromSnapshotTest-1082910625 None] Creating volume b5e1b664-0dd6-4713-90ab-2f906f960a4d {{(pid=83528) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 25 16:02:47 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-67a19ad6-f708-4b19-94d2-9e4b78a359f5 tempest-CreateVolumesFromSnapshotTest-1082910625 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 25 16:02:47 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-67a19ad6-f708-4b19-94d2-9e4b78a359f5 tempest-CreateVolumesFromSnapshotTest-1082910625 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 25 16:02:47 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.quobyte [None req-67a19ad6-f708-4b19-94d2-9e4b78a359f5 tempest-CreateVolumesFromSnapshotTest-1082910625 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23e9d725-3e04-4cd9-bfe0-c8ef43305589': None} {{(pid=83528) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 25 16:02:47 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.quobyte [None req-67a19ad6-f708-4b19-94d2-9e4b78a359f5 tempest-CreateVolumesFromSnapshotTest-1082910625 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23e9d725-3e04-4cd9-bfe0-c8ef43305589'] {{(pid=83528) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 25 16:02:47 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-67a19ad6-f708-4b19-94d2-9e4b78a359f5 tempest-CreateVolumesFromSnapshotTest-1082910625 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 25 16:02:47 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.quobyte [None req-67a19ad6-f708-4b19-94d2-9e4b78a359f5 tempest-CreateVolumesFromSnapshotTest-1082910625 None] Selected osci02.corp.quobyte.com/cinder-vol-23e9d725-3e04-4cd9-bfe0-c8ef43305589 as target Quobyte volume. {{(pid=83528) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 25 16:02:47 devstack cinder-volume[83528]: INFO cinder.volume.drivers.remotefs [None req-67a19ad6-f708-4b19-94d2-9e4b78a359f5 tempest-CreateVolumesFromSnapshotTest-1082910625 None] casted to osci02.corp.quobyte.com/cinder-vol-23e9d725-3e04-4cd9-bfe0-c8ef43305589 Feb 25 16:02:47 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-67a19ad6-f708-4b19-94d2-9e4b78a359f5 tempest-CreateVolumesFromSnapshotTest-1082910625 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-b5e1b664-0dd6-4713-90ab-2f906f960a4d 1073741824 {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 25 16:02:47 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-60c16c2f-f1d7-47d5-b6c9-0879459354af tempest-CreateVolumesFromSnapshotTest-1082910625 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6dcde4d7-0160-40f1-a01d-f444f88edef7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-92131519-d016-4969-b0d0-1dbcde63abda', 'volume_size': 1}' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 25 16:02:47 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-60c16c2f-f1d7-47d5-b6c9-0879459354af tempest-CreateVolumesFromSnapshotTest-1082910625 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (741ed702-b78e-4a8f-a3be-9bbd7bcb267e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 25 16:02:47 devstack sudo[91671]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-b5e1b664-0dd6-4713-90ab-2f906f960a4d 1073741824 Feb 25 16:02:47 devstack sudo[91671]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 25 16:02:47 devstack cinder-volume[83528]: DEBUG cinder.coordination [None req-18839342-daf2-4b78-895c-858529cb4bad tempest-VolumeDependencyTests-18272511 None] Acquiring lock "cinder-33b8b216-ea13-4c2a-9c22-443659f1c861-delete_volume" by "delete_volume" {{(pid=83528) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 25 16:02:47 devstack cinder-volume[83528]: INFO cinder.volume.flows.manager.create_volume [None req-60c16c2f-f1d7-47d5-b6c9-0879459354af tempest-CreateVolumesFromSnapshotTest-1082910625 None] Volume volume-92131519-d016-4969-b0d0-1dbcde63abda (92131519-d016-4969-b0d0-1dbcde63abda): created successfully Feb 25 16:02:47 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-60c16c2f-f1d7-47d5-b6c9-0879459354af tempest-CreateVolumesFromSnapshotTest-1082910625 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (741ed702-b78e-4a8f-a3be-9bbd7bcb267e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 25 16:02:47 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-60c16c2f-f1d7-47d5-b6c9-0879459354af tempest-CreateVolumesFromSnapshotTest-1082910625 None] Flow 'volume_create_manager' (dd6c40a0-d8f9-420a-9b89-d4989545ecac) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83528) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 25 16:02:47 devstack cinder-volume[83528]: INFO cinder.volume.manager [None req-60c16c2f-f1d7-47d5-b6c9-0879459354af tempest-CreateVolumesFromSnapshotTest-1082910625 None] Created volume successfully. Feb 25 16:02:47 devstack cinder-volume[83528]: DEBUG cinder.coordination [None req-18839342-daf2-4b78-895c-858529cb4bad tempest-VolumeDependencyTests-18272511 None] Lock "cinder-33b8b216-ea13-4c2a-9c22-443659f1c861-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=83528) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 25 16:02:47 devstack cinder-volume[83528]: DEBUG cinder.coordination [None req-18839342-daf2-4b78-895c-858529cb4bad tempest-VolumeDependencyTests-18272511 None] Acquiring lock "cinder-quobyte-33b8b216-ea13-4c2a-9c22-443659f1c861" by "delete_volume" {{(pid=83528) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 25 16:02:47 devstack cinder-volume[83528]: DEBUG cinder.coordination [None req-18839342-daf2-4b78-895c-858529cb4bad tempest-VolumeDependencyTests-18272511 None] Lock "cinder-quobyte-33b8b216-ea13-4c2a-9c22-443659f1c861" acquired by "delete_volume" :: waited 0.010s {{(pid=83528) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 25 16:02:47 devstack cinder-volume[83528]: DEBUG oslo.privsep.daemon [-] privsep: reply[752ac9da-b2c3-44e8-a19a-4eba1becd315]: (4, 'qcow2') {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 25 16:02:47 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-18839342-daf2-4b78-895c-858529cb4bad tempest-VolumeDependencyTests-18272511 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-33b8b216-ea13-4c2a-9c22-443659f1c861 {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 25 16:02:48 devstack sudo[91673]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-33b8b216-ea13-4c2a-9c22-443659f1c861 Feb 25 16:02:48 devstack sudo[91673]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 25 16:02:48 devstack sudo[91671]: pam_unix(sudo:session): session closed for user root Feb 25 16:02:48 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-67a19ad6-f708-4b19-94d2-9e4b78a359f5 tempest-CreateVolumesFromSnapshotTest-1082910625 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-b5e1b664-0dd6-4713-90ab-2f906f960a4d 1073741824" returned: 0 in 0.524s {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 25 16:02:48 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-67a19ad6-f708-4b19-94d2-9e4b78a359f5 tempest-CreateVolumesFromSnapshotTest-1082910625 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-b5e1b664-0dd6-4713-90ab-2f906f960a4d {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 25 16:02:48 devstack sudo[91678]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-b5e1b664-0dd6-4713-90ab-2f906f960a4d Feb 25 16:02:48 devstack sudo[91678]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 25 16:02:48 devstack sudo[91673]: pam_unix(sudo:session): session closed for user root Feb 25 16:02:48 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-18839342-daf2-4b78-895c-858529cb4bad tempest-VolumeDependencyTests-18272511 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-33b8b216-ea13-4c2a-9c22-443659f1c861" returned: 0 in 0.529s {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 25 16:02:48 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-18839342-daf2-4b78-895c-858529cb4bad tempest-VolumeDependencyTests-18272511 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-33b8b216-ea13-4c2a-9c22-443659f1c861 {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 25 16:02:48 devstack sudo[91683]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-33b8b216-ea13-4c2a-9c22-443659f1c861 Feb 25 16:02:48 devstack sudo[91683]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 25 16:02:48 devstack sudo[91678]: pam_unix(sudo:session): session closed for user root Feb 25 16:02:48 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-67a19ad6-f708-4b19-94d2-9e4b78a359f5 tempest-CreateVolumesFromSnapshotTest-1082910625 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-b5e1b664-0dd6-4713-90ab-2f906f960a4d" returned: 0 in 0.412s {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 25 16:02:48 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.quobyte [None req-67a19ad6-f708-4b19-94d2-9e4b78a359f5 tempest-CreateVolumesFromSnapshotTest-1082910625 None] <== create_volume: return (964ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-23e9d725-3e04-4cd9-bfe0-c8ef43305589'} {{(pid=83528) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 25 16:02:48 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-67a19ad6-f708-4b19-94d2-9e4b78a359f5 tempest-CreateVolumesFromSnapshotTest-1082910625 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.969s {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 25 16:02:48 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-e6657e4e-8c82-48eb-9b16-f8db29c9dead tempest-SnapshotDependencyTests-2073568565 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.237s {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 25 16:02:48 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.quobyte [None req-e6657e4e-8c82-48eb-9b16-f8db29c9dead tempest-SnapshotDependencyTests-2073568565 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-25T15:02:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-439522795',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b4a78707-43cc-4a9c-b6f9-e2b8ca42cfdc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2159f924ae4341cb8b84ebb667bb254e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-25T15:02:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-25T15:02:41Z,use_quota=True,user_id='2efbdffb69d64dcb93e4f254c8140fbf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ce71c2f9-6543-4165-9653-a1529b2ea243),volume_type_id=ce71c2f9-6543-4165-9653-a1529b2ea243)}" {{(pid=83528) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 25 16:02:48 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.remotefs [None req-e6657e4e-8c82-48eb-9b16-f8db29c9dead tempest-SnapshotDependencyTests-2073568565 None] Creating volume b4a78707-43cc-4a9c-b6f9-e2b8ca42cfdc {{(pid=83528) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 25 16:02:48 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-e6657e4e-8c82-48eb-9b16-f8db29c9dead tempest-SnapshotDependencyTests-2073568565 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 25 16:02:48 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-e6657e4e-8c82-48eb-9b16-f8db29c9dead tempest-SnapshotDependencyTests-2073568565 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 25 16:02:48 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.quobyte [None req-e6657e4e-8c82-48eb-9b16-f8db29c9dead tempest-SnapshotDependencyTests-2073568565 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23e9d725-3e04-4cd9-bfe0-c8ef43305589': None} {{(pid=83528) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 25 16:02:48 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.quobyte [None req-e6657e4e-8c82-48eb-9b16-f8db29c9dead tempest-SnapshotDependencyTests-2073568565 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23e9d725-3e04-4cd9-bfe0-c8ef43305589'] {{(pid=83528) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 25 16:02:48 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-e6657e4e-8c82-48eb-9b16-f8db29c9dead tempest-SnapshotDependencyTests-2073568565 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 25 16:02:48 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.quobyte [None req-e6657e4e-8c82-48eb-9b16-f8db29c9dead tempest-SnapshotDependencyTests-2073568565 None] Selected osci02.corp.quobyte.com/cinder-vol-23e9d725-3e04-4cd9-bfe0-c8ef43305589 as target Quobyte volume. {{(pid=83528) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 25 16:02:48 devstack cinder-volume[83528]: INFO cinder.volume.drivers.remotefs [None req-e6657e4e-8c82-48eb-9b16-f8db29c9dead tempest-SnapshotDependencyTests-2073568565 None] casted to osci02.corp.quobyte.com/cinder-vol-23e9d725-3e04-4cd9-bfe0-c8ef43305589 Feb 25 16:02:48 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-e6657e4e-8c82-48eb-9b16-f8db29c9dead tempest-SnapshotDependencyTests-2073568565 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-b4a78707-43cc-4a9c-b6f9-e2b8ca42cfdc 1073741824 {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 25 16:02:48 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-67a19ad6-f708-4b19-94d2-9e4b78a359f5 tempest-CreateVolumesFromSnapshotTest-1082910625 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b90783f8-68e6-4841-a720-f5d92e95557f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b5e1b664-0dd6-4713-90ab-2f906f960a4d', 'volume_size': 1}' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 25 16:02:48 devstack sudo[91687]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-b4a78707-43cc-4a9c-b6f9-e2b8ca42cfdc 1073741824 Feb 25 16:02:48 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-67a19ad6-f708-4b19-94d2-9e4b78a359f5 tempest-CreateVolumesFromSnapshotTest-1082910625 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dd0a26ca-e55d-4405-a29d-de994b896cbc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 25 16:02:48 devstack sudo[91687]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 25 16:02:48 devstack cinder-volume[83528]: INFO cinder.volume.flows.manager.create_volume [None req-67a19ad6-f708-4b19-94d2-9e4b78a359f5 tempest-CreateVolumesFromSnapshotTest-1082910625 None] Volume volume-b5e1b664-0dd6-4713-90ab-2f906f960a4d (b5e1b664-0dd6-4713-90ab-2f906f960a4d): created successfully Feb 25 16:02:48 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-67a19ad6-f708-4b19-94d2-9e4b78a359f5 tempest-CreateVolumesFromSnapshotTest-1082910625 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dd0a26ca-e55d-4405-a29d-de994b896cbc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 25 16:02:48 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-67a19ad6-f708-4b19-94d2-9e4b78a359f5 tempest-CreateVolumesFromSnapshotTest-1082910625 None] Flow 'volume_create_manager' (5adac81d-6780-4d10-9c28-56d59a40a3a6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83528) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 25 16:02:48 devstack cinder-volume[83528]: INFO cinder.volume.manager [None req-67a19ad6-f708-4b19-94d2-9e4b78a359f5 tempest-CreateVolumesFromSnapshotTest-1082910625 None] Created volume successfully. Feb 25 16:02:48 devstack sudo[91683]: pam_unix(sudo:session): session closed for user root Feb 25 16:02:48 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-18839342-daf2-4b78-895c-858529cb4bad tempest-VolumeDependencyTests-18272511 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-33b8b216-ea13-4c2a-9c22-443659f1c861" returned: 0 in 0.407s {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 25 16:02:48 devstack cinder-volume[83528]: DEBUG cinder.coordination [None req-18839342-daf2-4b78-895c-858529cb4bad tempest-VolumeDependencyTests-18272511 None] Lock "cinder-quobyte-33b8b216-ea13-4c2a-9c22-443659f1c861" released by "delete_volume" :: held 0.963s {{(pid=83528) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 25 16:02:48 devstack cinder-volume[83528]: DEBUG cinder.quota [None req-18839342-daf2-4b78-895c-858529cb4bad tempest-VolumeDependencyTests-18272511 None] Created reservations ['a3d66a68-cfe8-4a18-90f4-db9dd826ecc1', '985cc09b-4530-4946-9281-f4013457cc5b', 'aa9846d1-d672-4e28-a018-f8ded10585de', '1a92e53c-f59d-4976-a09c-6dd41d4450f4'] {{(pid=83528) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 25 16:02:49 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-18839342-daf2-4b78-895c-858529cb4bad tempest-VolumeDependencyTests-18272511 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 25 16:02:49 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-18839342-daf2-4b78-895c-858529cb4bad tempest-VolumeDependencyTests-18272511 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 25 16:02:49 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.quobyte [None req-18839342-daf2-4b78-895c-858529cb4bad tempest-VolumeDependencyTests-18272511 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23e9d725-3e04-4cd9-bfe0-c8ef43305589': None} {{(pid=83528) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 25 16:02:49 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.quobyte [None req-18839342-daf2-4b78-895c-858529cb4bad tempest-VolumeDependencyTests-18272511 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23e9d725-3e04-4cd9-bfe0-c8ef43305589'] {{(pid=83528) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 25 16:02:49 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-18839342-daf2-4b78-895c-858529cb4bad tempest-VolumeDependencyTests-18272511 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 25 16:02:49 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-18839342-daf2-4b78-895c-858529cb4bad tempest-VolumeDependencyTests-18272511 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85 {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 25 16:02:49 devstack sudo[91689]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85 Feb 25 16:02:49 devstack sudo[91689]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 25 16:02:49 devstack sudo[91687]: pam_unix(sudo:session): session closed for user root Feb 25 16:02:49 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-e6657e4e-8c82-48eb-9b16-f8db29c9dead tempest-SnapshotDependencyTests-2073568565 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-b4a78707-43cc-4a9c-b6f9-e2b8ca42cfdc 1073741824" returned: 0 in 0.508s {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 25 16:02:49 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-e6657e4e-8c82-48eb-9b16-f8db29c9dead tempest-SnapshotDependencyTests-2073568565 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-b4a78707-43cc-4a9c-b6f9-e2b8ca42cfdc {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 25 16:02:49 devstack sudo[91695]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-b4a78707-43cc-4a9c-b6f9-e2b8ca42cfdc Feb 25 16:02:49 devstack sudo[91695]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 25 16:02:49 devstack sudo[91689]: pam_unix(sudo:session): session closed for user root Feb 25 16:02:49 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-18839342-daf2-4b78-895c-858529cb4bad tempest-VolumeDependencyTests-18272511 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85" returned: 0 in 0.408s {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 25 16:02:49 devstack cinder-volume[83528]: DEBUG cinder.manager [None req-18839342-daf2-4b78-895c-858529cb4bad tempest-VolumeDependencyTests-18272511 None] Notifying Schedulers of capabilities ... {{(pid=83528) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 25 16:02:49 devstack cinder-volume[83528]: INFO cinder.volume.manager [None req-18839342-daf2-4b78-895c-858529cb4bad tempest-VolumeDependencyTests-18272511 None] Deleted volume successfully. Feb 25 16:02:49 devstack cinder-volume[83528]: DEBUG cinder.coordination [None req-18839342-daf2-4b78-895c-858529cb4bad tempest-VolumeDependencyTests-18272511 None] Lock "cinder-33b8b216-ea13-4c2a-9c22-443659f1c861-delete_volume" released by "delete_volume" :: held 1.515s {{(pid=83528) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 25 16:02:49 devstack cinder-volume[83528]: DEBUG cinder.coordination [None req-bea57df1-bbdd-48fb-82ed-f6cf170eccdb tempest-CreateVolumesFromSnapshotTest-1082910625 None] Acquiring lock "cinder-b5e1b664-0dd6-4713-90ab-2f906f960a4d-delete_volume" by "delete_volume" {{(pid=83528) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 25 16:02:49 devstack cinder-volume[83528]: DEBUG cinder.coordination [None req-bea57df1-bbdd-48fb-82ed-f6cf170eccdb tempest-CreateVolumesFromSnapshotTest-1082910625 None] Lock "cinder-b5e1b664-0dd6-4713-90ab-2f906f960a4d-delete_volume" acquired by "delete_volume" :: waited 0.008s {{(pid=83528) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 25 16:02:49 devstack cinder-volume[83528]: DEBUG cinder.coordination [None req-bea57df1-bbdd-48fb-82ed-f6cf170eccdb tempest-CreateVolumesFromSnapshotTest-1082910625 None] Acquiring lock "cinder-quobyte-b5e1b664-0dd6-4713-90ab-2f906f960a4d" by "delete_volume" {{(pid=83528) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 25 16:02:49 devstack cinder-volume[83528]: DEBUG cinder.coordination [None req-bea57df1-bbdd-48fb-82ed-f6cf170eccdb tempest-CreateVolumesFromSnapshotTest-1082910625 None] Lock "cinder-quobyte-b5e1b664-0dd6-4713-90ab-2f906f960a4d" acquired by "delete_volume" :: waited 0.007s {{(pid=83528) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 25 16:02:49 devstack cinder-volume[83528]: DEBUG oslo.privsep.daemon [-] privsep: reply[370182a7-38eb-4446-8b93-f361221bc21e]: (4, 'qcow2') {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 25 16:02:49 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-bea57df1-bbdd-48fb-82ed-f6cf170eccdb tempest-CreateVolumesFromSnapshotTest-1082910625 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-b5e1b664-0dd6-4713-90ab-2f906f960a4d {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 25 16:02:49 devstack sudo[91697]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-b5e1b664-0dd6-4713-90ab-2f906f960a4d Feb 25 16:02:49 devstack sudo[91697]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 25 16:02:49 devstack sudo[91695]: pam_unix(sudo:session): session closed for user root Feb 25 16:02:49 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-e6657e4e-8c82-48eb-9b16-f8db29c9dead tempest-SnapshotDependencyTests-2073568565 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-b4a78707-43cc-4a9c-b6f9-e2b8ca42cfdc" returned: 0 in 0.412s {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 25 16:02:49 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.quobyte [None req-e6657e4e-8c82-48eb-9b16-f8db29c9dead tempest-SnapshotDependencyTests-2073568565 None] <== create_volume: return (950ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-23e9d725-3e04-4cd9-bfe0-c8ef43305589'} {{(pid=83528) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 25 16:02:49 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-e6657e4e-8c82-48eb-9b16-f8db29c9dead tempest-SnapshotDependencyTests-2073568565 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.953s {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 25 16:02:49 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-d8e823ad-699d-4750-b589-06884716ca98 tempest-CreateVolumesFromSourceVolumeTest-931808651 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.594s {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 25 16:02:49 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.quobyte [None req-d8e823ad-699d-4750-b589-06884716ca98 tempest-CreateVolumesFromSourceVolumeTest-931808651 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-25T15:02:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1404409029',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fb9f5973-8aae-4d7a-a652-ba930478dbc0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fcf12f31e52c40859d85ba8f3aa4076b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-25T15:02:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-25T15:02:46Z,use_quota=True,user_id='ce4e44485cd646fc9c78daa6a071c681',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ce71c2f9-6543-4165-9653-a1529b2ea243),volume_type_id=ce71c2f9-6543-4165-9653-a1529b2ea243)}" {{(pid=83528) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 25 16:02:49 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.remotefs [None req-d8e823ad-699d-4750-b589-06884716ca98 tempest-CreateVolumesFromSourceVolumeTest-931808651 None] Creating volume fb9f5973-8aae-4d7a-a652-ba930478dbc0 {{(pid=83528) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 25 16:02:49 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-d8e823ad-699d-4750-b589-06884716ca98 tempest-CreateVolumesFromSourceVolumeTest-931808651 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 25 16:02:49 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-d8e823ad-699d-4750-b589-06884716ca98 tempest-CreateVolumesFromSourceVolumeTest-931808651 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 25 16:02:49 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.quobyte [None req-d8e823ad-699d-4750-b589-06884716ca98 tempest-CreateVolumesFromSourceVolumeTest-931808651 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23e9d725-3e04-4cd9-bfe0-c8ef43305589': None} {{(pid=83528) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 25 16:02:49 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.quobyte [None req-d8e823ad-699d-4750-b589-06884716ca98 tempest-CreateVolumesFromSourceVolumeTest-931808651 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23e9d725-3e04-4cd9-bfe0-c8ef43305589'] {{(pid=83528) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 25 16:02:49 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-d8e823ad-699d-4750-b589-06884716ca98 tempest-CreateVolumesFromSourceVolumeTest-931808651 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 25 16:02:49 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.quobyte [None req-d8e823ad-699d-4750-b589-06884716ca98 tempest-CreateVolumesFromSourceVolumeTest-931808651 None] Selected osci02.corp.quobyte.com/cinder-vol-23e9d725-3e04-4cd9-bfe0-c8ef43305589 as target Quobyte volume. {{(pid=83528) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 25 16:02:49 devstack cinder-volume[83528]: INFO cinder.volume.drivers.remotefs [None req-d8e823ad-699d-4750-b589-06884716ca98 tempest-CreateVolumesFromSourceVolumeTest-931808651 None] casted to osci02.corp.quobyte.com/cinder-vol-23e9d725-3e04-4cd9-bfe0-c8ef43305589 Feb 25 16:02:49 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-d8e823ad-699d-4750-b589-06884716ca98 tempest-CreateVolumesFromSourceVolumeTest-931808651 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-fb9f5973-8aae-4d7a-a652-ba930478dbc0 1073741824 {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 25 16:02:49 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-e6657e4e-8c82-48eb-9b16-f8db29c9dead tempest-SnapshotDependencyTests-2073568565 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (34e65e52-5b97-405d-a3bd-cae444a88a28) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b4a78707-43cc-4a9c-b6f9-e2b8ca42cfdc', 'volume_size': 1}' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 25 16:02:49 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-e6657e4e-8c82-48eb-9b16-f8db29c9dead tempest-SnapshotDependencyTests-2073568565 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (59938ff5-f7ec-4490-8c68-1c7ac35a8d1e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 25 16:02:49 devstack sudo[91700]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-fb9f5973-8aae-4d7a-a652-ba930478dbc0 1073741824 Feb 25 16:02:49 devstack sudo[91700]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 25 16:02:49 devstack cinder-volume[83528]: INFO cinder.volume.flows.manager.create_volume [None req-e6657e4e-8c82-48eb-9b16-f8db29c9dead tempest-SnapshotDependencyTests-2073568565 None] Volume volume-b4a78707-43cc-4a9c-b6f9-e2b8ca42cfdc (b4a78707-43cc-4a9c-b6f9-e2b8ca42cfdc): created successfully Feb 25 16:02:49 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-e6657e4e-8c82-48eb-9b16-f8db29c9dead tempest-SnapshotDependencyTests-2073568565 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (59938ff5-f7ec-4490-8c68-1c7ac35a8d1e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 25 16:02:49 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-e6657e4e-8c82-48eb-9b16-f8db29c9dead tempest-SnapshotDependencyTests-2073568565 None] Flow 'volume_create_manager' (d1eda8dd-a38f-4e9e-8b0f-e6ce5bbccb11) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83528) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 25 16:02:49 devstack cinder-volume[83528]: INFO cinder.volume.manager [None req-e6657e4e-8c82-48eb-9b16-f8db29c9dead tempest-SnapshotDependencyTests-2073568565 None] Created volume successfully. Feb 25 16:02:50 devstack sudo[91697]: pam_unix(sudo:session): session closed for user root Feb 25 16:02:50 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-bea57df1-bbdd-48fb-82ed-f6cf170eccdb tempest-CreateVolumesFromSnapshotTest-1082910625 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-b5e1b664-0dd6-4713-90ab-2f906f960a4d" returned: 0 in 0.514s {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 25 16:02:50 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-bea57df1-bbdd-48fb-82ed-f6cf170eccdb tempest-CreateVolumesFromSnapshotTest-1082910625 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-b5e1b664-0dd6-4713-90ab-2f906f960a4d {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 25 16:02:50 devstack sudo[91705]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-b5e1b664-0dd6-4713-90ab-2f906f960a4d Feb 25 16:02:50 devstack sudo[91705]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 25 16:02:50 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-7b424e9b-ff8c-4cdc-9bf1-100c55130586 tempest-SnapshotDependencyTests-2073568565 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 25 16:02:50 devstack cinder-volume[83528]: DEBUG cinder.volume.flows.manager.create_volume [None req-b5cff6aa-118c-4e43-81d9-ab9a667dcabd tempest-VolumeDependencyTests-18272511 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83528) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 25 16:02:50 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-b5cff6aa-118c-4e43-81d9-ab9a667dcabd tempest-VolumeDependencyTests-18272511 None] Flow 'volume_create_manager' (34a95c13-076f-4366-8dd3-0a1ba0b07b24) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83528) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 25 16:02:50 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-b5cff6aa-118c-4e43-81d9-ab9a667dcabd tempest-VolumeDependencyTests-18272511 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (949342eb-ed6d-4a02-a81e-2d4c5b75338e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 25 16:02:50 devstack sudo[91700]: pam_unix(sudo:session): session closed for user root Feb 25 16:02:50 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-b5cff6aa-118c-4e43-81d9-ab9a667dcabd tempest-VolumeDependencyTests-18272511 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (949342eb-ed6d-4a02-a81e-2d4c5b75338e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-25T15:02:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-2047485970',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=289e9ac3-09e6-4612-b623-d0bd566a16c4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a8840d2cf3ed4cbead7a7125ba5ed6db',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-25T15:02:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-25T15:02:50Z,use_quota=True,user_id='80a29926db28406da11a76818f583959',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ce71c2f9-6543-4165-9653-a1529b2ea243),volume_type_id=ce71c2f9-6543-4165-9653-a1529b2ea243)' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 25 16:02:50 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-b5cff6aa-118c-4e43-81d9-ab9a667dcabd tempest-VolumeDependencyTests-18272511 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2054d283-459a-4ec9-b431-523f014478dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 25 16:02:50 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-b5cff6aa-118c-4e43-81d9-ab9a667dcabd tempest-VolumeDependencyTests-18272511 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2054d283-459a-4ec9-b431-523f014478dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 25 16:02:50 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-b5cff6aa-118c-4e43-81d9-ab9a667dcabd tempest-VolumeDependencyTests-18272511 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c2d3e97d-3de0-4ed8-9317-90f3ae8924d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 25 16:02:50 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-b5cff6aa-118c-4e43-81d9-ab9a667dcabd tempest-VolumeDependencyTests-18272511 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c2d3e97d-3de0-4ed8-9317-90f3ae8924d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '289e9ac3-09e6-4612-b623-d0bd566a16c4', 'volume_name': 'volume-289e9ac3-09e6-4612-b623-d0bd566a16c4', 'volume_size': 1}' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 25 16:02:50 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-b5cff6aa-118c-4e43-81d9-ab9a667dcabd tempest-VolumeDependencyTests-18272511 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (131e276e-b889-4dbb-94bc-e867fc9a6f92) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 25 16:02:50 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-b5cff6aa-118c-4e43-81d9-ab9a667dcabd tempest-VolumeDependencyTests-18272511 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (131e276e-b889-4dbb-94bc-e867fc9a6f92) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 25 16:02:50 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-b5cff6aa-118c-4e43-81d9-ab9a667dcabd tempest-VolumeDependencyTests-18272511 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5a1a7df6-0900-472e-8875-14d41286dd04) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 25 16:02:50 devstack cinder-volume[83528]: INFO cinder.volume.flows.manager.create_volume [None req-b5cff6aa-118c-4e43-81d9-ab9a667dcabd tempest-VolumeDependencyTests-18272511 None] Volume 289e9ac3-09e6-4612-b623-d0bd566a16c4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-289e9ac3-09e6-4612-b623-d0bd566a16c4', 'volume_size': 1} Feb 25 16:02:50 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-b5cff6aa-118c-4e43-81d9-ab9a667dcabd tempest-VolumeDependencyTests-18272511 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 25 16:02:50 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-d8e823ad-699d-4750-b589-06884716ca98 tempest-CreateVolumesFromSourceVolumeTest-931808651 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-fb9f5973-8aae-4d7a-a652-ba930478dbc0 1073741824" returned: 0 in 0.612s {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 25 16:02:50 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-d8e823ad-699d-4750-b589-06884716ca98 tempest-CreateVolumesFromSourceVolumeTest-931808651 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-fb9f5973-8aae-4d7a-a652-ba930478dbc0 {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 25 16:02:50 devstack sudo[91710]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-fb9f5973-8aae-4d7a-a652-ba930478dbc0 Feb 25 16:02:50 devstack sudo[91710]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 25 16:02:50 devstack sudo[91705]: pam_unix(sudo:session): session closed for user root Feb 25 16:02:50 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-bea57df1-bbdd-48fb-82ed-f6cf170eccdb tempest-CreateVolumesFromSnapshotTest-1082910625 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-b5e1b664-0dd6-4713-90ab-2f906f960a4d" returned: 0 in 0.503s {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 25 16:02:50 devstack cinder-volume[83528]: DEBUG cinder.coordination [None req-bea57df1-bbdd-48fb-82ed-f6cf170eccdb tempest-CreateVolumesFromSnapshotTest-1082910625 None] Lock "cinder-quobyte-b5e1b664-0dd6-4713-90ab-2f906f960a4d" released by "delete_volume" :: held 1.049s {{(pid=83528) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 25 16:02:50 devstack cinder-volume[83528]: DEBUG cinder.quota [None req-bea57df1-bbdd-48fb-82ed-f6cf170eccdb tempest-CreateVolumesFromSnapshotTest-1082910625 None] Created reservations ['bd889672-7951-43cb-8511-47b8d4145349', 'd330c9c1-026e-4c80-b368-fba741bc3d49', '6f7382b5-5791-4ee9-aaed-0f1469628317', '62de1815-036d-4ac9-ab81-a0f47ef8abcf'] {{(pid=83528) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 25 16:02:50 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-bea57df1-bbdd-48fb-82ed-f6cf170eccdb tempest-CreateVolumesFromSnapshotTest-1082910625 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 25 16:02:50 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-bea57df1-bbdd-48fb-82ed-f6cf170eccdb tempest-CreateVolumesFromSnapshotTest-1082910625 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 25 16:02:50 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.quobyte [None req-bea57df1-bbdd-48fb-82ed-f6cf170eccdb tempest-CreateVolumesFromSnapshotTest-1082910625 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23e9d725-3e04-4cd9-bfe0-c8ef43305589': None} {{(pid=83528) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 25 16:02:50 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.quobyte [None req-bea57df1-bbdd-48fb-82ed-f6cf170eccdb tempest-CreateVolumesFromSnapshotTest-1082910625 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23e9d725-3e04-4cd9-bfe0-c8ef43305589'] {{(pid=83528) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 25 16:02:50 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-bea57df1-bbdd-48fb-82ed-f6cf170eccdb tempest-CreateVolumesFromSnapshotTest-1082910625 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 25 16:02:50 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-bea57df1-bbdd-48fb-82ed-f6cf170eccdb tempest-CreateVolumesFromSnapshotTest-1082910625 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85 {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 25 16:02:50 devstack sudo[91713]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85 Feb 25 16:02:50 devstack sudo[91713]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 25 16:02:50 devstack sudo[91710]: pam_unix(sudo:session): session closed for user root Feb 25 16:02:50 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-d8e823ad-699d-4750-b589-06884716ca98 tempest-CreateVolumesFromSourceVolumeTest-931808651 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-fb9f5973-8aae-4d7a-a652-ba930478dbc0" returned: 0 in 0.417s {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 25 16:02:50 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.quobyte [None req-d8e823ad-699d-4750-b589-06884716ca98 tempest-CreateVolumesFromSourceVolumeTest-931808651 None] <== create_volume: return (1051ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-23e9d725-3e04-4cd9-bfe0-c8ef43305589'} {{(pid=83528) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 25 16:02:50 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-d8e823ad-699d-4750-b589-06884716ca98 tempest-CreateVolumesFromSourceVolumeTest-931808651 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.054s {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 25 16:02:50 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-7b424e9b-ff8c-4cdc-9bf1-100c55130586 tempest-SnapshotDependencyTests-2073568565 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.742s {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 25 16:02:50 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.remotefs [None req-7b424e9b-ff8c-4cdc-9bf1-100c55130586 tempest-SnapshotDependencyTests-2073568565 None] Creating offline snapshot b7612e5c-1617-4e2b-af75-173a562fa3a1 of volume b4a78707-43cc-4a9c-b6f9-e2b8ca42cfdc {{(pid=83528) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Feb 25 16:02:50 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-d8e823ad-699d-4750-b589-06884716ca98 tempest-CreateVolumesFromSourceVolumeTest-931808651 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1e8d4fac-6414-4478-b05d-b3422353a1c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fb9f5973-8aae-4d7a-a652-ba930478dbc0', 'volume_size': 1}' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 25 16:02:50 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-d8e823ad-699d-4750-b589-06884716ca98 tempest-CreateVolumesFromSourceVolumeTest-931808651 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5c44636b-b257-4d79-a26b-3f243b591753) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 25 16:02:50 devstack cinder-volume[83528]: DEBUG oslo.privsep.daemon [-] privsep: reply[0be9be55-f630-4323-8ff5-2888d6484473]: (4, 'qcow2') {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 25 16:02:50 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-7b424e9b-ff8c-4cdc-9bf1-100c55130586 tempest-SnapshotDependencyTests-2073568565 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-b4a78707-43cc-4a9c-b6f9-e2b8ca42cfdc {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 25 16:02:50 devstack cinder-volume[83528]: INFO cinder.volume.flows.manager.create_volume [None req-d8e823ad-699d-4750-b589-06884716ca98 tempest-CreateVolumesFromSourceVolumeTest-931808651 None] Volume volume-fb9f5973-8aae-4d7a-a652-ba930478dbc0 (fb9f5973-8aae-4d7a-a652-ba930478dbc0): created successfully Feb 25 16:02:50 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-d8e823ad-699d-4750-b589-06884716ca98 tempest-CreateVolumesFromSourceVolumeTest-931808651 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5c44636b-b257-4d79-a26b-3f243b591753) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 25 16:02:50 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-d8e823ad-699d-4750-b589-06884716ca98 tempest-CreateVolumesFromSourceVolumeTest-931808651 None] Flow 'volume_create_manager' (fb0f3f52-a43c-48a4-bbc0-707455095bab) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83528) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 25 16:02:50 devstack cinder-volume[83528]: INFO cinder.volume.manager [None req-d8e823ad-699d-4750-b589-06884716ca98 tempest-CreateVolumesFromSourceVolumeTest-931808651 None] Created volume successfully. Feb 25 16:02:50 devstack sudo[91716]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-b4a78707-43cc-4a9c-b6f9-e2b8ca42cfdc Feb 25 16:02:50 devstack sudo[91716]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 25 16:02:51 devstack sudo[91713]: pam_unix(sudo:session): session closed for user root Feb 25 16:02:51 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-bea57df1-bbdd-48fb-82ed-f6cf170eccdb tempest-CreateVolumesFromSnapshotTest-1082910625 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85" returned: 0 in 0.385s {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 25 16:02:51 devstack cinder-volume[83528]: DEBUG cinder.manager [None req-bea57df1-bbdd-48fb-82ed-f6cf170eccdb tempest-CreateVolumesFromSnapshotTest-1082910625 None] Notifying Schedulers of capabilities ... {{(pid=83528) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 25 16:02:51 devstack cinder-volume[83528]: INFO cinder.volume.manager [None req-bea57df1-bbdd-48fb-82ed-f6cf170eccdb tempest-CreateVolumesFromSnapshotTest-1082910625 None] Deleted volume successfully. Feb 25 16:02:51 devstack cinder-volume[83528]: DEBUG cinder.coordination [None req-bea57df1-bbdd-48fb-82ed-f6cf170eccdb tempest-CreateVolumesFromSnapshotTest-1082910625 None] Lock "cinder-b5e1b664-0dd6-4713-90ab-2f906f960a4d-delete_volume" released by "delete_volume" :: held 1.551s {{(pid=83528) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 25 16:02:51 devstack sudo[91716]: pam_unix(sudo:session): session closed for user root Feb 25 16:02:51 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-7b424e9b-ff8c-4cdc-9bf1-100c55130586 tempest-SnapshotDependencyTests-2073568565 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-b4a78707-43cc-4a9c-b6f9-e2b8ca42cfdc" returned: 0 in 0.496s {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 25 16:02:51 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-7b424e9b-ff8c-4cdc-9bf1-100c55130586 tempest-SnapshotDependencyTests-2073568565 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-b4a78707-43cc-4a9c-b6f9-e2b8ca42cfdc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-b4a78707-43cc-4a9c-b6f9-e2b8ca42cfdc.b7612e5c-1617-4e2b-af75-173a562fa3a1 1G {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 25 16:02:51 devstack sudo[91722]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-b4a78707-43cc-4a9c-b6f9-e2b8ca42cfdc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-b4a78707-43cc-4a9c-b6f9-e2b8ca42cfdc.b7612e5c-1617-4e2b-af75-173a562fa3a1 1G Feb 25 16:02:51 devstack sudo[91722]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 25 16:02:51 devstack cinder-volume[83528]: DEBUG cinder.volume.flows.manager.create_volume [None req-5a20a34b-01fe-438f-b6e5-9edd5036a8f8 tempest-CreateVolumesFromSourceVolumeTest-931808651 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83528) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 25 16:02:51 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-5a20a34b-01fe-438f-b6e5-9edd5036a8f8 tempest-CreateVolumesFromSourceVolumeTest-931808651 None] Flow 'volume_create_manager' (4548b435-3ca7-4b63-b9ae-7ae7ad4a9f0e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83528) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 25 16:02:51 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-5a20a34b-01fe-438f-b6e5-9edd5036a8f8 tempest-CreateVolumesFromSourceVolumeTest-931808651 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (821954f5-e327-4d62-b04d-0929def2fe39) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 25 16:02:51 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-5a20a34b-01fe-438f-b6e5-9edd5036a8f8 tempest-CreateVolumesFromSourceVolumeTest-931808651 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (821954f5-e327-4d62-b04d-0929def2fe39) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-25T15:02:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-317692144',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=00f749da-8e33-4f4a-aab4-f2f1c17f6d41,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fcf12f31e52c40859d85ba8f3aa4076b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-25T15:02:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-25T15:02:52Z,use_quota=True,user_id='ce4e44485cd646fc9c78daa6a071c681',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ce71c2f9-6543-4165-9653-a1529b2ea243),volume_type_id=ce71c2f9-6543-4165-9653-a1529b2ea243)' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 25 16:02:51 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-5a20a34b-01fe-438f-b6e5-9edd5036a8f8 tempest-CreateVolumesFromSourceVolumeTest-931808651 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cd5d2e00-5e53-4d7e-9fa7-167921939b52) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 25 16:02:51 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-5a20a34b-01fe-438f-b6e5-9edd5036a8f8 tempest-CreateVolumesFromSourceVolumeTest-931808651 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cd5d2e00-5e53-4d7e-9fa7-167921939b52) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 25 16:02:51 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-5a20a34b-01fe-438f-b6e5-9edd5036a8f8 tempest-CreateVolumesFromSourceVolumeTest-931808651 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (07d6a2f6-699d-4858-9603-294dd95cf97d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 25 16:02:51 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-5a20a34b-01fe-438f-b6e5-9edd5036a8f8 tempest-CreateVolumesFromSourceVolumeTest-931808651 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (07d6a2f6-699d-4858-9603-294dd95cf97d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '00f749da-8e33-4f4a-aab4-f2f1c17f6d41', 'volume_name': 'volume-00f749da-8e33-4f4a-aab4-f2f1c17f6d41', 'volume_size': 1}' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 25 16:02:51 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-5a20a34b-01fe-438f-b6e5-9edd5036a8f8 tempest-CreateVolumesFromSourceVolumeTest-931808651 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cdd421cb-b606-4bfb-9995-759ee3d03c06) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 25 16:02:51 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-5a20a34b-01fe-438f-b6e5-9edd5036a8f8 tempest-CreateVolumesFromSourceVolumeTest-931808651 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cdd421cb-b606-4bfb-9995-759ee3d03c06) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 25 16:02:51 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-5a20a34b-01fe-438f-b6e5-9edd5036a8f8 tempest-CreateVolumesFromSourceVolumeTest-931808651 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7ff214cc-ab0b-4adc-9b19-6bd2abc5dfb8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 25 16:02:51 devstack cinder-volume[83528]: INFO cinder.volume.flows.manager.create_volume [None req-5a20a34b-01fe-438f-b6e5-9edd5036a8f8 tempest-CreateVolumesFromSourceVolumeTest-931808651 None] Volume 00f749da-8e33-4f4a-aab4-f2f1c17f6d41: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-00f749da-8e33-4f4a-aab4-f2f1c17f6d41', 'volume_size': 1} Feb 25 16:02:51 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-5a20a34b-01fe-438f-b6e5-9edd5036a8f8 tempest-CreateVolumesFromSourceVolumeTest-931808651 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 25 16:02:51 devstack cinder-volume[83528]: DEBUG cinder.coordination [None req-ff7988b1-3292-40b5-aa39-7c0ddbf4a33c tempest-CreateVolumesFromSnapshotTest-1082910625 None] Acquiring lock "cinder-92131519-d016-4969-b0d0-1dbcde63abda-delete_volume" by "delete_volume" {{(pid=83528) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 25 16:02:51 devstack cinder-volume[83528]: DEBUG cinder.coordination [None req-ff7988b1-3292-40b5-aa39-7c0ddbf4a33c tempest-CreateVolumesFromSnapshotTest-1082910625 None] Lock "cinder-92131519-d016-4969-b0d0-1dbcde63abda-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=83528) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 25 16:02:51 devstack cinder-volume[83528]: DEBUG cinder.coordination [None req-ff7988b1-3292-40b5-aa39-7c0ddbf4a33c tempest-CreateVolumesFromSnapshotTest-1082910625 None] Acquiring lock "cinder-quobyte-92131519-d016-4969-b0d0-1dbcde63abda" by "delete_volume" {{(pid=83528) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 25 16:02:51 devstack cinder-volume[83528]: DEBUG cinder.coordination [None req-ff7988b1-3292-40b5-aa39-7c0ddbf4a33c tempest-CreateVolumesFromSnapshotTest-1082910625 None] Lock "cinder-quobyte-92131519-d016-4969-b0d0-1dbcde63abda" acquired by "delete_volume" :: waited 0.012s {{(pid=83528) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 25 16:02:51 devstack cinder-volume[83528]: DEBUG oslo.privsep.daemon [-] privsep: reply[a551a8d8-7887-47f8-9c05-cc30cae27192]: (4, 'qcow2') {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 25 16:02:51 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-ff7988b1-3292-40b5-aa39-7c0ddbf4a33c tempest-CreateVolumesFromSnapshotTest-1082910625 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-92131519-d016-4969-b0d0-1dbcde63abda {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 25 16:02:51 devstack cinder-volume[83528]: DEBUG cinder.volume.flows.manager.create_volume [None req-dc9793d2-a9e7-4926-93ff-ce56a753cb6d tempest-CreateVolumesFromSourceVolumeTest-931808651 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83528) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 25 16:02:51 devstack sudo[91725]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-92131519-d016-4969-b0d0-1dbcde63abda Feb 25 16:02:51 devstack sudo[91725]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 25 16:02:51 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-dc9793d2-a9e7-4926-93ff-ce56a753cb6d tempest-CreateVolumesFromSourceVolumeTest-931808651 None] Flow 'volume_create_manager' (f04c9dba-8ea4-4296-924a-ad5f83edfd5d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83528) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 25 16:02:51 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-dc9793d2-a9e7-4926-93ff-ce56a753cb6d tempest-CreateVolumesFromSourceVolumeTest-931808651 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (64610167-ae36-4f21-9500-3d7ccf6412a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 25 16:02:51 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-dc9793d2-a9e7-4926-93ff-ce56a753cb6d tempest-CreateVolumesFromSourceVolumeTest-931808651 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (64610167-ae36-4f21-9500-3d7ccf6412a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-25T15:02:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1941950104',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c1e1de1e-613e-42ad-8f13-f8bceaf705d9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fcf12f31e52c40859d85ba8f3aa4076b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-25T15:02:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-25T15:02:52Z,use_quota=True,user_id='ce4e44485cd646fc9c78daa6a071c681',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ce71c2f9-6543-4165-9653-a1529b2ea243),volume_type_id=ce71c2f9-6543-4165-9653-a1529b2ea243)' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 25 16:02:51 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-dc9793d2-a9e7-4926-93ff-ce56a753cb6d tempest-CreateVolumesFromSourceVolumeTest-931808651 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (737253ff-6659-4841-94b1-7934b441e985) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 25 16:02:51 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-dc9793d2-a9e7-4926-93ff-ce56a753cb6d tempest-CreateVolumesFromSourceVolumeTest-931808651 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (737253ff-6659-4841-94b1-7934b441e985) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 25 16:02:51 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-dc9793d2-a9e7-4926-93ff-ce56a753cb6d tempest-CreateVolumesFromSourceVolumeTest-931808651 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3892c738-2eb3-4d52-ad98-a91d7d4ed09c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 25 16:02:51 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-dc9793d2-a9e7-4926-93ff-ce56a753cb6d tempest-CreateVolumesFromSourceVolumeTest-931808651 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3892c738-2eb3-4d52-ad98-a91d7d4ed09c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c1e1de1e-613e-42ad-8f13-f8bceaf705d9', 'volume_name': 'volume-c1e1de1e-613e-42ad-8f13-f8bceaf705d9', 'volume_size': 1}' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 25 16:02:51 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-dc9793d2-a9e7-4926-93ff-ce56a753cb6d tempest-CreateVolumesFromSourceVolumeTest-931808651 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (26739d04-e8a0-4896-83df-ce475bfcd378) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 25 16:02:51 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-dc9793d2-a9e7-4926-93ff-ce56a753cb6d tempest-CreateVolumesFromSourceVolumeTest-931808651 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (26739d04-e8a0-4896-83df-ce475bfcd378) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 25 16:02:51 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-dc9793d2-a9e7-4926-93ff-ce56a753cb6d tempest-CreateVolumesFromSourceVolumeTest-931808651 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1971f85e-6b20-4722-b5ff-17bb42aa10fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 25 16:02:51 devstack cinder-volume[83528]: INFO cinder.volume.flows.manager.create_volume [None req-dc9793d2-a9e7-4926-93ff-ce56a753cb6d tempest-CreateVolumesFromSourceVolumeTest-931808651 None] Volume c1e1de1e-613e-42ad-8f13-f8bceaf705d9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c1e1de1e-613e-42ad-8f13-f8bceaf705d9', 'volume_size': 1} Feb 25 16:02:51 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-dc9793d2-a9e7-4926-93ff-ce56a753cb6d tempest-CreateVolumesFromSourceVolumeTest-931808651 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 25 16:02:51 devstack sudo[91722]: pam_unix(sudo:session): session closed for user root Feb 25 16:02:51 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-7b424e9b-ff8c-4cdc-9bf1-100c55130586 tempest-SnapshotDependencyTests-2073568565 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-b4a78707-43cc-4a9c-b6f9-e2b8ca42cfdc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-b4a78707-43cc-4a9c-b6f9-e2b8ca42cfdc.b7612e5c-1617-4e2b-af75-173a562fa3a1 1G" returned: 0 in 0.536s {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 25 16:02:51 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-7b424e9b-ff8c-4cdc-9bf1-100c55130586 tempest-SnapshotDependencyTests-2073568565 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b4a78707-43cc-4a9c-b6f9-e2b8ca42cfdc -F qcow2 /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-b4a78707-43cc-4a9c-b6f9-e2b8ca42cfdc.b7612e5c-1617-4e2b-af75-173a562fa3a1 {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 25 16:02:51 devstack sudo[91729]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b4a78707-43cc-4a9c-b6f9-e2b8ca42cfdc -F qcow2 /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-b4a78707-43cc-4a9c-b6f9-e2b8ca42cfdc.b7612e5c-1617-4e2b-af75-173a562fa3a1 Feb 25 16:02:51 devstack sudo[91729]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 25 16:02:52 devstack cinder-volume[83528]: DEBUG cinder.volume.flows.manager.create_volume [None req-70eaca4e-e7c6-4c93-af35-837572b88d3d tempest-CreateVolumesFromSourceVolumeTest-931808651 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83528) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 25 16:02:52 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-70eaca4e-e7c6-4c93-af35-837572b88d3d tempest-CreateVolumesFromSourceVolumeTest-931808651 None] Flow 'volume_create_manager' (5e123d99-39dd-4549-84a2-9cf5a96ee195) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83528) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 25 16:02:52 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-70eaca4e-e7c6-4c93-af35-837572b88d3d tempest-CreateVolumesFromSourceVolumeTest-931808651 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (56f0cb7c-0ccb-4bc4-ad4e-afcbed60906a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 25 16:02:52 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-70eaca4e-e7c6-4c93-af35-837572b88d3d tempest-CreateVolumesFromSourceVolumeTest-931808651 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (56f0cb7c-0ccb-4bc4-ad4e-afcbed60906a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-25T15:02:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-388646419',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ccba4e52-9616-4165-a4b0-4fcf5a4fc1bf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fcf12f31e52c40859d85ba8f3aa4076b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-25T15:02:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-25T15:02:52Z,use_quota=True,user_id='ce4e44485cd646fc9c78daa6a071c681',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ce71c2f9-6543-4165-9653-a1529b2ea243),volume_type_id=ce71c2f9-6543-4165-9653-a1529b2ea243)' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 25 16:02:52 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-70eaca4e-e7c6-4c93-af35-837572b88d3d tempest-CreateVolumesFromSourceVolumeTest-931808651 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ac0b95fd-cfb1-4c82-9a74-d8fddd1f122e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 25 16:02:52 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-70eaca4e-e7c6-4c93-af35-837572b88d3d tempest-CreateVolumesFromSourceVolumeTest-931808651 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ac0b95fd-cfb1-4c82-9a74-d8fddd1f122e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 25 16:02:52 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-70eaca4e-e7c6-4c93-af35-837572b88d3d tempest-CreateVolumesFromSourceVolumeTest-931808651 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (91c5a737-15f0-4dbe-8e6c-5ac1160d4570) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 25 16:02:52 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-70eaca4e-e7c6-4c93-af35-837572b88d3d tempest-CreateVolumesFromSourceVolumeTest-931808651 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (91c5a737-15f0-4dbe-8e6c-5ac1160d4570) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ccba4e52-9616-4165-a4b0-4fcf5a4fc1bf', 'volume_name': 'volume-ccba4e52-9616-4165-a4b0-4fcf5a4fc1bf', 'volume_size': 1}' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 25 16:02:52 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-70eaca4e-e7c6-4c93-af35-837572b88d3d tempest-CreateVolumesFromSourceVolumeTest-931808651 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c715c666-c8c8-4ff3-9661-b92f596bda40) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 25 16:02:52 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-70eaca4e-e7c6-4c93-af35-837572b88d3d tempest-CreateVolumesFromSourceVolumeTest-931808651 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c715c666-c8c8-4ff3-9661-b92f596bda40) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 25 16:02:52 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-70eaca4e-e7c6-4c93-af35-837572b88d3d tempest-CreateVolumesFromSourceVolumeTest-931808651 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ad88aa4e-8c3d-4e81-9107-fd262c923aa0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 25 16:02:52 devstack cinder-volume[83528]: INFO cinder.volume.flows.manager.create_volume [None req-70eaca4e-e7c6-4c93-af35-837572b88d3d tempest-CreateVolumesFromSourceVolumeTest-931808651 None] Volume ccba4e52-9616-4165-a4b0-4fcf5a4fc1bf: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ccba4e52-9616-4165-a4b0-4fcf5a4fc1bf', 'volume_size': 1} Feb 25 16:02:52 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-70eaca4e-e7c6-4c93-af35-837572b88d3d tempest-CreateVolumesFromSourceVolumeTest-931808651 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 25 16:02:52 devstack cinder-volume[83528]: DEBUG cinder.volume.flows.manager.create_volume [None req-ceddda1e-e68a-40d4-a6e3-20c3aa8eaba3 tempest-CreateVolumesFromSourceVolumeTest-931808651 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83528) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 25 16:02:52 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-ceddda1e-e68a-40d4-a6e3-20c3aa8eaba3 tempest-CreateVolumesFromSourceVolumeTest-931808651 None] Flow 'volume_create_manager' (da437304-1d36-44c3-9128-34f7d97a96cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83528) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 25 16:02:52 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-ceddda1e-e68a-40d4-a6e3-20c3aa8eaba3 tempest-CreateVolumesFromSourceVolumeTest-931808651 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (29841a45-a596-409f-a7c8-93bb74060093) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 25 16:02:52 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-ceddda1e-e68a-40d4-a6e3-20c3aa8eaba3 tempest-CreateVolumesFromSourceVolumeTest-931808651 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (29841a45-a596-409f-a7c8-93bb74060093) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-25T15:02:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-665410033',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=196d00a8-7736-4c23-838f-4990d7a20a76,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fcf12f31e52c40859d85ba8f3aa4076b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-25T15:02:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-25T15:02:52Z,use_quota=True,user_id='ce4e44485cd646fc9c78daa6a071c681',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ce71c2f9-6543-4165-9653-a1529b2ea243),volume_type_id=ce71c2f9-6543-4165-9653-a1529b2ea243)' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 25 16:02:52 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-ceddda1e-e68a-40d4-a6e3-20c3aa8eaba3 tempest-CreateVolumesFromSourceVolumeTest-931808651 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3f4c706b-622a-40e0-b249-5f9eda1e5acc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 25 16:02:52 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-ceddda1e-e68a-40d4-a6e3-20c3aa8eaba3 tempest-CreateVolumesFromSourceVolumeTest-931808651 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3f4c706b-622a-40e0-b249-5f9eda1e5acc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 25 16:02:52 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-ceddda1e-e68a-40d4-a6e3-20c3aa8eaba3 tempest-CreateVolumesFromSourceVolumeTest-931808651 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4a0fe41e-696c-4358-a0ab-6673d60fdc50) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 25 16:02:52 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-ceddda1e-e68a-40d4-a6e3-20c3aa8eaba3 tempest-CreateVolumesFromSourceVolumeTest-931808651 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4a0fe41e-696c-4358-a0ab-6673d60fdc50) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '196d00a8-7736-4c23-838f-4990d7a20a76', 'volume_name': 'volume-196d00a8-7736-4c23-838f-4990d7a20a76', 'volume_size': 1}' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 25 16:02:52 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-ceddda1e-e68a-40d4-a6e3-20c3aa8eaba3 tempest-CreateVolumesFromSourceVolumeTest-931808651 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1476622b-e30a-4d82-8e83-e25954b8ce6d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 25 16:02:52 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-ceddda1e-e68a-40d4-a6e3-20c3aa8eaba3 tempest-CreateVolumesFromSourceVolumeTest-931808651 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1476622b-e30a-4d82-8e83-e25954b8ce6d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 25 16:02:52 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-ceddda1e-e68a-40d4-a6e3-20c3aa8eaba3 tempest-CreateVolumesFromSourceVolumeTest-931808651 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7ac8e784-ef71-411c-8f99-3678e63ef1f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 25 16:02:52 devstack cinder-volume[83528]: INFO cinder.volume.flows.manager.create_volume [None req-ceddda1e-e68a-40d4-a6e3-20c3aa8eaba3 tempest-CreateVolumesFromSourceVolumeTest-931808651 None] Volume 196d00a8-7736-4c23-838f-4990d7a20a76: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-196d00a8-7736-4c23-838f-4990d7a20a76', 'volume_size': 1} Feb 25 16:02:52 devstack sudo[91725]: pam_unix(sudo:session): session closed for user root Feb 25 16:02:52 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-ceddda1e-e68a-40d4-a6e3-20c3aa8eaba3 tempest-CreateVolumesFromSourceVolumeTest-931808651 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 25 16:02:52 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-ff7988b1-3292-40b5-aa39-7c0ddbf4a33c tempest-CreateVolumesFromSnapshotTest-1082910625 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-92131519-d016-4969-b0d0-1dbcde63abda" returned: 0 in 0.576s {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 25 16:02:52 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-ff7988b1-3292-40b5-aa39-7c0ddbf4a33c tempest-CreateVolumesFromSnapshotTest-1082910625 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-92131519-d016-4969-b0d0-1dbcde63abda {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 25 16:02:52 devstack sudo[91737]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-92131519-d016-4969-b0d0-1dbcde63abda Feb 25 16:02:52 devstack sudo[91737]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 25 16:02:52 devstack sudo[91729]: pam_unix(sudo:session): session closed for user root Feb 25 16:02:52 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-7b424e9b-ff8c-4cdc-9bf1-100c55130586 tempest-SnapshotDependencyTests-2073568565 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b4a78707-43cc-4a9c-b6f9-e2b8ca42cfdc -F qcow2 /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-b4a78707-43cc-4a9c-b6f9-e2b8ca42cfdc.b7612e5c-1617-4e2b-af75-173a562fa3a1" returned: 0 in 0.431s {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 25 16:02:52 devstack cinder-volume[83528]: WARNING cinder.volume.drivers.remotefs [None req-7b424e9b-ff8c-4cdc-9bf1-100c55130586 tempest-SnapshotDependencyTests-2073568565 None] /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-b4a78707-43cc-4a9c-b6f9-e2b8ca42cfdc.b7612e5c-1617-4e2b-af75-173a562fa3a1 is being set with open permissions: ugo+rw Feb 25 16:02:52 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-7b424e9b-ff8c-4cdc-9bf1-100c55130586 tempest-SnapshotDependencyTests-2073568565 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-b4a78707-43cc-4a9c-b6f9-e2b8ca42cfdc.b7612e5c-1617-4e2b-af75-173a562fa3a1 {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 25 16:02:52 devstack sudo[91739]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-b4a78707-43cc-4a9c-b6f9-e2b8ca42cfdc.b7612e5c-1617-4e2b-af75-173a562fa3a1 Feb 25 16:02:52 devstack sudo[91739]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 25 16:02:52 devstack cinder-volume[83528]: DEBUG cinder.volume.flows.manager.create_volume [None req-eb8705bf-831e-4bcd-940b-5716ee1e3b47 tempest-CreateVolumesFromSourceVolumeTest-931808651 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83528) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 25 16:02:52 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-eb8705bf-831e-4bcd-940b-5716ee1e3b47 tempest-CreateVolumesFromSourceVolumeTest-931808651 None] Flow 'volume_create_manager' (51e2c656-6864-4b96-98b9-f9423f96e969) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83528) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 25 16:02:52 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-eb8705bf-831e-4bcd-940b-5716ee1e3b47 tempest-CreateVolumesFromSourceVolumeTest-931808651 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4f0f256f-806f-4e91-ade0-aa284d850412) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 25 16:02:52 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-eb8705bf-831e-4bcd-940b-5716ee1e3b47 tempest-CreateVolumesFromSourceVolumeTest-931808651 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4f0f256f-806f-4e91-ade0-aa284d850412) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-25T15:02:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-368516767',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bf124820-f33f-4614-ba7a-f90023b30d5d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fcf12f31e52c40859d85ba8f3aa4076b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-25T15:02:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-25T15:02:52Z,use_quota=True,user_id='ce4e44485cd646fc9c78daa6a071c681',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ce71c2f9-6543-4165-9653-a1529b2ea243),volume_type_id=ce71c2f9-6543-4165-9653-a1529b2ea243)' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 25 16:02:52 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-eb8705bf-831e-4bcd-940b-5716ee1e3b47 tempest-CreateVolumesFromSourceVolumeTest-931808651 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6ffc4c8f-0185-4c5a-be1e-2978cbd725a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 25 16:02:52 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-eb8705bf-831e-4bcd-940b-5716ee1e3b47 tempest-CreateVolumesFromSourceVolumeTest-931808651 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6ffc4c8f-0185-4c5a-be1e-2978cbd725a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 25 16:02:52 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-eb8705bf-831e-4bcd-940b-5716ee1e3b47 tempest-CreateVolumesFromSourceVolumeTest-931808651 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9f24fc73-b347-42bc-b42b-083045ca267c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 25 16:02:52 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-eb8705bf-831e-4bcd-940b-5716ee1e3b47 tempest-CreateVolumesFromSourceVolumeTest-931808651 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9f24fc73-b347-42bc-b42b-083045ca267c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bf124820-f33f-4614-ba7a-f90023b30d5d', 'volume_name': 'volume-bf124820-f33f-4614-ba7a-f90023b30d5d', 'volume_size': 1}' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 25 16:02:52 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-eb8705bf-831e-4bcd-940b-5716ee1e3b47 tempest-CreateVolumesFromSourceVolumeTest-931808651 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0d75238b-6a04-409e-acb5-ce8550cc1522) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 25 16:02:52 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-eb8705bf-831e-4bcd-940b-5716ee1e3b47 tempest-CreateVolumesFromSourceVolumeTest-931808651 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0d75238b-6a04-409e-acb5-ce8550cc1522) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 25 16:02:52 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-eb8705bf-831e-4bcd-940b-5716ee1e3b47 tempest-CreateVolumesFromSourceVolumeTest-931808651 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b1ce9046-5524-49d7-9244-2f66b347ed9e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 25 16:02:52 devstack cinder-volume[83528]: INFO cinder.volume.flows.manager.create_volume [None req-eb8705bf-831e-4bcd-940b-5716ee1e3b47 tempest-CreateVolumesFromSourceVolumeTest-931808651 None] Volume bf124820-f33f-4614-ba7a-f90023b30d5d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bf124820-f33f-4614-ba7a-f90023b30d5d', 'volume_size': 1} Feb 25 16:02:52 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-eb8705bf-831e-4bcd-940b-5716ee1e3b47 tempest-CreateVolumesFromSourceVolumeTest-931808651 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 25 16:02:52 devstack sudo[91737]: pam_unix(sudo:session): session closed for user root Feb 25 16:02:52 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-ff7988b1-3292-40b5-aa39-7c0ddbf4a33c tempest-CreateVolumesFromSnapshotTest-1082910625 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-92131519-d016-4969-b0d0-1dbcde63abda" returned: 0 in 0.450s {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 25 16:02:52 devstack cinder-volume[83528]: DEBUG cinder.coordination [None req-ff7988b1-3292-40b5-aa39-7c0ddbf4a33c tempest-CreateVolumesFromSnapshotTest-1082910625 None] Lock "cinder-quobyte-92131519-d016-4969-b0d0-1dbcde63abda" released by "delete_volume" :: held 1.072s {{(pid=83528) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 25 16:02:52 devstack cinder-volume[83528]: DEBUG cinder.quota [None req-ff7988b1-3292-40b5-aa39-7c0ddbf4a33c tempest-CreateVolumesFromSnapshotTest-1082910625 None] Created reservations ['7695cb65-8482-4a0d-8085-146887aaa71c', 'c30e686e-fb40-4f3d-ad4c-67ba99f1b55a', 'b5b40fc4-5b68-4db2-9859-2901f4dc07b4', '286f0ab1-b678-43a9-ad4a-3e80b186b345'] {{(pid=83528) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 25 16:02:52 devstack sudo[91739]: pam_unix(sudo:session): session closed for user root Feb 25 16:02:52 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-7b424e9b-ff8c-4cdc-9bf1-100c55130586 tempest-SnapshotDependencyTests-2073568565 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-b4a78707-43cc-4a9c-b6f9-e2b8ca42cfdc.b7612e5c-1617-4e2b-af75-173a562fa3a1" returned: 0 in 0.474s {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 25 16:02:52 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-7b424e9b-ff8c-4cdc-9bf1-100c55130586 tempest-SnapshotDependencyTests-2073568565 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-b4a78707-43cc-4a9c-b6f9-e2b8ca42cfdc.info {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 25 16:02:52 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-ff7988b1-3292-40b5-aa39-7c0ddbf4a33c tempest-CreateVolumesFromSnapshotTest-1082910625 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 25 16:02:52 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-ff7988b1-3292-40b5-aa39-7c0ddbf4a33c tempest-CreateVolumesFromSnapshotTest-1082910625 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 25 16:02:52 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.quobyte [None req-ff7988b1-3292-40b5-aa39-7c0ddbf4a33c tempest-CreateVolumesFromSnapshotTest-1082910625 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23e9d725-3e04-4cd9-bfe0-c8ef43305589': None} {{(pid=83528) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 25 16:02:52 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.quobyte [None req-ff7988b1-3292-40b5-aa39-7c0ddbf4a33c tempest-CreateVolumesFromSnapshotTest-1082910625 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23e9d725-3e04-4cd9-bfe0-c8ef43305589'] {{(pid=83528) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 25 16:02:52 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-ff7988b1-3292-40b5-aa39-7c0ddbf4a33c tempest-CreateVolumesFromSnapshotTest-1082910625 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 25 16:02:52 devstack sudo[91743]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-b4a78707-43cc-4a9c-b6f9-e2b8ca42cfdc.info Feb 25 16:02:52 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-ff7988b1-3292-40b5-aa39-7c0ddbf4a33c tempest-CreateVolumesFromSnapshotTest-1082910625 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85 {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 25 16:02:52 devstack sudo[91743]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 25 16:02:52 devstack sudo[91745]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85 Feb 25 16:02:52 devstack sudo[91745]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 25 16:02:53 devstack sudo[91745]: pam_unix(sudo:session): session closed for user root Feb 25 16:02:53 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-ff7988b1-3292-40b5-aa39-7c0ddbf4a33c tempest-CreateVolumesFromSnapshotTest-1082910625 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85" returned: 0 in 0.384s {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 25 16:02:53 devstack cinder-volume[83528]: DEBUG cinder.manager [None req-ff7988b1-3292-40b5-aa39-7c0ddbf4a33c tempest-CreateVolumesFromSnapshotTest-1082910625 None] Notifying Schedulers of capabilities ... {{(pid=83528) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 25 16:02:53 devstack cinder-volume[83528]: INFO cinder.volume.manager [None req-ff7988b1-3292-40b5-aa39-7c0ddbf4a33c tempest-CreateVolumesFromSnapshotTest-1082910625 None] Deleted volume successfully. Feb 25 16:02:53 devstack sudo[91743]: pam_unix(sudo:session): session closed for user root Feb 25 16:02:53 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-7b424e9b-ff8c-4cdc-9bf1-100c55130586 tempest-SnapshotDependencyTests-2073568565 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-b4a78707-43cc-4a9c-b6f9-e2b8ca42cfdc.info" returned: 0 in 0.414s {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 25 16:02:53 devstack cinder-volume[83528]: WARNING cinder.volume.drivers.remotefs [None req-7b424e9b-ff8c-4cdc-9bf1-100c55130586 tempest-SnapshotDependencyTests-2073568565 None] /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-b4a78707-43cc-4a9c-b6f9-e2b8ca42cfdc.info is being set with open permissions: ugo+rw Feb 25 16:02:53 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-7b424e9b-ff8c-4cdc-9bf1-100c55130586 tempest-SnapshotDependencyTests-2073568565 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-b4a78707-43cc-4a9c-b6f9-e2b8ca42cfdc.info {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 25 16:02:53 devstack cinder-volume[83528]: DEBUG cinder.coordination [None req-ff7988b1-3292-40b5-aa39-7c0ddbf4a33c tempest-CreateVolumesFromSnapshotTest-1082910625 None] Lock "cinder-92131519-d016-4969-b0d0-1dbcde63abda-delete_volume" released by "delete_volume" :: held 1.604s {{(pid=83528) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 25 16:02:53 devstack sudo[91749]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-b4a78707-43cc-4a9c-b6f9-e2b8ca42cfdc.info Feb 25 16:02:53 devstack sudo[91749]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 25 16:02:53 devstack sudo[91749]: pam_unix(sudo:session): session closed for user root Feb 25 16:02:53 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-7b424e9b-ff8c-4cdc-9bf1-100c55130586 tempest-SnapshotDependencyTests-2073568565 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-b4a78707-43cc-4a9c-b6f9-e2b8ca42cfdc.info" returned: 0 in 0.389s {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 25 16:02:53 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-7b424e9b-ff8c-4cdc-9bf1-100c55130586 tempest-SnapshotDependencyTests-2073568565 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.806s {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 25 16:02:53 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-b5cff6aa-118c-4e43-81d9-ab9a667dcabd tempest-VolumeDependencyTests-18272511 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.250s {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 25 16:02:53 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.quobyte [None req-b5cff6aa-118c-4e43-81d9-ab9a667dcabd tempest-VolumeDependencyTests-18272511 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-25T15:02:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-2047485970',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=289e9ac3-09e6-4612-b623-d0bd566a16c4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a8840d2cf3ed4cbead7a7125ba5ed6db',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-25T15:02:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-25T15:02:50Z,use_quota=True,user_id='80a29926db28406da11a76818f583959',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ce71c2f9-6543-4165-9653-a1529b2ea243),volume_type_id=ce71c2f9-6543-4165-9653-a1529b2ea243)}" {{(pid=83528) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 25 16:02:53 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.remotefs [None req-b5cff6aa-118c-4e43-81d9-ab9a667dcabd tempest-VolumeDependencyTests-18272511 None] Creating volume 289e9ac3-09e6-4612-b623-d0bd566a16c4 {{(pid=83528) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 25 16:02:53 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-b5cff6aa-118c-4e43-81d9-ab9a667dcabd tempest-VolumeDependencyTests-18272511 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 25 16:02:53 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-b5cff6aa-118c-4e43-81d9-ab9a667dcabd tempest-VolumeDependencyTests-18272511 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 25 16:02:53 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.quobyte [None req-b5cff6aa-118c-4e43-81d9-ab9a667dcabd tempest-VolumeDependencyTests-18272511 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23e9d725-3e04-4cd9-bfe0-c8ef43305589': None} {{(pid=83528) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 25 16:02:53 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.quobyte [None req-b5cff6aa-118c-4e43-81d9-ab9a667dcabd tempest-VolumeDependencyTests-18272511 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23e9d725-3e04-4cd9-bfe0-c8ef43305589'] {{(pid=83528) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 25 16:02:53 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-b5cff6aa-118c-4e43-81d9-ab9a667dcabd tempest-VolumeDependencyTests-18272511 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 25 16:02:53 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.quobyte [None req-b5cff6aa-118c-4e43-81d9-ab9a667dcabd tempest-VolumeDependencyTests-18272511 None] Selected osci02.corp.quobyte.com/cinder-vol-23e9d725-3e04-4cd9-bfe0-c8ef43305589 as target Quobyte volume. {{(pid=83528) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 25 16:02:53 devstack cinder-volume[83528]: INFO cinder.volume.drivers.remotefs [None req-b5cff6aa-118c-4e43-81d9-ab9a667dcabd tempest-VolumeDependencyTests-18272511 None] casted to osci02.corp.quobyte.com/cinder-vol-23e9d725-3e04-4cd9-bfe0-c8ef43305589 Feb 25 16:02:53 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-b5cff6aa-118c-4e43-81d9-ab9a667dcabd tempest-VolumeDependencyTests-18272511 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-289e9ac3-09e6-4612-b623-d0bd566a16c4 1073741824 {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 25 16:02:53 devstack sudo[91752]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-289e9ac3-09e6-4612-b623-d0bd566a16c4 1073741824 Feb 25 16:02:53 devstack sudo[91752]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 25 16:02:53 devstack cinder-volume[83528]: INFO cinder.volume.manager [None req-7b424e9b-ff8c-4cdc-9bf1-100c55130586 tempest-SnapshotDependencyTests-2073568565 None] Create snapshot completed successfully Feb 25 16:02:53 devstack cinder-volume[83528]: DEBUG cinder.coordination [None req-5658d731-dd16-4262-8c50-3f7a1f2f72e1 tempest-CreateVolumesFromSnapshotTest-1082910625 None] Acquiring lock "cinder-b9fd0823-d4fe-4556-a10e-236a5baed233-delete_volume" by "delete_volume" {{(pid=83528) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 25 16:02:53 devstack cinder-volume[83528]: DEBUG cinder.coordination [None req-5658d731-dd16-4262-8c50-3f7a1f2f72e1 tempest-CreateVolumesFromSnapshotTest-1082910625 None] Lock "cinder-b9fd0823-d4fe-4556-a10e-236a5baed233-delete_volume" acquired by "delete_volume" :: waited 0.009s {{(pid=83528) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 25 16:02:53 devstack cinder-volume[83528]: DEBUG cinder.coordination [None req-5658d731-dd16-4262-8c50-3f7a1f2f72e1 tempest-CreateVolumesFromSnapshotTest-1082910625 None] Acquiring lock "cinder-quobyte-b9fd0823-d4fe-4556-a10e-236a5baed233" by "delete_volume" {{(pid=83528) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 25 16:02:53 devstack cinder-volume[83528]: DEBUG cinder.coordination [None req-5658d731-dd16-4262-8c50-3f7a1f2f72e1 tempest-CreateVolumesFromSnapshotTest-1082910625 None] Lock "cinder-quobyte-b9fd0823-d4fe-4556-a10e-236a5baed233" acquired by "delete_volume" :: waited 0.020s {{(pid=83528) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 25 16:02:53 devstack cinder-volume[83528]: DEBUG oslo.privsep.daemon [-] privsep: reply[9cde9952-e313-4db1-8ac7-9d59402f8d2d]: (4, 'qcow2') {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 25 16:02:53 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-5658d731-dd16-4262-8c50-3f7a1f2f72e1 tempest-CreateVolumesFromSnapshotTest-1082910625 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-b9fd0823-d4fe-4556-a10e-236a5baed233 {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 25 16:02:53 devstack sudo[91754]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-b9fd0823-d4fe-4556-a10e-236a5baed233 Feb 25 16:02:53 devstack sudo[91754]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 25 16:02:54 devstack sudo[91752]: pam_unix(sudo:session): session closed for user root Feb 25 16:02:54 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-b5cff6aa-118c-4e43-81d9-ab9a667dcabd tempest-VolumeDependencyTests-18272511 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-289e9ac3-09e6-4612-b623-d0bd566a16c4 1073741824" returned: 0 in 0.499s {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 25 16:02:54 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-b5cff6aa-118c-4e43-81d9-ab9a667dcabd tempest-VolumeDependencyTests-18272511 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-289e9ac3-09e6-4612-b623-d0bd566a16c4 {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 25 16:02:54 devstack sudo[91759]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-289e9ac3-09e6-4612-b623-d0bd566a16c4 Feb 25 16:02:54 devstack sudo[91759]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 25 16:02:54 devstack sudo[91754]: pam_unix(sudo:session): session closed for user root Feb 25 16:02:54 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-5658d731-dd16-4262-8c50-3f7a1f2f72e1 tempest-CreateVolumesFromSnapshotTest-1082910625 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-b9fd0823-d4fe-4556-a10e-236a5baed233" returned: 0 in 0.614s {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 25 16:02:54 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-5658d731-dd16-4262-8c50-3f7a1f2f72e1 tempest-CreateVolumesFromSnapshotTest-1082910625 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-b9fd0823-d4fe-4556-a10e-236a5baed233 {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 25 16:02:54 devstack sudo[91765]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-b9fd0823-d4fe-4556-a10e-236a5baed233 Feb 25 16:02:54 devstack sudo[91765]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 25 16:02:54 devstack cinder-volume[83528]: DEBUG cinder.volume.flows.manager.create_volume [None req-4887e50d-e8ae-47d6-a0d6-ed4234a4a206 tempest-SnapshotDependencyTests-2073568565 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83528) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 25 16:02:54 devstack sudo[91759]: pam_unix(sudo:session): session closed for user root Feb 25 16:02:54 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-b5cff6aa-118c-4e43-81d9-ab9a667dcabd tempest-VolumeDependencyTests-18272511 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-289e9ac3-09e6-4612-b623-d0bd566a16c4" returned: 0 in 0.445s {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 25 16:02:54 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.quobyte [None req-b5cff6aa-118c-4e43-81d9-ab9a667dcabd tempest-VolumeDependencyTests-18272511 None] <== create_volume: return (969ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-23e9d725-3e04-4cd9-bfe0-c8ef43305589'} {{(pid=83528) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 25 16:02:54 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-b5cff6aa-118c-4e43-81d9-ab9a667dcabd tempest-VolumeDependencyTests-18272511 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.972s {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 25 16:02:54 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-4887e50d-e8ae-47d6-a0d6-ed4234a4a206 tempest-SnapshotDependencyTests-2073568565 None] Flow 'volume_create_manager' (0711e4bc-8b0d-4bb6-a94a-51b00c1881b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83528) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 25 16:02:54 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-4887e50d-e8ae-47d6-a0d6-ed4234a4a206 tempest-SnapshotDependencyTests-2073568565 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (11ee0169-3c52-4830-b783-0c0563e912d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 25 16:02:54 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-5a20a34b-01fe-438f-b6e5-9edd5036a8f8 tempest-CreateVolumesFromSourceVolumeTest-931808651 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.025s {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 25 16:02:54 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.quobyte [None req-5a20a34b-01fe-438f-b6e5-9edd5036a8f8 tempest-CreateVolumesFromSourceVolumeTest-931808651 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-25T15:02:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-317692144',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=00f749da-8e33-4f4a-aab4-f2f1c17f6d41,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fcf12f31e52c40859d85ba8f3aa4076b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-25T15:02:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-25T15:02:52Z,use_quota=True,user_id='ce4e44485cd646fc9c78daa6a071c681',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ce71c2f9-6543-4165-9653-a1529b2ea243),volume_type_id=ce71c2f9-6543-4165-9653-a1529b2ea243)}" {{(pid=83528) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 25 16:02:54 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.remotefs [None req-5a20a34b-01fe-438f-b6e5-9edd5036a8f8 tempest-CreateVolumesFromSourceVolumeTest-931808651 None] Creating volume 00f749da-8e33-4f4a-aab4-f2f1c17f6d41 {{(pid=83528) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 25 16:02:54 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-5a20a34b-01fe-438f-b6e5-9edd5036a8f8 tempest-CreateVolumesFromSourceVolumeTest-931808651 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 25 16:02:54 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-5a20a34b-01fe-438f-b6e5-9edd5036a8f8 tempest-CreateVolumesFromSourceVolumeTest-931808651 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 25 16:02:54 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.quobyte [None req-5a20a34b-01fe-438f-b6e5-9edd5036a8f8 tempest-CreateVolumesFromSourceVolumeTest-931808651 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23e9d725-3e04-4cd9-bfe0-c8ef43305589': None} {{(pid=83528) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 25 16:02:54 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.quobyte [None req-5a20a34b-01fe-438f-b6e5-9edd5036a8f8 tempest-CreateVolumesFromSourceVolumeTest-931808651 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23e9d725-3e04-4cd9-bfe0-c8ef43305589'] {{(pid=83528) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 25 16:02:54 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-5a20a34b-01fe-438f-b6e5-9edd5036a8f8 tempest-CreateVolumesFromSourceVolumeTest-931808651 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 25 16:02:54 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.quobyte [None req-5a20a34b-01fe-438f-b6e5-9edd5036a8f8 tempest-CreateVolumesFromSourceVolumeTest-931808651 None] Selected osci02.corp.quobyte.com/cinder-vol-23e9d725-3e04-4cd9-bfe0-c8ef43305589 as target Quobyte volume. {{(pid=83528) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 25 16:02:54 devstack cinder-volume[83528]: INFO cinder.volume.drivers.remotefs [None req-5a20a34b-01fe-438f-b6e5-9edd5036a8f8 tempest-CreateVolumesFromSourceVolumeTest-931808651 None] casted to osci02.corp.quobyte.com/cinder-vol-23e9d725-3e04-4cd9-bfe0-c8ef43305589 Feb 25 16:02:54 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-5a20a34b-01fe-438f-b6e5-9edd5036a8f8 tempest-CreateVolumesFromSourceVolumeTest-931808651 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-00f749da-8e33-4f4a-aab4-f2f1c17f6d41 1073741824 {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 25 16:02:54 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-b5cff6aa-118c-4e43-81d9-ab9a667dcabd tempest-VolumeDependencyTests-18272511 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5a1a7df6-0900-472e-8875-14d41286dd04) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-289e9ac3-09e6-4612-b623-d0bd566a16c4', 'volume_size': 1}' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 25 16:02:54 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-b5cff6aa-118c-4e43-81d9-ab9a667dcabd tempest-VolumeDependencyTests-18272511 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9bdae4ea-1073-4cec-ab87-0bd8ee629127) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 25 16:02:54 devstack sudo[91767]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-00f749da-8e33-4f4a-aab4-f2f1c17f6d41 1073741824 Feb 25 16:02:54 devstack sudo[91767]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 25 16:02:54 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-4887e50d-e8ae-47d6-a0d6-ed4234a4a206 tempest-SnapshotDependencyTests-2073568565 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (11ee0169-3c52-4830-b783-0c0563e912d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-25T15:02:54Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a69c2263-b13b-4112-bf20-5c4e5f5577fc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2159f924ae4341cb8b84ebb667bb254e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-25T15:02:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=b7612e5c-1617-4e2b-af75-173a562fa3a1,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-25T15:02:55Z,use_quota=True,user_id='2efbdffb69d64dcb93e4f254c8140fbf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ce71c2f9-6543-4165-9653-a1529b2ea243),volume_type_id=ce71c2f9-6543-4165-9653-a1529b2ea243)' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 25 16:02:54 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-4887e50d-e8ae-47d6-a0d6-ed4234a4a206 tempest-SnapshotDependencyTests-2073568565 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ff8c3604-0249-491a-9e9b-b58c97573b45) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 25 16:02:54 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-4887e50d-e8ae-47d6-a0d6-ed4234a4a206 tempest-SnapshotDependencyTests-2073568565 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ff8c3604-0249-491a-9e9b-b58c97573b45) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 25 16:02:54 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-4887e50d-e8ae-47d6-a0d6-ed4234a4a206 tempest-SnapshotDependencyTests-2073568565 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (06f9b3cc-fd5b-4edd-8549-4b0ed6ab2065) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 25 16:02:54 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-4887e50d-e8ae-47d6-a0d6-ed4234a4a206 tempest-SnapshotDependencyTests-2073568565 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (06f9b3cc-fd5b-4edd-8549-4b0ed6ab2065) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'a69c2263-b13b-4112-bf20-5c4e5f5577fc', 'volume_name': 'volume-a69c2263-b13b-4112-bf20-5c4e5f5577fc', 'volume_size': 1, 'snapshot_id': 'b7612e5c-1617-4e2b-af75-173a562fa3a1'}' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 25 16:02:54 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-4887e50d-e8ae-47d6-a0d6-ed4234a4a206 tempest-SnapshotDependencyTests-2073568565 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8d833c3c-ae9c-4fe9-b7fc-c16cd2d738ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 25 16:02:54 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-4887e50d-e8ae-47d6-a0d6-ed4234a4a206 tempest-SnapshotDependencyTests-2073568565 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8d833c3c-ae9c-4fe9-b7fc-c16cd2d738ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 25 16:02:54 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-4887e50d-e8ae-47d6-a0d6-ed4234a4a206 tempest-SnapshotDependencyTests-2073568565 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (34e74eac-8b7e-417a-8fbc-4b7b61a4a36e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 25 16:02:54 devstack cinder-volume[83528]: INFO cinder.volume.flows.manager.create_volume [None req-4887e50d-e8ae-47d6-a0d6-ed4234a4a206 tempest-SnapshotDependencyTests-2073568565 None] Volume a69c2263-b13b-4112-bf20-5c4e5f5577fc: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-a69c2263-b13b-4112-bf20-5c4e5f5577fc', 'volume_size': 1, 'snapshot_id': 'b7612e5c-1617-4e2b-af75-173a562fa3a1'} Feb 25 16:02:54 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-4887e50d-e8ae-47d6-a0d6-ed4234a4a206 tempest-SnapshotDependencyTests-2073568565 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 25 16:02:54 devstack cinder-volume[83528]: INFO cinder.volume.flows.manager.create_volume [None req-b5cff6aa-118c-4e43-81d9-ab9a667dcabd tempest-VolumeDependencyTests-18272511 None] Volume volume-289e9ac3-09e6-4612-b623-d0bd566a16c4 (289e9ac3-09e6-4612-b623-d0bd566a16c4): created successfully Feb 25 16:02:54 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-b5cff6aa-118c-4e43-81d9-ab9a667dcabd tempest-VolumeDependencyTests-18272511 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9bdae4ea-1073-4cec-ab87-0bd8ee629127) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 25 16:02:54 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-b5cff6aa-118c-4e43-81d9-ab9a667dcabd tempest-VolumeDependencyTests-18272511 None] Flow 'volume_create_manager' (34a95c13-076f-4366-8dd3-0a1ba0b07b24) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83528) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 25 16:02:54 devstack cinder-volume[83528]: INFO cinder.volume.manager [None req-b5cff6aa-118c-4e43-81d9-ab9a667dcabd tempest-VolumeDependencyTests-18272511 None] Created volume successfully. Feb 25 16:02:54 devstack sudo[91765]: pam_unix(sudo:session): session closed for user root Feb 25 16:02:54 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-5658d731-dd16-4262-8c50-3f7a1f2f72e1 tempest-CreateVolumesFromSnapshotTest-1082910625 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-b9fd0823-d4fe-4556-a10e-236a5baed233" returned: 0 in 0.467s {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 25 16:02:54 devstack cinder-volume[83528]: DEBUG cinder.coordination [None req-5658d731-dd16-4262-8c50-3f7a1f2f72e1 tempest-CreateVolumesFromSnapshotTest-1082910625 None] Lock "cinder-quobyte-b9fd0823-d4fe-4556-a10e-236a5baed233" released by "delete_volume" :: held 1.101s {{(pid=83528) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 25 16:02:55 devstack cinder-volume[83528]: DEBUG cinder.quota [None req-5658d731-dd16-4262-8c50-3f7a1f2f72e1 tempest-CreateVolumesFromSnapshotTest-1082910625 None] Created reservations ['d1242521-c5c5-4856-8d8a-08e7c4f62a0a', 'd60977bb-5f3b-4c01-a267-d2210cc79716', '8848f515-4177-4ef5-b6ae-eef743f8e175', '926aa2ec-30eb-4e44-981d-f80496e78bf1'] {{(pid=83528) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 25 16:02:55 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-5658d731-dd16-4262-8c50-3f7a1f2f72e1 tempest-CreateVolumesFromSnapshotTest-1082910625 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 25 16:02:55 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-5658d731-dd16-4262-8c50-3f7a1f2f72e1 tempest-CreateVolumesFromSnapshotTest-1082910625 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 25 16:02:55 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.quobyte [None req-5658d731-dd16-4262-8c50-3f7a1f2f72e1 tempest-CreateVolumesFromSnapshotTest-1082910625 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23e9d725-3e04-4cd9-bfe0-c8ef43305589': None} {{(pid=83528) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 25 16:02:55 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.quobyte [None req-5658d731-dd16-4262-8c50-3f7a1f2f72e1 tempest-CreateVolumesFromSnapshotTest-1082910625 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23e9d725-3e04-4cd9-bfe0-c8ef43305589'] {{(pid=83528) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 25 16:02:55 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-5658d731-dd16-4262-8c50-3f7a1f2f72e1 tempest-CreateVolumesFromSnapshotTest-1082910625 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 25 16:02:55 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-5658d731-dd16-4262-8c50-3f7a1f2f72e1 tempest-CreateVolumesFromSnapshotTest-1082910625 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85 {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 25 16:02:55 devstack sudo[91774]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85 Feb 25 16:02:55 devstack sudo[91774]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 25 16:02:55 devstack sudo[91767]: pam_unix(sudo:session): session closed for user root Feb 25 16:02:55 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-5a20a34b-01fe-438f-b6e5-9edd5036a8f8 tempest-CreateVolumesFromSourceVolumeTest-931808651 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-00f749da-8e33-4f4a-aab4-f2f1c17f6d41 1073741824" returned: 0 in 0.514s {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 25 16:02:55 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-5a20a34b-01fe-438f-b6e5-9edd5036a8f8 tempest-CreateVolumesFromSourceVolumeTest-931808651 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-00f749da-8e33-4f4a-aab4-f2f1c17f6d41 {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 25 16:02:55 devstack sudo[91776]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-00f749da-8e33-4f4a-aab4-f2f1c17f6d41 Feb 25 16:02:55 devstack sudo[91776]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 25 16:02:55 devstack sudo[91774]: pam_unix(sudo:session): session closed for user root Feb 25 16:02:55 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-5658d731-dd16-4262-8c50-3f7a1f2f72e1 tempest-CreateVolumesFromSnapshotTest-1082910625 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85" returned: 0 in 0.386s {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 25 16:02:55 devstack cinder-volume[83528]: DEBUG cinder.manager [None req-5658d731-dd16-4262-8c50-3f7a1f2f72e1 tempest-CreateVolumesFromSnapshotTest-1082910625 None] Notifying Schedulers of capabilities ... {{(pid=83528) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 25 16:02:55 devstack cinder-volume[83528]: INFO cinder.volume.manager [None req-5658d731-dd16-4262-8c50-3f7a1f2f72e1 tempest-CreateVolumesFromSnapshotTest-1082910625 None] Deleted volume successfully. Feb 25 16:02:55 devstack cinder-volume[83528]: DEBUG cinder.coordination [None req-5658d731-dd16-4262-8c50-3f7a1f2f72e1 tempest-CreateVolumesFromSnapshotTest-1082910625 None] Lock "cinder-b9fd0823-d4fe-4556-a10e-236a5baed233-delete_volume" released by "delete_volume" :: held 1.616s {{(pid=83528) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 25 16:02:55 devstack sudo[91776]: pam_unix(sudo:session): session closed for user root Feb 25 16:02:55 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-5a20a34b-01fe-438f-b6e5-9edd5036a8f8 tempest-CreateVolumesFromSourceVolumeTest-931808651 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-00f749da-8e33-4f4a-aab4-f2f1c17f6d41" returned: 0 in 0.415s {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 25 16:02:55 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.quobyte [None req-5a20a34b-01fe-438f-b6e5-9edd5036a8f8 tempest-CreateVolumesFromSourceVolumeTest-931808651 None] <== create_volume: return (953ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-23e9d725-3e04-4cd9-bfe0-c8ef43305589'} {{(pid=83528) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 25 16:02:55 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-5a20a34b-01fe-438f-b6e5-9edd5036a8f8 tempest-CreateVolumesFromSourceVolumeTest-931808651 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.957s {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 25 16:02:55 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-dc9793d2-a9e7-4926-93ff-ce56a753cb6d tempest-CreateVolumesFromSourceVolumeTest-931808651 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.721s {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 25 16:02:55 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.quobyte [None req-dc9793d2-a9e7-4926-93ff-ce56a753cb6d tempest-CreateVolumesFromSourceVolumeTest-931808651 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-25T15:02:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1941950104',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c1e1de1e-613e-42ad-8f13-f8bceaf705d9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fcf12f31e52c40859d85ba8f3aa4076b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-25T15:02:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-25T15:02:52Z,use_quota=True,user_id='ce4e44485cd646fc9c78daa6a071c681',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ce71c2f9-6543-4165-9653-a1529b2ea243),volume_type_id=ce71c2f9-6543-4165-9653-a1529b2ea243)}" {{(pid=83528) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 25 16:02:55 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.remotefs [None req-dc9793d2-a9e7-4926-93ff-ce56a753cb6d tempest-CreateVolumesFromSourceVolumeTest-931808651 None] Creating volume c1e1de1e-613e-42ad-8f13-f8bceaf705d9 {{(pid=83528) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 25 16:02:55 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-dc9793d2-a9e7-4926-93ff-ce56a753cb6d tempest-CreateVolumesFromSourceVolumeTest-931808651 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 25 16:02:55 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-dc9793d2-a9e7-4926-93ff-ce56a753cb6d tempest-CreateVolumesFromSourceVolumeTest-931808651 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 25 16:02:55 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.quobyte [None req-dc9793d2-a9e7-4926-93ff-ce56a753cb6d tempest-CreateVolumesFromSourceVolumeTest-931808651 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23e9d725-3e04-4cd9-bfe0-c8ef43305589': None} {{(pid=83528) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 25 16:02:55 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.quobyte [None req-dc9793d2-a9e7-4926-93ff-ce56a753cb6d tempest-CreateVolumesFromSourceVolumeTest-931808651 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23e9d725-3e04-4cd9-bfe0-c8ef43305589'] {{(pid=83528) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 25 16:02:55 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-dc9793d2-a9e7-4926-93ff-ce56a753cb6d tempest-CreateVolumesFromSourceVolumeTest-931808651 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 25 16:02:55 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.quobyte [None req-dc9793d2-a9e7-4926-93ff-ce56a753cb6d tempest-CreateVolumesFromSourceVolumeTest-931808651 None] Selected osci02.corp.quobyte.com/cinder-vol-23e9d725-3e04-4cd9-bfe0-c8ef43305589 as target Quobyte volume. {{(pid=83528) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 25 16:02:55 devstack cinder-volume[83528]: INFO cinder.volume.drivers.remotefs [None req-dc9793d2-a9e7-4926-93ff-ce56a753cb6d tempest-CreateVolumesFromSourceVolumeTest-931808651 None] casted to osci02.corp.quobyte.com/cinder-vol-23e9d725-3e04-4cd9-bfe0-c8ef43305589 Feb 25 16:02:55 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-dc9793d2-a9e7-4926-93ff-ce56a753cb6d tempest-CreateVolumesFromSourceVolumeTest-931808651 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-c1e1de1e-613e-42ad-8f13-f8bceaf705d9 1073741824 {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 25 16:02:55 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-5a20a34b-01fe-438f-b6e5-9edd5036a8f8 tempest-CreateVolumesFromSourceVolumeTest-931808651 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7ff214cc-ab0b-4adc-9b19-6bd2abc5dfb8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-00f749da-8e33-4f4a-aab4-f2f1c17f6d41', 'volume_size': 1}' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 25 16:02:55 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-5a20a34b-01fe-438f-b6e5-9edd5036a8f8 tempest-CreateVolumesFromSourceVolumeTest-931808651 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1d7a287d-3c8d-4a3b-aa22-43324d4c53d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 25 16:02:55 devstack sudo[91780]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-c1e1de1e-613e-42ad-8f13-f8bceaf705d9 1073741824 Feb 25 16:02:55 devstack sudo[91780]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 25 16:02:55 devstack cinder-volume[83528]: INFO cinder.volume.flows.manager.create_volume [None req-5a20a34b-01fe-438f-b6e5-9edd5036a8f8 tempest-CreateVolumesFromSourceVolumeTest-931808651 None] Volume volume-00f749da-8e33-4f4a-aab4-f2f1c17f6d41 (00f749da-8e33-4f4a-aab4-f2f1c17f6d41): created successfully Feb 25 16:02:55 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-5a20a34b-01fe-438f-b6e5-9edd5036a8f8 tempest-CreateVolumesFromSourceVolumeTest-931808651 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1d7a287d-3c8d-4a3b-aa22-43324d4c53d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 25 16:02:55 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-5a20a34b-01fe-438f-b6e5-9edd5036a8f8 tempest-CreateVolumesFromSourceVolumeTest-931808651 None] Flow 'volume_create_manager' (4548b435-3ca7-4b63-b9ae-7ae7ad4a9f0e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83528) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 25 16:02:55 devstack cinder-volume[83528]: INFO cinder.volume.manager [None req-5a20a34b-01fe-438f-b6e5-9edd5036a8f8 tempest-CreateVolumesFromSourceVolumeTest-931808651 None] Created volume successfully. Feb 25 16:02:55 devstack cinder-volume[83528]: DEBUG cinder.volume.flows.manager.create_volume [None req-3f2c0c51-15e5-47c2-9096-652c2a74e086 tempest-VolumeDependencyTests-18272511 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83528) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 25 16:02:55 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-3f2c0c51-15e5-47c2-9096-652c2a74e086 tempest-VolumeDependencyTests-18272511 None] Flow 'volume_create_manager' (228f87ed-84bc-4e28-a625-35dfe46399c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83528) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 25 16:02:55 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-3f2c0c51-15e5-47c2-9096-652c2a74e086 tempest-VolumeDependencyTests-18272511 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2ecf606f-e431-47eb-9961-54ec639476a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 25 16:02:55 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-3f2c0c51-15e5-47c2-9096-652c2a74e086 tempest-VolumeDependencyTests-18272511 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2ecf606f-e431-47eb-9961-54ec639476a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-25T15:02:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1568460499',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=703af21c-fa8f-4628-a245-be5618097128,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a8840d2cf3ed4cbead7a7125ba5ed6db',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-25T15:02:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=289e9ac3-09e6-4612-b623-d0bd566a16c4,status='creating',terminated_at=None,updated_at=2026-02-25T15:02:56Z,use_quota=True,user_id='80a29926db28406da11a76818f583959',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ce71c2f9-6543-4165-9653-a1529b2ea243),volume_type_id=ce71c2f9-6543-4165-9653-a1529b2ea243)' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 25 16:02:55 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-3f2c0c51-15e5-47c2-9096-652c2a74e086 tempest-VolumeDependencyTests-18272511 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b8f5d4c4-d27c-470c-a121-e22a3967de88) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 25 16:02:55 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-3f2c0c51-15e5-47c2-9096-652c2a74e086 tempest-VolumeDependencyTests-18272511 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b8f5d4c4-d27c-470c-a121-e22a3967de88) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 25 16:02:56 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-3f2c0c51-15e5-47c2-9096-652c2a74e086 tempest-VolumeDependencyTests-18272511 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c453bf4b-5c9e-40f9-9853-8f905d57105b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 25 16:02:56 devstack cinder-volume[83528]: DEBUG cinder.coordination [None req-e30a68d5-bc47-4e50-b421-1a29e1c66819 tempest-CreateVolumesFromSnapshotTest-1082910625 None] Acquiring lock "cinder-dc4218d7-b90b-4062-9d9f-c3a0ece20987-delete_volume" by "delete_volume" {{(pid=83528) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 25 16:02:56 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-3f2c0c51-15e5-47c2-9096-652c2a74e086 tempest-VolumeDependencyTests-18272511 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c453bf4b-5c9e-40f9-9853-8f905d57105b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': '703af21c-fa8f-4628-a245-be5618097128', 'volume_name': 'volume-703af21c-fa8f-4628-a245-be5618097128', 'volume_size': 1, 'source_volid': '289e9ac3-09e6-4612-b623-d0bd566a16c4', 'source_volstatus': 'available'}' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 25 16:02:56 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-3f2c0c51-15e5-47c2-9096-652c2a74e086 tempest-VolumeDependencyTests-18272511 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a3863fb8-237c-48c3-96fe-d698dec1d0e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 25 16:02:56 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-3f2c0c51-15e5-47c2-9096-652c2a74e086 tempest-VolumeDependencyTests-18272511 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a3863fb8-237c-48c3-96fe-d698dec1d0e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 25 16:02:56 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-3f2c0c51-15e5-47c2-9096-652c2a74e086 tempest-VolumeDependencyTests-18272511 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (caed2781-d1be-447b-8017-1f981d4a26b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 25 16:02:56 devstack cinder-volume[83528]: INFO cinder.volume.flows.manager.create_volume [None req-3f2c0c51-15e5-47c2-9096-652c2a74e086 tempest-VolumeDependencyTests-18272511 None] Volume 703af21c-fa8f-4628-a245-be5618097128: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-703af21c-fa8f-4628-a245-be5618097128', 'volume_size': 1, 'source_volid': '289e9ac3-09e6-4612-b623-d0bd566a16c4', 'source_volstatus': 'available'} Feb 25 16:02:56 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-3f2c0c51-15e5-47c2-9096-652c2a74e086 tempest-VolumeDependencyTests-18272511 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 25 16:02:56 devstack cinder-volume[83528]: DEBUG cinder.coordination [None req-e30a68d5-bc47-4e50-b421-1a29e1c66819 tempest-CreateVolumesFromSnapshotTest-1082910625 None] Lock "cinder-dc4218d7-b90b-4062-9d9f-c3a0ece20987-delete_volume" acquired by "delete_volume" :: waited 0.050s {{(pid=83528) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 25 16:02:56 devstack cinder-volume[83528]: DEBUG cinder.coordination [None req-e30a68d5-bc47-4e50-b421-1a29e1c66819 tempest-CreateVolumesFromSnapshotTest-1082910625 None] Acquiring lock "cinder-quobyte-dc4218d7-b90b-4062-9d9f-c3a0ece20987" by "delete_volume" {{(pid=83528) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 25 16:02:56 devstack cinder-volume[83528]: DEBUG cinder.coordination [None req-e30a68d5-bc47-4e50-b421-1a29e1c66819 tempest-CreateVolumesFromSnapshotTest-1082910625 None] Lock "cinder-quobyte-dc4218d7-b90b-4062-9d9f-c3a0ece20987" acquired by "delete_volume" :: waited 0.012s {{(pid=83528) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 25 16:02:56 devstack cinder-volume[83528]: DEBUG oslo.privsep.daemon [-] privsep: reply[97dd2677-1219-4744-be99-6c571f3f24ea]: (4, 'qcow2') {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 25 16:02:56 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-e30a68d5-bc47-4e50-b421-1a29e1c66819 tempest-CreateVolumesFromSnapshotTest-1082910625 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-dc4218d7-b90b-4062-9d9f-c3a0ece20987 {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 25 16:02:56 devstack sudo[91780]: pam_unix(sudo:session): session closed for user root Feb 25 16:02:56 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-dc9793d2-a9e7-4926-93ff-ce56a753cb6d tempest-CreateVolumesFromSourceVolumeTest-931808651 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-c1e1de1e-613e-42ad-8f13-f8bceaf705d9 1073741824" returned: 0 in 0.531s {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 25 16:02:56 devstack sudo[91785]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-dc4218d7-b90b-4062-9d9f-c3a0ece20987 Feb 25 16:02:56 devstack sudo[91785]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 25 16:02:56 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-dc9793d2-a9e7-4926-93ff-ce56a753cb6d tempest-CreateVolumesFromSourceVolumeTest-931808651 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-c1e1de1e-613e-42ad-8f13-f8bceaf705d9 {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 25 16:02:56 devstack sudo[91787]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-c1e1de1e-613e-42ad-8f13-f8bceaf705d9 Feb 25 16:02:56 devstack sudo[91787]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 25 16:02:56 devstack sudo[91785]: pam_unix(sudo:session): session closed for user root Feb 25 16:02:56 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-e30a68d5-bc47-4e50-b421-1a29e1c66819 tempest-CreateVolumesFromSnapshotTest-1082910625 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-dc4218d7-b90b-4062-9d9f-c3a0ece20987" returned: 0 in 0.463s {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 25 16:02:56 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-e30a68d5-bc47-4e50-b421-1a29e1c66819 tempest-CreateVolumesFromSnapshotTest-1082910625 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-dc4218d7-b90b-4062-9d9f-c3a0ece20987 {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 25 16:02:56 devstack sudo[91793]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-dc4218d7-b90b-4062-9d9f-c3a0ece20987 Feb 25 16:02:56 devstack sudo[91793]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 25 16:02:56 devstack sudo[91787]: pam_unix(sudo:session): session closed for user root Feb 25 16:02:56 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-dc9793d2-a9e7-4926-93ff-ce56a753cb6d tempest-CreateVolumesFromSourceVolumeTest-931808651 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-c1e1de1e-613e-42ad-8f13-f8bceaf705d9" returned: 0 in 0.419s {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 25 16:02:56 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.quobyte [None req-dc9793d2-a9e7-4926-93ff-ce56a753cb6d tempest-CreateVolumesFromSourceVolumeTest-931808651 None] <== create_volume: return (994ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-23e9d725-3e04-4cd9-bfe0-c8ef43305589'} {{(pid=83528) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 25 16:02:56 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-dc9793d2-a9e7-4926-93ff-ce56a753cb6d tempest-CreateVolumesFromSourceVolumeTest-931808651 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.997s {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 25 16:02:56 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-70eaca4e-e7c6-4c93-af35-837572b88d3d tempest-CreateVolumesFromSourceVolumeTest-931808651 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.492s {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 25 16:02:56 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.quobyte [None req-70eaca4e-e7c6-4c93-af35-837572b88d3d tempest-CreateVolumesFromSourceVolumeTest-931808651 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-25T15:02:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-388646419',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ccba4e52-9616-4165-a4b0-4fcf5a4fc1bf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fcf12f31e52c40859d85ba8f3aa4076b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-25T15:02:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-25T15:02:52Z,use_quota=True,user_id='ce4e44485cd646fc9c78daa6a071c681',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ce71c2f9-6543-4165-9653-a1529b2ea243),volume_type_id=ce71c2f9-6543-4165-9653-a1529b2ea243)}" {{(pid=83528) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 25 16:02:56 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.remotefs [None req-70eaca4e-e7c6-4c93-af35-837572b88d3d tempest-CreateVolumesFromSourceVolumeTest-931808651 None] Creating volume ccba4e52-9616-4165-a4b0-4fcf5a4fc1bf {{(pid=83528) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 25 16:02:56 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-70eaca4e-e7c6-4c93-af35-837572b88d3d tempest-CreateVolumesFromSourceVolumeTest-931808651 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 25 16:02:56 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-70eaca4e-e7c6-4c93-af35-837572b88d3d tempest-CreateVolumesFromSourceVolumeTest-931808651 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 25 16:02:56 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.quobyte [None req-70eaca4e-e7c6-4c93-af35-837572b88d3d tempest-CreateVolumesFromSourceVolumeTest-931808651 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23e9d725-3e04-4cd9-bfe0-c8ef43305589': None} {{(pid=83528) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 25 16:02:56 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.quobyte [None req-70eaca4e-e7c6-4c93-af35-837572b88d3d tempest-CreateVolumesFromSourceVolumeTest-931808651 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23e9d725-3e04-4cd9-bfe0-c8ef43305589'] {{(pid=83528) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 25 16:02:56 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-70eaca4e-e7c6-4c93-af35-837572b88d3d tempest-CreateVolumesFromSourceVolumeTest-931808651 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 25 16:02:56 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.quobyte [None req-70eaca4e-e7c6-4c93-af35-837572b88d3d tempest-CreateVolumesFromSourceVolumeTest-931808651 None] Selected osci02.corp.quobyte.com/cinder-vol-23e9d725-3e04-4cd9-bfe0-c8ef43305589 as target Quobyte volume. {{(pid=83528) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 25 16:02:56 devstack cinder-volume[83528]: INFO cinder.volume.drivers.remotefs [None req-70eaca4e-e7c6-4c93-af35-837572b88d3d tempest-CreateVolumesFromSourceVolumeTest-931808651 None] casted to osci02.corp.quobyte.com/cinder-vol-23e9d725-3e04-4cd9-bfe0-c8ef43305589 Feb 25 16:02:56 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-70eaca4e-e7c6-4c93-af35-837572b88d3d tempest-CreateVolumesFromSourceVolumeTest-931808651 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-ccba4e52-9616-4165-a4b0-4fcf5a4fc1bf 1073741824 {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 25 16:02:56 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-dc9793d2-a9e7-4926-93ff-ce56a753cb6d tempest-CreateVolumesFromSourceVolumeTest-931808651 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1971f85e-6b20-4722-b5ff-17bb42aa10fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c1e1de1e-613e-42ad-8f13-f8bceaf705d9', 'volume_size': 1}' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 25 16:02:56 devstack sudo[91795]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-ccba4e52-9616-4165-a4b0-4fcf5a4fc1bf 1073741824 Feb 25 16:02:56 devstack sudo[91795]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 25 16:02:56 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-dc9793d2-a9e7-4926-93ff-ce56a753cb6d tempest-CreateVolumesFromSourceVolumeTest-931808651 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b7be4fbe-b8cc-4528-b52c-4f2b0cf692a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 25 16:02:56 devstack cinder-volume[83528]: INFO cinder.volume.flows.manager.create_volume [None req-dc9793d2-a9e7-4926-93ff-ce56a753cb6d tempest-CreateVolumesFromSourceVolumeTest-931808651 None] Volume volume-c1e1de1e-613e-42ad-8f13-f8bceaf705d9 (c1e1de1e-613e-42ad-8f13-f8bceaf705d9): created successfully Feb 25 16:02:56 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-dc9793d2-a9e7-4926-93ff-ce56a753cb6d tempest-CreateVolumesFromSourceVolumeTest-931808651 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b7be4fbe-b8cc-4528-b52c-4f2b0cf692a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 25 16:02:56 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-dc9793d2-a9e7-4926-93ff-ce56a753cb6d tempest-CreateVolumesFromSourceVolumeTest-931808651 None] Flow 'volume_create_manager' (f04c9dba-8ea4-4296-924a-ad5f83edfd5d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83528) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 25 16:02:56 devstack cinder-volume[83528]: INFO cinder.volume.manager [None req-dc9793d2-a9e7-4926-93ff-ce56a753cb6d tempest-CreateVolumesFromSourceVolumeTest-931808651 None] Created volume successfully. Feb 25 16:02:57 devstack sudo[91793]: pam_unix(sudo:session): session closed for user root Feb 25 16:02:57 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-e30a68d5-bc47-4e50-b421-1a29e1c66819 tempest-CreateVolumesFromSnapshotTest-1082910625 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-dc4218d7-b90b-4062-9d9f-c3a0ece20987" returned: 0 in 0.448s {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 25 16:02:57 devstack cinder-volume[83528]: DEBUG cinder.coordination [None req-e30a68d5-bc47-4e50-b421-1a29e1c66819 tempest-CreateVolumesFromSnapshotTest-1082910625 None] Lock "cinder-quobyte-dc4218d7-b90b-4062-9d9f-c3a0ece20987" released by "delete_volume" :: held 0.932s {{(pid=83528) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 25 16:02:57 devstack cinder-volume[83528]: DEBUG cinder.quota [None req-e30a68d5-bc47-4e50-b421-1a29e1c66819 tempest-CreateVolumesFromSnapshotTest-1082910625 None] Created reservations ['51ad47fc-76ae-42ab-9650-7f6f5f249a07', '08596396-60cf-417b-95be-8d5840593ec4', '8c1765bd-1f41-401f-b05c-3518c6b3ce27', 'cd823f79-18f8-4ec2-bbfa-90b0a50f6809'] {{(pid=83528) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 25 16:02:57 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-e30a68d5-bc47-4e50-b421-1a29e1c66819 tempest-CreateVolumesFromSnapshotTest-1082910625 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 25 16:02:57 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-e30a68d5-bc47-4e50-b421-1a29e1c66819 tempest-CreateVolumesFromSnapshotTest-1082910625 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 25 16:02:57 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.quobyte [None req-e30a68d5-bc47-4e50-b421-1a29e1c66819 tempest-CreateVolumesFromSnapshotTest-1082910625 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23e9d725-3e04-4cd9-bfe0-c8ef43305589': None} {{(pid=83528) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 25 16:02:57 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.quobyte [None req-e30a68d5-bc47-4e50-b421-1a29e1c66819 tempest-CreateVolumesFromSnapshotTest-1082910625 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23e9d725-3e04-4cd9-bfe0-c8ef43305589'] {{(pid=83528) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 25 16:02:57 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-e30a68d5-bc47-4e50-b421-1a29e1c66819 tempest-CreateVolumesFromSnapshotTest-1082910625 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 25 16:02:57 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-e30a68d5-bc47-4e50-b421-1a29e1c66819 tempest-CreateVolumesFromSnapshotTest-1082910625 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85 {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 25 16:02:57 devstack sudo[91795]: pam_unix(sudo:session): session closed for user root Feb 25 16:02:57 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-70eaca4e-e7c6-4c93-af35-837572b88d3d tempest-CreateVolumesFromSourceVolumeTest-931808651 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-ccba4e52-9616-4165-a4b0-4fcf5a4fc1bf 1073741824" returned: 0 in 0.499s {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 25 16:02:57 devstack sudo[91801]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85 Feb 25 16:02:57 devstack sudo[91801]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 25 16:02:57 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-70eaca4e-e7c6-4c93-af35-837572b88d3d tempest-CreateVolumesFromSourceVolumeTest-931808651 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-ccba4e52-9616-4165-a4b0-4fcf5a4fc1bf {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 25 16:02:57 devstack sudo[91803]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-ccba4e52-9616-4165-a4b0-4fcf5a4fc1bf Feb 25 16:02:57 devstack sudo[91803]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 25 16:02:57 devstack sudo[91801]: pam_unix(sudo:session): session closed for user root Feb 25 16:02:57 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-e30a68d5-bc47-4e50-b421-1a29e1c66819 tempest-CreateVolumesFromSnapshotTest-1082910625 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85" returned: 0 in 0.392s {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 25 16:02:57 devstack cinder-volume[83528]: DEBUG cinder.manager [None req-e30a68d5-bc47-4e50-b421-1a29e1c66819 tempest-CreateVolumesFromSnapshotTest-1082910625 None] Notifying Schedulers of capabilities ... {{(pid=83528) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 25 16:02:57 devstack cinder-volume[83528]: INFO cinder.volume.manager [None req-e30a68d5-bc47-4e50-b421-1a29e1c66819 tempest-CreateVolumesFromSnapshotTest-1082910625 None] Deleted volume successfully. Feb 25 16:02:57 devstack sudo[91803]: pam_unix(sudo:session): session closed for user root Feb 25 16:02:57 devstack cinder-volume[83528]: DEBUG cinder.coordination [None req-e30a68d5-bc47-4e50-b421-1a29e1c66819 tempest-CreateVolumesFromSnapshotTest-1082910625 None] Lock "cinder-dc4218d7-b90b-4062-9d9f-c3a0ece20987-delete_volume" released by "delete_volume" :: held 1.480s {{(pid=83528) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 25 16:02:57 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-70eaca4e-e7c6-4c93-af35-837572b88d3d tempest-CreateVolumesFromSourceVolumeTest-931808651 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-ccba4e52-9616-4165-a4b0-4fcf5a4fc1bf" returned: 0 in 0.396s {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 25 16:02:57 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.quobyte [None req-70eaca4e-e7c6-4c93-af35-837572b88d3d tempest-CreateVolumesFromSourceVolumeTest-931808651 None] <== create_volume: return (922ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-23e9d725-3e04-4cd9-bfe0-c8ef43305589'} {{(pid=83528) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 25 16:02:57 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-70eaca4e-e7c6-4c93-af35-837572b88d3d tempest-CreateVolumesFromSourceVolumeTest-931808651 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.925s {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 25 16:02:57 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-ceddda1e-e68a-40d4-a6e3-20c3aa8eaba3 tempest-CreateVolumesFromSourceVolumeTest-931808651 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.234s {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 25 16:02:57 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.quobyte [None req-ceddda1e-e68a-40d4-a6e3-20c3aa8eaba3 tempest-CreateVolumesFromSourceVolumeTest-931808651 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-25T15:02:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-665410033',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=196d00a8-7736-4c23-838f-4990d7a20a76,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fcf12f31e52c40859d85ba8f3aa4076b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-25T15:02:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-25T15:02:52Z,use_quota=True,user_id='ce4e44485cd646fc9c78daa6a071c681',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ce71c2f9-6543-4165-9653-a1529b2ea243),volume_type_id=ce71c2f9-6543-4165-9653-a1529b2ea243)}" {{(pid=83528) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 25 16:02:57 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.remotefs [None req-ceddda1e-e68a-40d4-a6e3-20c3aa8eaba3 tempest-CreateVolumesFromSourceVolumeTest-931808651 None] Creating volume 196d00a8-7736-4c23-838f-4990d7a20a76 {{(pid=83528) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 25 16:02:57 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-ceddda1e-e68a-40d4-a6e3-20c3aa8eaba3 tempest-CreateVolumesFromSourceVolumeTest-931808651 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 25 16:02:57 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-ceddda1e-e68a-40d4-a6e3-20c3aa8eaba3 tempest-CreateVolumesFromSourceVolumeTest-931808651 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 25 16:02:57 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.quobyte [None req-ceddda1e-e68a-40d4-a6e3-20c3aa8eaba3 tempest-CreateVolumesFromSourceVolumeTest-931808651 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23e9d725-3e04-4cd9-bfe0-c8ef43305589': None} {{(pid=83528) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 25 16:02:57 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.quobyte [None req-ceddda1e-e68a-40d4-a6e3-20c3aa8eaba3 tempest-CreateVolumesFromSourceVolumeTest-931808651 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23e9d725-3e04-4cd9-bfe0-c8ef43305589'] {{(pid=83528) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 25 16:02:57 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-ceddda1e-e68a-40d4-a6e3-20c3aa8eaba3 tempest-CreateVolumesFromSourceVolumeTest-931808651 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 25 16:02:57 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.quobyte [None req-ceddda1e-e68a-40d4-a6e3-20c3aa8eaba3 tempest-CreateVolumesFromSourceVolumeTest-931808651 None] Selected osci02.corp.quobyte.com/cinder-vol-23e9d725-3e04-4cd9-bfe0-c8ef43305589 as target Quobyte volume. {{(pid=83528) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 25 16:02:57 devstack cinder-volume[83528]: INFO cinder.volume.drivers.remotefs [None req-ceddda1e-e68a-40d4-a6e3-20c3aa8eaba3 tempest-CreateVolumesFromSourceVolumeTest-931808651 None] casted to osci02.corp.quobyte.com/cinder-vol-23e9d725-3e04-4cd9-bfe0-c8ef43305589 Feb 25 16:02:57 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-ceddda1e-e68a-40d4-a6e3-20c3aa8eaba3 tempest-CreateVolumesFromSourceVolumeTest-931808651 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-196d00a8-7736-4c23-838f-4990d7a20a76 1073741824 {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 25 16:02:57 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-70eaca4e-e7c6-4c93-af35-837572b88d3d tempest-CreateVolumesFromSourceVolumeTest-931808651 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ad88aa4e-8c3d-4e81-9107-fd262c923aa0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ccba4e52-9616-4165-a4b0-4fcf5a4fc1bf', 'volume_size': 1}' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 25 16:02:57 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-70eaca4e-e7c6-4c93-af35-837572b88d3d tempest-CreateVolumesFromSourceVolumeTest-931808651 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (492ab5d1-85fc-431e-b79a-c16564979a3d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 25 16:02:57 devstack sudo[91807]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-196d00a8-7736-4c23-838f-4990d7a20a76 1073741824 Feb 25 16:02:57 devstack sudo[91807]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 25 16:02:57 devstack cinder-volume[83528]: INFO cinder.volume.flows.manager.create_volume [None req-70eaca4e-e7c6-4c93-af35-837572b88d3d tempest-CreateVolumesFromSourceVolumeTest-931808651 None] Volume volume-ccba4e52-9616-4165-a4b0-4fcf5a4fc1bf (ccba4e52-9616-4165-a4b0-4fcf5a4fc1bf): created successfully Feb 25 16:02:57 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-70eaca4e-e7c6-4c93-af35-837572b88d3d tempest-CreateVolumesFromSourceVolumeTest-931808651 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (492ab5d1-85fc-431e-b79a-c16564979a3d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 25 16:02:57 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-70eaca4e-e7c6-4c93-af35-837572b88d3d tempest-CreateVolumesFromSourceVolumeTest-931808651 None] Flow 'volume_create_manager' (5e123d99-39dd-4549-84a2-9cf5a96ee195) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83528) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 25 16:02:57 devstack cinder-volume[83528]: INFO cinder.volume.manager [None req-70eaca4e-e7c6-4c93-af35-837572b88d3d tempest-CreateVolumesFromSourceVolumeTest-931808651 None] Created volume successfully. Feb 25 16:02:58 devstack sudo[91807]: pam_unix(sudo:session): session closed for user root Feb 25 16:02:58 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-ceddda1e-e68a-40d4-a6e3-20c3aa8eaba3 tempest-CreateVolumesFromSourceVolumeTest-931808651 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-196d00a8-7736-4c23-838f-4990d7a20a76 1073741824" returned: 0 in 0.469s {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 25 16:02:58 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-ceddda1e-e68a-40d4-a6e3-20c3aa8eaba3 tempest-CreateVolumesFromSourceVolumeTest-931808651 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-196d00a8-7736-4c23-838f-4990d7a20a76 {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 25 16:02:58 devstack sudo[91812]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-196d00a8-7736-4c23-838f-4990d7a20a76 Feb 25 16:02:58 devstack sudo[91812]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 25 16:02:58 devstack cinder-volume[83528]: DEBUG cinder.coordination [None req-e04d5000-d951-48f0-a3d5-008876709e59 tempest-CreateVolumesFromSnapshotTest-1082910625 None] Acquiring lock "cinder-81f3f2c7-aaae-494b-98fc-e393c88dbc38-delete_volume" by "delete_volume" {{(pid=83528) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 25 16:02:58 devstack cinder-volume[83528]: DEBUG cinder.coordination [None req-e04d5000-d951-48f0-a3d5-008876709e59 tempest-CreateVolumesFromSnapshotTest-1082910625 None] Lock "cinder-81f3f2c7-aaae-494b-98fc-e393c88dbc38-delete_volume" acquired by "delete_volume" :: waited 0.014s {{(pid=83528) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 25 16:02:58 devstack cinder-volume[83528]: DEBUG cinder.coordination [None req-e04d5000-d951-48f0-a3d5-008876709e59 tempest-CreateVolumesFromSnapshotTest-1082910625 None] Acquiring lock "cinder-quobyte-81f3f2c7-aaae-494b-98fc-e393c88dbc38" by "delete_volume" {{(pid=83528) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 25 16:02:58 devstack cinder-volume[83528]: DEBUG cinder.coordination [None req-e04d5000-d951-48f0-a3d5-008876709e59 tempest-CreateVolumesFromSnapshotTest-1082910625 None] Lock "cinder-quobyte-81f3f2c7-aaae-494b-98fc-e393c88dbc38" acquired by "delete_volume" :: waited 0.009s {{(pid=83528) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 25 16:02:58 devstack cinder-volume[83528]: DEBUG oslo.privsep.daemon [-] privsep: reply[89a1d6bf-2a0e-46f7-997a-ea53d54f8dba]: (4, 'qcow2') {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 25 16:02:58 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-e04d5000-d951-48f0-a3d5-008876709e59 tempest-CreateVolumesFromSnapshotTest-1082910625 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-81f3f2c7-aaae-494b-98fc-e393c88dbc38 {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 25 16:02:58 devstack sudo[91814]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-81f3f2c7-aaae-494b-98fc-e393c88dbc38 Feb 25 16:02:58 devstack sudo[91814]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 25 16:02:58 devstack sudo[91812]: pam_unix(sudo:session): session closed for user root Feb 25 16:02:58 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-ceddda1e-e68a-40d4-a6e3-20c3aa8eaba3 tempest-CreateVolumesFromSourceVolumeTest-931808651 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-196d00a8-7736-4c23-838f-4990d7a20a76" returned: 0 in 0.402s {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 25 16:02:58 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.quobyte [None req-ceddda1e-e68a-40d4-a6e3-20c3aa8eaba3 tempest-CreateVolumesFromSourceVolumeTest-931808651 None] <== create_volume: return (894ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-23e9d725-3e04-4cd9-bfe0-c8ef43305589'} {{(pid=83528) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 25 16:02:58 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-ceddda1e-e68a-40d4-a6e3-20c3aa8eaba3 tempest-CreateVolumesFromSourceVolumeTest-931808651 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.898s {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 25 16:02:58 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-eb8705bf-831e-4bcd-940b-5716ee1e3b47 tempest-CreateVolumesFromSourceVolumeTest-931808651 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.886s {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 25 16:02:58 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.quobyte [None req-eb8705bf-831e-4bcd-940b-5716ee1e3b47 tempest-CreateVolumesFromSourceVolumeTest-931808651 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-25T15:02:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-368516767',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bf124820-f33f-4614-ba7a-f90023b30d5d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fcf12f31e52c40859d85ba8f3aa4076b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-25T15:02:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-25T15:02:52Z,use_quota=True,user_id='ce4e44485cd646fc9c78daa6a071c681',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ce71c2f9-6543-4165-9653-a1529b2ea243),volume_type_id=ce71c2f9-6543-4165-9653-a1529b2ea243)}" {{(pid=83528) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 25 16:02:58 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.remotefs [None req-eb8705bf-831e-4bcd-940b-5716ee1e3b47 tempest-CreateVolumesFromSourceVolumeTest-931808651 None] Creating volume bf124820-f33f-4614-ba7a-f90023b30d5d {{(pid=83528) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 25 16:02:58 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-eb8705bf-831e-4bcd-940b-5716ee1e3b47 tempest-CreateVolumesFromSourceVolumeTest-931808651 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 25 16:02:58 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-eb8705bf-831e-4bcd-940b-5716ee1e3b47 tempest-CreateVolumesFromSourceVolumeTest-931808651 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 25 16:02:58 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.quobyte [None req-eb8705bf-831e-4bcd-940b-5716ee1e3b47 tempest-CreateVolumesFromSourceVolumeTest-931808651 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23e9d725-3e04-4cd9-bfe0-c8ef43305589': None} {{(pid=83528) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 25 16:02:58 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.quobyte [None req-eb8705bf-831e-4bcd-940b-5716ee1e3b47 tempest-CreateVolumesFromSourceVolumeTest-931808651 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23e9d725-3e04-4cd9-bfe0-c8ef43305589'] {{(pid=83528) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 25 16:02:58 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-eb8705bf-831e-4bcd-940b-5716ee1e3b47 tempest-CreateVolumesFromSourceVolumeTest-931808651 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 25 16:02:58 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.quobyte [None req-eb8705bf-831e-4bcd-940b-5716ee1e3b47 tempest-CreateVolumesFromSourceVolumeTest-931808651 None] Selected osci02.corp.quobyte.com/cinder-vol-23e9d725-3e04-4cd9-bfe0-c8ef43305589 as target Quobyte volume. {{(pid=83528) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 25 16:02:58 devstack cinder-volume[83528]: INFO cinder.volume.drivers.remotefs [None req-eb8705bf-831e-4bcd-940b-5716ee1e3b47 tempest-CreateVolumesFromSourceVolumeTest-931808651 None] casted to osci02.corp.quobyte.com/cinder-vol-23e9d725-3e04-4cd9-bfe0-c8ef43305589 Feb 25 16:02:58 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-eb8705bf-831e-4bcd-940b-5716ee1e3b47 tempest-CreateVolumesFromSourceVolumeTest-931808651 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-bf124820-f33f-4614-ba7a-f90023b30d5d 1073741824 {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 25 16:02:58 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-ceddda1e-e68a-40d4-a6e3-20c3aa8eaba3 tempest-CreateVolumesFromSourceVolumeTest-931808651 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7ac8e784-ef71-411c-8f99-3678e63ef1f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-196d00a8-7736-4c23-838f-4990d7a20a76', 'volume_size': 1}' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 25 16:02:58 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-ceddda1e-e68a-40d4-a6e3-20c3aa8eaba3 tempest-CreateVolumesFromSourceVolumeTest-931808651 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9761ec81-4cfc-4b36-9d22-7d0042cd0c96) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 25 16:02:58 devstack sudo[91817]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-bf124820-f33f-4614-ba7a-f90023b30d5d 1073741824 Feb 25 16:02:58 devstack sudo[91817]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 25 16:02:58 devstack cinder-volume[83528]: INFO cinder.volume.flows.manager.create_volume [None req-ceddda1e-e68a-40d4-a6e3-20c3aa8eaba3 tempest-CreateVolumesFromSourceVolumeTest-931808651 None] Volume volume-196d00a8-7736-4c23-838f-4990d7a20a76 (196d00a8-7736-4c23-838f-4990d7a20a76): created successfully Feb 25 16:02:58 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-ceddda1e-e68a-40d4-a6e3-20c3aa8eaba3 tempest-CreateVolumesFromSourceVolumeTest-931808651 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9761ec81-4cfc-4b36-9d22-7d0042cd0c96) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 25 16:02:58 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-ceddda1e-e68a-40d4-a6e3-20c3aa8eaba3 tempest-CreateVolumesFromSourceVolumeTest-931808651 None] Flow 'volume_create_manager' (da437304-1d36-44c3-9128-34f7d97a96cf) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83528) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 25 16:02:58 devstack cinder-volume[83528]: INFO cinder.volume.manager [None req-ceddda1e-e68a-40d4-a6e3-20c3aa8eaba3 tempest-CreateVolumesFromSourceVolumeTest-931808651 None] Created volume successfully. Feb 25 16:02:58 devstack sudo[91814]: pam_unix(sudo:session): session closed for user root Feb 25 16:02:58 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-e04d5000-d951-48f0-a3d5-008876709e59 tempest-CreateVolumesFromSnapshotTest-1082910625 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-81f3f2c7-aaae-494b-98fc-e393c88dbc38" returned: 0 in 0.459s {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 25 16:02:58 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-e04d5000-d951-48f0-a3d5-008876709e59 tempest-CreateVolumesFromSnapshotTest-1082910625 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-81f3f2c7-aaae-494b-98fc-e393c88dbc38 {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 25 16:02:58 devstack sudo[91822]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-81f3f2c7-aaae-494b-98fc-e393c88dbc38 Feb 25 16:02:58 devstack sudo[91822]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 25 16:02:58 devstack sudo[91817]: pam_unix(sudo:session): session closed for user root Feb 25 16:02:58 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-eb8705bf-831e-4bcd-940b-5716ee1e3b47 tempest-CreateVolumesFromSourceVolumeTest-931808651 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-bf124820-f33f-4614-ba7a-f90023b30d5d 1073741824" returned: 0 in 0.484s {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 25 16:02:58 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-eb8705bf-831e-4bcd-940b-5716ee1e3b47 tempest-CreateVolumesFromSourceVolumeTest-931808651 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-bf124820-f33f-4614-ba7a-f90023b30d5d {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 25 16:02:58 devstack sudo[91827]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-bf124820-f33f-4614-ba7a-f90023b30d5d Feb 25 16:02:58 devstack sudo[91827]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 25 16:02:59 devstack sudo[91822]: pam_unix(sudo:session): session closed for user root Feb 25 16:02:59 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-e04d5000-d951-48f0-a3d5-008876709e59 tempest-CreateVolumesFromSnapshotTest-1082910625 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-81f3f2c7-aaae-494b-98fc-e393c88dbc38" returned: 0 in 0.447s {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 25 16:02:59 devstack cinder-volume[83528]: DEBUG cinder.coordination [None req-e04d5000-d951-48f0-a3d5-008876709e59 tempest-CreateVolumesFromSnapshotTest-1082910625 None] Lock "cinder-quobyte-81f3f2c7-aaae-494b-98fc-e393c88dbc38" released by "delete_volume" :: held 0.938s {{(pid=83528) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 25 16:02:59 devstack cinder-volume[83528]: DEBUG cinder.quota [None req-e04d5000-d951-48f0-a3d5-008876709e59 tempest-CreateVolumesFromSnapshotTest-1082910625 None] Created reservations ['6c520f3f-c030-491b-96ea-7e83c0d12384', 'e8610a26-b139-4c84-bf04-0536ee642cae', '7b5c8de7-1f64-49e8-a371-9be74bcb3976', '6742c42f-3b15-485c-94e9-6ce41b2b205d'] {{(pid=83528) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 25 16:02:59 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-e04d5000-d951-48f0-a3d5-008876709e59 tempest-CreateVolumesFromSnapshotTest-1082910625 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 25 16:02:59 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-e04d5000-d951-48f0-a3d5-008876709e59 tempest-CreateVolumesFromSnapshotTest-1082910625 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 25 16:02:59 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.quobyte [None req-e04d5000-d951-48f0-a3d5-008876709e59 tempest-CreateVolumesFromSnapshotTest-1082910625 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23e9d725-3e04-4cd9-bfe0-c8ef43305589': None} {{(pid=83528) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 25 16:02:59 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.quobyte [None req-e04d5000-d951-48f0-a3d5-008876709e59 tempest-CreateVolumesFromSnapshotTest-1082910625 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23e9d725-3e04-4cd9-bfe0-c8ef43305589'] {{(pid=83528) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 25 16:02:59 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-e04d5000-d951-48f0-a3d5-008876709e59 tempest-CreateVolumesFromSnapshotTest-1082910625 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 25 16:02:59 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-e04d5000-d951-48f0-a3d5-008876709e59 tempest-CreateVolumesFromSnapshotTest-1082910625 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85 {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 25 16:02:59 devstack sudo[91830]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85 Feb 25 16:02:59 devstack sudo[91830]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 25 16:02:59 devstack cinder-volume[83528]: DEBUG cinder.coordination [None req-dfe21b5b-add1-4cba-a855-157546020835 tempest-CreateVolumesFromSnapshotTest-1082910625 None] Acquiring lock "cinder-71173e35-0ede-4a74-ab84-544e29e78339-delete_snapshot" by "delete_snapshot" {{(pid=83528) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 25 16:02:59 devstack cinder-volume[83528]: DEBUG cinder.coordination [None req-dfe21b5b-add1-4cba-a855-157546020835 tempest-CreateVolumesFromSnapshotTest-1082910625 None] Lock "cinder-71173e35-0ede-4a74-ab84-544e29e78339-delete_snapshot" acquired by "delete_snapshot" :: waited 0.011s {{(pid=83528) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 25 16:02:59 devstack cinder-volume[83528]: DEBUG cinder.coordination [None req-dfe21b5b-add1-4cba-a855-157546020835 tempest-CreateVolumesFromSnapshotTest-1082910625 None] Acquiring lock "cinder-quobyte-f30072d2-6e3e-4fcd-9fc0-b97e812f66ce" by "delete_snapshot" {{(pid=83528) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 25 16:02:59 devstack cinder-volume[83528]: DEBUG cinder.coordination [None req-dfe21b5b-add1-4cba-a855-157546020835 tempest-CreateVolumesFromSnapshotTest-1082910625 None] Lock "cinder-quobyte-f30072d2-6e3e-4fcd-9fc0-b97e812f66ce" acquired by "delete_snapshot" :: waited 0.009s {{(pid=83528) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 25 16:02:59 devstack cinder-volume[83528]: DEBUG cinder.coordination [None req-dfe21b5b-add1-4cba-a855-157546020835 tempest-CreateVolumesFromSnapshotTest-1082910625 None] Acquiring lock "cinder-quobyte-71173e35-0ede-4a74-ab84-544e29e78339" by "_delete_snapshot" {{(pid=83528) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 25 16:02:59 devstack cinder-volume[83528]: DEBUG cinder.coordination [None req-dfe21b5b-add1-4cba-a855-157546020835 tempest-CreateVolumesFromSnapshotTest-1082910625 None] Lock "cinder-quobyte-71173e35-0ede-4a74-ab84-544e29e78339" acquired by "_delete_snapshot" :: waited 0.008s {{(pid=83528) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 25 16:02:59 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.remotefs [None req-dfe21b5b-add1-4cba-a855-157546020835 tempest-CreateVolumesFromSnapshotTest-1082910625 None] Deleting offline snapshot 71173e35-0ede-4a74-ab84-544e29e78339 of volume f30072d2-6e3e-4fcd-9fc0-b97e812f66ce {{(pid=83528) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Feb 25 16:02:59 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.remotefs [None req-dfe21b5b-add1-4cba-a855-157546020835 tempest-CreateVolumesFromSnapshotTest-1082910625 None] snapshot_file for this snap is: volume-f30072d2-6e3e-4fcd-9fc0-b97e812f66ce.71173e35-0ede-4a74-ab84-544e29e78339 {{(pid=83528) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Feb 25 16:02:59 devstack cinder-volume[83528]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce8df979-3529-4c2e-b872-da11d04b85ad]: (4, 'qcow2') {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 25 16:02:59 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-dfe21b5b-add1-4cba-a855-157546020835 tempest-CreateVolumesFromSnapshotTest-1082910625 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-f30072d2-6e3e-4fcd-9fc0-b97e812f66ce.71173e35-0ede-4a74-ab84-544e29e78339 {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 25 16:02:59 devstack sudo[91827]: pam_unix(sudo:session): session closed for user root Feb 25 16:02:59 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-eb8705bf-831e-4bcd-940b-5716ee1e3b47 tempest-CreateVolumesFromSourceVolumeTest-931808651 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-bf124820-f33f-4614-ba7a-f90023b30d5d" returned: 0 in 0.468s {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 25 16:02:59 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.quobyte [None req-eb8705bf-831e-4bcd-940b-5716ee1e3b47 tempest-CreateVolumesFromSourceVolumeTest-931808651 None] <== create_volume: return (977ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-23e9d725-3e04-4cd9-bfe0-c8ef43305589'} {{(pid=83528) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 25 16:02:59 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-eb8705bf-831e-4bcd-940b-5716ee1e3b47 tempest-CreateVolumesFromSourceVolumeTest-931808651 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.980s {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 25 16:02:59 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-4887e50d-e8ae-47d6-a0d6-ed4234a4a206 tempest-SnapshotDependencyTests-2073568565 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 4.708s {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 25 16:02:59 devstack cinder-volume[83528]: DEBUG cinder.coordination [None req-4887e50d-e8ae-47d6-a0d6-ed4234a4a206 tempest-SnapshotDependencyTests-2073568565 None] Acquiring lock "cinder-quobyte-b7612e5c-1617-4e2b-af75-173a562fa3a1-a69c2263-b13b-4112-bf20-5c4e5f5577fc" by "_create_volume_from_snapshot" {{(pid=83528) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 25 16:02:59 devstack sudo[91833]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-f30072d2-6e3e-4fcd-9fc0-b97e812f66ce.71173e35-0ede-4a74-ab84-544e29e78339 Feb 25 16:02:59 devstack sudo[91833]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 25 16:02:59 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-eb8705bf-831e-4bcd-940b-5716ee1e3b47 tempest-CreateVolumesFromSourceVolumeTest-931808651 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b1ce9046-5524-49d7-9244-2f66b347ed9e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bf124820-f33f-4614-ba7a-f90023b30d5d', 'volume_size': 1}' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 25 16:02:59 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-eb8705bf-831e-4bcd-940b-5716ee1e3b47 tempest-CreateVolumesFromSourceVolumeTest-931808651 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (19951383-f56a-4776-873f-93a3c5312766) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 25 16:02:59 devstack cinder-volume[83528]: DEBUG cinder.coordination [None req-4887e50d-e8ae-47d6-a0d6-ed4234a4a206 tempest-SnapshotDependencyTests-2073568565 None] Lock "cinder-quobyte-b7612e5c-1617-4e2b-af75-173a562fa3a1-a69c2263-b13b-4112-bf20-5c4e5f5577fc" acquired by "_create_volume_from_snapshot" :: waited 0.021s {{(pid=83528) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 25 16:02:59 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.quobyte [None req-4887e50d-e8ae-47d6-a0d6-ed4234a4a206 tempest-SnapshotDependencyTests-2073568565 None] Creating volume a69c2263-b13b-4112-bf20-5c4e5f5577fc from snapshot b7612e5c-1617-4e2b-af75-173a562fa3a1 {{(pid=83528) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Feb 25 16:02:59 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-4887e50d-e8ae-47d6-a0d6-ed4234a4a206 tempest-SnapshotDependencyTests-2073568565 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 25 16:02:59 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-4887e50d-e8ae-47d6-a0d6-ed4234a4a206 tempest-SnapshotDependencyTests-2073568565 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 25 16:02:59 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.quobyte [None req-4887e50d-e8ae-47d6-a0d6-ed4234a4a206 tempest-SnapshotDependencyTests-2073568565 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23e9d725-3e04-4cd9-bfe0-c8ef43305589': None} {{(pid=83528) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 25 16:02:59 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.quobyte [None req-4887e50d-e8ae-47d6-a0d6-ed4234a4a206 tempest-SnapshotDependencyTests-2073568565 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23e9d725-3e04-4cd9-bfe0-c8ef43305589'] {{(pid=83528) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 25 16:02:59 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-4887e50d-e8ae-47d6-a0d6-ed4234a4a206 tempest-SnapshotDependencyTests-2073568565 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 25 16:02:59 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.quobyte [None req-4887e50d-e8ae-47d6-a0d6-ed4234a4a206 tempest-SnapshotDependencyTests-2073568565 None] Selected osci02.corp.quobyte.com/cinder-vol-23e9d725-3e04-4cd9-bfe0-c8ef43305589 as target Quobyte volume. {{(pid=83528) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 25 16:02:59 devstack cinder-volume[83528]: DEBUG cinder.coordination [None req-4887e50d-e8ae-47d6-a0d6-ed4234a4a206 tempest-SnapshotDependencyTests-2073568565 None] Acquiring lock "cinder-quobyte-a69c2263-b13b-4112-bf20-5c4e5f5577fc" by "_copy_volume_from_snapshot" {{(pid=83528) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 25 16:02:59 devstack cinder-volume[83528]: INFO cinder.volume.flows.manager.create_volume [None req-eb8705bf-831e-4bcd-940b-5716ee1e3b47 tempest-CreateVolumesFromSourceVolumeTest-931808651 None] Volume volume-bf124820-f33f-4614-ba7a-f90023b30d5d (bf124820-f33f-4614-ba7a-f90023b30d5d): created successfully Feb 25 16:02:59 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-eb8705bf-831e-4bcd-940b-5716ee1e3b47 tempest-CreateVolumesFromSourceVolumeTest-931808651 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (19951383-f56a-4776-873f-93a3c5312766) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 25 16:02:59 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-eb8705bf-831e-4bcd-940b-5716ee1e3b47 tempest-CreateVolumesFromSourceVolumeTest-931808651 None] Flow 'volume_create_manager' (51e2c656-6864-4b96-98b9-f9423f96e969) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83528) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 25 16:02:59 devstack cinder-volume[83528]: DEBUG cinder.coordination [None req-4887e50d-e8ae-47d6-a0d6-ed4234a4a206 tempest-SnapshotDependencyTests-2073568565 None] Lock "cinder-quobyte-a69c2263-b13b-4112-bf20-5c4e5f5577fc" acquired by "_copy_volume_from_snapshot" :: waited 0.019s {{(pid=83528) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 25 16:02:59 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.quobyte [None req-4887e50d-e8ae-47d6-a0d6-ed4234a4a206 tempest-SnapshotDependencyTests-2073568565 None] snapshot: b7612e5c-1617-4e2b-af75-173a562fa3a1, volume: a69c2263-b13b-4112-bf20-5c4e5f5577fc, {{(pid=83528) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Feb 25 16:02:59 devstack cinder-volume[83528]: INFO cinder.volume.manager [None req-eb8705bf-831e-4bcd-940b-5716ee1e3b47 tempest-CreateVolumesFromSourceVolumeTest-931808651 None] Created volume successfully. Feb 25 16:02:59 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-4887e50d-e8ae-47d6-a0d6-ed4234a4a206 tempest-SnapshotDependencyTests-2073568565 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 25 16:02:59 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-4887e50d-e8ae-47d6-a0d6-ed4234a4a206 tempest-SnapshotDependencyTests-2073568565 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 25 16:02:59 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.quobyte [None req-4887e50d-e8ae-47d6-a0d6-ed4234a4a206 tempest-SnapshotDependencyTests-2073568565 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23e9d725-3e04-4cd9-bfe0-c8ef43305589': None} {{(pid=83528) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 25 16:02:59 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.quobyte [None req-4887e50d-e8ae-47d6-a0d6-ed4234a4a206 tempest-SnapshotDependencyTests-2073568565 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23e9d725-3e04-4cd9-bfe0-c8ef43305589'] {{(pid=83528) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 25 16:02:59 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-4887e50d-e8ae-47d6-a0d6-ed4234a4a206 tempest-SnapshotDependencyTests-2073568565 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 25 16:02:59 devstack cinder-volume[83528]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff41d0e4-1e38-4005-9df7-545a4605eb31]: (4, 'qcow2') {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 25 16:02:59 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-4887e50d-e8ae-47d6-a0d6-ed4234a4a206 tempest-SnapshotDependencyTests-2073568565 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-b4a78707-43cc-4a9c-b6f9-e2b8ca42cfdc.b7612e5c-1617-4e2b-af75-173a562fa3a1 {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 25 16:02:59 devstack sudo[91835]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-b4a78707-43cc-4a9c-b6f9-e2b8ca42cfdc.b7612e5c-1617-4e2b-af75-173a562fa3a1 Feb 25 16:02:59 devstack sudo[91835]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 25 16:02:59 devstack sudo[91830]: pam_unix(sudo:session): session closed for user root Feb 25 16:02:59 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-e04d5000-d951-48f0-a3d5-008876709e59 tempest-CreateVolumesFromSnapshotTest-1082910625 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85" returned: 0 in 0.481s {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 25 16:02:59 devstack cinder-volume[83528]: DEBUG cinder.manager [None req-e04d5000-d951-48f0-a3d5-008876709e59 tempest-CreateVolumesFromSnapshotTest-1082910625 None] Notifying Schedulers of capabilities ... {{(pid=83528) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 25 16:02:59 devstack cinder-volume[83528]: INFO cinder.volume.manager [None req-e04d5000-d951-48f0-a3d5-008876709e59 tempest-CreateVolumesFromSnapshotTest-1082910625 None] Deleted volume successfully. Feb 25 16:02:59 devstack cinder-volume[83528]: DEBUG cinder.coordination [None req-e04d5000-d951-48f0-a3d5-008876709e59 tempest-CreateVolumesFromSnapshotTest-1082910625 None] Lock "cinder-81f3f2c7-aaae-494b-98fc-e393c88dbc38-delete_volume" released by "delete_volume" :: held 1.555s {{(pid=83528) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 25 16:02:59 devstack sudo[91833]: pam_unix(sudo:session): session closed for user root Feb 25 16:02:59 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-dfe21b5b-add1-4cba-a855-157546020835 tempest-CreateVolumesFromSnapshotTest-1082910625 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-f30072d2-6e3e-4fcd-9fc0-b97e812f66ce.71173e35-0ede-4a74-ab84-544e29e78339" returned: 0 in 0.541s {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 25 16:02:59 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.remotefs [None req-dfe21b5b-add1-4cba-a855-157546020835 tempest-CreateVolumesFromSnapshotTest-1082910625 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f30072d2-6e3e-4fcd-9fc0-b97e812f66ce(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83528) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Feb 25 16:02:59 devstack cinder-volume[83528]: DEBUG oslo.privsep.daemon [-] privsep: reply[090d71b8-ac60-4875-b8d7-224bfb251e96]: (4, 'qcow2') {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 25 16:02:59 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-dfe21b5b-add1-4cba-a855-157546020835 tempest-CreateVolumesFromSnapshotTest-1082910625 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-f30072d2-6e3e-4fcd-9fc0-b97e812f66ce {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 25 16:02:59 devstack sudo[91841]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-f30072d2-6e3e-4fcd-9fc0-b97e812f66ce Feb 25 16:03:00 devstack sudo[91841]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 25 16:03:00 devstack sudo[91835]: pam_unix(sudo:session): session closed for user root Feb 25 16:03:00 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-4887e50d-e8ae-47d6-a0d6-ed4234a4a206 tempest-SnapshotDependencyTests-2073568565 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-b4a78707-43cc-4a9c-b6f9-e2b8ca42cfdc.b7612e5c-1617-4e2b-af75-173a562fa3a1" returned: 0 in 0.523s {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 25 16:03:00 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.remotefs [None req-4887e50d-e8ae-47d6-a0d6-ed4234a4a206 tempest-SnapshotDependencyTests-2073568565 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b4a78707-43cc-4a9c-b6f9-e2b8ca42cfdc(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83528) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Feb 25 16:03:00 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.quobyte [None req-4887e50d-e8ae-47d6-a0d6-ed4234a4a206 tempest-SnapshotDependencyTests-2073568565 None] will copy from snapshot at /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-b4a78707-43cc-4a9c-b6f9-e2b8ca42cfdc {{(pid=83528) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Feb 25 16:03:00 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.quobyte [None req-4887e50d-e8ae-47d6-a0d6-ed4234a4a206 tempest-SnapshotDependencyTests-2073568565 None] Creating direct copy from snapshot {{(pid=83528) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Feb 25 16:03:00 devstack cinder-volume[83528]: DEBUG oslo.privsep.daemon [-] privsep: reply[0812b2d4-58d9-44e9-a46f-505da876eeaa]: (4, 'qcow2') {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 25 16:03:00 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-4887e50d-e8ae-47d6-a0d6-ed4234a4a206 tempest-SnapshotDependencyTests-2073568565 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-b4a78707-43cc-4a9c-b6f9-e2b8ca42cfdc {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 25 16:03:00 devstack cinder-volume[83528]: DEBUG cinder.coordination [None req-0ae7bebc-e383-43e7-81fe-d06d39de55c8 tempest-CreateVolumesFromSourceVolumeTest-931808651 None] Acquiring lock "cinder-bf124820-f33f-4614-ba7a-f90023b30d5d-delete_volume" by "delete_volume" {{(pid=83528) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 25 16:03:00 devstack cinder-volume[83528]: DEBUG cinder.coordination [None req-0ae7bebc-e383-43e7-81fe-d06d39de55c8 tempest-CreateVolumesFromSourceVolumeTest-931808651 None] Lock "cinder-bf124820-f33f-4614-ba7a-f90023b30d5d-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=83528) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 25 16:03:00 devstack sudo[91846]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-b4a78707-43cc-4a9c-b6f9-e2b8ca42cfdc Feb 25 16:03:00 devstack sudo[91846]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 25 16:03:00 devstack cinder-volume[83528]: DEBUG cinder.coordination [None req-0ae7bebc-e383-43e7-81fe-d06d39de55c8 tempest-CreateVolumesFromSourceVolumeTest-931808651 None] Acquiring lock "cinder-quobyte-bf124820-f33f-4614-ba7a-f90023b30d5d" by "delete_volume" {{(pid=83528) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 25 16:03:00 devstack cinder-volume[83528]: DEBUG cinder.coordination [None req-0ae7bebc-e383-43e7-81fe-d06d39de55c8 tempest-CreateVolumesFromSourceVolumeTest-931808651 None] Lock "cinder-quobyte-bf124820-f33f-4614-ba7a-f90023b30d5d" acquired by "delete_volume" :: waited 0.020s {{(pid=83528) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 25 16:03:00 devstack cinder-volume[83528]: DEBUG oslo.privsep.daemon [-] privsep: reply[a03a4612-ab2a-451a-b445-bdea408e1783]: (4, 'qcow2') {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 25 16:03:00 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-0ae7bebc-e383-43e7-81fe-d06d39de55c8 tempest-CreateVolumesFromSourceVolumeTest-931808651 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-bf124820-f33f-4614-ba7a-f90023b30d5d {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 25 16:03:00 devstack sudo[91848]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-bf124820-f33f-4614-ba7a-f90023b30d5d Feb 25 16:03:00 devstack sudo[91848]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 25 16:03:00 devstack sudo[91841]: pam_unix(sudo:session): session closed for user root Feb 25 16:03:00 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-dfe21b5b-add1-4cba-a855-157546020835 tempest-CreateVolumesFromSnapshotTest-1082910625 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-f30072d2-6e3e-4fcd-9fc0-b97e812f66ce" returned: 0 in 0.556s {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 25 16:03:00 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-dfe21b5b-add1-4cba-a855-157546020835 tempest-CreateVolumesFromSnapshotTest-1082910625 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-f30072d2-6e3e-4fcd-9fc0-b97e812f66ce.71173e35-0ede-4a74-ab84-544e29e78339 {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 25 16:03:00 devstack sudo[91854]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-f30072d2-6e3e-4fcd-9fc0-b97e812f66ce.71173e35-0ede-4a74-ab84-544e29e78339 Feb 25 16:03:00 devstack sudo[91854]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 25 16:03:00 devstack sudo[91846]: pam_unix(sudo:session): session closed for user root Feb 25 16:03:00 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-4887e50d-e8ae-47d6-a0d6-ed4234a4a206 tempest-SnapshotDependencyTests-2073568565 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-b4a78707-43cc-4a9c-b6f9-e2b8ca42cfdc" returned: 0 in 0.524s {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 25 16:03:00 devstack cinder-volume[83528]: DEBUG cinder.utils [None req-4887e50d-e8ae-47d6-a0d6-ed4234a4a206 tempest-SnapshotDependencyTests-2073568565 None] Path /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-a69c2263-b13b-4112-bf20-5c4e5f5577fc not found in is_blk_device check {{(pid=83528) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Feb 25 16:03:00 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-4887e50d-e8ae-47d6-a0d6-ed4234a4a206 tempest-SnapshotDependencyTests-2073568565 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-b4a78707-43cc-4a9c-b6f9-e2b8ca42cfdc /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-a69c2263-b13b-4112-bf20-5c4e5f5577fc {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 25 16:03:00 devstack sudo[91858]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-b4a78707-43cc-4a9c-b6f9-e2b8ca42cfdc /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-a69c2263-b13b-4112-bf20-5c4e5f5577fc Feb 25 16:03:00 devstack sudo[91858]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 25 16:03:00 devstack sudo[91848]: pam_unix(sudo:session): session closed for user root Feb 25 16:03:00 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-0ae7bebc-e383-43e7-81fe-d06d39de55c8 tempest-CreateVolumesFromSourceVolumeTest-931808651 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-bf124820-f33f-4614-ba7a-f90023b30d5d" returned: 0 in 0.498s {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 25 16:03:00 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-0ae7bebc-e383-43e7-81fe-d06d39de55c8 tempest-CreateVolumesFromSourceVolumeTest-931808651 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-bf124820-f33f-4614-ba7a-f90023b30d5d {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 25 16:03:00 devstack sudo[91863]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-bf124820-f33f-4614-ba7a-f90023b30d5d Feb 25 16:03:00 devstack sudo[91863]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 25 16:03:00 devstack sudo[91854]: pam_unix(sudo:session): session closed for user root Feb 25 16:03:00 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-dfe21b5b-add1-4cba-a855-157546020835 tempest-CreateVolumesFromSnapshotTest-1082910625 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-f30072d2-6e3e-4fcd-9fc0-b97e812f66ce.71173e35-0ede-4a74-ab84-544e29e78339" returned: 0 in 0.470s {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 25 16:03:00 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-dfe21b5b-add1-4cba-a855-157546020835 tempest-CreateVolumesFromSnapshotTest-1082910625 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-f30072d2-6e3e-4fcd-9fc0-b97e812f66ce.71173e35-0ede-4a74-ab84-544e29e78339 {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 25 16:03:00 devstack sudo[91871]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-f30072d2-6e3e-4fcd-9fc0-b97e812f66ce.71173e35-0ede-4a74-ab84-544e29e78339 Feb 25 16:03:00 devstack sudo[91871]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 25 16:03:01 devstack sudo[91863]: pam_unix(sudo:session): session closed for user root Feb 25 16:03:01 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-0ae7bebc-e383-43e7-81fe-d06d39de55c8 tempest-CreateVolumesFromSourceVolumeTest-931808651 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-bf124820-f33f-4614-ba7a-f90023b30d5d" returned: 0 in 0.780s {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 25 16:03:01 devstack cinder-volume[83528]: DEBUG cinder.coordination [None req-0ae7bebc-e383-43e7-81fe-d06d39de55c8 tempest-CreateVolumesFromSourceVolumeTest-931808651 None] Lock "cinder-quobyte-bf124820-f33f-4614-ba7a-f90023b30d5d" released by "delete_volume" :: held 1.305s {{(pid=83528) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 25 16:03:01 devstack cinder-volume[83528]: DEBUG cinder.quota [None req-0ae7bebc-e383-43e7-81fe-d06d39de55c8 tempest-CreateVolumesFromSourceVolumeTest-931808651 None] Created reservations ['c2e427dc-9c5d-4236-bc3f-7cffb801286e', 'c04765cd-dcfe-4905-8172-13b9849aac0f', 'daabbaef-8215-48f7-a401-48c2478bdef6', '27392900-8def-43b7-af44-ffc728eed389'] {{(pid=83528) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 25 16:03:01 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-0ae7bebc-e383-43e7-81fe-d06d39de55c8 tempest-CreateVolumesFromSourceVolumeTest-931808651 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 25 16:03:01 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-0ae7bebc-e383-43e7-81fe-d06d39de55c8 tempest-CreateVolumesFromSourceVolumeTest-931808651 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 25 16:03:01 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.quobyte [None req-0ae7bebc-e383-43e7-81fe-d06d39de55c8 tempest-CreateVolumesFromSourceVolumeTest-931808651 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23e9d725-3e04-4cd9-bfe0-c8ef43305589': None} {{(pid=83528) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 25 16:03:01 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.quobyte [None req-0ae7bebc-e383-43e7-81fe-d06d39de55c8 tempest-CreateVolumesFromSourceVolumeTest-931808651 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23e9d725-3e04-4cd9-bfe0-c8ef43305589'] {{(pid=83528) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 25 16:03:01 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-0ae7bebc-e383-43e7-81fe-d06d39de55c8 tempest-CreateVolumesFromSourceVolumeTest-931808651 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 25 16:03:01 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-0ae7bebc-e383-43e7-81fe-d06d39de55c8 tempest-CreateVolumesFromSourceVolumeTest-931808651 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85 {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 25 16:03:01 devstack sudo[91882]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85 Feb 25 16:03:01 devstack sudo[91882]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 25 16:03:01 devstack sudo[91871]: pam_unix(sudo:session): session closed for user root Feb 25 16:03:01 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-dfe21b5b-add1-4cba-a855-157546020835 tempest-CreateVolumesFromSnapshotTest-1082910625 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-f30072d2-6e3e-4fcd-9fc0-b97e812f66ce.71173e35-0ede-4a74-ab84-544e29e78339" returned: 0 in 0.907s {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 25 16:03:01 devstack cinder-volume[83528]: DEBUG cinder.coordination [None req-dfe21b5b-add1-4cba-a855-157546020835 tempest-CreateVolumesFromSnapshotTest-1082910625 None] Lock "cinder-quobyte-71173e35-0ede-4a74-ab84-544e29e78339" released by "_delete_snapshot" :: held 2.604s {{(pid=83528) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 25 16:03:01 devstack cinder-volume[83528]: DEBUG cinder.coordination [None req-dfe21b5b-add1-4cba-a855-157546020835 tempest-CreateVolumesFromSnapshotTest-1082910625 None] Lock "cinder-quobyte-f30072d2-6e3e-4fcd-9fc0-b97e812f66ce" released by "delete_snapshot" :: held 2.625s {{(pid=83528) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 25 16:03:02 devstack cinder-volume[83528]: DEBUG cinder.quota [None req-dfe21b5b-add1-4cba-a855-157546020835 tempest-CreateVolumesFromSnapshotTest-1082910625 None] Created reservations ['200e5c22-419c-4655-b9cf-2a4d4bd0dd45', '29a5fdd5-5b91-4abc-ba31-8ecce825b0c7', '116dc7ae-bf87-4829-8238-9503b6cfe9a2', 'b32bede8-c1c0-4333-94f0-fc5c11771ce6'] {{(pid=83528) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 25 16:03:02 devstack cinder-volume[83528]: INFO cinder.volume.manager [None req-dfe21b5b-add1-4cba-a855-157546020835 tempest-CreateVolumesFromSnapshotTest-1082910625 None] Delete snapshot completed successfully. Feb 25 16:03:02 devstack cinder-volume[83528]: DEBUG cinder.coordination [None req-dfe21b5b-add1-4cba-a855-157546020835 tempest-CreateVolumesFromSnapshotTest-1082910625 None] Lock "cinder-71173e35-0ede-4a74-ab84-544e29e78339-delete_snapshot" released by "delete_snapshot" :: held 2.934s {{(pid=83528) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 25 16:03:02 devstack cinder-volume[83528]: DEBUG cinder.coordination [None req-9d8c66a1-4523-4f5d-95c8-03c6f794e284 tempest-CreateVolumesFromSourceVolumeTest-931808651 None] Acquiring lock "cinder-196d00a8-7736-4c23-838f-4990d7a20a76-delete_volume" by "delete_volume" {{(pid=83528) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 25 16:03:02 devstack cinder-volume[83528]: DEBUG cinder.coordination [None req-9d8c66a1-4523-4f5d-95c8-03c6f794e284 tempest-CreateVolumesFromSourceVolumeTest-931808651 None] Lock "cinder-196d00a8-7736-4c23-838f-4990d7a20a76-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=83528) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 25 16:03:02 devstack cinder-volume[83528]: DEBUG cinder.coordination [None req-18f8dea7-9b06-4199-a7ce-cc68de7dc027 tempest-CreateVolumesFromSnapshotTest-1082910625 None] Acquiring lock "cinder-f30072d2-6e3e-4fcd-9fc0-b97e812f66ce-delete_volume" by "delete_volume" {{(pid=83528) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 25 16:03:02 devstack cinder-volume[83528]: DEBUG cinder.coordination [None req-9d8c66a1-4523-4f5d-95c8-03c6f794e284 tempest-CreateVolumesFromSourceVolumeTest-931808651 None] Acquiring lock "cinder-quobyte-196d00a8-7736-4c23-838f-4990d7a20a76" by "delete_volume" {{(pid=83528) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 25 16:03:02 devstack cinder-volume[83528]: DEBUG cinder.coordination [None req-18f8dea7-9b06-4199-a7ce-cc68de7dc027 tempest-CreateVolumesFromSnapshotTest-1082910625 None] Lock "cinder-f30072d2-6e3e-4fcd-9fc0-b97e812f66ce-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=83528) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 25 16:03:02 devstack cinder-volume[83528]: DEBUG cinder.coordination [None req-9d8c66a1-4523-4f5d-95c8-03c6f794e284 tempest-CreateVolumesFromSourceVolumeTest-931808651 None] Lock "cinder-quobyte-196d00a8-7736-4c23-838f-4990d7a20a76" acquired by "delete_volume" :: waited 0.014s {{(pid=83528) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 25 16:03:02 devstack cinder-volume[83528]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ee1fc19-0715-4468-9921-750d8a420bc0]: (4, 'qcow2') {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 25 16:03:02 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-9d8c66a1-4523-4f5d-95c8-03c6f794e284 tempest-CreateVolumesFromSourceVolumeTest-931808651 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-196d00a8-7736-4c23-838f-4990d7a20a76 {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 25 16:03:02 devstack cinder-volume[83528]: DEBUG cinder.coordination [None req-18f8dea7-9b06-4199-a7ce-cc68de7dc027 tempest-CreateVolumesFromSnapshotTest-1082910625 None] Acquiring lock "cinder-quobyte-f30072d2-6e3e-4fcd-9fc0-b97e812f66ce" by "delete_volume" {{(pid=83528) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 25 16:03:02 devstack cinder-volume[83528]: DEBUG cinder.coordination [None req-18f8dea7-9b06-4199-a7ce-cc68de7dc027 tempest-CreateVolumesFromSnapshotTest-1082910625 None] Lock "cinder-quobyte-f30072d2-6e3e-4fcd-9fc0-b97e812f66ce" acquired by "delete_volume" :: waited 0.009s {{(pid=83528) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 25 16:03:02 devstack cinder-volume[83528]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb024d00-668e-490a-a994-0ec1d5963866]: (4, 'qcow2') {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 25 16:03:02 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-18f8dea7-9b06-4199-a7ce-cc68de7dc027 tempest-CreateVolumesFromSnapshotTest-1082910625 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-f30072d2-6e3e-4fcd-9fc0-b97e812f66ce {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 25 16:03:02 devstack sudo[91858]: pam_unix(sudo:session): session closed for user root Feb 25 16:03:02 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-4887e50d-e8ae-47d6-a0d6-ed4234a4a206 tempest-SnapshotDependencyTests-2073568565 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-b4a78707-43cc-4a9c-b6f9-e2b8ca42cfdc /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-a69c2263-b13b-4112-bf20-5c4e5f5577fc" returned: 0 in 2.232s {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 25 16:03:02 devstack cinder-volume[83528]: DEBUG oslo.privsep.daemon [-] privsep: reply[a84b409d-9219-431b-90df-f4ae09864bc3]: (4, 'qcow2') {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 25 16:03:02 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-4887e50d-e8ae-47d6-a0d6-ed4234a4a206 tempest-SnapshotDependencyTests-2073568565 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-b4a78707-43cc-4a9c-b6f9-e2b8ca42cfdc {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 25 16:03:02 devstack sudo[91884]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-196d00a8-7736-4c23-838f-4990d7a20a76 Feb 25 16:03:02 devstack sudo[91884]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 25 16:03:02 devstack sudo[91882]: pam_unix(sudo:session): session closed for user root Feb 25 16:03:02 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-0ae7bebc-e383-43e7-81fe-d06d39de55c8 tempest-CreateVolumesFromSourceVolumeTest-931808651 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85" returned: 0 in 1.129s {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 25 16:03:02 devstack cinder-volume[83528]: DEBUG cinder.manager [None req-0ae7bebc-e383-43e7-81fe-d06d39de55c8 tempest-CreateVolumesFromSourceVolumeTest-931808651 None] Notifying Schedulers of capabilities ... {{(pid=83528) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 25 16:03:02 devstack cinder-volume[83528]: INFO cinder.volume.manager [None req-0ae7bebc-e383-43e7-81fe-d06d39de55c8 tempest-CreateVolumesFromSourceVolumeTest-931808651 None] Deleted volume successfully. Feb 25 16:03:02 devstack cinder-volume[83528]: DEBUG cinder.coordination [None req-0ae7bebc-e383-43e7-81fe-d06d39de55c8 tempest-CreateVolumesFromSourceVolumeTest-931808651 None] Lock "cinder-bf124820-f33f-4614-ba7a-f90023b30d5d-delete_volume" released by "delete_volume" :: held 2.750s {{(pid=83528) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 25 16:03:02 devstack sudo[91886]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-f30072d2-6e3e-4fcd-9fc0-b97e812f66ce Feb 25 16:03:02 devstack sudo[91886]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 25 16:03:02 devstack sudo[91887]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-b4a78707-43cc-4a9c-b6f9-e2b8ca42cfdc Feb 25 16:03:02 devstack sudo[91887]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 25 16:03:03 devstack sudo[91884]: pam_unix(sudo:session): session closed for user root Feb 25 16:03:03 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-9d8c66a1-4523-4f5d-95c8-03c6f794e284 tempest-CreateVolumesFromSourceVolumeTest-931808651 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-196d00a8-7736-4c23-838f-4990d7a20a76" returned: 0 in 0.511s {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 25 16:03:03 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-9d8c66a1-4523-4f5d-95c8-03c6f794e284 tempest-CreateVolumesFromSourceVolumeTest-931808651 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-196d00a8-7736-4c23-838f-4990d7a20a76 {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 25 16:03:03 devstack sudo[91899]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-196d00a8-7736-4c23-838f-4990d7a20a76 Feb 25 16:03:03 devstack sudo[91899]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 25 16:03:03 devstack sudo[91886]: pam_unix(sudo:session): session closed for user root Feb 25 16:03:03 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-18f8dea7-9b06-4199-a7ce-cc68de7dc027 tempest-CreateVolumesFromSnapshotTest-1082910625 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-f30072d2-6e3e-4fcd-9fc0-b97e812f66ce" returned: 0 in 0.496s {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 25 16:03:03 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-18f8dea7-9b06-4199-a7ce-cc68de7dc027 tempest-CreateVolumesFromSnapshotTest-1082910625 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-f30072d2-6e3e-4fcd-9fc0-b97e812f66ce {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 25 16:03:03 devstack sudo[91901]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-f30072d2-6e3e-4fcd-9fc0-b97e812f66ce Feb 25 16:03:03 devstack sudo[91901]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 25 16:03:03 devstack sudo[91887]: pam_unix(sudo:session): session closed for user root Feb 25 16:03:03 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-4887e50d-e8ae-47d6-a0d6-ed4234a4a206 tempest-SnapshotDependencyTests-2073568565 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-b4a78707-43cc-4a9c-b6f9-e2b8ca42cfdc" returned: 0 in 0.635s {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 25 16:03:03 devstack cinder-volume[83528]: DEBUG cinder.image.image_utils [None req-4887e50d-e8ae-47d6-a0d6-ed4234a4a206 tempest-SnapshotDependencyTests-2073568565 None] Image conversion details: src /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-b4a78707-43cc-4a9c-b6f9-e2b8ca42cfdc, size 1024.00 MB, duration 2.23 sec, destination /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-a69c2263-b13b-4112-bf20-5c4e5f5577fc {{(pid=83528) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Feb 25 16:03:03 devstack cinder-volume[83528]: INFO cinder.image.image_utils [None req-4887e50d-e8ae-47d6-a0d6-ed4234a4a206 tempest-SnapshotDependencyTests-2073568565 None] Converted 1024.00 MB image at 458.47 MB/s Feb 25 16:03:03 devstack cinder-volume[83528]: WARNING cinder.volume.drivers.remotefs [None req-4887e50d-e8ae-47d6-a0d6-ed4234a4a206 tempest-SnapshotDependencyTests-2073568565 None] /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-a69c2263-b13b-4112-bf20-5c4e5f5577fc is being set with open permissions: ugo+rw Feb 25 16:03:03 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-4887e50d-e8ae-47d6-a0d6-ed4234a4a206 tempest-SnapshotDependencyTests-2073568565 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-a69c2263-b13b-4112-bf20-5c4e5f5577fc {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 25 16:03:03 devstack sudo[91904]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-a69c2263-b13b-4112-bf20-5c4e5f5577fc Feb 25 16:03:03 devstack sudo[91904]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 25 16:03:03 devstack sudo[91899]: pam_unix(sudo:session): session closed for user root Feb 25 16:03:03 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-9d8c66a1-4523-4f5d-95c8-03c6f794e284 tempest-CreateVolumesFromSourceVolumeTest-931808651 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-196d00a8-7736-4c23-838f-4990d7a20a76" returned: 0 in 0.418s {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 25 16:03:03 devstack cinder-volume[83528]: DEBUG cinder.coordination [None req-9d8c66a1-4523-4f5d-95c8-03c6f794e284 tempest-CreateVolumesFromSourceVolumeTest-931808651 None] Lock "cinder-quobyte-196d00a8-7736-4c23-838f-4990d7a20a76" released by "delete_volume" :: held 0.954s {{(pid=83528) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 25 16:03:03 devstack cinder-volume[83528]: DEBUG cinder.quota [None req-9d8c66a1-4523-4f5d-95c8-03c6f794e284 tempest-CreateVolumesFromSourceVolumeTest-931808651 None] Created reservations ['f8014768-7147-4c4a-a1a4-ebc6311f0fa8', 'dbc2160b-034c-4396-8308-fc2b7b71fe51', 'a8695aec-a135-4359-8c28-b69b590fd2b0', '4263cde6-4a22-467e-91dd-a8811d8f258f'] {{(pid=83528) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 25 16:03:03 devstack sudo[91901]: pam_unix(sudo:session): session closed for user root Feb 25 16:03:03 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-18f8dea7-9b06-4199-a7ce-cc68de7dc027 tempest-CreateVolumesFromSnapshotTest-1082910625 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-f30072d2-6e3e-4fcd-9fc0-b97e812f66ce" returned: 0 in 0.467s {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 25 16:03:03 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-9d8c66a1-4523-4f5d-95c8-03c6f794e284 tempest-CreateVolumesFromSourceVolumeTest-931808651 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 25 16:03:03 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-9d8c66a1-4523-4f5d-95c8-03c6f794e284 tempest-CreateVolumesFromSourceVolumeTest-931808651 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 25 16:03:03 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.quobyte [None req-9d8c66a1-4523-4f5d-95c8-03c6f794e284 tempest-CreateVolumesFromSourceVolumeTest-931808651 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23e9d725-3e04-4cd9-bfe0-c8ef43305589': None} {{(pid=83528) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 25 16:03:03 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.quobyte [None req-9d8c66a1-4523-4f5d-95c8-03c6f794e284 tempest-CreateVolumesFromSourceVolumeTest-931808651 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23e9d725-3e04-4cd9-bfe0-c8ef43305589'] {{(pid=83528) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 25 16:03:03 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-9d8c66a1-4523-4f5d-95c8-03c6f794e284 tempest-CreateVolumesFromSourceVolumeTest-931808651 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 25 16:03:03 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-9d8c66a1-4523-4f5d-95c8-03c6f794e284 tempest-CreateVolumesFromSourceVolumeTest-931808651 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85 {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 25 16:03:03 devstack cinder-volume[83528]: DEBUG cinder.coordination [None req-18f8dea7-9b06-4199-a7ce-cc68de7dc027 tempest-CreateVolumesFromSnapshotTest-1082910625 None] Lock "cinder-quobyte-f30072d2-6e3e-4fcd-9fc0-b97e812f66ce" released by "delete_volume" :: held 1.006s {{(pid=83528) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 25 16:03:03 devstack sudo[91908]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85 Feb 25 16:03:03 devstack sudo[91908]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 25 16:03:03 devstack cinder-volume[83528]: DEBUG cinder.quota [None req-18f8dea7-9b06-4199-a7ce-cc68de7dc027 tempest-CreateVolumesFromSnapshotTest-1082910625 None] Created reservations ['bc504656-ee93-4afd-9bbf-158641d40918', 'c2a1cad8-6820-4fff-b66f-4f5aa06389c0', '2ca0fa9a-89ec-4e0f-a756-96cd5b20e056', '344304bc-0762-428a-958d-66908b778d9b'] {{(pid=83528) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 25 16:03:03 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-18f8dea7-9b06-4199-a7ce-cc68de7dc027 tempest-CreateVolumesFromSnapshotTest-1082910625 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 25 16:03:03 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-18f8dea7-9b06-4199-a7ce-cc68de7dc027 tempest-CreateVolumesFromSnapshotTest-1082910625 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 25 16:03:03 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.quobyte [None req-18f8dea7-9b06-4199-a7ce-cc68de7dc027 tempest-CreateVolumesFromSnapshotTest-1082910625 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23e9d725-3e04-4cd9-bfe0-c8ef43305589': None} {{(pid=83528) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 25 16:03:03 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.quobyte [None req-18f8dea7-9b06-4199-a7ce-cc68de7dc027 tempest-CreateVolumesFromSnapshotTest-1082910625 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23e9d725-3e04-4cd9-bfe0-c8ef43305589'] {{(pid=83528) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 25 16:03:03 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-18f8dea7-9b06-4199-a7ce-cc68de7dc027 tempest-CreateVolumesFromSnapshotTest-1082910625 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 25 16:03:03 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-18f8dea7-9b06-4199-a7ce-cc68de7dc027 tempest-CreateVolumesFromSnapshotTest-1082910625 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85 {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 25 16:03:03 devstack sudo[91911]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85 Feb 25 16:03:03 devstack sudo[91911]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 25 16:03:03 devstack sudo[91904]: pam_unix(sudo:session): session closed for user root Feb 25 16:03:03 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-4887e50d-e8ae-47d6-a0d6-ed4234a4a206 tempest-SnapshotDependencyTests-2073568565 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-a69c2263-b13b-4112-bf20-5c4e5f5577fc" returned: 0 in 0.492s {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 25 16:03:03 devstack cinder-volume[83528]: DEBUG cinder.coordination [None req-4887e50d-e8ae-47d6-a0d6-ed4234a4a206 tempest-SnapshotDependencyTests-2073568565 None] Lock "cinder-quobyte-a69c2263-b13b-4112-bf20-5c4e5f5577fc" released by "_copy_volume_from_snapshot" :: held 4.468s {{(pid=83528) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 25 16:03:03 devstack cinder-volume[83528]: DEBUG cinder.coordination [None req-4887e50d-e8ae-47d6-a0d6-ed4234a4a206 tempest-SnapshotDependencyTests-2073568565 None] Lock "cinder-quobyte-b7612e5c-1617-4e2b-af75-173a562fa3a1-a69c2263-b13b-4112-bf20-5c4e5f5577fc" released by "_create_volume_from_snapshot" :: held 4.498s {{(pid=83528) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 25 16:03:03 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-4887e50d-e8ae-47d6-a0d6-ed4234a4a206 tempest-SnapshotDependencyTests-2073568565 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 4.521s {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 25 16:03:03 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-3f2c0c51-15e5-47c2-9096-652c2a74e086 tempest-VolumeDependencyTests-18272511 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 7.912s {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 25 16:03:03 devstack cinder-volume[83528]: INFO cinder.volume.drivers.remotefs [None req-3f2c0c51-15e5-47c2-9096-652c2a74e086 tempest-VolumeDependencyTests-18272511 None] Cloning volume 289e9ac3-09e6-4612-b623-d0bd566a16c4 to volume 703af21c-fa8f-4628-a245-be5618097128 Feb 25 16:03:03 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.remotefs [None req-3f2c0c51-15e5-47c2-9096-652c2a74e086 tempest-VolumeDependencyTests-18272511 None] Creating offline snapshot baf0aa98-aa14-4d46-b604-add6b24e7716 of volume 289e9ac3-09e6-4612-b623-d0bd566a16c4 {{(pid=83528) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Feb 25 16:03:04 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-4887e50d-e8ae-47d6-a0d6-ed4234a4a206 tempest-SnapshotDependencyTests-2073568565 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (34e74eac-8b7e-417a-8fbc-4b7b61a4a36e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a69c2263-b13b-4112-bf20-5c4e5f5577fc', 'volume_size': 1, 'snapshot_id': 'b7612e5c-1617-4e2b-af75-173a562fa3a1'}' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 25 16:03:04 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-4887e50d-e8ae-47d6-a0d6-ed4234a4a206 tempest-SnapshotDependencyTests-2073568565 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (548c5e7a-1ed8-4d08-8745-239398c1a7ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 25 16:03:04 devstack cinder-volume[83528]: DEBUG oslo.privsep.daemon [-] privsep: reply[3dd2f32b-c261-4f3d-b6a0-b5ae9d839b5e]: (4, 'qcow2') {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 25 16:03:04 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-3f2c0c51-15e5-47c2-9096-652c2a74e086 tempest-VolumeDependencyTests-18272511 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-289e9ac3-09e6-4612-b623-d0bd566a16c4 {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 25 16:03:04 devstack cinder-volume[83528]: INFO cinder.volume.flows.manager.create_volume [None req-4887e50d-e8ae-47d6-a0d6-ed4234a4a206 tempest-SnapshotDependencyTests-2073568565 None] Volume volume-a69c2263-b13b-4112-bf20-5c4e5f5577fc (a69c2263-b13b-4112-bf20-5c4e5f5577fc): created successfully Feb 25 16:03:04 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-4887e50d-e8ae-47d6-a0d6-ed4234a4a206 tempest-SnapshotDependencyTests-2073568565 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (548c5e7a-1ed8-4d08-8745-239398c1a7ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 25 16:03:04 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-4887e50d-e8ae-47d6-a0d6-ed4234a4a206 tempest-SnapshotDependencyTests-2073568565 None] Flow 'volume_create_manager' (0711e4bc-8b0d-4bb6-a94a-51b00c1881b4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83528) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 25 16:03:04 devstack cinder-volume[83528]: INFO cinder.volume.manager [None req-4887e50d-e8ae-47d6-a0d6-ed4234a4a206 tempest-SnapshotDependencyTests-2073568565 None] Created volume successfully. Feb 25 16:03:04 devstack sudo[91913]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-289e9ac3-09e6-4612-b623-d0bd566a16c4 Feb 25 16:03:04 devstack sudo[91913]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 25 16:03:04 devstack sudo[91908]: pam_unix(sudo:session): session closed for user root Feb 25 16:03:04 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-9d8c66a1-4523-4f5d-95c8-03c6f794e284 tempest-CreateVolumesFromSourceVolumeTest-931808651 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85" returned: 0 in 0.430s {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 25 16:03:04 devstack cinder-volume[83528]: DEBUG cinder.manager [None req-9d8c66a1-4523-4f5d-95c8-03c6f794e284 tempest-CreateVolumesFromSourceVolumeTest-931808651 None] Notifying Schedulers of capabilities ... {{(pid=83528) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 25 16:03:04 devstack cinder-volume[83528]: INFO cinder.volume.manager [None req-9d8c66a1-4523-4f5d-95c8-03c6f794e284 tempest-CreateVolumesFromSourceVolumeTest-931808651 None] Deleted volume successfully. Feb 25 16:03:04 devstack cinder-volume[83528]: DEBUG cinder.coordination [None req-9d8c66a1-4523-4f5d-95c8-03c6f794e284 tempest-CreateVolumesFromSourceVolumeTest-931808651 None] Lock "cinder-196d00a8-7736-4c23-838f-4990d7a20a76-delete_volume" released by "delete_volume" :: held 1.640s {{(pid=83528) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 25 16:03:04 devstack cinder-volume[83528]: DEBUG cinder.coordination [None req-1d3594e8-ee39-43ef-8872-0c342e9f9e5f tempest-SnapshotDependencyTests-2073568565 None] Acquiring lock "cinder-b7612e5c-1617-4e2b-af75-173a562fa3a1-delete_snapshot" by "delete_snapshot" {{(pid=83528) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 25 16:03:04 devstack cinder-volume[83528]: DEBUG cinder.coordination [None req-1d3594e8-ee39-43ef-8872-0c342e9f9e5f tempest-SnapshotDependencyTests-2073568565 None] Lock "cinder-b7612e5c-1617-4e2b-af75-173a562fa3a1-delete_snapshot" acquired by "delete_snapshot" :: waited 0.021s {{(pid=83528) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 25 16:03:04 devstack cinder-volume[83528]: DEBUG cinder.coordination [None req-1d3594e8-ee39-43ef-8872-0c342e9f9e5f tempest-SnapshotDependencyTests-2073568565 None] Acquiring lock "cinder-quobyte-b4a78707-43cc-4a9c-b6f9-e2b8ca42cfdc" by "delete_snapshot" {{(pid=83528) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 25 16:03:04 devstack cinder-volume[83528]: DEBUG cinder.coordination [None req-1d3594e8-ee39-43ef-8872-0c342e9f9e5f tempest-SnapshotDependencyTests-2073568565 None] Lock "cinder-quobyte-b4a78707-43cc-4a9c-b6f9-e2b8ca42cfdc" acquired by "delete_snapshot" :: waited 0.008s {{(pid=83528) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 25 16:03:04 devstack cinder-volume[83528]: DEBUG cinder.coordination [None req-1d3594e8-ee39-43ef-8872-0c342e9f9e5f tempest-SnapshotDependencyTests-2073568565 None] Acquiring lock "cinder-quobyte-b7612e5c-1617-4e2b-af75-173a562fa3a1" by "_delete_snapshot" {{(pid=83528) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 25 16:03:04 devstack cinder-volume[83528]: DEBUG cinder.coordination [None req-1d3594e8-ee39-43ef-8872-0c342e9f9e5f tempest-SnapshotDependencyTests-2073568565 None] Lock "cinder-quobyte-b7612e5c-1617-4e2b-af75-173a562fa3a1" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=83528) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 25 16:03:04 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.remotefs [None req-1d3594e8-ee39-43ef-8872-0c342e9f9e5f tempest-SnapshotDependencyTests-2073568565 None] Deleting offline snapshot b7612e5c-1617-4e2b-af75-173a562fa3a1 of volume b4a78707-43cc-4a9c-b6f9-e2b8ca42cfdc {{(pid=83528) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Feb 25 16:03:04 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.remotefs [None req-1d3594e8-ee39-43ef-8872-0c342e9f9e5f tempest-SnapshotDependencyTests-2073568565 None] snapshot_file for this snap is: volume-b4a78707-43cc-4a9c-b6f9-e2b8ca42cfdc.b7612e5c-1617-4e2b-af75-173a562fa3a1 {{(pid=83528) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Feb 25 16:03:04 devstack cinder-volume[83528]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e2e6d32-9cff-4361-a27e-adf787ebaf0f]: (4, 'qcow2') {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 25 16:03:04 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-1d3594e8-ee39-43ef-8872-0c342e9f9e5f tempest-SnapshotDependencyTests-2073568565 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-b4a78707-43cc-4a9c-b6f9-e2b8ca42cfdc.b7612e5c-1617-4e2b-af75-173a562fa3a1 {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 25 16:03:04 devstack sudo[91916]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-b4a78707-43cc-4a9c-b6f9-e2b8ca42cfdc.b7612e5c-1617-4e2b-af75-173a562fa3a1 Feb 25 16:03:04 devstack sudo[91916]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 25 16:03:04 devstack sudo[91911]: pam_unix(sudo:session): session closed for user root Feb 25 16:03:04 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-18f8dea7-9b06-4199-a7ce-cc68de7dc027 tempest-CreateVolumesFromSnapshotTest-1082910625 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85" returned: 0 in 0.633s {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 25 16:03:04 devstack cinder-volume[83528]: DEBUG cinder.manager [None req-18f8dea7-9b06-4199-a7ce-cc68de7dc027 tempest-CreateVolumesFromSnapshotTest-1082910625 None] Notifying Schedulers of capabilities ... {{(pid=83528) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 25 16:03:04 devstack cinder-volume[83528]: INFO cinder.volume.manager [None req-18f8dea7-9b06-4199-a7ce-cc68de7dc027 tempest-CreateVolumesFromSnapshotTest-1082910625 None] Deleted volume successfully. Feb 25 16:03:04 devstack cinder-volume[83528]: DEBUG cinder.coordination [None req-18f8dea7-9b06-4199-a7ce-cc68de7dc027 tempest-CreateVolumesFromSnapshotTest-1082910625 None] Lock "cinder-f30072d2-6e3e-4fcd-9fc0-b97e812f66ce-delete_volume" released by "delete_volume" :: held 1.815s {{(pid=83528) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 25 16:03:04 devstack sudo[91913]: pam_unix(sudo:session): session closed for user root Feb 25 16:03:04 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-3f2c0c51-15e5-47c2-9096-652c2a74e086 tempest-VolumeDependencyTests-18272511 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-289e9ac3-09e6-4612-b623-d0bd566a16c4" returned: 0 in 0.586s {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 25 16:03:04 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-3f2c0c51-15e5-47c2-9096-652c2a74e086 tempest-VolumeDependencyTests-18272511 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-289e9ac3-09e6-4612-b623-d0bd566a16c4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-289e9ac3-09e6-4612-b623-d0bd566a16c4.baf0aa98-aa14-4d46-b604-add6b24e7716 1G {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 25 16:03:04 devstack sudo[91922]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-289e9ac3-09e6-4612-b623-d0bd566a16c4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-289e9ac3-09e6-4612-b623-d0bd566a16c4.baf0aa98-aa14-4d46-b604-add6b24e7716 1G Feb 25 16:03:04 devstack sudo[91922]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 25 16:03:04 devstack cinder-volume[83528]: DEBUG cinder.coordination [None req-05c98399-17a9-4d51-b5a2-417080986e04 tempest-CreateVolumesFromSourceVolumeTest-931808651 None] Acquiring lock "cinder-ccba4e52-9616-4165-a4b0-4fcf5a4fc1bf-delete_volume" by "delete_volume" {{(pid=83528) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 25 16:03:04 devstack cinder-volume[83528]: DEBUG cinder.coordination [None req-05c98399-17a9-4d51-b5a2-417080986e04 tempest-CreateVolumesFromSourceVolumeTest-931808651 None] Lock "cinder-ccba4e52-9616-4165-a4b0-4fcf5a4fc1bf-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=83528) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 25 16:03:04 devstack cinder-volume[83528]: DEBUG cinder.coordination [None req-05c98399-17a9-4d51-b5a2-417080986e04 tempest-CreateVolumesFromSourceVolumeTest-931808651 None] Acquiring lock "cinder-quobyte-ccba4e52-9616-4165-a4b0-4fcf5a4fc1bf" by "delete_volume" {{(pid=83528) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 25 16:03:04 devstack cinder-volume[83528]: DEBUG cinder.coordination [None req-05c98399-17a9-4d51-b5a2-417080986e04 tempest-CreateVolumesFromSourceVolumeTest-931808651 None] Lock "cinder-quobyte-ccba4e52-9616-4165-a4b0-4fcf5a4fc1bf" acquired by "delete_volume" :: waited 0.012s {{(pid=83528) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 25 16:03:04 devstack cinder-volume[83528]: DEBUG oslo.privsep.daemon [-] privsep: reply[47f81d79-e095-4193-9b25-d55c37de0bbd]: (4, 'qcow2') {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 25 16:03:04 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-05c98399-17a9-4d51-b5a2-417080986e04 tempest-CreateVolumesFromSourceVolumeTest-931808651 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-ccba4e52-9616-4165-a4b0-4fcf5a4fc1bf {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 25 16:03:04 devstack sudo[91916]: pam_unix(sudo:session): session closed for user root Feb 25 16:03:04 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-1d3594e8-ee39-43ef-8872-0c342e9f9e5f tempest-SnapshotDependencyTests-2073568565 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-b4a78707-43cc-4a9c-b6f9-e2b8ca42cfdc.b7612e5c-1617-4e2b-af75-173a562fa3a1" returned: 0 in 0.585s {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 25 16:03:04 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.remotefs [None req-1d3594e8-ee39-43ef-8872-0c342e9f9e5f tempest-SnapshotDependencyTests-2073568565 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b4a78707-43cc-4a9c-b6f9-e2b8ca42cfdc(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83528) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Feb 25 16:03:04 devstack cinder-volume[83528]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b03e687-e15f-47c8-9c7d-d6f75308cdd0]: (4, 'qcow2') {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 25 16:03:04 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-1d3594e8-ee39-43ef-8872-0c342e9f9e5f tempest-SnapshotDependencyTests-2073568565 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-b4a78707-43cc-4a9c-b6f9-e2b8ca42cfdc {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 25 16:03:04 devstack sudo[91928]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-ccba4e52-9616-4165-a4b0-4fcf5a4fc1bf Feb 25 16:03:04 devstack sudo[91928]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 25 16:03:04 devstack sudo[91929]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-b4a78707-43cc-4a9c-b6f9-e2b8ca42cfdc Feb 25 16:03:04 devstack sudo[91929]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 25 16:03:05 devstack sudo[91922]: pam_unix(sudo:session): session closed for user root Feb 25 16:03:05 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-3f2c0c51-15e5-47c2-9096-652c2a74e086 tempest-VolumeDependencyTests-18272511 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-289e9ac3-09e6-4612-b623-d0bd566a16c4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-289e9ac3-09e6-4612-b623-d0bd566a16c4.baf0aa98-aa14-4d46-b604-add6b24e7716 1G" returned: 0 in 0.599s {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 25 16:03:05 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-3f2c0c51-15e5-47c2-9096-652c2a74e086 tempest-VolumeDependencyTests-18272511 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-289e9ac3-09e6-4612-b623-d0bd566a16c4 -F qcow2 /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-289e9ac3-09e6-4612-b623-d0bd566a16c4.baf0aa98-aa14-4d46-b604-add6b24e7716 {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 25 16:03:05 devstack sudo[91935]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-289e9ac3-09e6-4612-b623-d0bd566a16c4 -F qcow2 /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-289e9ac3-09e6-4612-b623-d0bd566a16c4.baf0aa98-aa14-4d46-b604-add6b24e7716 Feb 25 16:03:05 devstack sudo[91935]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 25 16:03:05 devstack sudo[91928]: pam_unix(sudo:session): session closed for user root Feb 25 16:03:05 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-05c98399-17a9-4d51-b5a2-417080986e04 tempest-CreateVolumesFromSourceVolumeTest-931808651 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-ccba4e52-9616-4165-a4b0-4fcf5a4fc1bf" returned: 0 in 0.613s {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 25 16:03:05 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-05c98399-17a9-4d51-b5a2-417080986e04 tempest-CreateVolumesFromSourceVolumeTest-931808651 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-ccba4e52-9616-4165-a4b0-4fcf5a4fc1bf {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 25 16:03:05 devstack sudo[91943]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-ccba4e52-9616-4165-a4b0-4fcf5a4fc1bf Feb 25 16:03:05 devstack sudo[91943]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 25 16:03:05 devstack sudo[91929]: pam_unix(sudo:session): session closed for user root Feb 25 16:03:05 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-1d3594e8-ee39-43ef-8872-0c342e9f9e5f tempest-SnapshotDependencyTests-2073568565 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-b4a78707-43cc-4a9c-b6f9-e2b8ca42cfdc" returned: 0 in 0.637s {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 25 16:03:05 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-1d3594e8-ee39-43ef-8872-0c342e9f9e5f tempest-SnapshotDependencyTests-2073568565 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-b4a78707-43cc-4a9c-b6f9-e2b8ca42cfdc.b7612e5c-1617-4e2b-af75-173a562fa3a1 {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 25 16:03:05 devstack sudo[91945]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-b4a78707-43cc-4a9c-b6f9-e2b8ca42cfdc.b7612e5c-1617-4e2b-af75-173a562fa3a1 Feb 25 16:03:05 devstack sudo[91945]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 25 16:03:05 devstack sudo[91935]: pam_unix(sudo:session): session closed for user root Feb 25 16:03:05 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-3f2c0c51-15e5-47c2-9096-652c2a74e086 tempest-VolumeDependencyTests-18272511 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-289e9ac3-09e6-4612-b623-d0bd566a16c4 -F qcow2 /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-289e9ac3-09e6-4612-b623-d0bd566a16c4.baf0aa98-aa14-4d46-b604-add6b24e7716" returned: 0 in 0.553s {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 25 16:03:05 devstack cinder-volume[83528]: WARNING cinder.volume.drivers.remotefs [None req-3f2c0c51-15e5-47c2-9096-652c2a74e086 tempest-VolumeDependencyTests-18272511 None] /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-289e9ac3-09e6-4612-b623-d0bd566a16c4.baf0aa98-aa14-4d46-b604-add6b24e7716 is being set with open permissions: ugo+rw Feb 25 16:03:05 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-3f2c0c51-15e5-47c2-9096-652c2a74e086 tempest-VolumeDependencyTests-18272511 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-289e9ac3-09e6-4612-b623-d0bd566a16c4.baf0aa98-aa14-4d46-b604-add6b24e7716 {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 25 16:03:05 devstack sudo[91950]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-289e9ac3-09e6-4612-b623-d0bd566a16c4.baf0aa98-aa14-4d46-b604-add6b24e7716 Feb 25 16:03:05 devstack sudo[91950]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 25 16:03:06 devstack sudo[91943]: pam_unix(sudo:session): session closed for user root Feb 25 16:03:06 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-05c98399-17a9-4d51-b5a2-417080986e04 tempest-CreateVolumesFromSourceVolumeTest-931808651 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-ccba4e52-9616-4165-a4b0-4fcf5a4fc1bf" returned: 0 in 0.607s {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 25 16:03:06 devstack sudo[91945]: pam_unix(sudo:session): session closed for user root Feb 25 16:03:06 devstack cinder-volume[83528]: DEBUG cinder.coordination [None req-05c98399-17a9-4d51-b5a2-417080986e04 tempest-CreateVolumesFromSourceVolumeTest-931808651 None] Lock "cinder-quobyte-ccba4e52-9616-4165-a4b0-4fcf5a4fc1bf" released by "delete_volume" :: held 1.260s {{(pid=83528) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 25 16:03:06 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-1d3594e8-ee39-43ef-8872-0c342e9f9e5f tempest-SnapshotDependencyTests-2073568565 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-b4a78707-43cc-4a9c-b6f9-e2b8ca42cfdc.b7612e5c-1617-4e2b-af75-173a562fa3a1" returned: 0 in 0.597s {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 25 16:03:06 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-1d3594e8-ee39-43ef-8872-0c342e9f9e5f tempest-SnapshotDependencyTests-2073568565 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-b4a78707-43cc-4a9c-b6f9-e2b8ca42cfdc.b7612e5c-1617-4e2b-af75-173a562fa3a1 {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 25 16:03:06 devstack cinder-volume[83528]: DEBUG cinder.quota [None req-05c98399-17a9-4d51-b5a2-417080986e04 tempest-CreateVolumesFromSourceVolumeTest-931808651 None] Created reservations ['04e8b11f-bfe1-4651-8a19-d8867a97bb5f', 'f9580cba-21a6-4342-95c6-d3c1fdaca57d', '84040650-bce3-4126-9d96-7fa3412d016b', 'c42a5c4c-b4e0-4f36-b624-b57b550bc85d'] {{(pid=83528) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 25 16:03:06 devstack sudo[91956]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-b4a78707-43cc-4a9c-b6f9-e2b8ca42cfdc.b7612e5c-1617-4e2b-af75-173a562fa3a1 Feb 25 16:03:06 devstack sudo[91956]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 25 16:03:06 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-05c98399-17a9-4d51-b5a2-417080986e04 tempest-CreateVolumesFromSourceVolumeTest-931808651 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 25 16:03:06 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-05c98399-17a9-4d51-b5a2-417080986e04 tempest-CreateVolumesFromSourceVolumeTest-931808651 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 25 16:03:06 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.quobyte [None req-05c98399-17a9-4d51-b5a2-417080986e04 tempest-CreateVolumesFromSourceVolumeTest-931808651 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23e9d725-3e04-4cd9-bfe0-c8ef43305589': None} {{(pid=83528) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 25 16:03:06 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.quobyte [None req-05c98399-17a9-4d51-b5a2-417080986e04 tempest-CreateVolumesFromSourceVolumeTest-931808651 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23e9d725-3e04-4cd9-bfe0-c8ef43305589'] {{(pid=83528) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 25 16:03:06 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-05c98399-17a9-4d51-b5a2-417080986e04 tempest-CreateVolumesFromSourceVolumeTest-931808651 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 25 16:03:06 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-05c98399-17a9-4d51-b5a2-417080986e04 tempest-CreateVolumesFromSourceVolumeTest-931808651 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85 {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 25 16:03:06 devstack sudo[91959]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85 Feb 25 16:03:06 devstack sudo[91959]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 25 16:03:06 devstack sudo[91950]: pam_unix(sudo:session): session closed for user root Feb 25 16:03:06 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-3f2c0c51-15e5-47c2-9096-652c2a74e086 tempest-VolumeDependencyTests-18272511 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-289e9ac3-09e6-4612-b623-d0bd566a16c4.baf0aa98-aa14-4d46-b604-add6b24e7716" returned: 0 in 0.537s {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 25 16:03:06 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-3f2c0c51-15e5-47c2-9096-652c2a74e086 tempest-VolumeDependencyTests-18272511 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-289e9ac3-09e6-4612-b623-d0bd566a16c4.info {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 25 16:03:06 devstack sudo[91961]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-289e9ac3-09e6-4612-b623-d0bd566a16c4.info Feb 25 16:03:06 devstack sudo[91961]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 25 16:03:06 devstack sudo[91956]: pam_unix(sudo:session): session closed for user root Feb 25 16:03:06 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-1d3594e8-ee39-43ef-8872-0c342e9f9e5f tempest-SnapshotDependencyTests-2073568565 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-b4a78707-43cc-4a9c-b6f9-e2b8ca42cfdc.b7612e5c-1617-4e2b-af75-173a562fa3a1" returned: 0 in 0.448s {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 25 16:03:06 devstack cinder-volume[83528]: DEBUG cinder.coordination [None req-1d3594e8-ee39-43ef-8872-0c342e9f9e5f tempest-SnapshotDependencyTests-2073568565 None] Lock "cinder-quobyte-b7612e5c-1617-4e2b-af75-173a562fa3a1" released by "_delete_snapshot" :: held 2.340s {{(pid=83528) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 25 16:03:06 devstack cinder-volume[83528]: DEBUG cinder.coordination [None req-1d3594e8-ee39-43ef-8872-0c342e9f9e5f tempest-SnapshotDependencyTests-2073568565 None] Lock "cinder-quobyte-b4a78707-43cc-4a9c-b6f9-e2b8ca42cfdc" released by "delete_snapshot" :: held 2.360s {{(pid=83528) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 25 16:03:06 devstack sudo[91959]: pam_unix(sudo:session): session closed for user root Feb 25 16:03:06 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-05c98399-17a9-4d51-b5a2-417080986e04 tempest-CreateVolumesFromSourceVolumeTest-931808651 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85" returned: 0 in 0.450s {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 25 16:03:06 devstack cinder-volume[83528]: DEBUG cinder.manager [None req-05c98399-17a9-4d51-b5a2-417080986e04 tempest-CreateVolumesFromSourceVolumeTest-931808651 None] Notifying Schedulers of capabilities ... {{(pid=83528) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 25 16:03:06 devstack cinder-volume[83528]: DEBUG cinder.quota [None req-1d3594e8-ee39-43ef-8872-0c342e9f9e5f tempest-SnapshotDependencyTests-2073568565 None] Created reservations ['24f6a7ef-bbf4-4c93-9435-83cdde5fe1f4', '8d4c10b8-6105-4450-a6b5-1cb0b3fc3a43', '16d905d4-cc98-4a60-baf8-e865ef7fc7f2', 'd28bf767-6aa9-4d43-8deb-b3f97fd8af4c'] {{(pid=83528) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 25 16:03:06 devstack cinder-volume[83528]: INFO cinder.volume.manager [None req-05c98399-17a9-4d51-b5a2-417080986e04 tempest-CreateVolumesFromSourceVolumeTest-931808651 None] Deleted volume successfully. Feb 25 16:03:06 devstack cinder-volume[83528]: DEBUG cinder.coordination [None req-05c98399-17a9-4d51-b5a2-417080986e04 tempest-CreateVolumesFromSourceVolumeTest-931808651 None] Lock "cinder-ccba4e52-9616-4165-a4b0-4fcf5a4fc1bf-delete_volume" released by "delete_volume" :: held 1.919s {{(pid=83528) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 25 16:03:06 devstack cinder-volume[83528]: INFO cinder.volume.manager [None req-1d3594e8-ee39-43ef-8872-0c342e9f9e5f tempest-SnapshotDependencyTests-2073568565 None] Delete snapshot completed successfully. Feb 25 16:03:06 devstack cinder-volume[83528]: DEBUG cinder.coordination [None req-1d3594e8-ee39-43ef-8872-0c342e9f9e5f tempest-SnapshotDependencyTests-2073568565 None] Lock "cinder-b7612e5c-1617-4e2b-af75-173a562fa3a1-delete_snapshot" released by "delete_snapshot" :: held 2.485s {{(pid=83528) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 25 16:03:06 devstack sudo[91961]: pam_unix(sudo:session): session closed for user root Feb 25 16:03:06 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-3f2c0c51-15e5-47c2-9096-652c2a74e086 tempest-VolumeDependencyTests-18272511 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-289e9ac3-09e6-4612-b623-d0bd566a16c4.info" returned: 0 in 0.448s {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 25 16:03:06 devstack cinder-volume[83528]: WARNING cinder.volume.drivers.remotefs [None req-3f2c0c51-15e5-47c2-9096-652c2a74e086 tempest-VolumeDependencyTests-18272511 None] /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-289e9ac3-09e6-4612-b623-d0bd566a16c4.info is being set with open permissions: ugo+rw Feb 25 16:03:06 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-3f2c0c51-15e5-47c2-9096-652c2a74e086 tempest-VolumeDependencyTests-18272511 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-289e9ac3-09e6-4612-b623-d0bd566a16c4.info {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 25 16:03:06 devstack sudo[91966]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-289e9ac3-09e6-4612-b623-d0bd566a16c4.info Feb 25 16:03:06 devstack sudo[91966]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 25 16:03:06 devstack cinder-volume[83528]: DEBUG cinder.coordination [None req-2db6f972-6491-4c30-a197-8b63b7bbbaef tempest-CreateVolumesFromSourceVolumeTest-931808651 None] Acquiring lock "cinder-c1e1de1e-613e-42ad-8f13-f8bceaf705d9-delete_volume" by "delete_volume" {{(pid=83528) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 25 16:03:07 devstack cinder-volume[83528]: DEBUG cinder.coordination [None req-2db6f972-6491-4c30-a197-8b63b7bbbaef tempest-CreateVolumesFromSourceVolumeTest-931808651 None] Lock "cinder-c1e1de1e-613e-42ad-8f13-f8bceaf705d9-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=83528) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 25 16:03:07 devstack cinder-volume[83528]: DEBUG cinder.coordination [None req-2db6f972-6491-4c30-a197-8b63b7bbbaef tempest-CreateVolumesFromSourceVolumeTest-931808651 None] Acquiring lock "cinder-quobyte-c1e1de1e-613e-42ad-8f13-f8bceaf705d9" by "delete_volume" {{(pid=83528) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 25 16:03:07 devstack cinder-volume[83528]: DEBUG cinder.coordination [None req-2db6f972-6491-4c30-a197-8b63b7bbbaef tempest-CreateVolumesFromSourceVolumeTest-931808651 None] Lock "cinder-quobyte-c1e1de1e-613e-42ad-8f13-f8bceaf705d9" acquired by "delete_volume" :: waited 0.007s {{(pid=83528) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 25 16:03:07 devstack cinder-volume[83528]: DEBUG oslo.privsep.daemon [-] privsep: reply[aab50b73-de1e-4fd6-9a8d-dac43dbe085d]: (4, 'qcow2') {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 25 16:03:07 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-2db6f972-6491-4c30-a197-8b63b7bbbaef tempest-CreateVolumesFromSourceVolumeTest-931808651 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-c1e1de1e-613e-42ad-8f13-f8bceaf705d9 {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 25 16:03:07 devstack sudo[91968]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-c1e1de1e-613e-42ad-8f13-f8bceaf705d9 Feb 25 16:03:07 devstack sudo[91968]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 25 16:03:07 devstack sudo[91966]: pam_unix(sudo:session): session closed for user root Feb 25 16:03:07 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-3f2c0c51-15e5-47c2-9096-652c2a74e086 tempest-VolumeDependencyTests-18272511 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-289e9ac3-09e6-4612-b623-d0bd566a16c4.info" returned: 0 in 0.445s {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 25 16:03:07 devstack cinder-volume[83528]: DEBUG cinder.coordination [None req-3f2c0c51-15e5-47c2-9096-652c2a74e086 tempest-VolumeDependencyTests-18272511 None] Acquiring lock "cinder-quobyte-703af21c-fa8f-4628-a245-be5618097128" by "_copy_volume_from_snapshot" {{(pid=83528) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 25 16:03:07 devstack cinder-volume[83528]: DEBUG cinder.coordination [None req-3f2c0c51-15e5-47c2-9096-652c2a74e086 tempest-VolumeDependencyTests-18272511 None] Lock "cinder-quobyte-703af21c-fa8f-4628-a245-be5618097128" acquired by "_copy_volume_from_snapshot" :: waited 0.008s {{(pid=83528) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 25 16:03:07 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.quobyte [None req-3f2c0c51-15e5-47c2-9096-652c2a74e086 tempest-VolumeDependencyTests-18272511 None] snapshot: baf0aa98-aa14-4d46-b604-add6b24e7716, volume: 703af21c-fa8f-4628-a245-be5618097128, {{(pid=83528) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Feb 25 16:03:07 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-3f2c0c51-15e5-47c2-9096-652c2a74e086 tempest-VolumeDependencyTests-18272511 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 25 16:03:07 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-3f2c0c51-15e5-47c2-9096-652c2a74e086 tempest-VolumeDependencyTests-18272511 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 25 16:03:07 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.quobyte [None req-3f2c0c51-15e5-47c2-9096-652c2a74e086 tempest-VolumeDependencyTests-18272511 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23e9d725-3e04-4cd9-bfe0-c8ef43305589': None} {{(pid=83528) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 25 16:03:07 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.quobyte [None req-3f2c0c51-15e5-47c2-9096-652c2a74e086 tempest-VolumeDependencyTests-18272511 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23e9d725-3e04-4cd9-bfe0-c8ef43305589'] {{(pid=83528) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 25 16:03:07 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-3f2c0c51-15e5-47c2-9096-652c2a74e086 tempest-VolumeDependencyTests-18272511 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 25 16:03:07 devstack cinder-volume[83528]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff9bcaa8-863b-4e88-91ce-8ef028b12d79]: (4, 'qcow2') {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 25 16:03:07 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-3f2c0c51-15e5-47c2-9096-652c2a74e086 tempest-VolumeDependencyTests-18272511 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-289e9ac3-09e6-4612-b623-d0bd566a16c4.baf0aa98-aa14-4d46-b604-add6b24e7716 {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 25 16:03:07 devstack sudo[91971]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-289e9ac3-09e6-4612-b623-d0bd566a16c4.baf0aa98-aa14-4d46-b604-add6b24e7716 Feb 25 16:03:07 devstack sudo[91971]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 25 16:03:07 devstack cinder-volume[83528]: DEBUG cinder.coordination [None req-fb7c5d67-e3d0-46ee-87df-8748026e2966 tempest-SnapshotDependencyTests-2073568565 None] Acquiring lock "cinder-b4a78707-43cc-4a9c-b6f9-e2b8ca42cfdc-delete_volume" by "delete_volume" {{(pid=83528) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 25 16:03:07 devstack cinder-volume[83528]: DEBUG cinder.coordination [None req-fb7c5d67-e3d0-46ee-87df-8748026e2966 tempest-SnapshotDependencyTests-2073568565 None] Lock "cinder-b4a78707-43cc-4a9c-b6f9-e2b8ca42cfdc-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=83528) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 25 16:03:07 devstack cinder-volume[83528]: DEBUG cinder.coordination [None req-fb7c5d67-e3d0-46ee-87df-8748026e2966 tempest-SnapshotDependencyTests-2073568565 None] Acquiring lock "cinder-quobyte-b4a78707-43cc-4a9c-b6f9-e2b8ca42cfdc" by "delete_volume" {{(pid=83528) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 25 16:03:07 devstack cinder-volume[83528]: DEBUG cinder.coordination [None req-fb7c5d67-e3d0-46ee-87df-8748026e2966 tempest-SnapshotDependencyTests-2073568565 None] Lock "cinder-quobyte-b4a78707-43cc-4a9c-b6f9-e2b8ca42cfdc" acquired by "delete_volume" :: waited 0.009s {{(pid=83528) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 25 16:03:07 devstack cinder-volume[83528]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc5669d5-a8e0-4c7f-9a0c-e17ca8b81f93]: (4, 'qcow2') {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 25 16:03:07 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-fb7c5d67-e3d0-46ee-87df-8748026e2966 tempest-SnapshotDependencyTests-2073568565 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-b4a78707-43cc-4a9c-b6f9-e2b8ca42cfdc {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 25 16:03:07 devstack sudo[91973]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-b4a78707-43cc-4a9c-b6f9-e2b8ca42cfdc Feb 25 16:03:07 devstack sudo[91973]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 25 16:03:07 devstack sudo[91968]: pam_unix(sudo:session): session closed for user root Feb 25 16:03:07 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-2db6f972-6491-4c30-a197-8b63b7bbbaef tempest-CreateVolumesFromSourceVolumeTest-931808651 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-c1e1de1e-613e-42ad-8f13-f8bceaf705d9" returned: 0 in 0.528s {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 25 16:03:07 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-2db6f972-6491-4c30-a197-8b63b7bbbaef tempest-CreateVolumesFromSourceVolumeTest-931808651 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-c1e1de1e-613e-42ad-8f13-f8bceaf705d9 {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 25 16:03:07 devstack sudo[91978]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-c1e1de1e-613e-42ad-8f13-f8bceaf705d9 Feb 25 16:03:07 devstack sudo[91978]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 25 16:03:07 devstack sudo[91971]: pam_unix(sudo:session): session closed for user root Feb 25 16:03:07 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-3f2c0c51-15e5-47c2-9096-652c2a74e086 tempest-VolumeDependencyTests-18272511 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-289e9ac3-09e6-4612-b623-d0bd566a16c4.baf0aa98-aa14-4d46-b604-add6b24e7716" returned: 0 in 0.555s {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 25 16:03:07 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.remotefs [None req-3f2c0c51-15e5-47c2-9096-652c2a74e086 tempest-VolumeDependencyTests-18272511 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-289e9ac3-09e6-4612-b623-d0bd566a16c4(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83528) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Feb 25 16:03:07 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.quobyte [None req-3f2c0c51-15e5-47c2-9096-652c2a74e086 tempest-VolumeDependencyTests-18272511 None] will copy from snapshot at /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-289e9ac3-09e6-4612-b623-d0bd566a16c4 {{(pid=83528) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Feb 25 16:03:07 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.quobyte [None req-3f2c0c51-15e5-47c2-9096-652c2a74e086 tempest-VolumeDependencyTests-18272511 None] Creating direct copy from snapshot {{(pid=83528) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Feb 25 16:03:07 devstack cinder-volume[83528]: DEBUG oslo.privsep.daemon [-] privsep: reply[ddcdbeaa-5dae-4b14-9171-9c82d8417edb]: (4, 'qcow2') {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 25 16:03:07 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-3f2c0c51-15e5-47c2-9096-652c2a74e086 tempest-VolumeDependencyTests-18272511 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-289e9ac3-09e6-4612-b623-d0bd566a16c4 {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 25 16:03:07 devstack sudo[91983]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-289e9ac3-09e6-4612-b623-d0bd566a16c4 Feb 25 16:03:07 devstack sudo[91983]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 25 16:03:07 devstack sudo[91973]: pam_unix(sudo:session): session closed for user root Feb 25 16:03:07 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-fb7c5d67-e3d0-46ee-87df-8748026e2966 tempest-SnapshotDependencyTests-2073568565 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-b4a78707-43cc-4a9c-b6f9-e2b8ca42cfdc" returned: 0 in 0.521s {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 25 16:03:07 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-fb7c5d67-e3d0-46ee-87df-8748026e2966 tempest-SnapshotDependencyTests-2073568565 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-b4a78707-43cc-4a9c-b6f9-e2b8ca42cfdc {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 25 16:03:07 devstack sudo[91989]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-b4a78707-43cc-4a9c-b6f9-e2b8ca42cfdc Feb 25 16:03:08 devstack sudo[91989]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 25 16:03:08 devstack sudo[91978]: pam_unix(sudo:session): session closed for user root Feb 25 16:03:08 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-2db6f972-6491-4c30-a197-8b63b7bbbaef tempest-CreateVolumesFromSourceVolumeTest-931808651 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-c1e1de1e-613e-42ad-8f13-f8bceaf705d9" returned: 0 in 0.420s {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 25 16:03:08 devstack cinder-volume[83528]: DEBUG cinder.coordination [None req-2db6f972-6491-4c30-a197-8b63b7bbbaef tempest-CreateVolumesFromSourceVolumeTest-931808651 None] Lock "cinder-quobyte-c1e1de1e-613e-42ad-8f13-f8bceaf705d9" released by "delete_volume" :: held 0.969s {{(pid=83528) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 25 16:03:08 devstack cinder-volume[83528]: DEBUG cinder.quota [None req-2db6f972-6491-4c30-a197-8b63b7bbbaef tempest-CreateVolumesFromSourceVolumeTest-931808651 None] Created reservations ['217b1838-4277-4c0a-ba24-3bb320b54a9f', 'a9136e99-7303-4977-9420-0cc36e6d78ae', '3077d563-cc20-47bc-9313-5f62e127b985', '853d811e-7273-4caf-ae89-a81aaf9042e0'] {{(pid=83528) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 25 16:03:08 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-2db6f972-6491-4c30-a197-8b63b7bbbaef tempest-CreateVolumesFromSourceVolumeTest-931808651 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 25 16:03:08 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-2db6f972-6491-4c30-a197-8b63b7bbbaef tempest-CreateVolumesFromSourceVolumeTest-931808651 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 25 16:03:08 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.quobyte [None req-2db6f972-6491-4c30-a197-8b63b7bbbaef tempest-CreateVolumesFromSourceVolumeTest-931808651 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23e9d725-3e04-4cd9-bfe0-c8ef43305589': None} {{(pid=83528) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 25 16:03:08 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.quobyte [None req-2db6f972-6491-4c30-a197-8b63b7bbbaef tempest-CreateVolumesFromSourceVolumeTest-931808651 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23e9d725-3e04-4cd9-bfe0-c8ef43305589'] {{(pid=83528) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 25 16:03:08 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-2db6f972-6491-4c30-a197-8b63b7bbbaef tempest-CreateVolumesFromSourceVolumeTest-931808651 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 25 16:03:08 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-2db6f972-6491-4c30-a197-8b63b7bbbaef tempest-CreateVolumesFromSourceVolumeTest-931808651 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85 {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 25 16:03:08 devstack sudo[91991]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85 Feb 25 16:03:08 devstack sudo[91991]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 25 16:03:08 devstack sudo[91983]: pam_unix(sudo:session): session closed for user root Feb 25 16:03:08 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-3f2c0c51-15e5-47c2-9096-652c2a74e086 tempest-VolumeDependencyTests-18272511 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-289e9ac3-09e6-4612-b623-d0bd566a16c4" returned: 0 in 0.497s {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 25 16:03:08 devstack cinder-volume[83528]: DEBUG cinder.utils [None req-3f2c0c51-15e5-47c2-9096-652c2a74e086 tempest-VolumeDependencyTests-18272511 None] Path /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-703af21c-fa8f-4628-a245-be5618097128 not found in is_blk_device check {{(pid=83528) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Feb 25 16:03:08 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-3f2c0c51-15e5-47c2-9096-652c2a74e086 tempest-VolumeDependencyTests-18272511 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-289e9ac3-09e6-4612-b623-d0bd566a16c4 /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-703af21c-fa8f-4628-a245-be5618097128 {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 25 16:03:08 devstack sudo[91996]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-289e9ac3-09e6-4612-b623-d0bd566a16c4 /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-703af21c-fa8f-4628-a245-be5618097128 Feb 25 16:03:08 devstack sudo[91996]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 25 16:03:08 devstack sudo[91989]: pam_unix(sudo:session): session closed for user root Feb 25 16:03:08 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-fb7c5d67-e3d0-46ee-87df-8748026e2966 tempest-SnapshotDependencyTests-2073568565 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-b4a78707-43cc-4a9c-b6f9-e2b8ca42cfdc" returned: 0 in 0.421s {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 25 16:03:08 devstack cinder-volume[83528]: DEBUG cinder.coordination [None req-fb7c5d67-e3d0-46ee-87df-8748026e2966 tempest-SnapshotDependencyTests-2073568565 None] Lock "cinder-quobyte-b4a78707-43cc-4a9c-b6f9-e2b8ca42cfdc" released by "delete_volume" :: held 0.968s {{(pid=83528) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 25 16:03:08 devstack cinder-volume[83528]: DEBUG cinder.quota [None req-fb7c5d67-e3d0-46ee-87df-8748026e2966 tempest-SnapshotDependencyTests-2073568565 None] Created reservations ['3e8c88aa-d9b6-4d23-bb34-2ef154a28d8f', 'ab2ee03e-644a-4aa9-a7f6-e478085ac328', 'dad7bb6b-ec8f-4251-a831-b3c4f4dcff0b', '66e8e2d9-f53d-4395-bccd-65bce76abe28'] {{(pid=83528) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 25 16:03:08 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-fb7c5d67-e3d0-46ee-87df-8748026e2966 tempest-SnapshotDependencyTests-2073568565 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 25 16:03:08 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-fb7c5d67-e3d0-46ee-87df-8748026e2966 tempest-SnapshotDependencyTests-2073568565 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 25 16:03:08 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.quobyte [None req-fb7c5d67-e3d0-46ee-87df-8748026e2966 tempest-SnapshotDependencyTests-2073568565 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23e9d725-3e04-4cd9-bfe0-c8ef43305589': None} {{(pid=83528) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 25 16:03:08 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.quobyte [None req-fb7c5d67-e3d0-46ee-87df-8748026e2966 tempest-SnapshotDependencyTests-2073568565 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23e9d725-3e04-4cd9-bfe0-c8ef43305589'] {{(pid=83528) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 25 16:03:08 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-fb7c5d67-e3d0-46ee-87df-8748026e2966 tempest-SnapshotDependencyTests-2073568565 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 25 16:03:08 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-fb7c5d67-e3d0-46ee-87df-8748026e2966 tempest-SnapshotDependencyTests-2073568565 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85 {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 25 16:03:08 devstack sudo[92000]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85 Feb 25 16:03:08 devstack sudo[92000]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 25 16:03:08 devstack sudo[91991]: pam_unix(sudo:session): session closed for user root Feb 25 16:03:08 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-2db6f972-6491-4c30-a197-8b63b7bbbaef tempest-CreateVolumesFromSourceVolumeTest-931808651 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85" returned: 0 in 0.458s {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 25 16:03:08 devstack cinder-volume[83528]: DEBUG cinder.manager [None req-2db6f972-6491-4c30-a197-8b63b7bbbaef tempest-CreateVolumesFromSourceVolumeTest-931808651 None] Notifying Schedulers of capabilities ... {{(pid=83528) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 25 16:03:08 devstack cinder-volume[83528]: INFO cinder.volume.manager [None req-2db6f972-6491-4c30-a197-8b63b7bbbaef tempest-CreateVolumesFromSourceVolumeTest-931808651 None] Deleted volume successfully. Feb 25 16:03:08 devstack cinder-volume[83528]: DEBUG cinder.coordination [None req-2db6f972-6491-4c30-a197-8b63b7bbbaef tempest-CreateVolumesFromSourceVolumeTest-931808651 None] Lock "cinder-c1e1de1e-613e-42ad-8f13-f8bceaf705d9-delete_volume" released by "delete_volume" :: held 1.580s {{(pid=83528) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 25 16:03:09 devstack sudo[92000]: pam_unix(sudo:session): session closed for user root Feb 25 16:03:09 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-fb7c5d67-e3d0-46ee-87df-8748026e2966 tempest-SnapshotDependencyTests-2073568565 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85" returned: 0 in 0.708s {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 25 16:03:09 devstack cinder-volume[83528]: DEBUG cinder.manager [None req-fb7c5d67-e3d0-46ee-87df-8748026e2966 tempest-SnapshotDependencyTests-2073568565 None] Notifying Schedulers of capabilities ... {{(pid=83528) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 25 16:03:09 devstack cinder-volume[83528]: INFO cinder.volume.manager [None req-fb7c5d67-e3d0-46ee-87df-8748026e2966 tempest-SnapshotDependencyTests-2073568565 None] Deleted volume successfully. Feb 25 16:03:09 devstack cinder-volume[83528]: DEBUG cinder.coordination [None req-fb7c5d67-e3d0-46ee-87df-8748026e2966 tempest-SnapshotDependencyTests-2073568565 None] Lock "cinder-b4a78707-43cc-4a9c-b6f9-e2b8ca42cfdc-delete_volume" released by "delete_volume" :: held 1.827s {{(pid=83528) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 25 16:03:09 devstack cinder-volume[83528]: DEBUG cinder.coordination [None req-e669e2dc-9262-47fd-9b64-853360726d27 tempest-CreateVolumesFromSourceVolumeTest-931808651 None] Acquiring lock "cinder-00f749da-8e33-4f4a-aab4-f2f1c17f6d41-delete_volume" by "delete_volume" {{(pid=83528) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 25 16:03:09 devstack cinder-volume[83528]: DEBUG cinder.coordination [None req-e669e2dc-9262-47fd-9b64-853360726d27 tempest-CreateVolumesFromSourceVolumeTest-931808651 None] Lock "cinder-00f749da-8e33-4f4a-aab4-f2f1c17f6d41-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=83528) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 25 16:03:09 devstack cinder-volume[83528]: DEBUG cinder.coordination [None req-e669e2dc-9262-47fd-9b64-853360726d27 tempest-CreateVolumesFromSourceVolumeTest-931808651 None] Acquiring lock "cinder-quobyte-00f749da-8e33-4f4a-aab4-f2f1c17f6d41" by "delete_volume" {{(pid=83528) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 25 16:03:09 devstack cinder-volume[83528]: DEBUG cinder.coordination [None req-e669e2dc-9262-47fd-9b64-853360726d27 tempest-CreateVolumesFromSourceVolumeTest-931808651 None] Lock "cinder-quobyte-00f749da-8e33-4f4a-aab4-f2f1c17f6d41" acquired by "delete_volume" :: waited 0.026s {{(pid=83528) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 25 16:03:09 devstack cinder-volume[83528]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a2fc107-d484-4a38-88ed-316197510272]: (4, 'qcow2') {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 25 16:03:09 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-e669e2dc-9262-47fd-9b64-853360726d27 tempest-CreateVolumesFromSourceVolumeTest-931808651 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-00f749da-8e33-4f4a-aab4-f2f1c17f6d41 {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 25 16:03:09 devstack cinder-volume[83528]: DEBUG cinder.coordination [None req-e7e1ab7a-309f-40a3-ae3d-bd9e965fcfd5 tempest-SnapshotDependencyTests-2073568565 None] Acquiring lock "cinder-a69c2263-b13b-4112-bf20-5c4e5f5577fc-delete_volume" by "delete_volume" {{(pid=83528) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 25 16:03:09 devstack cinder-volume[83528]: DEBUG cinder.coordination [None req-e7e1ab7a-309f-40a3-ae3d-bd9e965fcfd5 tempest-SnapshotDependencyTests-2073568565 None] Lock "cinder-a69c2263-b13b-4112-bf20-5c4e5f5577fc-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=83528) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 25 16:03:09 devstack sudo[92013]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-00f749da-8e33-4f4a-aab4-f2f1c17f6d41 Feb 25 16:03:09 devstack sudo[92013]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 25 16:03:09 devstack cinder-volume[83528]: DEBUG cinder.coordination [None req-e7e1ab7a-309f-40a3-ae3d-bd9e965fcfd5 tempest-SnapshotDependencyTests-2073568565 None] Acquiring lock "cinder-quobyte-a69c2263-b13b-4112-bf20-5c4e5f5577fc" by "delete_volume" {{(pid=83528) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 25 16:03:09 devstack cinder-volume[83528]: DEBUG cinder.coordination [None req-e7e1ab7a-309f-40a3-ae3d-bd9e965fcfd5 tempest-SnapshotDependencyTests-2073568565 None] Lock "cinder-quobyte-a69c2263-b13b-4112-bf20-5c4e5f5577fc" acquired by "delete_volume" :: waited 0.020s {{(pid=83528) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 25 16:03:09 devstack cinder-volume[83528]: DEBUG oslo.privsep.daemon [-] privsep: reply[16255bcc-f197-456a-87c3-1055d9ccf8c5]: (4, 'qcow2') {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 25 16:03:09 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-e7e1ab7a-309f-40a3-ae3d-bd9e965fcfd5 tempest-SnapshotDependencyTests-2073568565 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-a69c2263-b13b-4112-bf20-5c4e5f5577fc {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 25 16:03:10 devstack sudo[92015]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-a69c2263-b13b-4112-bf20-5c4e5f5577fc Feb 25 16:03:10 devstack sudo[92015]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 25 16:03:10 devstack sudo[91996]: pam_unix(sudo:session): session closed for user root Feb 25 16:03:10 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-3f2c0c51-15e5-47c2-9096-652c2a74e086 tempest-VolumeDependencyTests-18272511 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-289e9ac3-09e6-4612-b623-d0bd566a16c4 /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-703af21c-fa8f-4628-a245-be5618097128" returned: 0 in 2.105s {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 25 16:03:10 devstack cinder-volume[83528]: DEBUG oslo.privsep.daemon [-] privsep: reply[1bad25e1-90b3-491d-99fb-7076c4c6f82c]: (4, 'qcow2') {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 25 16:03:10 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-3f2c0c51-15e5-47c2-9096-652c2a74e086 tempest-VolumeDependencyTests-18272511 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-289e9ac3-09e6-4612-b623-d0bd566a16c4 {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 25 16:03:10 devstack sudo[92017]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-289e9ac3-09e6-4612-b623-d0bd566a16c4 Feb 25 16:03:10 devstack sudo[92017]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 25 16:03:10 devstack sudo[92013]: pam_unix(sudo:session): session closed for user root Feb 25 16:03:10 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-e669e2dc-9262-47fd-9b64-853360726d27 tempest-CreateVolumesFromSourceVolumeTest-931808651 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-00f749da-8e33-4f4a-aab4-f2f1c17f6d41" returned: 0 in 0.989s {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 25 16:03:10 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-e669e2dc-9262-47fd-9b64-853360726d27 tempest-CreateVolumesFromSourceVolumeTest-931808651 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-00f749da-8e33-4f4a-aab4-f2f1c17f6d41 {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 25 16:03:10 devstack sudo[92025]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-00f749da-8e33-4f4a-aab4-f2f1c17f6d41 Feb 25 16:03:10 devstack sudo[92025]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 25 16:03:10 devstack sudo[92015]: pam_unix(sudo:session): session closed for user root Feb 25 16:03:10 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-e7e1ab7a-309f-40a3-ae3d-bd9e965fcfd5 tempest-SnapshotDependencyTests-2073568565 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-a69c2263-b13b-4112-bf20-5c4e5f5577fc" returned: 0 in 0.738s {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 25 16:03:10 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-e7e1ab7a-309f-40a3-ae3d-bd9e965fcfd5 tempest-SnapshotDependencyTests-2073568565 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-a69c2263-b13b-4112-bf20-5c4e5f5577fc {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 25 16:03:10 devstack sudo[92027]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-a69c2263-b13b-4112-bf20-5c4e5f5577fc Feb 25 16:03:10 devstack sudo[92027]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 25 16:03:10 devstack sudo[92025]: pam_unix(sudo:session): session closed for user root Feb 25 16:03:10 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-e669e2dc-9262-47fd-9b64-853360726d27 tempest-CreateVolumesFromSourceVolumeTest-931808651 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-00f749da-8e33-4f4a-aab4-f2f1c17f6d41" returned: 0 in 0.405s {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 25 16:03:10 devstack cinder-volume[83528]: DEBUG cinder.coordination [None req-e669e2dc-9262-47fd-9b64-853360726d27 tempest-CreateVolumesFromSourceVolumeTest-931808651 None] Lock "cinder-quobyte-00f749da-8e33-4f4a-aab4-f2f1c17f6d41" released by "delete_volume" :: held 1.454s {{(pid=83528) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 25 16:03:11 devstack cinder-volume[83528]: DEBUG cinder.quota [None req-e669e2dc-9262-47fd-9b64-853360726d27 tempest-CreateVolumesFromSourceVolumeTest-931808651 None] Created reservations ['7841d894-8228-48dd-9c4d-17b6755dda89', '849abab5-3252-47b9-a3a5-943cb8818b55', '299bc766-1b31-4729-b865-21e518841b7d', 'e64fad77-af7e-4b05-bfb7-ede62cf66647'] {{(pid=83528) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 25 16:03:11 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-e669e2dc-9262-47fd-9b64-853360726d27 tempest-CreateVolumesFromSourceVolumeTest-931808651 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 25 16:03:11 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-e669e2dc-9262-47fd-9b64-853360726d27 tempest-CreateVolumesFromSourceVolumeTest-931808651 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 25 16:03:11 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.quobyte [None req-e669e2dc-9262-47fd-9b64-853360726d27 tempest-CreateVolumesFromSourceVolumeTest-931808651 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23e9d725-3e04-4cd9-bfe0-c8ef43305589': None} {{(pid=83528) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 25 16:03:11 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.quobyte [None req-e669e2dc-9262-47fd-9b64-853360726d27 tempest-CreateVolumesFromSourceVolumeTest-931808651 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23e9d725-3e04-4cd9-bfe0-c8ef43305589'] {{(pid=83528) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 25 16:03:11 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-e669e2dc-9262-47fd-9b64-853360726d27 tempest-CreateVolumesFromSourceVolumeTest-931808651 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 25 16:03:11 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-e669e2dc-9262-47fd-9b64-853360726d27 tempest-CreateVolumesFromSourceVolumeTest-931808651 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85 {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 25 16:03:11 devstack sudo[92017]: pam_unix(sudo:session): session closed for user root Feb 25 16:03:11 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-3f2c0c51-15e5-47c2-9096-652c2a74e086 tempest-VolumeDependencyTests-18272511 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-289e9ac3-09e6-4612-b623-d0bd566a16c4" returned: 0 in 0.661s {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 25 16:03:11 devstack cinder-volume[83528]: DEBUG cinder.image.image_utils [None req-3f2c0c51-15e5-47c2-9096-652c2a74e086 tempest-VolumeDependencyTests-18272511 None] Image conversion details: src /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-289e9ac3-09e6-4612-b623-d0bd566a16c4, size 1024.00 MB, duration 2.11 sec, destination /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-703af21c-fa8f-4628-a245-be5618097128 {{(pid=83528) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Feb 25 16:03:11 devstack cinder-volume[83528]: INFO cinder.image.image_utils [None req-3f2c0c51-15e5-47c2-9096-652c2a74e086 tempest-VolumeDependencyTests-18272511 None] Converted 1024.00 MB image at 486.09 MB/s Feb 25 16:03:11 devstack cinder-volume[83528]: WARNING cinder.volume.drivers.remotefs [None req-3f2c0c51-15e5-47c2-9096-652c2a74e086 tempest-VolumeDependencyTests-18272511 None] /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-703af21c-fa8f-4628-a245-be5618097128 is being set with open permissions: ugo+rw Feb 25 16:03:11 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-3f2c0c51-15e5-47c2-9096-652c2a74e086 tempest-VolumeDependencyTests-18272511 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-703af21c-fa8f-4628-a245-be5618097128 {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 25 16:03:11 devstack sudo[92034]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85 Feb 25 16:03:11 devstack sudo[92034]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 25 16:03:11 devstack sudo[92027]: pam_unix(sudo:session): session closed for user root Feb 25 16:03:11 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-e7e1ab7a-309f-40a3-ae3d-bd9e965fcfd5 tempest-SnapshotDependencyTests-2073568565 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-a69c2263-b13b-4112-bf20-5c4e5f5577fc" returned: 0 in 0.480s {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 25 16:03:11 devstack sudo[92035]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-703af21c-fa8f-4628-a245-be5618097128 Feb 25 16:03:11 devstack sudo[92035]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 25 16:03:11 devstack cinder-volume[83528]: DEBUG cinder.coordination [None req-e7e1ab7a-309f-40a3-ae3d-bd9e965fcfd5 tempest-SnapshotDependencyTests-2073568565 None] Lock "cinder-quobyte-a69c2263-b13b-4112-bf20-5c4e5f5577fc" released by "delete_volume" :: held 1.254s {{(pid=83528) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 25 16:03:11 devstack cinder-volume[83528]: DEBUG cinder.quota [None req-e7e1ab7a-309f-40a3-ae3d-bd9e965fcfd5 tempest-SnapshotDependencyTests-2073568565 None] Created reservations ['77c22ade-bdca-4f13-b095-f540ec564462', 'c0ddf677-9b89-43c0-9db3-15a371959837', '44c20d80-35e5-4ad8-a2da-938d082e4af5', '8f5c1a7a-da6e-4cb4-9641-0f936906a600'] {{(pid=83528) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 25 16:03:11 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-e7e1ab7a-309f-40a3-ae3d-bd9e965fcfd5 tempest-SnapshotDependencyTests-2073568565 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 25 16:03:11 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-e7e1ab7a-309f-40a3-ae3d-bd9e965fcfd5 tempest-SnapshotDependencyTests-2073568565 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 25 16:03:11 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.quobyte [None req-e7e1ab7a-309f-40a3-ae3d-bd9e965fcfd5 tempest-SnapshotDependencyTests-2073568565 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23e9d725-3e04-4cd9-bfe0-c8ef43305589': None} {{(pid=83528) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 25 16:03:11 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.quobyte [None req-e7e1ab7a-309f-40a3-ae3d-bd9e965fcfd5 tempest-SnapshotDependencyTests-2073568565 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23e9d725-3e04-4cd9-bfe0-c8ef43305589'] {{(pid=83528) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 25 16:03:11 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-e7e1ab7a-309f-40a3-ae3d-bd9e965fcfd5 tempest-SnapshotDependencyTests-2073568565 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 25 16:03:11 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-e7e1ab7a-309f-40a3-ae3d-bd9e965fcfd5 tempest-SnapshotDependencyTests-2073568565 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85 {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 25 16:03:11 devstack sudo[92038]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85 Feb 25 16:03:11 devstack sudo[92038]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 25 16:03:11 devstack sudo[92034]: pam_unix(sudo:session): session closed for user root Feb 25 16:03:11 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-e669e2dc-9262-47fd-9b64-853360726d27 tempest-CreateVolumesFromSourceVolumeTest-931808651 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85" returned: 0 in 0.402s {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 25 16:03:11 devstack cinder-volume[83528]: DEBUG cinder.manager [None req-e669e2dc-9262-47fd-9b64-853360726d27 tempest-CreateVolumesFromSourceVolumeTest-931808651 None] Notifying Schedulers of capabilities ... {{(pid=83528) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 25 16:03:11 devstack cinder-volume[83528]: INFO cinder.volume.manager [None req-e669e2dc-9262-47fd-9b64-853360726d27 tempest-CreateVolumesFromSourceVolumeTest-931808651 None] Deleted volume successfully. Feb 25 16:03:11 devstack cinder-volume[83528]: DEBUG cinder.coordination [None req-e669e2dc-9262-47fd-9b64-853360726d27 tempest-CreateVolumesFromSourceVolumeTest-931808651 None] Lock "cinder-00f749da-8e33-4f4a-aab4-f2f1c17f6d41-delete_volume" released by "delete_volume" :: held 2.121s {{(pid=83528) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 25 16:03:11 devstack sudo[92035]: pam_unix(sudo:session): session closed for user root Feb 25 16:03:11 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-3f2c0c51-15e5-47c2-9096-652c2a74e086 tempest-VolumeDependencyTests-18272511 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-703af21c-fa8f-4628-a245-be5618097128" returned: 0 in 0.465s {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 25 16:03:11 devstack cinder-volume[83528]: DEBUG cinder.coordination [None req-3f2c0c51-15e5-47c2-9096-652c2a74e086 tempest-VolumeDependencyTests-18272511 None] Lock "cinder-quobyte-703af21c-fa8f-4628-a245-be5618097128" released by "_copy_volume_from_snapshot" :: held 4.324s {{(pid=83528) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 25 16:03:11 devstack cinder-volume[83528]: DEBUG cinder.coordination [None req-3f2c0c51-15e5-47c2-9096-652c2a74e086 tempest-VolumeDependencyTests-18272511 None] Acquiring lock "cinder-quobyte-baf0aa98-aa14-4d46-b604-add6b24e7716" by "_delete_snapshot" {{(pid=83528) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 25 16:03:11 devstack cinder-volume[83528]: DEBUG cinder.coordination [None req-3f2c0c51-15e5-47c2-9096-652c2a74e086 tempest-VolumeDependencyTests-18272511 None] Lock "cinder-quobyte-baf0aa98-aa14-4d46-b604-add6b24e7716" acquired by "_delete_snapshot" :: waited 0.010s {{(pid=83528) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 25 16:03:11 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.remotefs [None req-3f2c0c51-15e5-47c2-9096-652c2a74e086 tempest-VolumeDependencyTests-18272511 None] Deleting offline snapshot baf0aa98-aa14-4d46-b604-add6b24e7716 of volume 289e9ac3-09e6-4612-b623-d0bd566a16c4 {{(pid=83528) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Feb 25 16:03:11 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.remotefs [None req-3f2c0c51-15e5-47c2-9096-652c2a74e086 tempest-VolumeDependencyTests-18272511 None] snapshot_file for this snap is: volume-289e9ac3-09e6-4612-b623-d0bd566a16c4.baf0aa98-aa14-4d46-b604-add6b24e7716 {{(pid=83528) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Feb 25 16:03:11 devstack cinder-volume[83528]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0f490c5-03d2-49f8-a49c-a8e6ad93a9bd]: (4, 'qcow2') {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 25 16:03:11 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-3f2c0c51-15e5-47c2-9096-652c2a74e086 tempest-VolumeDependencyTests-18272511 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-289e9ac3-09e6-4612-b623-d0bd566a16c4.baf0aa98-aa14-4d46-b604-add6b24e7716 {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 25 16:03:11 devstack sudo[92038]: pam_unix(sudo:session): session closed for user root Feb 25 16:03:11 devstack cinder-volume[83528]: DEBUG cinder.coordination [None req-9d71ff51-8425-488c-a376-892ceb21e94c tempest-CreateVolumesFromSourceVolumeTest-931808651 None] Acquiring lock "cinder-fb9f5973-8aae-4d7a-a652-ba930478dbc0-delete_volume" by "delete_volume" {{(pid=83528) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 25 16:03:11 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-e7e1ab7a-309f-40a3-ae3d-bd9e965fcfd5 tempest-SnapshotDependencyTests-2073568565 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85" returned: 0 in 0.462s {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 25 16:03:11 devstack cinder-volume[83528]: DEBUG cinder.manager [None req-e7e1ab7a-309f-40a3-ae3d-bd9e965fcfd5 tempest-SnapshotDependencyTests-2073568565 None] Notifying Schedulers of capabilities ... {{(pid=83528) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 25 16:03:11 devstack cinder-volume[83528]: INFO cinder.volume.manager [None req-e7e1ab7a-309f-40a3-ae3d-bd9e965fcfd5 tempest-SnapshotDependencyTests-2073568565 None] Deleted volume successfully. Feb 25 16:03:11 devstack cinder-volume[83528]: DEBUG cinder.coordination [None req-9d71ff51-8425-488c-a376-892ceb21e94c tempest-CreateVolumesFromSourceVolumeTest-931808651 None] Lock "cinder-fb9f5973-8aae-4d7a-a652-ba930478dbc0-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=83528) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 25 16:03:11 devstack cinder-volume[83528]: DEBUG cinder.coordination [None req-e7e1ab7a-309f-40a3-ae3d-bd9e965fcfd5 tempest-SnapshotDependencyTests-2073568565 None] Lock "cinder-a69c2263-b13b-4112-bf20-5c4e5f5577fc-delete_volume" released by "delete_volume" :: held 1.987s {{(pid=83528) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 25 16:03:11 devstack sudo[92043]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-289e9ac3-09e6-4612-b623-d0bd566a16c4.baf0aa98-aa14-4d46-b604-add6b24e7716 Feb 25 16:03:11 devstack sudo[92043]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 25 16:03:11 devstack cinder-volume[83528]: DEBUG cinder.coordination [None req-9d71ff51-8425-488c-a376-892ceb21e94c tempest-CreateVolumesFromSourceVolumeTest-931808651 None] Acquiring lock "cinder-quobyte-fb9f5973-8aae-4d7a-a652-ba930478dbc0" by "delete_volume" {{(pid=83528) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 25 16:03:11 devstack cinder-volume[83528]: DEBUG cinder.coordination [None req-9d71ff51-8425-488c-a376-892ceb21e94c tempest-CreateVolumesFromSourceVolumeTest-931808651 None] Lock "cinder-quobyte-fb9f5973-8aae-4d7a-a652-ba930478dbc0" acquired by "delete_volume" :: waited 0.007s {{(pid=83528) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 25 16:03:11 devstack cinder-volume[83528]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad236a3b-21c5-4798-9d68-0861a173c62b]: (4, 'qcow2') {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 25 16:03:11 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-9d71ff51-8425-488c-a376-892ceb21e94c tempest-CreateVolumesFromSourceVolumeTest-931808651 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-fb9f5973-8aae-4d7a-a652-ba930478dbc0 {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 25 16:03:11 devstack sudo[92045]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-fb9f5973-8aae-4d7a-a652-ba930478dbc0 Feb 25 16:03:11 devstack sudo[92045]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 25 16:03:12 devstack sudo[92043]: pam_unix(sudo:session): session closed for user root Feb 25 16:03:12 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-3f2c0c51-15e5-47c2-9096-652c2a74e086 tempest-VolumeDependencyTests-18272511 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-289e9ac3-09e6-4612-b623-d0bd566a16c4.baf0aa98-aa14-4d46-b604-add6b24e7716" returned: 0 in 0.546s {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 25 16:03:12 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.remotefs [None req-3f2c0c51-15e5-47c2-9096-652c2a74e086 tempest-VolumeDependencyTests-18272511 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-289e9ac3-09e6-4612-b623-d0bd566a16c4(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83528) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Feb 25 16:03:12 devstack cinder-volume[83528]: DEBUG oslo.privsep.daemon [-] privsep: reply[c33d212e-19f0-4243-bd7c-556be96b5a15]: (4, 'qcow2') {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 25 16:03:12 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-3f2c0c51-15e5-47c2-9096-652c2a74e086 tempest-VolumeDependencyTests-18272511 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-289e9ac3-09e6-4612-b623-d0bd566a16c4 {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 25 16:03:12 devstack sudo[92050]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-289e9ac3-09e6-4612-b623-d0bd566a16c4 Feb 25 16:03:12 devstack sudo[92050]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 25 16:03:12 devstack sudo[92045]: pam_unix(sudo:session): session closed for user root Feb 25 16:03:12 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-9d71ff51-8425-488c-a376-892ceb21e94c tempest-CreateVolumesFromSourceVolumeTest-931808651 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-fb9f5973-8aae-4d7a-a652-ba930478dbc0" returned: 0 in 0.553s {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 25 16:03:12 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-9d71ff51-8425-488c-a376-892ceb21e94c tempest-CreateVolumesFromSourceVolumeTest-931808651 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-fb9f5973-8aae-4d7a-a652-ba930478dbc0 {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 25 16:03:12 devstack sudo[92055]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-fb9f5973-8aae-4d7a-a652-ba930478dbc0 Feb 25 16:03:12 devstack sudo[92055]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 25 16:03:12 devstack sudo[92050]: pam_unix(sudo:session): session closed for user root Feb 25 16:03:12 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-3f2c0c51-15e5-47c2-9096-652c2a74e086 tempest-VolumeDependencyTests-18272511 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-289e9ac3-09e6-4612-b623-d0bd566a16c4" returned: 0 in 0.536s {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 25 16:03:12 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-3f2c0c51-15e5-47c2-9096-652c2a74e086 tempest-VolumeDependencyTests-18272511 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-289e9ac3-09e6-4612-b623-d0bd566a16c4.baf0aa98-aa14-4d46-b604-add6b24e7716 {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 25 16:03:12 devstack sudo[92055]: pam_unix(sudo:session): session closed for user root Feb 25 16:03:12 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-9d71ff51-8425-488c-a376-892ceb21e94c tempest-CreateVolumesFromSourceVolumeTest-931808651 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-fb9f5973-8aae-4d7a-a652-ba930478dbc0" returned: 0 in 0.454s {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 25 16:03:12 devstack sudo[92061]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-289e9ac3-09e6-4612-b623-d0bd566a16c4.baf0aa98-aa14-4d46-b604-add6b24e7716 Feb 25 16:03:12 devstack sudo[92061]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 25 16:03:12 devstack cinder-volume[83528]: DEBUG cinder.coordination [None req-9d71ff51-8425-488c-a376-892ceb21e94c tempest-CreateVolumesFromSourceVolumeTest-931808651 None] Lock "cinder-quobyte-fb9f5973-8aae-4d7a-a652-ba930478dbc0" released by "delete_volume" :: held 1.027s {{(pid=83528) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 25 16:03:12 devstack cinder-volume[83528]: DEBUG cinder.quota [None req-9d71ff51-8425-488c-a376-892ceb21e94c tempest-CreateVolumesFromSourceVolumeTest-931808651 None] Created reservations ['8175a565-07eb-4004-8761-ebfd6c086a99', '87b83408-dc86-47c3-9b17-b18587402491', '68a48069-64bc-4559-bc18-f061dbc6e0e1', '7f144fc1-f64a-481c-8c96-fe0df0a8ee5d'] {{(pid=83528) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 25 16:03:12 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-9d71ff51-8425-488c-a376-892ceb21e94c tempest-CreateVolumesFromSourceVolumeTest-931808651 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 25 16:03:12 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-9d71ff51-8425-488c-a376-892ceb21e94c tempest-CreateVolumesFromSourceVolumeTest-931808651 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 25 16:03:12 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.quobyte [None req-9d71ff51-8425-488c-a376-892ceb21e94c tempest-CreateVolumesFromSourceVolumeTest-931808651 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23e9d725-3e04-4cd9-bfe0-c8ef43305589': None} {{(pid=83528) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 25 16:03:12 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.quobyte [None req-9d71ff51-8425-488c-a376-892ceb21e94c tempest-CreateVolumesFromSourceVolumeTest-931808651 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23e9d725-3e04-4cd9-bfe0-c8ef43305589'] {{(pid=83528) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 25 16:03:12 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-9d71ff51-8425-488c-a376-892ceb21e94c tempest-CreateVolumesFromSourceVolumeTest-931808651 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 25 16:03:12 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-9d71ff51-8425-488c-a376-892ceb21e94c tempest-CreateVolumesFromSourceVolumeTest-931808651 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85 {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 25 16:03:12 devstack sudo[92063]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85 Feb 25 16:03:12 devstack sudo[92063]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 25 16:03:13 devstack sudo[92061]: pam_unix(sudo:session): session closed for user root Feb 25 16:03:13 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-3f2c0c51-15e5-47c2-9096-652c2a74e086 tempest-VolumeDependencyTests-18272511 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-289e9ac3-09e6-4612-b623-d0bd566a16c4.baf0aa98-aa14-4d46-b604-add6b24e7716" returned: 0 in 0.528s {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 25 16:03:13 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-3f2c0c51-15e5-47c2-9096-652c2a74e086 tempest-VolumeDependencyTests-18272511 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-289e9ac3-09e6-4612-b623-d0bd566a16c4.baf0aa98-aa14-4d46-b604-add6b24e7716 {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 25 16:03:13 devstack sudo[92069]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-289e9ac3-09e6-4612-b623-d0bd566a16c4.baf0aa98-aa14-4d46-b604-add6b24e7716 Feb 25 16:03:13 devstack sudo[92069]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 25 16:03:13 devstack sudo[92063]: pam_unix(sudo:session): session closed for user root Feb 25 16:03:13 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-9d71ff51-8425-488c-a376-892ceb21e94c tempest-CreateVolumesFromSourceVolumeTest-931808651 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85" returned: 0 in 0.499s {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 25 16:03:13 devstack cinder-volume[83528]: DEBUG cinder.manager [None req-9d71ff51-8425-488c-a376-892ceb21e94c tempest-CreateVolumesFromSourceVolumeTest-931808651 None] Notifying Schedulers of capabilities ... {{(pid=83528) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 25 16:03:13 devstack cinder-volume[83528]: INFO cinder.volume.manager [None req-9d71ff51-8425-488c-a376-892ceb21e94c tempest-CreateVolumesFromSourceVolumeTest-931808651 None] Deleted volume successfully. Feb 25 16:03:13 devstack cinder-volume[83528]: DEBUG cinder.coordination [None req-9d71ff51-8425-488c-a376-892ceb21e94c tempest-CreateVolumesFromSourceVolumeTest-931808651 None] Lock "cinder-fb9f5973-8aae-4d7a-a652-ba930478dbc0-delete_volume" released by "delete_volume" :: held 1.675s {{(pid=83528) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 25 16:03:13 devstack sudo[92069]: pam_unix(sudo:session): session closed for user root Feb 25 16:03:13 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-3f2c0c51-15e5-47c2-9096-652c2a74e086 tempest-VolumeDependencyTests-18272511 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-289e9ac3-09e6-4612-b623-d0bd566a16c4.baf0aa98-aa14-4d46-b604-add6b24e7716" returned: 0 in 0.437s {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 25 16:03:13 devstack cinder-volume[83528]: DEBUG cinder.coordination [None req-3f2c0c51-15e5-47c2-9096-652c2a74e086 tempest-VolumeDependencyTests-18272511 None] Lock "cinder-quobyte-baf0aa98-aa14-4d46-b604-add6b24e7716" released by "_delete_snapshot" :: held 2.102s {{(pid=83528) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 25 16:03:13 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-3f2c0c51-15e5-47c2-9096-652c2a74e086 tempest-VolumeDependencyTests-18272511 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 9.720s {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 25 16:03:13 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-3f2c0c51-15e5-47c2-9096-652c2a74e086 tempest-VolumeDependencyTests-18272511 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (caed2781-d1be-447b-8017-1f981d4a26b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-703af21c-fa8f-4628-a245-be5618097128', 'volume_size': 1, 'source_volid': '289e9ac3-09e6-4612-b623-d0bd566a16c4', 'source_volstatus': 'available'}' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 25 16:03:13 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-3f2c0c51-15e5-47c2-9096-652c2a74e086 tempest-VolumeDependencyTests-18272511 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f3829ecb-7a6f-45b5-bdf4-decfe97db85b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 25 16:03:13 devstack cinder-volume[83528]: INFO cinder.volume.flows.manager.create_volume [None req-3f2c0c51-15e5-47c2-9096-652c2a74e086 tempest-VolumeDependencyTests-18272511 None] Volume volume-703af21c-fa8f-4628-a245-be5618097128 (703af21c-fa8f-4628-a245-be5618097128): created successfully Feb 25 16:03:13 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-3f2c0c51-15e5-47c2-9096-652c2a74e086 tempest-VolumeDependencyTests-18272511 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f3829ecb-7a6f-45b5-bdf4-decfe97db85b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 25 16:03:13 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-3f2c0c51-15e5-47c2-9096-652c2a74e086 tempest-VolumeDependencyTests-18272511 None] Flow 'volume_create_manager' (228f87ed-84bc-4e28-a625-35dfe46399c9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83528) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 25 16:03:13 devstack cinder-volume[83528]: INFO cinder.volume.manager [None req-3f2c0c51-15e5-47c2-9096-652c2a74e086 tempest-VolumeDependencyTests-18272511 None] Created volume successfully. Feb 25 16:03:14 devstack cinder-volume[83528]: DEBUG cinder.coordination [None req-dc197c2c-b5c3-4629-b737-16cfc361d149 tempest-VolumeDependencyTests-18272511 None] Acquiring lock "cinder-289e9ac3-09e6-4612-b623-d0bd566a16c4-delete_volume" by "delete_volume" {{(pid=83528) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 25 16:03:14 devstack cinder-volume[83528]: DEBUG cinder.coordination [None req-dc197c2c-b5c3-4629-b737-16cfc361d149 tempest-VolumeDependencyTests-18272511 None] Lock "cinder-289e9ac3-09e6-4612-b623-d0bd566a16c4-delete_volume" acquired by "delete_volume" :: waited 0.008s {{(pid=83528) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 25 16:03:14 devstack cinder-volume[83528]: DEBUG cinder.coordination [None req-dc197c2c-b5c3-4629-b737-16cfc361d149 tempest-VolumeDependencyTests-18272511 None] Acquiring lock "cinder-quobyte-289e9ac3-09e6-4612-b623-d0bd566a16c4" by "delete_volume" {{(pid=83528) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 25 16:03:14 devstack cinder-volume[83528]: DEBUG cinder.coordination [None req-dc197c2c-b5c3-4629-b737-16cfc361d149 tempest-VolumeDependencyTests-18272511 None] Lock "cinder-quobyte-289e9ac3-09e6-4612-b623-d0bd566a16c4" acquired by "delete_volume" :: waited 0.012s {{(pid=83528) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 25 16:03:14 devstack cinder-volume[83528]: DEBUG oslo.privsep.daemon [-] privsep: reply[f194c6dc-19f6-445e-90c8-3f97cf6c44be]: (4, 'qcow2') {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 25 16:03:14 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-dc197c2c-b5c3-4629-b737-16cfc361d149 tempest-VolumeDependencyTests-18272511 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-289e9ac3-09e6-4612-b623-d0bd566a16c4 {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 25 16:03:14 devstack sudo[92113]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-289e9ac3-09e6-4612-b623-d0bd566a16c4 Feb 25 16:03:14 devstack sudo[92113]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 25 16:03:14 devstack sudo[92113]: pam_unix(sudo:session): session closed for user root Feb 25 16:03:14 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-dc197c2c-b5c3-4629-b737-16cfc361d149 tempest-VolumeDependencyTests-18272511 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-289e9ac3-09e6-4612-b623-d0bd566a16c4" returned: 0 in 0.551s {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 25 16:03:14 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-dc197c2c-b5c3-4629-b737-16cfc361d149 tempest-VolumeDependencyTests-18272511 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-289e9ac3-09e6-4612-b623-d0bd566a16c4 {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 25 16:03:14 devstack sudo[92120]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-289e9ac3-09e6-4612-b623-d0bd566a16c4 Feb 25 16:03:14 devstack sudo[92120]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 25 16:03:15 devstack sudo[92120]: pam_unix(sudo:session): session closed for user root Feb 25 16:03:15 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-dc197c2c-b5c3-4629-b737-16cfc361d149 tempest-VolumeDependencyTests-18272511 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-289e9ac3-09e6-4612-b623-d0bd566a16c4" returned: 0 in 0.463s {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 25 16:03:15 devstack cinder-volume[83528]: DEBUG cinder.coordination [None req-dc197c2c-b5c3-4629-b737-16cfc361d149 tempest-VolumeDependencyTests-18272511 None] Lock "cinder-quobyte-289e9ac3-09e6-4612-b623-d0bd566a16c4" released by "delete_volume" :: held 1.058s {{(pid=83528) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 25 16:03:15 devstack cinder-volume[83528]: DEBUG cinder.quota [None req-dc197c2c-b5c3-4629-b737-16cfc361d149 tempest-VolumeDependencyTests-18272511 None] Created reservations ['e7cb1d46-f775-4007-909b-784b48345dc7', '8d48f2ab-2447-4361-beca-0bd729ea1179', '943d397f-48ac-4c8b-9509-466a84e71805', '6366a56e-4d38-40d6-8500-74099ed898ca'] {{(pid=83528) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 25 16:03:15 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-dc197c2c-b5c3-4629-b737-16cfc361d149 tempest-VolumeDependencyTests-18272511 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 25 16:03:15 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-dc197c2c-b5c3-4629-b737-16cfc361d149 tempest-VolumeDependencyTests-18272511 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 25 16:03:15 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.quobyte [None req-dc197c2c-b5c3-4629-b737-16cfc361d149 tempest-VolumeDependencyTests-18272511 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23e9d725-3e04-4cd9-bfe0-c8ef43305589': None} {{(pid=83528) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 25 16:03:15 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.quobyte [None req-dc197c2c-b5c3-4629-b737-16cfc361d149 tempest-VolumeDependencyTests-18272511 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23e9d725-3e04-4cd9-bfe0-c8ef43305589'] {{(pid=83528) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 25 16:03:15 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-dc197c2c-b5c3-4629-b737-16cfc361d149 tempest-VolumeDependencyTests-18272511 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 25 16:03:15 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-dc197c2c-b5c3-4629-b737-16cfc361d149 tempest-VolumeDependencyTests-18272511 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85 {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 25 16:03:15 devstack sudo[92123]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85 Feb 25 16:03:15 devstack sudo[92123]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 25 16:03:15 devstack cinder-volume[83528]: DEBUG cinder.volume.flows.manager.create_volume [None req-def3dbc1-f539-4670-bbd2-7c76ccd558b7 tempest-CinderUnicodeTest-1311043769 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83528) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 25 16:03:15 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-def3dbc1-f539-4670-bbd2-7c76ccd558b7 tempest-CinderUnicodeTest-1311043769 None] Flow 'volume_create_manager' (c1bb8091-2560-4ec2-bc8f-8446bdc72254) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83528) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 25 16:03:15 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-def3dbc1-f539-4670-bbd2-7c76ccd558b7 tempest-CinderUnicodeTest-1311043769 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a3b97dce-4e71-4682-abb4-7c1ed6ea8311) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 25 16:03:15 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-def3dbc1-f539-4670-bbd2-7c76ccd558b7 tempest-CinderUnicodeTest-1311043769 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a3b97dce-4e71-4682-abb4-7c1ed6ea8311) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-25T15:03:16Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=152cbd7c-2694-481e-b805-2617b3663437,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dfbdad1d30ec4c9fa0d54c07645a9039',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-25T15:03:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-25T15:03:16Z,use_quota=True,user_id='94accf29c049476198c4bde7a97bccef',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ce71c2f9-6543-4165-9653-a1529b2ea243),volume_type_id=ce71c2f9-6543-4165-9653-a1529b2ea243)' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 25 16:03:15 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-def3dbc1-f539-4670-bbd2-7c76ccd558b7 tempest-CinderUnicodeTest-1311043769 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4c03f49c-88d6-49fa-9d36-62e8b1f097a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 25 16:03:15 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-def3dbc1-f539-4670-bbd2-7c76ccd558b7 tempest-CinderUnicodeTest-1311043769 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4c03f49c-88d6-49fa-9d36-62e8b1f097a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 25 16:03:15 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-def3dbc1-f539-4670-bbd2-7c76ccd558b7 tempest-CinderUnicodeTest-1311043769 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cf19bdd2-e0ac-41c0-898c-d5313dc02b77) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 25 16:03:15 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-def3dbc1-f539-4670-bbd2-7c76ccd558b7 tempest-CinderUnicodeTest-1311043769 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cf19bdd2-e0ac-41c0-898c-d5313dc02b77) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '152cbd7c-2694-481e-b805-2617b3663437', 'volume_name': 'volume-152cbd7c-2694-481e-b805-2617b3663437', 'volume_size': 1}' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 25 16:03:15 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-def3dbc1-f539-4670-bbd2-7c76ccd558b7 tempest-CinderUnicodeTest-1311043769 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1e834f82-5e3a-4b2d-bfbf-57862f559450) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 25 16:03:15 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-def3dbc1-f539-4670-bbd2-7c76ccd558b7 tempest-CinderUnicodeTest-1311043769 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1e834f82-5e3a-4b2d-bfbf-57862f559450) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 25 16:03:15 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-def3dbc1-f539-4670-bbd2-7c76ccd558b7 tempest-CinderUnicodeTest-1311043769 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e1b45536-d5d3-4fcf-a3ca-83a44b740219) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 25 16:03:15 devstack cinder-volume[83528]: INFO cinder.volume.flows.manager.create_volume [None req-def3dbc1-f539-4670-bbd2-7c76ccd558b7 tempest-CinderUnicodeTest-1311043769 None] Volume 152cbd7c-2694-481e-b805-2617b3663437: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-152cbd7c-2694-481e-b805-2617b3663437', 'volume_size': 1} Feb 25 16:03:15 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-def3dbc1-f539-4670-bbd2-7c76ccd558b7 tempest-CinderUnicodeTest-1311043769 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 25 16:03:15 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-def3dbc1-f539-4670-bbd2-7c76ccd558b7 tempest-CinderUnicodeTest-1311043769 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 25 16:03:15 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.quobyte [None req-def3dbc1-f539-4670-bbd2-7c76ccd558b7 tempest-CinderUnicodeTest-1311043769 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-25T15:03:16Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=152cbd7c-2694-481e-b805-2617b3663437,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dfbdad1d30ec4c9fa0d54c07645a9039',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-25T15:03:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-25T15:03:16Z,use_quota=True,user_id='94accf29c049476198c4bde7a97bccef',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ce71c2f9-6543-4165-9653-a1529b2ea243),volume_type_id=ce71c2f9-6543-4165-9653-a1529b2ea243)}" {{(pid=83528) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 25 16:03:15 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.remotefs [None req-def3dbc1-f539-4670-bbd2-7c76ccd558b7 tempest-CinderUnicodeTest-1311043769 None] Creating volume 152cbd7c-2694-481e-b805-2617b3663437 {{(pid=83528) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 25 16:03:15 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-def3dbc1-f539-4670-bbd2-7c76ccd558b7 tempest-CinderUnicodeTest-1311043769 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 25 16:03:15 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-def3dbc1-f539-4670-bbd2-7c76ccd558b7 tempest-CinderUnicodeTest-1311043769 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 25 16:03:15 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.quobyte [None req-def3dbc1-f539-4670-bbd2-7c76ccd558b7 tempest-CinderUnicodeTest-1311043769 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23e9d725-3e04-4cd9-bfe0-c8ef43305589': None} {{(pid=83528) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 25 16:03:15 devstack sudo[92123]: pam_unix(sudo:session): session closed for user root Feb 25 16:03:15 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.quobyte [None req-def3dbc1-f539-4670-bbd2-7c76ccd558b7 tempest-CinderUnicodeTest-1311043769 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23e9d725-3e04-4cd9-bfe0-c8ef43305589'] {{(pid=83528) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 25 16:03:15 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-def3dbc1-f539-4670-bbd2-7c76ccd558b7 tempest-CinderUnicodeTest-1311043769 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 25 16:03:15 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.quobyte [None req-def3dbc1-f539-4670-bbd2-7c76ccd558b7 tempest-CinderUnicodeTest-1311043769 None] Selected osci02.corp.quobyte.com/cinder-vol-23e9d725-3e04-4cd9-bfe0-c8ef43305589 as target Quobyte volume. {{(pid=83528) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 25 16:03:15 devstack cinder-volume[83528]: INFO cinder.volume.drivers.remotefs [None req-def3dbc1-f539-4670-bbd2-7c76ccd558b7 tempest-CinderUnicodeTest-1311043769 None] casted to osci02.corp.quobyte.com/cinder-vol-23e9d725-3e04-4cd9-bfe0-c8ef43305589 Feb 25 16:03:15 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-def3dbc1-f539-4670-bbd2-7c76ccd558b7 tempest-CinderUnicodeTest-1311043769 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-152cbd7c-2694-481e-b805-2617b3663437 1073741824 {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 25 16:03:15 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-dc197c2c-b5c3-4629-b737-16cfc361d149 tempest-VolumeDependencyTests-18272511 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85" returned: 0 in 0.450s {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 25 16:03:15 devstack cinder-volume[83528]: DEBUG cinder.manager [None req-dc197c2c-b5c3-4629-b737-16cfc361d149 tempest-VolumeDependencyTests-18272511 None] Notifying Schedulers of capabilities ... {{(pid=83528) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 25 16:03:15 devstack cinder-volume[83528]: INFO cinder.volume.manager [None req-dc197c2c-b5c3-4629-b737-16cfc361d149 tempest-VolumeDependencyTests-18272511 None] Deleted volume successfully. Feb 25 16:03:15 devstack sudo[92126]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-152cbd7c-2694-481e-b805-2617b3663437 1073741824 Feb 25 16:03:15 devstack sudo[92126]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 25 16:03:15 devstack cinder-volume[83528]: DEBUG cinder.coordination [None req-dc197c2c-b5c3-4629-b737-16cfc361d149 tempest-VolumeDependencyTests-18272511 None] Lock "cinder-289e9ac3-09e6-4612-b623-d0bd566a16c4-delete_volume" released by "delete_volume" :: held 1.659s {{(pid=83528) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 25 16:03:16 devstack sudo[92126]: pam_unix(sudo:session): session closed for user root Feb 25 16:03:16 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-def3dbc1-f539-4670-bbd2-7c76ccd558b7 tempest-CinderUnicodeTest-1311043769 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-152cbd7c-2694-481e-b805-2617b3663437 1073741824" returned: 0 in 0.552s {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 25 16:03:16 devstack cinder-volume[83528]: DEBUG cinder.coordination [None req-eba9af2a-6055-48e0-87b2-28fede6b9704 tempest-VolumeDependencyTests-18272511 None] Acquiring lock "cinder-703af21c-fa8f-4628-a245-be5618097128-delete_volume" by "delete_volume" {{(pid=83528) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 25 16:03:16 devstack cinder-volume[83528]: DEBUG cinder.coordination [None req-eba9af2a-6055-48e0-87b2-28fede6b9704 tempest-VolumeDependencyTests-18272511 None] Lock "cinder-703af21c-fa8f-4628-a245-be5618097128-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=83528) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 25 16:03:16 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-def3dbc1-f539-4670-bbd2-7c76ccd558b7 tempest-CinderUnicodeTest-1311043769 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-152cbd7c-2694-481e-b805-2617b3663437 {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 25 16:03:16 devstack sudo[92133]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-152cbd7c-2694-481e-b805-2617b3663437 Feb 25 16:03:16 devstack sudo[92133]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 25 16:03:16 devstack cinder-volume[83528]: DEBUG cinder.coordination [None req-eba9af2a-6055-48e0-87b2-28fede6b9704 tempest-VolumeDependencyTests-18272511 None] Acquiring lock "cinder-quobyte-703af21c-fa8f-4628-a245-be5618097128" by "delete_volume" {{(pid=83528) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 25 16:03:16 devstack cinder-volume[83528]: DEBUG cinder.coordination [None req-eba9af2a-6055-48e0-87b2-28fede6b9704 tempest-VolumeDependencyTests-18272511 None] Lock "cinder-quobyte-703af21c-fa8f-4628-a245-be5618097128" acquired by "delete_volume" :: waited 0.009s {{(pid=83528) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 25 16:03:16 devstack cinder-volume[83528]: DEBUG oslo.privsep.daemon [-] privsep: reply[de33b88b-35de-40f0-a26f-e433f5af277d]: (4, 'qcow2') {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 25 16:03:16 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-eba9af2a-6055-48e0-87b2-28fede6b9704 tempest-VolumeDependencyTests-18272511 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-703af21c-fa8f-4628-a245-be5618097128 {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 25 16:03:16 devstack sudo[92135]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-703af21c-fa8f-4628-a245-be5618097128 Feb 25 16:03:16 devstack sudo[92135]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 25 16:03:16 devstack sudo[92133]: pam_unix(sudo:session): session closed for user root Feb 25 16:03:16 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-def3dbc1-f539-4670-bbd2-7c76ccd558b7 tempest-CinderUnicodeTest-1311043769 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-152cbd7c-2694-481e-b805-2617b3663437" returned: 0 in 0.440s {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 25 16:03:16 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.quobyte [None req-def3dbc1-f539-4670-bbd2-7c76ccd558b7 tempest-CinderUnicodeTest-1311043769 None] <== create_volume: return (1044ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-23e9d725-3e04-4cd9-bfe0-c8ef43305589'} {{(pid=83528) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 25 16:03:16 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-def3dbc1-f539-4670-bbd2-7c76ccd558b7 tempest-CinderUnicodeTest-1311043769 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.046s {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 25 16:03:16 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-def3dbc1-f539-4670-bbd2-7c76ccd558b7 tempest-CinderUnicodeTest-1311043769 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e1b45536-d5d3-4fcf-a3ca-83a44b740219) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-152cbd7c-2694-481e-b805-2617b3663437', 'volume_size': 1}' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 25 16:03:16 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-def3dbc1-f539-4670-bbd2-7c76ccd558b7 tempest-CinderUnicodeTest-1311043769 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a094ca3d-ec40-4c59-bdcd-989f3a397050) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 25 16:03:16 devstack cinder-volume[83528]: INFO cinder.volume.flows.manager.create_volume [None req-def3dbc1-f539-4670-bbd2-7c76ccd558b7 tempest-CinderUnicodeTest-1311043769 None] Volume volume-152cbd7c-2694-481e-b805-2617b3663437 (152cbd7c-2694-481e-b805-2617b3663437): created successfully Feb 25 16:03:16 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-def3dbc1-f539-4670-bbd2-7c76ccd558b7 tempest-CinderUnicodeTest-1311043769 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a094ca3d-ec40-4c59-bdcd-989f3a397050) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 25 16:03:16 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-def3dbc1-f539-4670-bbd2-7c76ccd558b7 tempest-CinderUnicodeTest-1311043769 None] Flow 'volume_create_manager' (c1bb8091-2560-4ec2-bc8f-8446bdc72254) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83528) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 25 16:03:16 devstack cinder-volume[83528]: INFO cinder.volume.manager [None req-def3dbc1-f539-4670-bbd2-7c76ccd558b7 tempest-CinderUnicodeTest-1311043769 None] Created volume successfully. Feb 25 16:03:17 devstack sudo[92135]: pam_unix(sudo:session): session closed for user root Feb 25 16:03:17 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-eba9af2a-6055-48e0-87b2-28fede6b9704 tempest-VolumeDependencyTests-18272511 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-703af21c-fa8f-4628-a245-be5618097128" returned: 0 in 0.559s {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 25 16:03:17 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-eba9af2a-6055-48e0-87b2-28fede6b9704 tempest-VolumeDependencyTests-18272511 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-703af21c-fa8f-4628-a245-be5618097128 {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 25 16:03:17 devstack sudo[92141]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-703af21c-fa8f-4628-a245-be5618097128 Feb 25 16:03:17 devstack sudo[92141]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 25 16:03:17 devstack sudo[92141]: pam_unix(sudo:session): session closed for user root Feb 25 16:03:17 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-eba9af2a-6055-48e0-87b2-28fede6b9704 tempest-VolumeDependencyTests-18272511 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-703af21c-fa8f-4628-a245-be5618097128" returned: 0 in 0.456s {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 25 16:03:17 devstack cinder-volume[83528]: DEBUG cinder.coordination [None req-eba9af2a-6055-48e0-87b2-28fede6b9704 tempest-VolumeDependencyTests-18272511 None] Lock "cinder-quobyte-703af21c-fa8f-4628-a245-be5618097128" released by "delete_volume" :: held 1.042s {{(pid=83528) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 25 16:03:17 devstack cinder-volume[83528]: DEBUG cinder.quota [None req-eba9af2a-6055-48e0-87b2-28fede6b9704 tempest-VolumeDependencyTests-18272511 None] Created reservations ['1ae8bb2d-fda7-4535-acac-8de20ed68b7e', 'd4c1f2c4-8ea3-4115-8eb5-e438438bab92', '557571d4-4ca2-4c36-8dfe-629856e706b4', '6efbde36-cef6-44fd-b305-0e18220de4ad'] {{(pid=83528) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 25 16:03:17 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-eba9af2a-6055-48e0-87b2-28fede6b9704 tempest-VolumeDependencyTests-18272511 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 25 16:03:17 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-eba9af2a-6055-48e0-87b2-28fede6b9704 tempest-VolumeDependencyTests-18272511 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 25 16:03:17 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.quobyte [None req-eba9af2a-6055-48e0-87b2-28fede6b9704 tempest-VolumeDependencyTests-18272511 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23e9d725-3e04-4cd9-bfe0-c8ef43305589': None} {{(pid=83528) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 25 16:03:17 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.quobyte [None req-eba9af2a-6055-48e0-87b2-28fede6b9704 tempest-VolumeDependencyTests-18272511 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23e9d725-3e04-4cd9-bfe0-c8ef43305589'] {{(pid=83528) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 25 16:03:17 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-eba9af2a-6055-48e0-87b2-28fede6b9704 tempest-VolumeDependencyTests-18272511 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 25 16:03:17 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-eba9af2a-6055-48e0-87b2-28fede6b9704 tempest-VolumeDependencyTests-18272511 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85 {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 25 16:03:17 devstack sudo[92146]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85 Feb 25 16:03:17 devstack sudo[92146]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 25 16:03:18 devstack sudo[92146]: pam_unix(sudo:session): session closed for user root Feb 25 16:03:18 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-eba9af2a-6055-48e0-87b2-28fede6b9704 tempest-VolumeDependencyTests-18272511 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85" returned: 0 in 0.437s {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 25 16:03:18 devstack cinder-volume[83528]: DEBUG cinder.manager [None req-eba9af2a-6055-48e0-87b2-28fede6b9704 tempest-VolumeDependencyTests-18272511 None] Notifying Schedulers of capabilities ... {{(pid=83528) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 25 16:03:18 devstack cinder-volume[83528]: INFO cinder.volume.manager [None req-eba9af2a-6055-48e0-87b2-28fede6b9704 tempest-VolumeDependencyTests-18272511 None] Deleted volume successfully. Feb 25 16:03:18 devstack cinder-volume[83528]: DEBUG cinder.coordination [None req-eba9af2a-6055-48e0-87b2-28fede6b9704 tempest-VolumeDependencyTests-18272511 None] Lock "cinder-703af21c-fa8f-4628-a245-be5618097128-delete_volume" released by "delete_volume" :: held 1.663s {{(pid=83528) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 25 16:03:18 devstack cinder-volume[83528]: DEBUG cinder.volume.flows.manager.create_volume [None req-9840933b-5e63-4bc2-9bc5-0c96d3d24b24 tempest-CinderUnicodeTest-1311043769 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83528) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 25 16:03:18 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-9840933b-5e63-4bc2-9bc5-0c96d3d24b24 tempest-CinderUnicodeTest-1311043769 None] Flow 'volume_create_manager' (517beead-9fa8-478c-9d84-94315aaee29b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83528) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 25 16:03:18 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-9840933b-5e63-4bc2-9bc5-0c96d3d24b24 tempest-CinderUnicodeTest-1311043769 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8dc9d3c4-a49a-439d-b40b-5db9570767ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 25 16:03:18 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-9840933b-5e63-4bc2-9bc5-0c96d3d24b24 tempest-CinderUnicodeTest-1311043769 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8dc9d3c4-a49a-439d-b40b-5db9570767ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-25T15:03:18Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-2004185099',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=078a06cd-0fa7-431d-8c8a-0a78c34f560f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dfbdad1d30ec4c9fa0d54c07645a9039',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-25T15:03:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-25T15:03:18Z,use_quota=True,user_id='94accf29c049476198c4bde7a97bccef',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ce71c2f9-6543-4165-9653-a1529b2ea243),volume_type_id=ce71c2f9-6543-4165-9653-a1529b2ea243)' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 25 16:03:18 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-9840933b-5e63-4bc2-9bc5-0c96d3d24b24 tempest-CinderUnicodeTest-1311043769 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7d5f6b61-d3ee-4524-b1c3-96332f278280) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 25 16:03:18 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-9840933b-5e63-4bc2-9bc5-0c96d3d24b24 tempest-CinderUnicodeTest-1311043769 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7d5f6b61-d3ee-4524-b1c3-96332f278280) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 25 16:03:18 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-9840933b-5e63-4bc2-9bc5-0c96d3d24b24 tempest-CinderUnicodeTest-1311043769 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (293b0018-9077-4fc0-abe7-db1e2535abaa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 25 16:03:18 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-9840933b-5e63-4bc2-9bc5-0c96d3d24b24 tempest-CinderUnicodeTest-1311043769 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (293b0018-9077-4fc0-abe7-db1e2535abaa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '078a06cd-0fa7-431d-8c8a-0a78c34f560f', 'volume_name': 'volume-078a06cd-0fa7-431d-8c8a-0a78c34f560f', 'volume_size': 1}' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 25 16:03:18 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-9840933b-5e63-4bc2-9bc5-0c96d3d24b24 tempest-CinderUnicodeTest-1311043769 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d2ed39ad-f07f-4f0f-aee0-4548de0eb3d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 25 16:03:18 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-9840933b-5e63-4bc2-9bc5-0c96d3d24b24 tempest-CinderUnicodeTest-1311043769 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d2ed39ad-f07f-4f0f-aee0-4548de0eb3d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 25 16:03:18 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-9840933b-5e63-4bc2-9bc5-0c96d3d24b24 tempest-CinderUnicodeTest-1311043769 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bf4b1e7c-6c94-4dda-90ee-bacbe5fd5701) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 25 16:03:18 devstack cinder-volume[83528]: INFO cinder.volume.flows.manager.create_volume [None req-9840933b-5e63-4bc2-9bc5-0c96d3d24b24 tempest-CinderUnicodeTest-1311043769 None] Volume 078a06cd-0fa7-431d-8c8a-0a78c34f560f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-078a06cd-0fa7-431d-8c8a-0a78c34f560f', 'volume_size': 1} Feb 25 16:03:18 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-9840933b-5e63-4bc2-9bc5-0c96d3d24b24 tempest-CinderUnicodeTest-1311043769 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 25 16:03:18 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-9840933b-5e63-4bc2-9bc5-0c96d3d24b24 tempest-CinderUnicodeTest-1311043769 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 25 16:03:18 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.quobyte [None req-9840933b-5e63-4bc2-9bc5-0c96d3d24b24 tempest-CinderUnicodeTest-1311043769 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-25T15:03:18Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-2004185099',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=078a06cd-0fa7-431d-8c8a-0a78c34f560f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dfbdad1d30ec4c9fa0d54c07645a9039',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-25T15:03:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-25T15:03:18Z,use_quota=True,user_id='94accf29c049476198c4bde7a97bccef',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ce71c2f9-6543-4165-9653-a1529b2ea243),volume_type_id=ce71c2f9-6543-4165-9653-a1529b2ea243)}" {{(pid=83528) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 25 16:03:18 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.remotefs [None req-9840933b-5e63-4bc2-9bc5-0c96d3d24b24 tempest-CinderUnicodeTest-1311043769 None] Creating volume 078a06cd-0fa7-431d-8c8a-0a78c34f560f {{(pid=83528) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 25 16:03:18 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-9840933b-5e63-4bc2-9bc5-0c96d3d24b24 tempest-CinderUnicodeTest-1311043769 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 25 16:03:18 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-9840933b-5e63-4bc2-9bc5-0c96d3d24b24 tempest-CinderUnicodeTest-1311043769 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 25 16:03:18 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.quobyte [None req-9840933b-5e63-4bc2-9bc5-0c96d3d24b24 tempest-CinderUnicodeTest-1311043769 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23e9d725-3e04-4cd9-bfe0-c8ef43305589': None} {{(pid=83528) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 25 16:03:18 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.quobyte [None req-9840933b-5e63-4bc2-9bc5-0c96d3d24b24 tempest-CinderUnicodeTest-1311043769 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23e9d725-3e04-4cd9-bfe0-c8ef43305589'] {{(pid=83528) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 25 16:03:18 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-9840933b-5e63-4bc2-9bc5-0c96d3d24b24 tempest-CinderUnicodeTest-1311043769 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 25 16:03:18 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.quobyte [None req-9840933b-5e63-4bc2-9bc5-0c96d3d24b24 tempest-CinderUnicodeTest-1311043769 None] Selected osci02.corp.quobyte.com/cinder-vol-23e9d725-3e04-4cd9-bfe0-c8ef43305589 as target Quobyte volume. {{(pid=83528) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 25 16:03:18 devstack cinder-volume[83528]: INFO cinder.volume.drivers.remotefs [None req-9840933b-5e63-4bc2-9bc5-0c96d3d24b24 tempest-CinderUnicodeTest-1311043769 None] casted to osci02.corp.quobyte.com/cinder-vol-23e9d725-3e04-4cd9-bfe0-c8ef43305589 Feb 25 16:03:18 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-9840933b-5e63-4bc2-9bc5-0c96d3d24b24 tempest-CinderUnicodeTest-1311043769 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-078a06cd-0fa7-431d-8c8a-0a78c34f560f 1073741824 {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 25 16:03:18 devstack sudo[92149]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-078a06cd-0fa7-431d-8c8a-0a78c34f560f 1073741824 Feb 25 16:03:18 devstack sudo[92149]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 25 16:03:18 devstack cinder-volume[83528]: DEBUG cinder.coordination [None req-9cf1c4d3-adf8-437f-9be8-336e13f608fe tempest-VolumeDependencyTests-18272511 None] Acquiring lock "cinder-aaff583b-3dac-4ecc-bea8-832524cd0fd0-delete_volume" by "delete_volume" {{(pid=83528) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 25 16:03:18 devstack cinder-volume[83528]: DEBUG cinder.coordination [None req-9cf1c4d3-adf8-437f-9be8-336e13f608fe tempest-VolumeDependencyTests-18272511 None] Lock "cinder-aaff583b-3dac-4ecc-bea8-832524cd0fd0-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=83528) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 25 16:03:18 devstack cinder-volume[83528]: DEBUG cinder.coordination [None req-9cf1c4d3-adf8-437f-9be8-336e13f608fe tempest-VolumeDependencyTests-18272511 None] Acquiring lock "cinder-quobyte-aaff583b-3dac-4ecc-bea8-832524cd0fd0" by "delete_volume" {{(pid=83528) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 25 16:03:18 devstack cinder-volume[83528]: DEBUG cinder.coordination [None req-9cf1c4d3-adf8-437f-9be8-336e13f608fe tempest-VolumeDependencyTests-18272511 None] Lock "cinder-quobyte-aaff583b-3dac-4ecc-bea8-832524cd0fd0" acquired by "delete_volume" :: waited 0.010s {{(pid=83528) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 25 16:03:18 devstack cinder-volume[83528]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d1d7542-4685-43df-8708-4c480fe3b43b]: (4, 'qcow2') {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 25 16:03:18 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-9cf1c4d3-adf8-437f-9be8-336e13f608fe tempest-VolumeDependencyTests-18272511 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-aaff583b-3dac-4ecc-bea8-832524cd0fd0 {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 25 16:03:18 devstack sudo[92154]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-aaff583b-3dac-4ecc-bea8-832524cd0fd0 Feb 25 16:03:18 devstack sudo[92154]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 25 16:03:18 devstack sudo[92149]: pam_unix(sudo:session): session closed for user root Feb 25 16:03:18 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-9840933b-5e63-4bc2-9bc5-0c96d3d24b24 tempest-CinderUnicodeTest-1311043769 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-078a06cd-0fa7-431d-8c8a-0a78c34f560f 1073741824" returned: 0 in 0.573s {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 25 16:03:18 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-9840933b-5e63-4bc2-9bc5-0c96d3d24b24 tempest-CinderUnicodeTest-1311043769 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-078a06cd-0fa7-431d-8c8a-0a78c34f560f {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 25 16:03:18 devstack sudo[92156]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-078a06cd-0fa7-431d-8c8a-0a78c34f560f Feb 25 16:03:18 devstack sudo[92156]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 25 16:03:19 devstack sudo[92154]: pam_unix(sudo:session): session closed for user root Feb 25 16:03:19 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-9cf1c4d3-adf8-437f-9be8-336e13f608fe tempest-VolumeDependencyTests-18272511 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-aaff583b-3dac-4ecc-bea8-832524cd0fd0" returned: 0 in 0.491s {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 25 16:03:19 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-9cf1c4d3-adf8-437f-9be8-336e13f608fe tempest-VolumeDependencyTests-18272511 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-aaff583b-3dac-4ecc-bea8-832524cd0fd0 {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 25 16:03:19 devstack sudo[92162]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-aaff583b-3dac-4ecc-bea8-832524cd0fd0 Feb 25 16:03:19 devstack sudo[92162]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 25 16:03:19 devstack sudo[92156]: pam_unix(sudo:session): session closed for user root Feb 25 16:03:19 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-9840933b-5e63-4bc2-9bc5-0c96d3d24b24 tempest-CinderUnicodeTest-1311043769 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-078a06cd-0fa7-431d-8c8a-0a78c34f560f" returned: 0 in 0.404s {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 25 16:03:19 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.quobyte [None req-9840933b-5e63-4bc2-9bc5-0c96d3d24b24 tempest-CinderUnicodeTest-1311043769 None] <== create_volume: return (1005ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-23e9d725-3e04-4cd9-bfe0-c8ef43305589'} {{(pid=83528) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 25 16:03:19 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-9840933b-5e63-4bc2-9bc5-0c96d3d24b24 tempest-CinderUnicodeTest-1311043769 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.007s {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 25 16:03:19 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-9840933b-5e63-4bc2-9bc5-0c96d3d24b24 tempest-CinderUnicodeTest-1311043769 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bf4b1e7c-6c94-4dda-90ee-bacbe5fd5701) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-078a06cd-0fa7-431d-8c8a-0a78c34f560f', 'volume_size': 1}' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 25 16:03:19 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-9840933b-5e63-4bc2-9bc5-0c96d3d24b24 tempest-CinderUnicodeTest-1311043769 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (87cc87c2-d4a5-46c8-9baa-185c7b262d07) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 25 16:03:19 devstack cinder-volume[83528]: INFO cinder.volume.flows.manager.create_volume [None req-9840933b-5e63-4bc2-9bc5-0c96d3d24b24 tempest-CinderUnicodeTest-1311043769 None] Volume volume-078a06cd-0fa7-431d-8c8a-0a78c34f560f (078a06cd-0fa7-431d-8c8a-0a78c34f560f): created successfully Feb 25 16:03:19 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-9840933b-5e63-4bc2-9bc5-0c96d3d24b24 tempest-CinderUnicodeTest-1311043769 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (87cc87c2-d4a5-46c8-9baa-185c7b262d07) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83528) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 25 16:03:19 devstack cinder-volume[83528]: DEBUG cinder.volume.manager [None req-9840933b-5e63-4bc2-9bc5-0c96d3d24b24 tempest-CinderUnicodeTest-1311043769 None] Flow 'volume_create_manager' (517beead-9fa8-478c-9d84-94315aaee29b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83528) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 25 16:03:19 devstack cinder-volume[83528]: INFO cinder.volume.manager [None req-9840933b-5e63-4bc2-9bc5-0c96d3d24b24 tempest-CinderUnicodeTest-1311043769 None] Created volume successfully. Feb 25 16:03:19 devstack sudo[92162]: pam_unix(sudo:session): session closed for user root Feb 25 16:03:19 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-9cf1c4d3-adf8-437f-9be8-336e13f608fe tempest-VolumeDependencyTests-18272511 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-aaff583b-3dac-4ecc-bea8-832524cd0fd0" returned: 0 in 0.395s {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 25 16:03:19 devstack cinder-volume[83528]: DEBUG cinder.coordination [None req-9cf1c4d3-adf8-437f-9be8-336e13f608fe tempest-VolumeDependencyTests-18272511 None] Lock "cinder-quobyte-aaff583b-3dac-4ecc-bea8-832524cd0fd0" released by "delete_volume" :: held 0.914s {{(pid=83528) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 25 16:03:19 devstack cinder-volume[83528]: DEBUG cinder.quota [None req-9cf1c4d3-adf8-437f-9be8-336e13f608fe tempest-VolumeDependencyTests-18272511 None] Created reservations ['5aafae97-3760-4de4-86e5-cbf04dd2d048', 'f714dd06-0a3f-41cb-b0ba-fc42f6a6d712', '1a1dbb65-ba0f-4f59-9043-28d6f94ac917', 'e03a32c4-ceae-460a-b007-d40b0efc1309'] {{(pid=83528) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 25 16:03:19 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-9cf1c4d3-adf8-437f-9be8-336e13f608fe tempest-VolumeDependencyTests-18272511 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 25 16:03:19 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-9cf1c4d3-adf8-437f-9be8-336e13f608fe tempest-VolumeDependencyTests-18272511 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 25 16:03:19 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.quobyte [None req-9cf1c4d3-adf8-437f-9be8-336e13f608fe tempest-VolumeDependencyTests-18272511 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23e9d725-3e04-4cd9-bfe0-c8ef43305589': None} {{(pid=83528) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 25 16:03:19 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.quobyte [None req-9cf1c4d3-adf8-437f-9be8-336e13f608fe tempest-VolumeDependencyTests-18272511 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23e9d725-3e04-4cd9-bfe0-c8ef43305589'] {{(pid=83528) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 25 16:03:19 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-9cf1c4d3-adf8-437f-9be8-336e13f608fe tempest-VolumeDependencyTests-18272511 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 25 16:03:19 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-9cf1c4d3-adf8-437f-9be8-336e13f608fe tempest-VolumeDependencyTests-18272511 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85 {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 25 16:03:19 devstack sudo[92165]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85 Feb 25 16:03:19 devstack sudo[92165]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 25 16:03:20 devstack sudo[92165]: pam_unix(sudo:session): session closed for user root Feb 25 16:03:20 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-9cf1c4d3-adf8-437f-9be8-336e13f608fe tempest-VolumeDependencyTests-18272511 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85" returned: 0 in 0.415s {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 25 16:03:20 devstack cinder-volume[83528]: DEBUG cinder.manager [None req-9cf1c4d3-adf8-437f-9be8-336e13f608fe tempest-VolumeDependencyTests-18272511 None] Notifying Schedulers of capabilities ... {{(pid=83528) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 25 16:03:20 devstack cinder-volume[83528]: INFO cinder.volume.manager [None req-9cf1c4d3-adf8-437f-9be8-336e13f608fe tempest-VolumeDependencyTests-18272511 None] Deleted volume successfully. Feb 25 16:03:20 devstack cinder-volume[83528]: DEBUG cinder.coordination [None req-9cf1c4d3-adf8-437f-9be8-336e13f608fe tempest-VolumeDependencyTests-18272511 None] Lock "cinder-aaff583b-3dac-4ecc-bea8-832524cd0fd0-delete_volume" released by "delete_volume" :: held 1.457s {{(pid=83528) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 25 16:03:20 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-35a79dd4-6229-479f-afb6-175b14f930ef tempest-CinderUnicodeTest-1311043769 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 25 16:03:20 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-35a79dd4-6229-479f-afb6-175b14f930ef tempest-CinderUnicodeTest-1311043769 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 25 16:03:20 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.remotefs [None req-35a79dd4-6229-479f-afb6-175b14f930ef tempest-CinderUnicodeTest-1311043769 None] Creating offline snapshot 7ebd0da2-7672-488e-9a10-373460e3729a of volume 078a06cd-0fa7-431d-8c8a-0a78c34f560f {{(pid=83528) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Feb 25 16:03:20 devstack cinder-volume[83528]: DEBUG oslo.privsep.daemon [-] privsep: reply[5809813b-ca83-4879-ba12-36f81e69b79e]: (4, 'qcow2') {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 25 16:03:20 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-35a79dd4-6229-479f-afb6-175b14f930ef tempest-CinderUnicodeTest-1311043769 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-078a06cd-0fa7-431d-8c8a-0a78c34f560f {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 25 16:03:20 devstack sudo[92168]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-078a06cd-0fa7-431d-8c8a-0a78c34f560f Feb 25 16:03:20 devstack sudo[92168]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 25 16:03:21 devstack sudo[92168]: pam_unix(sudo:session): session closed for user root Feb 25 16:03:21 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-35a79dd4-6229-479f-afb6-175b14f930ef tempest-CinderUnicodeTest-1311043769 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-078a06cd-0fa7-431d-8c8a-0a78c34f560f" returned: 0 in 0.498s {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 25 16:03:21 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-35a79dd4-6229-479f-afb6-175b14f930ef tempest-CinderUnicodeTest-1311043769 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-078a06cd-0fa7-431d-8c8a-0a78c34f560f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-078a06cd-0fa7-431d-8c8a-0a78c34f560f.7ebd0da2-7672-488e-9a10-373460e3729a 1G {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 25 16:03:21 devstack sudo[92173]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-078a06cd-0fa7-431d-8c8a-0a78c34f560f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-078a06cd-0fa7-431d-8c8a-0a78c34f560f.7ebd0da2-7672-488e-9a10-373460e3729a 1G Feb 25 16:03:21 devstack sudo[92173]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 25 16:03:21 devstack sudo[92173]: pam_unix(sudo:session): session closed for user root Feb 25 16:03:21 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-35a79dd4-6229-479f-afb6-175b14f930ef tempest-CinderUnicodeTest-1311043769 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-078a06cd-0fa7-431d-8c8a-0a78c34f560f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-078a06cd-0fa7-431d-8c8a-0a78c34f560f.7ebd0da2-7672-488e-9a10-373460e3729a 1G" returned: 0 in 0.476s {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 25 16:03:21 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-35a79dd4-6229-479f-afb6-175b14f930ef tempest-CinderUnicodeTest-1311043769 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-078a06cd-0fa7-431d-8c8a-0a78c34f560f -F qcow2 /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-078a06cd-0fa7-431d-8c8a-0a78c34f560f.7ebd0da2-7672-488e-9a10-373460e3729a {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 25 16:03:21 devstack sudo[92178]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-078a06cd-0fa7-431d-8c8a-0a78c34f560f -F qcow2 /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-078a06cd-0fa7-431d-8c8a-0a78c34f560f.7ebd0da2-7672-488e-9a10-373460e3729a Feb 25 16:03:21 devstack sudo[92178]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 25 16:03:21 devstack sudo[92178]: pam_unix(sudo:session): session closed for user root Feb 25 16:03:21 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-35a79dd4-6229-479f-afb6-175b14f930ef tempest-CinderUnicodeTest-1311043769 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-078a06cd-0fa7-431d-8c8a-0a78c34f560f -F qcow2 /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-078a06cd-0fa7-431d-8c8a-0a78c34f560f.7ebd0da2-7672-488e-9a10-373460e3729a" returned: 0 in 0.419s {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 25 16:03:21 devstack cinder-volume[83528]: WARNING cinder.volume.drivers.remotefs [None req-35a79dd4-6229-479f-afb6-175b14f930ef tempest-CinderUnicodeTest-1311043769 None] /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-078a06cd-0fa7-431d-8c8a-0a78c34f560f.7ebd0da2-7672-488e-9a10-373460e3729a is being set with open permissions: ugo+rw Feb 25 16:03:21 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-35a79dd4-6229-479f-afb6-175b14f930ef tempest-CinderUnicodeTest-1311043769 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-078a06cd-0fa7-431d-8c8a-0a78c34f560f.7ebd0da2-7672-488e-9a10-373460e3729a {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 25 16:03:21 devstack sudo[92183]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-078a06cd-0fa7-431d-8c8a-0a78c34f560f.7ebd0da2-7672-488e-9a10-373460e3729a Feb 25 16:03:21 devstack sudo[92183]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 25 16:03:22 devstack sudo[92183]: pam_unix(sudo:session): session closed for user root Feb 25 16:03:22 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-35a79dd4-6229-479f-afb6-175b14f930ef tempest-CinderUnicodeTest-1311043769 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-078a06cd-0fa7-431d-8c8a-0a78c34f560f.7ebd0da2-7672-488e-9a10-373460e3729a" returned: 0 in 0.374s {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 25 16:03:22 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-35a79dd4-6229-479f-afb6-175b14f930ef tempest-CinderUnicodeTest-1311043769 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-078a06cd-0fa7-431d-8c8a-0a78c34f560f.info {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 25 16:03:22 devstack sudo[92186]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-078a06cd-0fa7-431d-8c8a-0a78c34f560f.info Feb 25 16:03:22 devstack sudo[92186]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 25 16:03:22 devstack sudo[92186]: pam_unix(sudo:session): session closed for user root Feb 25 16:03:22 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-35a79dd4-6229-479f-afb6-175b14f930ef tempest-CinderUnicodeTest-1311043769 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-078a06cd-0fa7-431d-8c8a-0a78c34f560f.info" returned: 0 in 0.416s {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 25 16:03:22 devstack cinder-volume[83528]: WARNING cinder.volume.drivers.remotefs [None req-35a79dd4-6229-479f-afb6-175b14f930ef tempest-CinderUnicodeTest-1311043769 None] /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-078a06cd-0fa7-431d-8c8a-0a78c34f560f.info is being set with open permissions: ugo+rw Feb 25 16:03:22 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-35a79dd4-6229-479f-afb6-175b14f930ef tempest-CinderUnicodeTest-1311043769 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-078a06cd-0fa7-431d-8c8a-0a78c34f560f.info {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 25 16:03:22 devstack sudo[92189]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-078a06cd-0fa7-431d-8c8a-0a78c34f560f.info Feb 25 16:03:22 devstack sudo[92189]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 25 16:03:23 devstack sudo[92189]: pam_unix(sudo:session): session closed for user root Feb 25 16:03:23 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-35a79dd4-6229-479f-afb6-175b14f930ef tempest-CinderUnicodeTest-1311043769 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-078a06cd-0fa7-431d-8c8a-0a78c34f560f.info" returned: 0 in 0.378s {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 25 16:03:23 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-35a79dd4-6229-479f-afb6-175b14f930ef tempest-CinderUnicodeTest-1311043769 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.613s {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 25 16:03:23 devstack cinder-volume[83528]: INFO cinder.volume.manager [None req-35a79dd4-6229-479f-afb6-175b14f930ef tempest-CinderUnicodeTest-1311043769 None] Create snapshot completed successfully Feb 25 16:03:23 devstack cinder-volume[83528]: DEBUG cinder.coordination [None req-ac4e1fd6-59d3-46d3-8adb-d4faf6b844f5 tempest-CinderUnicodeTest-1311043769 None] Acquiring lock "cinder-7ebd0da2-7672-488e-9a10-373460e3729a-delete_snapshot" by "delete_snapshot" {{(pid=83528) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 25 16:03:23 devstack cinder-volume[83528]: DEBUG cinder.coordination [None req-ac4e1fd6-59d3-46d3-8adb-d4faf6b844f5 tempest-CinderUnicodeTest-1311043769 None] Lock "cinder-7ebd0da2-7672-488e-9a10-373460e3729a-delete_snapshot" acquired by "delete_snapshot" :: waited 0.011s {{(pid=83528) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 25 16:03:23 devstack cinder-volume[83528]: DEBUG cinder.coordination [None req-ac4e1fd6-59d3-46d3-8adb-d4faf6b844f5 tempest-CinderUnicodeTest-1311043769 None] Acquiring lock "cinder-quobyte-078a06cd-0fa7-431d-8c8a-0a78c34f560f" by "delete_snapshot" {{(pid=83528) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 25 16:03:23 devstack cinder-volume[83528]: DEBUG cinder.coordination [None req-ac4e1fd6-59d3-46d3-8adb-d4faf6b844f5 tempest-CinderUnicodeTest-1311043769 None] Lock "cinder-quobyte-078a06cd-0fa7-431d-8c8a-0a78c34f560f" acquired by "delete_snapshot" :: waited 0.010s {{(pid=83528) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 25 16:03:23 devstack cinder-volume[83528]: DEBUG cinder.coordination [None req-ac4e1fd6-59d3-46d3-8adb-d4faf6b844f5 tempest-CinderUnicodeTest-1311043769 None] Acquiring lock "cinder-quobyte-7ebd0da2-7672-488e-9a10-373460e3729a" by "_delete_snapshot" {{(pid=83528) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 25 16:03:23 devstack cinder-volume[83528]: DEBUG cinder.coordination [None req-ac4e1fd6-59d3-46d3-8adb-d4faf6b844f5 tempest-CinderUnicodeTest-1311043769 None] Lock "cinder-quobyte-7ebd0da2-7672-488e-9a10-373460e3729a" acquired by "_delete_snapshot" :: waited 0.008s {{(pid=83528) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 25 16:03:23 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.remotefs [None req-ac4e1fd6-59d3-46d3-8adb-d4faf6b844f5 tempest-CinderUnicodeTest-1311043769 None] Deleting offline snapshot 7ebd0da2-7672-488e-9a10-373460e3729a of volume 078a06cd-0fa7-431d-8c8a-0a78c34f560f {{(pid=83528) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Feb 25 16:03:23 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.remotefs [None req-ac4e1fd6-59d3-46d3-8adb-d4faf6b844f5 tempest-CinderUnicodeTest-1311043769 None] snapshot_file for this snap is: volume-078a06cd-0fa7-431d-8c8a-0a78c34f560f.7ebd0da2-7672-488e-9a10-373460e3729a {{(pid=83528) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Feb 25 16:03:23 devstack cinder-volume[83528]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6a01956-30d0-437f-92dd-a5a6ae977dca]: (4, 'qcow2') {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 25 16:03:23 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-ac4e1fd6-59d3-46d3-8adb-d4faf6b844f5 tempest-CinderUnicodeTest-1311043769 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-078a06cd-0fa7-431d-8c8a-0a78c34f560f.7ebd0da2-7672-488e-9a10-373460e3729a {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 25 16:03:23 devstack sudo[92192]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-078a06cd-0fa7-431d-8c8a-0a78c34f560f.7ebd0da2-7672-488e-9a10-373460e3729a Feb 25 16:03:23 devstack sudo[92192]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 25 16:03:24 devstack sudo[92192]: pam_unix(sudo:session): session closed for user root Feb 25 16:03:24 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-ac4e1fd6-59d3-46d3-8adb-d4faf6b844f5 tempest-CinderUnicodeTest-1311043769 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-078a06cd-0fa7-431d-8c8a-0a78c34f560f.7ebd0da2-7672-488e-9a10-373460e3729a" returned: 0 in 0.432s {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 25 16:03:24 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.remotefs [None req-ac4e1fd6-59d3-46d3-8adb-d4faf6b844f5 tempest-CinderUnicodeTest-1311043769 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-078a06cd-0fa7-431d-8c8a-0a78c34f560f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83528) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Feb 25 16:03:24 devstack cinder-volume[83528]: DEBUG oslo.privsep.daemon [-] privsep: reply[d77f3114-4131-466a-987b-cd62a8535478]: (4, 'qcow2') {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 25 16:03:24 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-ac4e1fd6-59d3-46d3-8adb-d4faf6b844f5 tempest-CinderUnicodeTest-1311043769 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-078a06cd-0fa7-431d-8c8a-0a78c34f560f {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 25 16:03:24 devstack sudo[92197]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-078a06cd-0fa7-431d-8c8a-0a78c34f560f Feb 25 16:03:24 devstack sudo[92197]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 25 16:03:24 devstack sudo[92197]: pam_unix(sudo:session): session closed for user root Feb 25 16:03:24 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-ac4e1fd6-59d3-46d3-8adb-d4faf6b844f5 tempest-CinderUnicodeTest-1311043769 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-078a06cd-0fa7-431d-8c8a-0a78c34f560f" returned: 0 in 0.440s {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 25 16:03:24 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-ac4e1fd6-59d3-46d3-8adb-d4faf6b844f5 tempest-CinderUnicodeTest-1311043769 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-078a06cd-0fa7-431d-8c8a-0a78c34f560f.7ebd0da2-7672-488e-9a10-373460e3729a {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 25 16:03:24 devstack sudo[92202]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-078a06cd-0fa7-431d-8c8a-0a78c34f560f.7ebd0da2-7672-488e-9a10-373460e3729a Feb 25 16:03:24 devstack sudo[92202]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 25 16:03:24 devstack sudo[92202]: pam_unix(sudo:session): session closed for user root Feb 25 16:03:24 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-ac4e1fd6-59d3-46d3-8adb-d4faf6b844f5 tempest-CinderUnicodeTest-1311043769 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-078a06cd-0fa7-431d-8c8a-0a78c34f560f.7ebd0da2-7672-488e-9a10-373460e3729a" returned: 0 in 0.416s {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 25 16:03:25 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-ac4e1fd6-59d3-46d3-8adb-d4faf6b844f5 tempest-CinderUnicodeTest-1311043769 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-078a06cd-0fa7-431d-8c8a-0a78c34f560f.7ebd0da2-7672-488e-9a10-373460e3729a {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 25 16:03:25 devstack sudo[92208]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-078a06cd-0fa7-431d-8c8a-0a78c34f560f.7ebd0da2-7672-488e-9a10-373460e3729a Feb 25 16:03:25 devstack sudo[92208]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 25 16:03:25 devstack sudo[92208]: pam_unix(sudo:session): session closed for user root Feb 25 16:03:25 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-ac4e1fd6-59d3-46d3-8adb-d4faf6b844f5 tempest-CinderUnicodeTest-1311043769 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-078a06cd-0fa7-431d-8c8a-0a78c34f560f.7ebd0da2-7672-488e-9a10-373460e3729a" returned: 0 in 0.378s {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 25 16:03:25 devstack cinder-volume[83528]: DEBUG cinder.coordination [None req-ac4e1fd6-59d3-46d3-8adb-d4faf6b844f5 tempest-CinderUnicodeTest-1311043769 None] Lock "cinder-quobyte-7ebd0da2-7672-488e-9a10-373460e3729a" released by "_delete_snapshot" :: held 1.718s {{(pid=83528) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 25 16:03:25 devstack cinder-volume[83528]: DEBUG cinder.coordination [None req-ac4e1fd6-59d3-46d3-8adb-d4faf6b844f5 tempest-CinderUnicodeTest-1311043769 None] Lock "cinder-quobyte-078a06cd-0fa7-431d-8c8a-0a78c34f560f" released by "delete_snapshot" :: held 1.731s {{(pid=83528) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 25 16:03:25 devstack cinder-volume[83528]: DEBUG cinder.quota [None req-ac4e1fd6-59d3-46d3-8adb-d4faf6b844f5 tempest-CinderUnicodeTest-1311043769 None] Created reservations ['c5b42567-49d0-4caa-906b-478bfd42946c', '3cb1e5e5-5206-4e01-a777-068359de5e72', '5a9bc219-19a6-41e8-b5cc-c3474d6bb24e', '49c215d2-89b8-44d4-a22e-d97710e9030d'] {{(pid=83528) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 25 16:03:25 devstack cinder-volume[83528]: INFO cinder.volume.manager [None req-ac4e1fd6-59d3-46d3-8adb-d4faf6b844f5 tempest-CinderUnicodeTest-1311043769 None] Delete snapshot completed successfully. Feb 25 16:03:25 devstack cinder-volume[83528]: DEBUG cinder.coordination [None req-ac4e1fd6-59d3-46d3-8adb-d4faf6b844f5 tempest-CinderUnicodeTest-1311043769 None] Lock "cinder-7ebd0da2-7672-488e-9a10-373460e3729a-delete_snapshot" released by "delete_snapshot" :: held 1.809s {{(pid=83528) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 25 16:03:25 devstack cinder-volume[83528]: DEBUG cinder.coordination [None req-f499ccab-5750-4dfc-b0a7-32e01d561dea tempest-CinderUnicodeTest-1311043769 None] Acquiring lock "cinder-078a06cd-0fa7-431d-8c8a-0a78c34f560f-delete_volume" by "delete_volume" {{(pid=83528) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 25 16:03:25 devstack cinder-volume[83528]: DEBUG cinder.coordination [None req-f499ccab-5750-4dfc-b0a7-32e01d561dea tempest-CinderUnicodeTest-1311043769 None] Lock "cinder-078a06cd-0fa7-431d-8c8a-0a78c34f560f-delete_volume" acquired by "delete_volume" :: waited 0.008s {{(pid=83528) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 25 16:03:25 devstack cinder-volume[83528]: DEBUG cinder.coordination [None req-f499ccab-5750-4dfc-b0a7-32e01d561dea tempest-CinderUnicodeTest-1311043769 None] Acquiring lock "cinder-quobyte-078a06cd-0fa7-431d-8c8a-0a78c34f560f" by "delete_volume" {{(pid=83528) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 25 16:03:25 devstack cinder-volume[83528]: DEBUG cinder.coordination [None req-f499ccab-5750-4dfc-b0a7-32e01d561dea tempest-CinderUnicodeTest-1311043769 None] Lock "cinder-quobyte-078a06cd-0fa7-431d-8c8a-0a78c34f560f" acquired by "delete_volume" :: waited 0.007s {{(pid=83528) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 25 16:03:25 devstack cinder-volume[83528]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0ad630b-7a01-481a-a657-97a424656f20]: (4, 'qcow2') {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 25 16:03:25 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-f499ccab-5750-4dfc-b0a7-32e01d561dea tempest-CinderUnicodeTest-1311043769 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-078a06cd-0fa7-431d-8c8a-0a78c34f560f {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 25 16:03:25 devstack sudo[92211]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-078a06cd-0fa7-431d-8c8a-0a78c34f560f Feb 25 16:03:25 devstack sudo[92211]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 25 16:03:26 devstack sudo[92211]: pam_unix(sudo:session): session closed for user root Feb 25 16:03:26 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-f499ccab-5750-4dfc-b0a7-32e01d561dea tempest-CinderUnicodeTest-1311043769 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-078a06cd-0fa7-431d-8c8a-0a78c34f560f" returned: 0 in 0.433s {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 25 16:03:26 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-f499ccab-5750-4dfc-b0a7-32e01d561dea tempest-CinderUnicodeTest-1311043769 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-078a06cd-0fa7-431d-8c8a-0a78c34f560f {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 25 16:03:26 devstack sudo[92216]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-078a06cd-0fa7-431d-8c8a-0a78c34f560f Feb 25 16:03:26 devstack sudo[92216]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 25 16:03:26 devstack sudo[92216]: pam_unix(sudo:session): session closed for user root Feb 25 16:03:26 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-f499ccab-5750-4dfc-b0a7-32e01d561dea tempest-CinderUnicodeTest-1311043769 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-078a06cd-0fa7-431d-8c8a-0a78c34f560f" returned: 0 in 0.396s {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 25 16:03:26 devstack cinder-volume[83528]: DEBUG cinder.coordination [None req-f499ccab-5750-4dfc-b0a7-32e01d561dea tempest-CinderUnicodeTest-1311043769 None] Lock "cinder-quobyte-078a06cd-0fa7-431d-8c8a-0a78c34f560f" released by "delete_volume" :: held 0.863s {{(pid=83528) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 25 16:03:26 devstack cinder-volume[83528]: DEBUG cinder.quota [None req-f499ccab-5750-4dfc-b0a7-32e01d561dea tempest-CinderUnicodeTest-1311043769 None] Created reservations ['91391d86-56b1-407a-b91a-0f0788b14fd2', 'fa4237f1-2d10-4697-8651-cfda6a08260d', 'c9fcbb9a-5d1a-4e51-9a42-b64b7aec23ea', 'c4232caa-01e2-446b-b894-2a99d042e778'] {{(pid=83528) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 25 16:03:26 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-f499ccab-5750-4dfc-b0a7-32e01d561dea tempest-CinderUnicodeTest-1311043769 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 25 16:03:26 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-f499ccab-5750-4dfc-b0a7-32e01d561dea tempest-CinderUnicodeTest-1311043769 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 25 16:03:26 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.quobyte [None req-f499ccab-5750-4dfc-b0a7-32e01d561dea tempest-CinderUnicodeTest-1311043769 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23e9d725-3e04-4cd9-bfe0-c8ef43305589': None} {{(pid=83528) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 25 16:03:26 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.quobyte [None req-f499ccab-5750-4dfc-b0a7-32e01d561dea tempest-CinderUnicodeTest-1311043769 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23e9d725-3e04-4cd9-bfe0-c8ef43305589'] {{(pid=83528) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 25 16:03:26 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-f499ccab-5750-4dfc-b0a7-32e01d561dea tempest-CinderUnicodeTest-1311043769 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 25 16:03:26 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-f499ccab-5750-4dfc-b0a7-32e01d561dea tempest-CinderUnicodeTest-1311043769 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85 {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 25 16:03:26 devstack sudo[92219]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85 Feb 25 16:03:26 devstack sudo[92219]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 25 16:03:26 devstack cinder-volume[83528]: DEBUG cinder.coordination [None req-b110399f-d1b4-4d05-802e-5a19cda72ebf tempest-CinderUnicodeTest-1311043769 None] Acquiring lock "cinder-152cbd7c-2694-481e-b805-2617b3663437-delete_volume" by "delete_volume" {{(pid=83528) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 25 16:03:26 devstack cinder-volume[83528]: DEBUG cinder.coordination [None req-b110399f-d1b4-4d05-802e-5a19cda72ebf tempest-CinderUnicodeTest-1311043769 None] Lock "cinder-152cbd7c-2694-481e-b805-2617b3663437-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=83528) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 25 16:03:26 devstack cinder-volume[83528]: DEBUG cinder.coordination [None req-b110399f-d1b4-4d05-802e-5a19cda72ebf tempest-CinderUnicodeTest-1311043769 None] Acquiring lock "cinder-quobyte-152cbd7c-2694-481e-b805-2617b3663437" by "delete_volume" {{(pid=83528) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 25 16:03:26 devstack cinder-volume[83528]: DEBUG cinder.coordination [None req-b110399f-d1b4-4d05-802e-5a19cda72ebf tempest-CinderUnicodeTest-1311043769 None] Lock "cinder-quobyte-152cbd7c-2694-481e-b805-2617b3663437" acquired by "delete_volume" :: waited 0.008s {{(pid=83528) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 25 16:03:26 devstack cinder-volume[83528]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4cb8a24-c0c4-42d0-a713-09af2eb821a6]: (4, 'qcow2') {{(pid=84389) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 25 16:03:26 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-b110399f-d1b4-4d05-802e-5a19cda72ebf tempest-CinderUnicodeTest-1311043769 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-152cbd7c-2694-481e-b805-2617b3663437 {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 25 16:03:27 devstack sudo[92221]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-152cbd7c-2694-481e-b805-2617b3663437 Feb 25 16:03:27 devstack sudo[92221]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 25 16:03:27 devstack sudo[92219]: pam_unix(sudo:session): session closed for user root Feb 25 16:03:27 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-f499ccab-5750-4dfc-b0a7-32e01d561dea tempest-CinderUnicodeTest-1311043769 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85" returned: 0 in 0.432s {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 25 16:03:27 devstack cinder-volume[83528]: DEBUG cinder.manager [None req-f499ccab-5750-4dfc-b0a7-32e01d561dea tempest-CinderUnicodeTest-1311043769 None] Notifying Schedulers of capabilities ... {{(pid=83528) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 25 16:03:27 devstack cinder-volume[83528]: INFO cinder.volume.manager [None req-f499ccab-5750-4dfc-b0a7-32e01d561dea tempest-CinderUnicodeTest-1311043769 None] Deleted volume successfully. Feb 25 16:03:27 devstack cinder-volume[83528]: DEBUG cinder.coordination [None req-f499ccab-5750-4dfc-b0a7-32e01d561dea tempest-CinderUnicodeTest-1311043769 None] Lock "cinder-078a06cd-0fa7-431d-8c8a-0a78c34f560f-delete_volume" released by "delete_volume" :: held 1.416s {{(pid=83528) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 25 16:03:27 devstack sudo[92221]: pam_unix(sudo:session): session closed for user root Feb 25 16:03:27 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-b110399f-d1b4-4d05-802e-5a19cda72ebf tempest-CinderUnicodeTest-1311043769 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-152cbd7c-2694-481e-b805-2617b3663437" returned: 0 in 0.456s {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 25 16:03:27 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-b110399f-d1b4-4d05-802e-5a19cda72ebf tempest-CinderUnicodeTest-1311043769 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-152cbd7c-2694-481e-b805-2617b3663437 {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 25 16:03:27 devstack sudo[92227]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-152cbd7c-2694-481e-b805-2617b3663437 Feb 25 16:03:27 devstack sudo[92227]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 25 16:03:27 devstack sudo[92227]: pam_unix(sudo:session): session closed for user root Feb 25 16:03:27 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-b110399f-d1b4-4d05-802e-5a19cda72ebf tempest-CinderUnicodeTest-1311043769 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85/volume-152cbd7c-2694-481e-b805-2617b3663437" returned: 0 in 0.382s {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 25 16:03:27 devstack cinder-volume[83528]: DEBUG cinder.coordination [None req-b110399f-d1b4-4d05-802e-5a19cda72ebf tempest-CinderUnicodeTest-1311043769 None] Lock "cinder-quobyte-152cbd7c-2694-481e-b805-2617b3663437" released by "delete_volume" :: held 0.869s {{(pid=83528) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 25 16:03:27 devstack cinder-volume[83528]: DEBUG cinder.quota [None req-b110399f-d1b4-4d05-802e-5a19cda72ebf tempest-CinderUnicodeTest-1311043769 None] Created reservations ['5fb4c99e-0384-4396-a7bf-ec550e13ef70', '2689ac3e-f92f-4863-ac3e-f9c09fdb21c4', 'dbc91ee7-0684-4a98-8dcd-97a969cc3c6a', '1d390f53-328d-4cd4-a3bc-f3ca8b8bb3a6'] {{(pid=83528) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 25 16:03:27 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-b110399f-d1b4-4d05-802e-5a19cda72ebf tempest-CinderUnicodeTest-1311043769 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 25 16:03:27 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-b110399f-d1b4-4d05-802e-5a19cda72ebf tempest-CinderUnicodeTest-1311043769 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 25 16:03:27 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.quobyte [None req-b110399f-d1b4-4d05-802e-5a19cda72ebf tempest-CinderUnicodeTest-1311043769 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23e9d725-3e04-4cd9-bfe0-c8ef43305589': None} {{(pid=83528) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 25 16:03:27 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.quobyte [None req-b110399f-d1b4-4d05-802e-5a19cda72ebf tempest-CinderUnicodeTest-1311043769 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23e9d725-3e04-4cd9-bfe0-c8ef43305589'] {{(pid=83528) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 25 16:03:27 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-b110399f-d1b4-4d05-802e-5a19cda72ebf tempest-CinderUnicodeTest-1311043769 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 25 16:03:27 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-b110399f-d1b4-4d05-802e-5a19cda72ebf tempest-CinderUnicodeTest-1311043769 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85 {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 25 16:03:27 devstack sudo[92230]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85 Feb 25 16:03:27 devstack sudo[92230]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 25 16:03:28 devstack sudo[92230]: pam_unix(sudo:session): session closed for user root Feb 25 16:03:28 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-b110399f-d1b4-4d05-802e-5a19cda72ebf tempest-CinderUnicodeTest-1311043769 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85" returned: 0 in 0.438s {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 25 16:03:28 devstack cinder-volume[83528]: DEBUG cinder.manager [None req-b110399f-d1b4-4d05-802e-5a19cda72ebf tempest-CinderUnicodeTest-1311043769 None] Notifying Schedulers of capabilities ... {{(pid=83528) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 25 16:03:28 devstack cinder-volume[83528]: INFO cinder.volume.manager [None req-b110399f-d1b4-4d05-802e-5a19cda72ebf tempest-CinderUnicodeTest-1311043769 None] Deleted volume successfully. Feb 25 16:03:28 devstack cinder-volume[83528]: DEBUG cinder.coordination [None req-b110399f-d1b4-4d05-802e-5a19cda72ebf tempest-CinderUnicodeTest-1311043769 None] Lock "cinder-152cbd7c-2694-481e-b805-2617b3663437-delete_volume" released by "delete_volume" :: held 1.429s {{(pid=83528) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 25 16:03:37 devstack cinder-volume[83528]: DEBUG dbcounter [-] [83528] Writing DB stats cinder:SELECT=161,cinder:INSERT=50,cinder:UPDATE=277,cinder:DELETE=18 {{(pid=83528) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Feb 25 16:03:38 devstack cinder-volume[83528]: DEBUG dbcounter [-] [83528] Writing DB stats cinder:UPDATE=209,cinder:SELECT=170,cinder:DELETE=23,cinder:INSERT=70 {{(pid=83528) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Feb 25 16:03:38 devstack cinder-volume[83528]: DEBUG oslo_service.periodic_task [None req-d4c764ec-0ebb-4b31-b534-c9a53c1ab0dd None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=83528) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Feb 25 16:03:38 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-d4c764ec-0ebb-4b31-b534-c9a53c1ab0dd None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 25 16:03:38 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-d4c764ec-0ebb-4b31-b534-c9a53c1ab0dd None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 25 16:03:38 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.quobyte [None req-d4c764ec-0ebb-4b31-b534-c9a53c1ab0dd None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23e9d725-3e04-4cd9-bfe0-c8ef43305589': None} {{(pid=83528) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 25 16:03:38 devstack cinder-volume[83528]: DEBUG cinder.volume.drivers.quobyte [None req-d4c764ec-0ebb-4b31-b534-c9a53c1ab0dd None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23e9d725-3e04-4cd9-bfe0-c8ef43305589'] {{(pid=83528) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 25 16:03:38 devstack cinder-volume[83528]: DEBUG oslo_concurrency.lockutils [None req-d4c764ec-0ebb-4b31-b534-c9a53c1ab0dd None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=83528) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 25 16:03:38 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-d4c764ec-0ebb-4b31-b534-c9a53c1ab0dd None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85 {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 25 16:03:38 devstack sudo[92251]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85 Feb 25 16:03:38 devstack sudo[92251]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 25 16:03:39 devstack sudo[92251]: pam_unix(sudo:session): session closed for user root Feb 25 16:03:39 devstack cinder-volume[83528]: DEBUG oslo_concurrency.processutils [None req-d4c764ec-0ebb-4b31-b534-c9a53c1ab0dd None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fe6dd0cf8e7563f40de9c85fe900fd85" returned: 0 in 0.408s {{(pid=83528) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 25 16:03:39 devstack cinder-volume[83528]: DEBUG cinder.manager [None req-d4c764ec-0ebb-4b31-b534-c9a53c1ab0dd None None] Notifying Schedulers of capabilities ... {{(pid=83528) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}